Eric Fagnan wrote...
Testing in game doesn't mean not doing number analysis, it just means we track real damage done to enemies rather than theoretical formulas. Many of our weapons have very exotic mechanics that prevent us from coming up with a single magic formula to tell us if a weapon is balanced or not.
As the guy who runs the spreadsheets I'll weigh in on this:
I have always said that there is a reason that we call it theorycrafting, because it is only in theory. As a programmer I am very much aware of the fact that what should happen in theory and what does happen in reality are two very different things(If it wasn't, my job would be a lot easier).
A good example are people found often quoting reload cancelled DPS values, which are actually impossible for a human being to achieve in-game. I put those values on the sheets to give a general idea as to how something is going to perform, not to tell you what gun is mathematically the best in the game, because the answer to that is that there isn't one.
I see a use for theorycrafting, but it's not ever going to trump in-game experience.
Now, the RNG hasn't seen fit to give me a Spitfire, so I don't actually know how it performs in-game. I wont comment on that, but I will say that balance is not entirely objective and thus cannot be figured out with a complicated mathematical formula. I wish that it could be some days, but it can't.
For example, it would seem that BioWare places a bigger weight on the ammo capacity of a weapon, while I would not when talking about things like Harrier(at least in MP). Neither of us are necessarily wrong, but rather we just have different opinions on the matter. I can't deny that I do have to visit the ammo box more often while using a Harrier, but I can't mathematically prove that the Harrier is better than say, the Lancer(I actually like the Lancer more because I'm nostalgic like that).
Am I going to agree that the Spitfire is fine when I play with it? To be honest I'm not really expecting that I will, but I could always be proven wrong. There are plenty of guns that I'm not a fan of that the BSN thinks are amazing(The Talon is one) and there are guns that I think are quite good that the BSN thinks are terrible(a lot of them are Assault Rifles). I would probably suggest taking a look at the fact that we have in-game tests showing 600 RPM while Eric is saying it fires at 650 RPM, however.
Either way I can't objectively say that it is wrong.
Doing balance requires asking yourself where you stand on a lot of points, and there is no right or wrong answer to any of those questions.
but people will be very quick to tell you that you're wrong if they don't agree with you =P