Icinix wrote...
I hate seeing analytics used in game development - you can't break down an individual or a groups experience into a set of numbers and graphs.
That's true. You want to avoid drawing erroneous conclusions-- we can know
what people did, but not necessarily why they did it. The good thing that this information does is help us not rely solely on anecdotal evidence. We know exactly how many people do what in the game, and that at least informs our decisions if not dictate them.
We know how many people don't complete a game, but just because it's not a lot doesn't mean we shouldn't create an ending or put much effort into it. It does, however, mean we should look at the places where people tend to stop playing and try and figure out why that might be. We know that the vast majority take "good" options, but that doesn't mean we shouldn't include "evil" ones... there might be value placed upon the fact a choice exists even if it's not taken. An individual might do something in a game for any reason, sure, but when you're talking about a sampling pool of this size you can look at events which are statistically significant and act accordingly.
I can see the fear that we might look at this information and discard options which are unpopular-- I think everyone who comes to a forum like this knows, in their heart of hearts whether they admit it or not, that they are far from the norm. The act of coming to this forum alone makes one an anomoly, never mind playing a game repeatedly or arguing on points of nuance for years on end. That's the definition of "hardcore" and that makes you a small, small minority of the audience-- that has always been the case and always will. There are people in the larger audience who might feel similarly about things, neither you nor we know for certain. This kind of information does, however, let us know how they play if not how they feel about it. That, at least, let's us ignore people who try to speak on their behalf regarding things that are factually incorrect (something, quite frankly, people on forums like to do a great deal)... but doesn't mean that we'll automatically also ignore opinions on things people have every right to have opinions on. That's also feedback, and it's useful.
If one's concern, however, is that a developer should
only be listening to the hardcore audience because they're the ones willing to speak their minds, and ignore factual data because
it might indicate most people don't play the game the way they do... well, that has never happened. Ever. This simply makes us better-informed, nothing more.