Great_Horn wrote...
snip
Since we're talking quantitative methods, any internet rating with non-random sampling is statistically useless. That should be obvious. They're not just completely irrelevant if you're looking for the general opinion of a game, they're counterproductive. I'm not surprised developers take no notice of them, and use far more helpful things like the 'constructive criticism' threads on the BSN. If people point to 'user scores' as any sort of generalisable representation of popular opinion, they're delusional.
It has all sorts of self-selection biases, for starters. 'People who rate things on Metacritic' are clearly not going to be an accurate, generalisable sample of 'the entire DA2 playerbase'. People (generally) use user ratings as a bludgeon to attack a game they don't like, or as a blind expression of faith for a game they do. Honest feedback is rare, and even if it's given, it rarely matches with the numerical score.
Then there's the methodological stupidity of asking people to give a game a number rating without any explanation why, or any obligation for this score to be accurate. The cliche that most user scores are 0 or 10 should make this apparent.
*If* you wanted an accurate picture of player opinion about videogames, it's not going to come through looking at self-selected responses on the internet.
Bioware, I'm sure, do focus testing with statistically-significant quotas and certainly have telemetry embedded in their games to give automatic user feedback (like playtime, popular classes or quests, the percentage of players that finished it, etc) without even needing to ask. They probably never tell us, but they'd be combining this with player feedback to chart any new directions - not relying on the gibberish from Metacritic user reviews.
Point being: Metacritic user ratings are useless. I'd say numerical ratings for critical reviews are equally unhelpful, but at the very least they (nominally) aspire to impartiality and give a fair amount of qualitative feedback that doesn't involve capital letters and barely literate rants of praise or derision.