Quantcast

BioShock


How Metacritic rules the games industry

It puts every review in the world at your fingertips – but is Metacritic ruining videogames?

Words: PSM3 UK

You’re probably kicking yourself for not thinking of it first. Instead of relying on one critic’s point of view, mash them all together into one easily-understood uberscore. Rubbish games will be punished, quality will win out, and the occasional dodgy verdict will be smoothed over by the masses. That’s the theory. Some games publishers hate it, others are trying to manipulate it, and the end result’s a system that might end up misleading you more than the individual sources it relies on. So exactly how much can you trust Metacritic?

Before you decide, you need to understand how it works. Founded in 2001 by three friends, the games arm of Metacritic’s day-to-day running is down to one man – former lawyer Marc Doyle. The site aggregates scores from a variety of websites, newspapers and magazines, ‘weighting’ more popular or reliable ones to give them more input into the overall average.

The appeal of a single score is so overwhelming that everyone from fanboys to shareholders has an interest in the magic number. Some developers even reportedly sign contracts including a stipulation that royalties or bonuses won’t be delivered unless their product hits a certain Metacritic score. “I’ve gotten emails from developers over the years who have said, ‘I don’t think you realize what you’re doing to me with this review’ because my review knocked them out of the range of some bonus that they were up for,” says former Gamespot editor Jeff Gerstmann. “That really troubled me.”

Eidos’ PR firm Barrington Harvey reportedly told website VG247 “We’re trying to make sure the Metacritic score is high,” but later reversed position, affirming that: “Barrington Harvey is not in the position of telling reviewers what they can and cannot say.” Doyle, meanwhile, thinks this approach is unsustainable anyway: “A certain AAA game last year had some amazingly high individual scores posted on Metacritic until about 7 or 8 days after the game’s release, and then the subsequent review scores started dropping like a rock. It doesn’t happen very often, but gamers are smart people, and they tend to sniff that kind of manipulation out.”

Finally, of course, fans themselves are trying to mess with the system. Recently, user-submitted scores for LittleBigPlanet and Gears of War 2 plummeted as rabid fans of each console tried to sabotage the other’s chances – LBP hitting a low of 6.4 while GOW2 hit rock bottom at 2.4.

“If a game publisher does everything it can to achieve a higher Metascore, the end result is probably going to be a better game.” says Doyle. “Publishers have realized over the last five or six years that certain high profile games with massive advertising budgets but abysmal critical receptions haven’t been selling as well as they used to.”


 
56 Comments
Order Comments: Newest First | Oldest First
BluePikmin  - 9 months 22 days ago 
- Comment removed by Moderator
Reported
BluePikmin  - 9 months 22 days ago 
Ok but seriously this article makes a strong point.
Jbo87  - 9 months 22 days ago 
To be honest I find the use of the review system to be pretty flawed. I personally can't come up with a better way of judging the quality of a game but as seen as the current system is so established then it should at least be used sensibly, i.e. on an out of 10 system 5 should be average as opposed to 7. If a game doesn't get over a 7 its relegated to obscurity.

Also Metacritic sucks balls. Soemthing I've noticed is that higher profile games get more reviews posted hence evening out the score should there be one or two that are less than flattering.
Gahmah  - 9 months 22 days ago 
5 average does seem like it might allow for better scale, or maybe it could be set up like Hulu's where it goes from a middle ok to degree's of likeness to degrees of hate
RebornKusabi  - 9 months 22 days ago 
I used reviews a little too much when I was younger but as I got older, I realized that, with the "help" of internet review scores that I liked didn't have THAT GREAT of a review score. If I had listened to reviews that had come out at the time, I would not have played Silent Hill 1-2, Fatal Frame 1-3, The Suffering 1-2, Bloodrayne 1-2, Siren, Covert Ops, Galarians 1-2, Space Griffin VF-9, Final Fantasy 8, System Shock 1-2 and countless others that recieved low scores when they were released.
ELpork  - 9 months 22 days ago 
Never EVER read or trust the "user" review's. Almost all of them consist of nothing but fanboy dribble for one side or the other.
Corsair89  - 9 months 22 days ago 
I never gave Metacritic much thought. Their opinion never mattered to me, unlike GR or 1up, which do matter to me. In the end, I trust my instincts and personal thoughts and preferences more than reviews, and they have rarely lead me astray.
AnonymouZ  - 9 months 22 days ago 
goddamn. well, it makes me kinda glad i didn't even knew about metacritic site... now tho... i feel like going to mess some gearsofwar scores... hahaha. nah... not really. kinda.
may.be.vital  - 9 months 22 days ago 
I agree with Corsair89. User reviews are generally a waste of time. If they are not extremely biased to a system then they are just stupid!

(At the risk of sounding like a fanboy myself): I was reading through some user reviews on Metacritic and saw one where a man had given Left 4 Dead a 2 because the guns werent as realistic as he thought they should be! Here is exactly what he said:

"And the best gun is the repeating shotgun and the worst is the pump action shotgun. The best weapon Should be the AR-15(M16) but it is not really here except as a visual. I think the programmers should portray it as a pellet pistol because that's all the damage I can do with the game version! The programmers should go out and try some of the guns at the shooting range or at least talk to people familiar with the weapons. I have a problem with the reality of changing the magazine and clearing a dud round etc, but give me a 300 round can and not the 50 round, or give a realistic hit level for the zombies. 4000 hits to take down a Tank!?Way too much. For Example,with the AR-15, I can kill you with less than the 20 rounds in a small clip in about 5 seconds, break every bone in your body and you'd be dead before the 10th round; so 4000 hits without any visible damage and having to change clips at least 20 times in teamwork or depend on fire or something else to stop the attack, is crazy."

It goes on, with him griping about how he wants tracer bullets and such. You should not base your entire review on two things, the tank is full of muscle and is essentially, a tank, so it should run faster than a little human. Also, he shouldnt be comparing the guns with the guns in the real world just as common sense...

In this one I may sound like a major fanboy but ya...

I was reading some ocarina of time reviews and some people wrote the reviews (in 2007 mind you) about how the graphics sucked and the world was too small. The game was made in 1999! the graphics will definetly suck compared to today. Its just unfair to compare it to crysis or something. The game was huge back then and is still quite a large map, sure it isnt as big as say GTA IV but this was on a cartrdge. Its amazing that the music was able to fit on that thing!

I do apologize for the extremely long post and hope I havent made anyone to mad at me :P
cheapojoe  - 9 months 22 days ago 
@May.be.vital and Jbo87

You guys are both right. Jbo is right about the scoring guide. It is critically flawed. In a society were students are given rank based on a letter grade, the C & B students are passed off as inferior. Much like video games, if a game is given a 7 or 70%, the community perceives it as a "might as well never been made" title. This just isn't true.

I think we need to change the review system to a more qualitative grading system. More of an expectations guide.


May.be.vital is very correct as well. Metacritic is a flawed system because of the number grades given. As Corsair said, people need to pick a critic who matches their tastes in gaming and just follow them. Any half-wit can grade a game.
Sabtos  - 9 months 22 days ago 
I'm glad this was addressed somewhere. For a time with LBP there was a disclaimer you had to click on to actually view the user score because it was being spammed with bad scores. It's ridiculous people would vote for a game they haven't played. Guess that's what happens when you give a voice to a bunch of 8 year olds.
mirthor  - 9 months 22 days ago 
i think metacritic is good and bad. i love that you can find out about a game you were sketchy on and then make an educated judgement on that topic. i also think that it prevents people from playing games that they might actually love.
Synster  - 9 months 22 days ago 
User reviews on almost every site are the part of the sole definition of Fanboys. I've never trusted them, and I will always refuse to trust them no matter how much I've been bought into a game. I'll still soley think "Some Playstation/Xbox fanboy at this very moment is trying to rack up the score to a perfect 100, as the other is trying to drag it down." I've seen multiple threads about this how some of the people are saying "Lol. Killzone 2 6.4. Stupid Xbots" Seriously? Have any of you seen the Halo Wars user reviews? A bloody 0.2. Now look who's calling the kettle black.

Now then. For the most part I trust this site, GamesRadar, and out of the most, IGN. Not a whole lot of others because they seem to be slightly passive and ignorant about bits and pieces of Games these days. I occasionally trust MetaCritic, though I don't think it's ruining Gaming as a whole, people rely on buying games too much out of review scores these days. Though to me, It's still a bit more valid than other sites because it takes a rough average of sites and sees the Generalized score. Now sometimes this can be a bit over the top because of Official Magazines and the such, but hey? What can you do?
Geigan  - 9 months 22 days ago 
@may.be.vital

A little friendly advice. Try not to respond to the idiot. It makes you less of a fanboy by miles. When people look at that guy and read his review they mark him under the ****tard category. So when anyone tries to rebuff said ****tard people the ****tardedness rubs off on you in their eyes. If everyone just ignores the idiot he will just go away. But when people try to express their opinion that his opinion is wrong it usually starts a fight between him and you. Which makes everyone watching shake their heads at the two ****tards going at it even if one of them isn't a ****tard.
GoldenMe  - 9 months 22 days ago 
@Geigan

You can swear, you know. Your Grandma ain't gonna be on the Internet any time soon.
Geigan  - 9 months 22 days ago 
General rule of mine. Never swear in posts or it might be banned. Still not sure how strict GR is on that
DeadGirls  - 9 months 22 days ago 
User reviews are hilarious. Gamespot, Metacritic, IGN, and even Amazon user reviews are completely unreliable and pointless (except for the occasional entertainment value). It basically comes down to the fact that users are fucking retards.
The best thing about Metacritic is that it allows you to browse through all the reviews in one place, and provides links to the ones available online.
If the "average" scores were done away with, which I think would be to everyone's benefit, responsible and educated gamers wouldn't miss it at all.
An intresting thing to note -- reviews from gamesradar are not included in Metacritc scores (although PC Gamer reviews are).
crazytar  - 9 months 22 days ago 
instead of giving a general review for the entire game, make it based on different parts of the game such as music and visuals (similar to how gamespot does it) but don't factor any of that into the "total" score of the game, simply because there wont be a total score. also, get only reviewers who are interested in whatever the genre is and get them to do the review because sometimes this isnt the case and it creates expectations that one genre just cant easily live up to. reviews should only be critical of the strengths and weaknesses of a game (like the "you'll like' and "you'll hate" section at the end of each GR review but bigger and more in depth).

i dont know if metacritic does this but do they seperate user scores from critic scores?
cart00n  - 9 months 22 days ago 
Uh, a 5 is STILL the average score in the eyes of critics - it is only the READERS mistakenly assuming that anything under an 8 means the game sucks. A 7 is still a good game, it just has flaws, or it just missed seeing its full potential. Take Force Unleashed for example - it's a perfectly fun game, but the controls can be a little sketchy, and, lets face it, it's not really "unleashed" (should've been M rated!). So it rates a 7. Still doesn't suck, tho...
Craza  - 9 months 22 days ago 
Honestly, I do depend on reviews to give me a little opinion on what other people think. As a 14 year old who doesn't have a job, money is hard to come by, so when I save up enough to buy a game, I really want to research what I'm looking to buy. I don't just look at the score and then make that the deciding factor, I also read the review, find out why that score was given, what the game's flaws were, and how it was good or bad in areas. User reviews can be helpful, all you gotta do is sort out the fanboys from people who actually have a head on their shoulders and wrote a good review.

This is why I love Gamesradar's "Love This, Hate This" at the end of every review, it tells me things that might make me rethink my decision and it sums up what the reviewer ultimately thought of the game.

I also love Game Informer's review system as well, they pick apart the game and give separate reviews of music, controls, and the like. So I usually go by these two sources.

Though of course, reviews still don't make up my mind for me. It was a really tough choice between Mass Effect and Assassin's Creed. I bought AC, loved every minute of it, and now guess what? Mass Effect is down to like $20! :D
Related Games
Gears of War 2
Xbox 360
Dead Space
Xbox 360
Gamecube
GameCube
Xbox
Xbox
Brink's single-player is "massive" N4G
PC News from N4G
Nov 27, 2009
Dawn Of War II: Chaos Rising Release Date Unveiled N4G
PC News from N4G
Nov 27, 2009
Mass Effect 2 Website Relaunched Again N4G
PC News from N4G
Nov 26, 2009
Killing Floor Update Released N4G
PC News from N4G
Nov 26, 2009