Home
Twitter
RSS
Newsletter
Luke
14 Sep, 2007

Critical Opinion - How relevant is it?

PALGN Feature | We compare critical opinion with those of non-critics.
Reviews and review scores can be a contentious issue. Just how important are they for most people, and how do they affect the sales of games at the cash register? Among the weekly top ten titles in Australia, games that PALGN has given average scores to are a consistent presence. Secondly, as reviews are, at least to some extent, a subjective exercise, should reviewers be screened before they even touch a title? For a child's game should publications get a child to review the game? Should a sports nut always be the one to review the latest EA Sports title, and should a female be the reviewer for a game clearly marketed to women?

We decided to check out the opinions of three individuals who belong to demographics that don't necessarily match that of your average critic (non-critic gamer, female gamer, young child) and compare their response to PALGN's review of the title as well as the the average score of the title at Gamerankings.com, a website which catalogues reviews from every major publication.

For our gamer's opinion, we looked to our forums. Through a combination of both reader reviews and forumer opinions, we were able to get an idea on a gamer's opinion of the titles we are looking at here. Our token female is Rebecca, who is 20 years old and generally quite pleased to bowl up a high score in Wii Sports or belt out a tune in one of Sony's Singstar titles. And for the child we turned to Mitchell, a ten year old grade four student who owns both an Xbox and a PlayStation 2. Mitchell is generally quite happy playing either sports titles or racing games which can be played in short bursts.

We asked our participants to play the games and then write a one hundred word review of the games in question and then assign them a score out of ten.


AFL Premiership 2007

  

AFL Premiership 2007 was released in June, 2007. The series is consistently in the top ten sales charts for Australia and is so popular that Sony purchased exclusivity rights for the series from AFL Premiership 2006 on. The series is developed in Melbourne by IR Gurus and the AFL Premiership titles are the only AFL games released. As the game is only available on the PlayStation 2, the reviewers reviewed the game on the PlayStation 2.


PALGN: We weren't a huge fan of AFL Premiership 2007 when we reviewed it earlier this year. The game was a little better than its predecessor and could be enjoyable in multiplayer, but just hadn't changed all that much from AFL Premiership 2006. The game also had a few umpiring bugs, and as this was the 6th AFL title from IR Gurus, we thought the title should have been more polished by now - the commentary in particular became repetitive after about ten minutes. 5.5/10


GAMER: One of PALGN's forumers, grandtheft88 submitted his own reader review of AFL Premiership 2007. Grandtheft88, states that the introduction movie for the game was good, but when it comes to the gameplay it hasn't changed at all. Grandtheft88 agrees with PALGN's contention that when you're under pressure, it is just about impossible to kick for a goal. He is also able to tolerate the sound but gives a big thumbs down to the graphics and states 'the player animation is slow and clunky and the drop of the football onto the player's boot is not life-like whatsoever. In close, the players look absolutely ludicrous and you quite often see right through them.' 5/10


FEMALE: AFL 2007 is an average video game on the Playstation two. The graphics and sound are good as the players are all labeled and the commentary fits in well. I think that the game is aimed at males as the game is based on football and the majority of males enjoy football whilst many females are not as interested in the sport. As a female I did not enjoy the game, the controls were confusing and the players were all over the place. I had no idea which player I was, even with the little triangles above the player’s heads. Overall the game was not enjoyable and although it looked realistic (which was good) the game was rather boring. 3/10


CHILD: The game AFL 2007 was fun and the game had good graphics and sound. The graphics AFL 2007 are a lot better then the graphics in AFL 2006. One thing I did not like was the controls, for example: when a player grabs the ball and goes to take a shot at goal the game allows other players to tackle too quickly. I liked that I could choose to play a season or grand final game. I enjoyed the game because I like football. 8/10



Pirates of the Caribbean: At World's End

  

Pirates of the Caribbean: At World's End was released in May, 2007. The game follows the story of the film and was one of the first movie to game adaptations released for the year. The game is an action adventure title developed by Eurocom and designed to be played by both adults and children. For the critical reviews, we looked at the PlayStation 2 version of the game.


PALGN: Back when we reviewed the game we were less than impressed. Pirates main focus is on swordplay but unfortunately, the fighting system ended up feeling repetitive. We found the battles in the game to be boring and worst of all; generic. The game didn't fair any better from other critics either. 4/10


GAMER: PALGN's forumer, El Taco, submitted his review for Pirates of the Caribbean: At World's End and seemed less than impressed. "Pirates of the Caribbean 3: At World’s End is the latest (and last) installment of the worldly acclaimed Pirates of the Caribbean movies, and as today’s trend follows, with every famous movie comes a low-grade game. Games have broken that mold (King Kong and Spiderman 2) but unfortunately this hasn’t. This game tries to be good, but the usual movie game rules apply here, boring missions, check, differs from movie, check, repetitive gameplay, check, other pointless characters, check. This game biggest flaw is the combat. Press Square 3 times and you have killed a man. Apparently when I defend someone with my sword twice, I turn around and stand there for no reason. The graphics are the only redeeming factor of this game, but as we all know, graphics aren’t everything. It’s a miss." 4/10


FEMALE: The graphics in the game are good and the sound is fantastic. The music in the background when a fight is taking place is from the movie adding a dramatic and exciting effect to the game. Story mode is great as you take on the role of Captain Jack Sparrow, Will Turner, Elizabeth Swann and Captain Barbossa as you move through the levels. The controls are easy to understand, making the game easier to play. Overall the game was very enjoyable. 8/10


CHILD: Pirates of the Caribbean: At World’s End is a good game. It has great graphics and sound. I like the music because it sounds like the music in the movie. The game was exciting as I got to play different characters from the movie and I got to fight. The fights in the game were fun. The game is great for kids and teenagers. The people talking in the dungeons helped me understand what to do next but also added to the graphics. The controls were easy to understand. I did not expect the game to be good but after playing it I really enjoy it. 9/10



Spider-Man 3

  

Spiderman 3 was released in May, 2007 to coincide with the latest Spidey movie. The game had been in development since its predecessor, the enjoyable Spider-Man 2, was released. It was released on several platforms including the Xbox 360, PlayStation 3, Wii and the PlayStation 2, but for the reviews we asked our respondents to look at the Xbox 360 version of the game.


PALGN: When we reviewed Spider-Man 3 back in May, we were left a little disappointed. All we wanted to see was an improved version of Spider-Man 2 but Activision shipped the game with a poor camera, boring missions and average controls. The game didn't fare much better with other critics either, with its average ratio on Gamerankings sitting at 67%. 5.0/10


GAMER: Our forumer, El Taco, helped out with the review for Spider-Man 3. "One of the year's biggest sequels, and one of the year's most disappointing games. Spider-Man 2 the game is regarded as one of the best movie license games, with that behind it how could it go so wrong? Let's see, terrible graphics and bugs, differs way too much from the original story, things have become bland and combat isn't as fun as we remembered. I'm trying to be negative, but there's not a lot of positive to find in this game. Maybe a 5 year old would find it fun, but most gamers these days will breeze it. Not recommended." 4/10


FEMALE: Spider Man 3 is another game that is based on a movie. The graphics were good but the sound and the commentary throughout were disappointing. The commentary made the game boring and there was no background music during fighting scenes. The sound effect when an item blew up was the only exciting sound effect in the game as the controller shock making me feel a part of the game. Overall the game was pretty ordinary. 5/10


CHILD: Spider-Man 3 is a very ordinary game. The graphics and sound in the game was not as good as the sound and graphics in Pirates of the Caribbean. I thought that I was going to enjoy the game but it ended up being very disappointing. The game was boring. Overall the game was disappointing and was ordinary. Even though the game had a person talking throughout it I still did not always understand what I had to do next in the game. 3/10


So there we have it. Our humble little piece on how three games can be received similarly or differently by different people.


PALGN would like to thank forum users grandtheft88 and El Taco as well as Rebecca and Mitchell for their participation in this feature. We'd also like to thank the several people who suggested this feature including Kashmere from our forums and Michael Thomas. Please note the image for Mitchell is a cartoon and not Mitchell.

Related Content

Pirates of the Caribbean: At World's End Interview
26 Apr, 2007 We have a yaaarn with the producer.
Matt Carroll Interview
02 Apr, 2007 We speak to the country director for Disney Interactive Studios.
A Kiwi in Tokyo - On the PS3 launch frontline
01 Dec, 2006 Our man in Japan on the launch that was.
47 Comments
5 years ago
^ That is actually a great idea, we'll definitely do that mate.
5 years ago
Luke wrote
It's stereotypical, so Rebecca is a female but not a gamer, the gamer is our forumers, males.

ok im going to do a second part to this feature with higher rated games, if you have suggestions please feel free to put them forth

But please note MA15+ titles we can't do, Mitchell is 10 icon_wink.gif
You let El Taco play Pirates of the Caribbean, whats your point?

Great idea, for a feature cant wait for the second installment where Mitchell reviews manhunt 2 the US copy on Wii... Right? icon_lol.gif
5 years ago
Klawrence wrote
Luke wrote
It's stereotypical, so Rebecca is a female but not a gamer, the gamer is our forumers, males.

ok im going to do a second part to this feature with higher rated games, if you have suggestions please feel free to put them forth

But please note MA15+ titles we can't do, Mitchell is 10 icon_wink.gif
You let El Taco play Pirates of the Caribbean, whats your point?

Great idea, for a feature cant wait for the second installment where Mitchell reviews manhunt 2 the US copy on Wii... Right? icon_lol.gif
Nah, RE4.
5 years ago
Jim Dash wrote
Everyone hates Spiderman because it has nothing good going for it. Besides Groovy, he loves it! icon_razz.gif
I actually liked Pirates too icon_lol.gif Of course there not the cream of the crop but they supplied some good casual play for me. Then again as most know I play almost everything, I went to Game yesterday with the intention to buy something on 360 but theres nothing left to really get..
5 years ago
Great article!!

But what about average games and good games and great games?? YOu guys need a part two!

For example, what about God of War? Bioshock? Counter Strike? Singstar?

It seems like with the games you selected you had a rough idea of what answer you were going to expect. ie That there was a chance that of the casual gamer enjoying games that were reviewed poorly.

Keep up the good work.
5 years ago
Get five gamers whom love and own different consoles and PC gamers and have a roundhouse type review style where they all give their opinions on selected titles.

I don't know how you'd get them to play them all...maybe have a party at Luke's place or something (I assume Luke will provide the grog? icon_razz.gif ).
5 years ago
Luke wrote
But please note MA15+ titles we can't do, Mitchell is 10 icon_wink.gif
Oh cmon, what harm will 10 minutes of Gears of War do to a ten year old? icon_wink.gif

No seriously, do Halo 3 in your next feature (it should be out by then?.. and its only M of course). Viva Pinata mightn't be a bad idea either..
5 years ago
Passa wrote
Luke wrote
But please note MA15+ titles we can't do, Mitchell is 10 icon_wink.gif
Oh cmon, what harm will 10 minutes of Gears of War do to a ten year old? icon_wink.gif

No seriously, do Halo 3 in your next feature (it should be out by then?.. and its only M of course). Viva Pinata mightn't be a bad idea either..
My friend had a mental breakdown the first time he chainsawed a guy, god it was hilarious to watch
Mind you he was 15 too
5 years ago
Good article, it shows kinda why games like AFL and Pirates sell well despite being mediocre as games. Girl/Kid just seemed to want to spend 5 minutes playing as the people from the movies/sports they liked, rather than play something with interesting gameplay.

For the next one I'd like to see what they think of something with great gameplay but either average graphics or non-licensed graphics. Maybe add someone from the other big demographic; 18-25 year old occasional gamer. You know, the guy that games with his mates over a few beers and bought all those copies of Need For Speed Underground icon_smile.gif
5 years ago
The Japanese mag FAMITSU has one of the best game review methods - 4 different people give a score out of ten (no separate marks for, graphics, lifespan, or sound, game reviewing is not science you know) accompanied by a short (not 1000+ words PALGN) overview of the game. You don't see movie reviews that include a score for sound, or cinematography, or acting, it's all part of the overall package. How can you score a game on 'lifespan'? Wouldn't you have to re-visit the game a year down the track and see if it's still in your console?

In an ideal world we could all get access to a demo before purchasing a game - I've played FIFA08, Stranglehold, & Tony Hawk over the last few days, and I know for varying reasons, I won't be buying these games - whatever reviews they recieve.
5 years ago
Maikii wrote
The Japanese mag FAMITSU has one of the best game review methods - 4 different people give a score out of ten (no separate marks for, graphics, lifespan, or sound, game reviewing is not science you know) accompanied by a short (not 1000+ words PALGN) overview of the game. You don't see movie reviews that include a score for sound, or cinematography, or acting, it's all part of the overall package. How can you score a game on 'lifespan'? Wouldn't you have to re-visit the game a year down the track and see if it's still in your console?
i don't like Famitsu's scoring method tbh, i don't usually go for outright scores, but rather the reason behind this final score, so when a review relies solely on an outright score with only minor opinion, it doesn't lend itself to any form of reliable benchmarking.

lifespan - for example - is not about whether it'll still be popular/payable a year from now, but rather how long it should take you to complete. it helps give an indication of whether a game is a 20 hour beast, or if it should only take 2 hours to complete - and how robust any multiplayer aspect is.

i also disagree with you on movie reviews. i have seen reviews that have those aspects separate, but even if they don't, there's usually a paragraph dedicated to the soundtrack, whether it fits with the film, or if it's wrong. there's usually a mention of who directed it, and potentially comparisons of their work to someone elses. it mightn't be explicitly labeled "Sound" but the breakdown is usually there.

i think it's somewhat important to break reviews down into these things, especially in mid-range scores, as you can divine some reason as to why it was marked down, and make a more informed decision to buy, or not buy.
some games don't rely on graphics, for example, to be engaging, so a title might only score a final score of say, 7.5, when it might have 9s for sound, lifespan, gameplay, but because it runs on rudimentary line graphics, might only be scored as a 3 here.
i know i would be more likely to to check out a game scored this way, rather than a 7.5 scored game with no breakdown of good and bad.
5 years ago
ObsoletE wrote
i don't like Famitsu's scoring method tbh, i don't usually go for outright scores, but rather the reason behind this final score, so when a review relies solely on an outright score with only minor opinion, it doesn't lend itself to any form of reliable benchmarking.
Do you have any idea how many people actually read the reviews - or do they just scroll down to see the score?

The comparison to movie reviews I think is valid - from what I read in mainstream media - a five star system is usually used - I have never seen separate scores for sound etc. I never said they didn't mention these at all in the text of the review.

My point with the FAMITSU scoring system, was firstly it gives 4 different perspectives (surely better than one) and the score is out of 10 (that is 10 different degrees of quality). PALGN uses a score out of 10 but includes a single decimal place - meaning that there are effectively 100 different degrees of quality (not having a go at PALGN, this is what most reviewers use). Is there a difference between a score of 3.3 and 4.6? - they are both low scores.

All I'm saying is that if PALGN wanted to distinguish it's reviews from the masses, there are much more interesting ways to do it.
5 years ago
I can see where Maikii from, the scoring for Famitsu gives more varied opinions, sure the review is short but the rest of the mag makes up for it, by having A LOT of exclusives and first looks, plus the mag comes out every week.
5 years ago
Maikii wrote
Do you have any idea how many people actually read the reviews - or do they just scroll down to see the score?

The comparison to movie reviews I think is valid - from what I read in mainstream media - a five star system is usually used - I have never seen separate scores for sound etc. I never said they didn't mention these at all in the text of the review.

My point with the FAMITSU scoring system, was firstly it gives 4 different perspectives (surely better than one) and the score is out of 10 (that is 10 different degrees of quality). PALGN uses a score out of 10 but includes a single decimal place - meaning that there are effectively 100 different degrees of quality (not having a go at PALGN, this is what most reviewers use). Is there a difference between a score of 3.3 and 4.6? - they are both low scores.

All I'm saying is that if PALGN wanted to distinguish it's reviews from the masses, there are much more interesting ways to do it.
tbh, i think more people read the review, instead of looking at the scores. perhaps it's just that the people i know are intelligent, and prefer to know more about what they're going to spend their money on, rather than splurging on a number.

i agree with you on the percentile based scoring system, i think it's overkill, however it's important to note that PALGN uses a 20 point system, not 100 (0, 0.5, 1, 1.5...9.5, 10) but the comparison point is valid for any scoring system.
what's the difference between 33% and 46?
what's different between 3 stars and 3.5 stars?
what's the difference between 5/10 and 6/10?
these are all subjective.
and therefore it's up to the reviewer to present his case in the body of the review, something FAMITSU lacks, and i feel it suffers in quality as a result. why is one person giving it a 5, and another a 6? oh shoot, i don't know because they don't have enough room for them to explain themselves.

you are right about more opinions being better than fewer, and i wish that the second opinion panel were used more frequently on PALGN, but i would still prefer a more indepth review overall, so i might judge whether i'll like a game from this rather than 2 (or more) smaller reviews which don't get to the heart of what makes the game bad.
however, given that the reviewers on this site work on a voluntary basis, i understand perfectly that time is a major issue - a second opinion mightn't be used because someone might be too busy at their day job to spend the time playing a game they mightn't want to play - or would simply rather spend the time playing a game they like.

you are right that most movie reviews don't break the scoring down by the various aspects, but some do, and i still tend to read the words rather than the numbers.
5 years ago
^^^ oops - my mistake about the 100 point scoring system - yep, a 20 point system isn't over kill at all ...
5 years ago
ObsoletE wrote
[
tbh, i think more people read the review, instead of looking at the scores. perhaps it's just that the people i know are intelligent, and prefer to know more about what they're going to spend their money on, rather than splurging on a number.
have you heard of a site could Metacritic? reviews are all about the numbers, whether you agree or not.

And if the score is to help 'know more about what they're going to spend their money on' - how 'bout a score for 'value'. Surely if a game costs 5 bucks on PSN or Live it's a 'better' game than if it had cost $100. Which brings me to why PALGN would bother reviewing Wii Sports at all (which you gave 8/10) - it comes with the console, no-one has to decide whether to buy it or not.
5 years ago
Because who says it will always come with the console? It's a game, we review games regardless of whether they're pack-ins.
5 years ago
^^^ I think you missed my point about 'value' . The price should have a big influence on the overall score a game gets.
5 years ago
Value is a valid suggestion but prices drop, so maintaining a review everytime it goes down in price could get tiresome.
5 years ago
But that opens a whole new can of worms - should they change the review when the game goes platinum? What if Target has a sale on it?

EDIT: Yeah what Luke said.
5 years ago
ObsoletE wrote
i don't like Famitsu's scoring method tbh, i don't usually go for outright scores, but rather the reason behind this final score, so when a review relies solely on an outright score with only minor opinion, it doesn't lend itself to any form of reliable benchmarking.

lifespan - for example - is not about whether it'll still be popular/payable a year from now, but rather how long it should take you to complete. it helps give an indication of whether a game is a 20 hour beast, or if it should only take 2 hours to complete - and how robust any multiplayer aspect is.

i also disagree with you on movie reviews. i have seen reviews that have those aspects separate, but even if they don't, there's usually a paragraph dedicated to the soundtrack, whether it fits with the film, or if it's wrong. there's usually a mention of who directed it, and potentially comparisons of their work to someone elses. it mightn't be explicitly labeled "Sound" but the breakdown is usually there.

i think it's somewhat important to break reviews down into these things, especially in mid-range scores, as you can divine some reason as to why it was marked down, and make a more informed decision to buy, or not buy.
some games don't rely on graphics, for example, to be engaging, so a title might only score a final score of say, 7.5, when it might have 9s for sound, lifespan, gameplay, but because it runs on rudimentary line graphics, might only be scored as a 3 here.
i know i would be more likely to to check out a game scored this way, rather than a 7.5 scored game with no breakdown of good and bad.
Quoted for truth.

Especially on Famitsu. The final score is eventually just a reflection of the reviewer's opinion, while the body of the review provides an insight into the game. I'm playing Brave Story and Sword of Mana at the moment, two games that didn't get the greatest reviews, yet both are very enjoyable for me. Since when is a reviewer's taste like mine?
5 years ago
Make the value score a $ score, how much you would be a reasonable amount to pay for it
$0 being least, $x being most
5 years ago
puddingfork wrote
Make the value score a $ score, how much you would be a reasonable amount to pay for it
$0 being least, $x being most
And what might be reasonable to pay for a particular game to some people may not be reasonable to others, don't think value should be added in my opinion.
Add Comment
Like this feature?
Share it with this tiny url: http://palg.nu/Vl

N4G : News for Gamers         Twitter This!

Digg!     Stumble This!

| More
Currently Popular on PALGN
Australian Gaming Bargains - 08/12/11
'Tis the season to be bargaining.
R18+ Legislation
R18+ Legislation
Naruto Shippuden: Ultimate Ninja Storm Generations Preview
Hands on time with the game. Chat time with the CEO of CyberConnect 2.
PALGN's Most Anticipated Games of 2007
24 titles to keep an eye on during 2007.
PALGN's Most Anticipated Games of 2008
And you thought 2007 was populated.