Metacritic weighting system report “wholly, wildly inaccurate”, site says

Thursday, 28 March 2013 00:02 GMT By Brenna Hillier

A presentation at GDC 2013 gave a list of weightings purportedly used by Metacritic to determine how much a publication’s review scores affect a title’s average rating, but the site has vehemently denied the report.

The list does not come from Metacritic itself, but was produced by a team of researchers led by Adams Greenwood-Ericksen of Full Sail University. During a a talk titled ‘A Scientific Assessment of the Validity and Value of Metacritic’, Greenwood-Ericksen said Metacritic has confirmed it applies different weightings to various critics.

Looking at existing averages, the team or researchers created a hypothetical model of how Metacritic applies this weighting, and than checked it against the next six months of results, finding it “almost entirely accurate”, according to Gamasutra.

The list of weightings has been published in full and you can check it out below, but Metacritic has responded by saying the information is “wildly, wholly inaccurate”.

“They are simply their best guesses based on research. And here’s the most important thing: their guesses are wildly, wholly inaccurate,” a representative for the site wrote on its Facebook page.

“We use far fewer tiers than listed in the article. The disparity between tiers listed in the article is far more extreme than what we actually use on Metacritic; our publication weights are much closer together and have much less of an impact on the score calculation. Our placement of publications in each tier differs from what is displayed in the article. The article overvalues some publications and undervalues others. In addition, our weights are periodically adjusted as needed if, over time, a publication demonstrates an increase or decrease in overall quality.”

    HIGHEST

  • Dark Zero
  • Digital Chumps
  • Digital Entertainment News
  • Extreme Gamer
  • Firing Squad
  • Game Almighty
  • Game Informer
  • GamePro
  • Gamers Europe
  • GameTrailers
  • GotNext
  • IGN
  • IGN AU
  • IGN UK
  • Just Adventure
  • Machinima
  • Planet Xbox 360
  • PlayStation Official Magazine UK
  • PlayStation Official Magazine US
  • Telegraph
  • The New York Times
  • TheSixthAxis
  • TotalPlayStation
  • VGPub
  • Videogameszone.de
  • Wired
  • Xboxic
  • Yahoo Games
  • ZTGames Domain
    HIGH

  • Absolute Games
  • ActionTrip
  • Adventure Gamers
  • Computer & Video Games
  • Console Gameworld
  • Da GameBoyz
  • Darkstation
  • Edge Magazine
  • EGM
  • EuroGamer Italy
  • EuroGamer Spain
  • G4 TV
  • Game Chronicles
  • GameDaily
  • Gameplayer
  • Gamer 2.0
  • Gamervision
  • Games Master UK
  • Gamespot
  • GameSpy
  • Gaming Age
  • Gaming Nexus
  • Maxi Consoles (Portugal)
  • Pelit
  • Play.tm
  • PlayStation Universe
  • PlayStation Official AU
  • PSM3 Magazine UK
  • PS Extreme
  • RPG Fan
  • Strategy Informer
  • Team Xbox
  • The Onion (AV Club)
  • Totally 360
  • WonderwallWeb
  • XGN
    MEDIUM

  • 1Up
  • CPU Gamer
  • Cubed3
  • Cynamite
  • D+Pad Magazine
  • DailyGame
  • Destructoid
  • Eurogamer
  • Everyeye.it
  • Game Revolution
  • Game Shark
  • Gameblog.fr
  • GameKult
  • Gamereactor Denmark
  • Gamers’ Temple
  • GameShark
  • Gameblog.fr
  • GamesNation
  • GameStar
  • GameTap
  • Gaming Target
  • Gamereactor Sweden
  • The Guardian
  • Hardcore Gamer Magazine
  • HellBored
  • NiceGamers
  • Joystiq
  • Just RPG
  • Level 7.nu
  • Modojo
  • MondoXbox
  • Multiplayer.it
  • N-Europe
  • Netjak
  • NGamer Magazine
  • Nintendo Life
  • Nintendo Power
  • Nintendojo
  • Nintendo World Report
  • NZGamer
  • Official Nintendo Magazine UK
  • Official Xbox 360 Magazine UK
  • Official Xbox Magazine
  • Official Xbox Magazine UK
  • PALGN
  • PC Format
  • PC Gamer (Germany)
  • PC Gamer UK
  • PC Gamer
  • PC Powerplay
  • PGNx Media
  • Play Magazine
  • PlayStation LifeStyle
  • Pocketgamer UK
  • PT Games
  • Real Gamer
  • SpazioGames
  • Talk Xbox
  • The Escapist
  • Thunderbolt
  • Total VideoGames
  • Worth Playing
  • X360 Magazine UK
  • Xbox World 360 Magazine UK
  • Xbox World Australia
  • Xbox360 Achievements
  • Xbox Addict
    LOW

  • 360 Gamer Magazine UK
  • 3DJuegos
  • Ace Gamez
  • Atomic Gamer
  • BigPond GameArena
  • Console Monster
  • Deeko
  • Eurogamer Portugal
  • Game Focus
  • Gameplanet
  • Gamer Limit
  • Gamer.nl
  • Games Radar (in-house)
  • Games TM
  • Gamestyle
  • GameZone
  • Gaming Excellence
  • Gaming Trend
  • Impulse gamer
  • Kombo
  • MEGamers
  • Metro Game Central
  • MS Xbox World
  • NTSC-uk
  • PS Focus
  • PSW Magazine UK
  • Video Game Talk
  • VideoGamer
    LOWER

  • Armchair Empire
  • Cheat Code Central
  • Game Over Online
  • Game Positive
  • Gamer’s Hell
  • Gamereactor Sweden
  • Gamers.at
  • Giant Bomb
  • PS3bloggen.se
  • RPGamer
  • Vandal Online
    LOWEST

  • 9Lives
  • Boomtown
  • Computer Games Online RO
  • GamerNode
  • GamingXP
  • IC-Games
  • Insidegamer.nl
  • Jolt Online Gaming
  • Kikizo
  • LEVEL
  • Meritstation
  • My Gamer
  • Official PlayStation 2 Magazine UK
  • Play UK
  • WHAM! Gaming

Latest