Xona Games Targeted For Rating Manipulation Abuse, Twice
Wednesday, July 6, 2011
By: Matthew Doucette


Decimation X3's results of two rating manipulation attacks.
The first attack starts off-screen, as data was collected only after the first attack started.

I hate writing articles like this. :(

But, I have to document it for reference purposes.

It is now twice that our games have had their ratings abused on Microsoft's Xbox LIVE Indie Games platform. The first occurred in March 2011, detailed in Michael Neel's "The Real March Madness - XBLIG Rating Manipulation Continues" article. The second occurred in June 2011, as brought to light by my APP HUB posts (1,2,3), all three quoted here:

 

APP HUB Posts:

Charles,

There is now more rating abuse taking place.

Our ratings are dropping in Japan as well as beginning to drop in the U.S. again (and presumably in other countries). Only for Decimation X3 and Score Rush, but not Decimation X (our lowest rated game before the abuse):

So now our worse game is #3 in Japan and the others are #21 and #35... they used to be #3, #4, and #5.

http://marketplace.xbox.com/ja-JP/Games/XboxIndieGames?SortBy=TopRated

And now our worse game is also the highest in US, where it was left after the first rating abuse, and the others are #220 and #221... they used to be in the top 30. They were approximately #170..#180 after the first rating abuse.

http://marketplace.xbox.com/en-US/Games/XboxIndieGames?page=8&sortby=TopRated

It's hard not to view this as a lack of respect for your developers. Can you please fix this, for the sake of doing what is right for your developers? What do we have to do to inspire you to fix what rightfully should be fixed without needlessly challenging our relationship? I have not gone public with this which has been my overwhelming feedback on what to do, to essentially force Microsoft in a position to do the right thing. I don't even want to do such a thing. I support Microsoft, this is clear. Please support me back.

Thank you.

Matthew Doucette, Xona Games

- http://forums.create.msdn.com/forums/p/80881/516323.aspx#516323

I'll show the example of just Score Rush in Japan:

Score Rush 28/06/2011 4 194 24 (rating, number of votes, rating rank)
Score Rush 27/06/2011 4 194 25
Score Rush 26/06/2011 4 194 28
Score Rush 24/06/2011 4 194 28
Score Rush 23/06/2011 4 194 29
Score Rush 22/06/2011 4 194 30
Score Rush 21/06/2011 4 194 30
Score Rush 20/06/2011 4 194 30
Score Rush 19/06/2011 4 194 31
Score Rush 18/06/2011 4 193 29
Score Rush 17/06/2011 4 193 28
Score Rush 16/06/2011 4 193 28
Score Rush 15/06/2011 4 193 28
Score Rush 14/06/2011 4 193 30
Score Rush 13/06/2011 4 193 30
Score Rush 12/06/2011 4 193 30
Score Rush 11/06/2011 4 185 7
Score Rush 10/06/2011 4 185 7
Score Rush 09/06/2011 4.25 177 6
Score Rush 08/06/2011 4.25 177 6
Score Rush 07/06/2011 4.25 176 6
Score Rush 06/06/2011 4.25 176 6
Score Rush 05/06/2011 4.5 158 3
Score Rush 03/06/2011 4.5 158 3
Score Rush 02/06/2011 4.5 158 3
Score Rush 01/06/2011 4.5 158 3
Score Rush 31/05/2011 4.5 158 3
Score Rush 30/05/2011 4.5 154 3
Score Rush 29/05/2011 4.5 154 3
Score Rush 28/05/2011 4.5 154 3
Score Rush 27/05/2011 4.5 154 3
Score Rush 26/05/2011 4.5 154 3
Score Rush 25/05/2011 4.5 154 2
Score Rush 24/05/2011 4.5 154 3
Score Rush 10/05/2011 4.5 150 3
Score Rush 09/05/2011 4.5 150 3
Score Rush 08/05/2011 4.5 150 3
Score Rush 07/05/2011 4.5 150 3
Score Rush 06/05/2011 4.5 150 3
Score Rush 05/05/2011 4.5 150 3
Score Rush 04/05/2011 4.5 150 3
Score Rush 03/05/2011 4.5 150 3
Score Rush 02/05/2011 4.5 150 3
Score Rush 30/04/2011 4.5 148 3
Score Rush 29/04/2011 4.5 148 3
Score Rush 28/04/2011 4.5 148 3
Score Rush 26/04/2011 4.5 148 3
Score Rush 25/04/2011 4.5 148 3
Score Rush 24/04/2011 4.5 148 3
Score Rush 23/04/2011 4.5 148 3
Score Rush 22/04/2011 4.5 148 3
Score Rush 21/04/2011 4.5 148 3
Score Rush 19/04/2011 4.5 148 3
Score Rush 18/04/2011 4.5 148 3
Score Rush 17/04/2011 4.5 147 3
Score Rush 15/04/2011 4.5 146 3
Score Rush 14/04/2011 4.5 146 3
Score Rush 13/04/2011 4.5 146 3
Score Rush 12/04/2011 4.5 146 3
Score Rush 11/04/2011 4.5 146 3

The math fits that every vote after 158 (after June 6th, 2011 and the end of our #3 spot in Japan) could have been a 1 star vote. It only takes 36 such votes to do this damage. 1 star votes cause incredible damage to top rated lists.

Matthew Doucette, Xona Games

-http://forums.create.msdn.com/forums/p/80881/516374.aspx#516374

"Murudai" posted:
...the position on the Top Rated list does actually make a big difference.


This is information Robert Boyd has already clearly demonstrated to us, and I appreciate you coming forward, Murudai, to silence any doubt.

The most scarring issue is the indirect value of discrediting the developer. In our talks with publishers and media we mention our #3/4/5 ranks of 1,800 games in Japan all the time. It doesn't help that http://marketplace.xbox.com/ja-JP/Games/XboxIndieGames?SortBy=TopRated shows Decimation X3 and Score Rush at #20 and #39 (at the time of this writing). Our ratings is one of our standout accomplishments, beyond our $100,000 contest win, as it's a measure of our success on the field. Damaging to Microsoft is where the conversation leads to next, which is talks of rating manipulations and the lack of support. I wish I could avoid this all.

What about the value of simply doing what is right, respecting (top) developers, and showcasing truthful lists to the Xbox LIVE gaming community?

Matthew Doucette, Xona Games

- http://forums.create.msdn.com/forums/p/80881/520197.aspx#520197

 

Stat Screenshots:

Michael Neel of GameMarx and Xbox Indies, both great sites, helped shed light on the both issues with stat tracking. Here you can see the stats of all our games and how they were targeted and abused via rating manipulation:

Here are screenshots of each, as of today (July 6th, 2011):


Score Rush stats, showing rating manipulation.
Look at the "Top Rated Position" graph for United States and Japan.
Source: xboxindies.com/game/score-rush/stats.


Decimation X3 stats, showing rating manipulation.
Look at the "Top Rated Position" graph for United States and Japan.
Source: xboxindies.com/game/decimation-x3/stats.


Decimation X stats, showing rating manipulation.
Look at the "Top Rated Position" graph for United States (potentially targeted) and Japan (not targeted).
Source: xboxindies.com/game/decimation-x/stats.

.

Please note, these stats do not cover the beginning of the first rating abuse. They were collected only after it started.

 

Ranks Before and After:

After both rating abuse manipulations, as of today (July 6, 2011), we had two top 30 games in the U.S. kicked down to 200, off the charts essentially. And in Japan, we had the #3, #4, and #5 games, two of them kicked down to #20 (Decimation X3) and #39 (Score Rush ). The untargeted and worse of our games jumped from #5 to #3 with the absence of our other two games (Decimation X). This is out of 1,800 games These changes are signifcant.

 

Conclusion:

And Microsoft's official response to all of this: "We have also investigated rolling back suspect votes, however, we determined it will not be possible to do this." - Charles Cox, Microsoft. Of course it is possible to do this, and I wish they would.

There are so many issues. One is the lost ability to rate games in the Games Library on the Xbox 360 Dashboard, which has lowered the amount of XBLIG voting that takes place which makes rating manipulations easier to perform. I created a connect issue on it which currently has an incredible 105 up votes and 0 down votes, but no response from Microsoft. Please vote and comment on it, it requires a free signup to Microsoft Connect:

It's not like Microsoft never moves. So don't read this the wrong way. They reacted to the most up voted connect issue on XBLIG ever, when XBLIG devs fought to move Indie Games back under "Games and Demos:

There's a lot of dreams I have for XBLIG, including the "Xona Proposal", that may never see the light of day. It's a truly amazing platform with even more amazing potential. It's sad to see it only get half way there, because the second half could truly be magnificent for indie game developers and gamers alike.

 

More Xona Games Articles:

2017/Apr/10 Exploring Non-Euclidean Geometry
2017/Mar/30 PAX East 2017 Wrap Up
2017/Mar/26 GDC 2017 Wrap Up
2016/Dec/06 Matthew Doucette: Featured in Canada Business Network
2016/Oct/17 Xona Games: Featured by Futurpreneur
2016/Oct/06 Random: 3rd Place at Atlantic Lottery Hackathon
2016/Aug/01 Matthew Doucette: Xbox MVP Award!
2016/Jul/21 Practicing Self-Care as an Entrepreneur
2016/Jul/06 Ego is the Enemy
2016/Jul/05 XNA 5.0 Officially Declined by Microsoft
2016/Jun/28 Kickstarter: Xydonia: Action Packed Japanese Inspired Retro Shmup
2016/Jun/12 Xona Games: Featured on CJLS Radio
2016/Jun/08 Xona Games: Featured in Yarmouth Vanguard
2016/Jun/01 Xona Games: Featured in The Chronicle Herald
2015/Oct/05 Futurpreneur Funds Xona Games
2015/Sep/23 Matthew Doucette Pitching Xona Games at Invest Atlantic
2015/Jul/30 Matthew Doucette: Completed 100 Xbox LIVE Games!
2015/Jul/17 Xona Games: Featured in Progress Magazine
2015/Jun/29 Matthew Doucette: Keynote Speaker at Game Space AV
2015/Mar/22 Matthew Doucette: CJLS Radio Interview on Bizcraft
2015/Mar/14 Matthew Doucette: Keynote Speaker at Bizcraft
2015/Feb/12 Matthew Doucette: Guest Speaker on Artificial Intelligence
2014/Sep/19 Google Adsense
2014/Aug/18 Xona Games Lands $50,000 ACOA Funding
2014/Aug/16 Halifax Scramble S (Wrap Up)
2014/Aug/10 How Many Games Does a Game Developer Own?
2014/Aug/04 Kickstarter: Elysian Shadows, a Next-Gen 2D RPG
2014/Jul/25 Kickstarter: Funded Viridis, an Indie Shmup
2014/Jul/17 Xona Games in Wikipedia!
2014/Jun/27 Xona Games: Featured in Greater Halifax
2014/Jun/10 Xona Games: Featured in Yarmouth Vanguard
2014/Jun/06 Alexander Bruce: Inspirational Indie Developer
2014/Jun/05 Matthew Doucette: Guest Speaker at 1T
2014/Apr/02 Domains, Domains, Domains
2014/Mar/10 Matthew Doucette: Interviewed on Indie Dev Podcast
2014/Mar/04 Matthew Doucette: Interviewed on Game Code TV
2014/Mar/01 Xona Games: Featured in Official Xbox Magazine
2014/Feb/27 Xona Games: Announced as Official ID@Xbox Developer
2014/Feb/24 Matthew Doucette: 80 Completed Xbox LIVE Games
2014/Feb/23 Xona Games & Turbulenz Win $50,000 Tizen App Challenge
2014/Feb/18 Xona Games: Featured in Connected for Business
2014/Feb/17 Halifax Scramble Wrap Up
2014/Feb/15 Matthew Doucette Wins Raiden Fighters Jet Tournament
2014/Feb/14 Xona Games Shmup Tournament
2014/Jan/22 Xona Games: Interviewed by Rogers
2013/Dec/05 Don't Forget, Xona Games is in ID@Xbox too!
2013/Nov/07 Matthew Doucette: Guest Speaker at Entrepreneurship Seminar
2013/Oct/29 Xona Games Wins $20,000 Rogers Big Idea Contest
2013/Oct/25 Halifax Game Jam 2013 Wrap Up
2013/Oct/17 GDC 2014, Here We Come!
2013/Oct/14 Xona Games Supports NSGDA
2013/Sep/17 Running CityDesk on Windows Vista/7/8/10
2013/Sep/12 Xona Games Accepted in ID@Xbox
2013/Sep/09 Our Own NES Game Genie Codes
2013/Sep/03 Kickstarter: Funded Mighty No. 9!
2013/Aug/27 Take Risks
2013/Jul/25 Indie Royale's Indie Gamer Chick Bundle
2013/Jul/23 We're featured in Yarmouth Vanguard
2013/Jul/18 We're featured in Nova Scotia's ICT 2013 Sector Report
2013/Jun/25 Jalloo 2013 Wrap Up
2013/May/20 Sad News on Radiangames' First F2P, Bombcats
2013/May/14 Xonatron Breaks Top 10,000 on TrueAchievements
2013/May/02 Xona Games: Interviewed by Independent Gaming
2013/May/02 Funded Another Retro Kickstarter: Chasm
2013/Apr/29 Two Cool Kickstarter Projects
2013/Apr/25 GDC 2013 Wrap Up
2013/Apr/23 PAX East 2013 Wrap Up
2013/Apr/10 Kickstarter: Shmup Devs Unite!
2013/Mar/27 GDC 2013: Beating Score Rush in 0:10:20
2013/Mar/25 Xona Games Featured in Develop Magazine, Thrice!
2013/Mar/23 PAX East 2013: Matthew Wins Geometry Wars 2 Tournament
2013/Mar/13 Matthew Doucette Interviewed on Monetization Practices
2013/Jan/28 Don't Stop
2013/Jan/08 Xona Games: Jason Doucette GDC 2012 Interview
2012/Dec/18 Help Xona Games win a OUYA Dev Console
2012/Dec/06 Are Games Art? It Doesn't Matter
2012/Apr/06 Xona Games Devs Beat Super-C in 0:16:28 at PAX EAST 2012
2012/Mar/25 #1 and #2 in SHMUP Contest!
2011/Jul/22 Xona Games Backs Indie Game: The Movie On Kickstarter
2011/Jul/06 Xona Games Targeted For Rating Manipulation Abuse, Twice
2011/Jul/04 Xona Games: Featured in Official Xbox Magazine Online
2011/Jun/27 Halifax Game Jam 2011 Wrap Up
2011/Jun/20 Xona Games: Canada Business Feature
2011/Jun/20 "How I come to be Xona-Infected?"
2011/May/30 Xona Games: Featured in Chronicle Herald
2011/May/09 Xona Games: Interviewed by The Thoughtful Gamers
2011/Apr/11 Xona Games 1 of 3 Developers To Produce Three 4-Star XBLIG Games
2011/Mar/25 Xona Games is 4-Player Shmup King of XBLIG: Created 3 of Top 7
2011/Mar/21 Xona Games Running Lean: The Lean Startup Challenge
2011/Mar/14 Xona Games: Featured in Nova Scotia's "Your Studio Here" Promotions
2011/Mar/14 GDC 2011 Wrap Up
2011/Feb/22 Xona Games Featuered: Indie Games Counter Sequel-Driven Market
2011/Feb/02 Xona Games: Featured in Chronicle Herald, Again!
2011/Jan/27 Xona Games: Are You Smarter Than A CEO? Interview
2011/Jan/26 Featured Indie Developers: Xona Games
2011/Jan/10 Xona Games Featured in Develop Magazine, Again!
2011/Jan/04 Xona Games: CBC News Recap
2011/Jan/02 Xona Games 2 of Top 3 Picks in #1 Japanese Gaming Magazine, Famitsu
2010/Dec/17 Xona Games 10th & 11th Best Selling XBLIGs Worldwide
2010/Dec/12 Xona Games Dominates Japan in Top Ratings and Best Sellers
2010/Nov/03 Xona Games Congratulated by Nova Scotia House of Assembly
2010/Sep/23 Xona Games Inspires!
2010/Sep/10 Calculated Success
2010/Sep/06 Racketboy Podcast #15 - Indie Shmups
2010/Aug/30 Xona Games Featured Over 200 Times!
2010/Aug/25 Xona Games NSBI Photoshoot!
2010/Aug/09 Living the Dream!!!
2010/Jun/18 Google Respect
2010/Jun/16 Jalloo Festival to Showcase Duality ZF
2010/May/25 And In Local News... (Yarmouth, Nova Scotia)
2010/Apr/30 Homebrew Heroes: Retro Gamer Feature
2010/Apr/19 Xona Games Featured in Open to the World Magazine
2010/Apr/15 Xona Games Inc.: We're Officially Incorporated!
2010/Mar/25 Matthew Doucette: Guest Speaker at Innovation Social
2010/Mar/16 GDC 2010 Wrap Up
2010/Feb/25 Xona Games Speaks at Business Over Breakfast
2010/Feb/20 Xona Games Wins $100,000 - I-3 Technology Start-Up Competition (Video)
2010/Feb/02 50,000 YouTube Views
2010/Jan/26 Xona Games Featured in Local Newspaper
2010/Jan/26 Xona Games Wins $100,000 - I-3 Technology Start-Up Competition
2009/Dec/17 Acadia University Coverage: A Passion For Programming
2009/Dec/08 Xona Games Top 3 in $200,000 Technology Competition
2009/Nov/09 Xona Games Featured in Develop Magazine
2009/Oct/22 Xona Games I-3 Technology Start-Up Competition Finalist
2009/Sep/24 Xona Games Featured on CBC TV News
2009/Sep/23 Xona Games on CBC News Website
2009/Sep/23 CBC Radio One Interviews Xona Games
2009/Aug/18 Xona Games Company Profile for NSBI
2009/Jun/15 Console Arcade Interviews Xona Games
2008/Aug/28 Introducing Xona Games

 

About the Author: I am Matthew Doucette of Xona Games, an award-winning indie game studio that I founded with my twin brother. We make intensified arcade-style retro games. Our business, our games, our technology, and we as competitive gamers have won prestigious awards and received worldwide press. Our business has won $180,000 in contests. Our games have ranked from #1 in Canada to #1 in Japan, have become #1 best sellers in multiple countries, have won game contests, and have held 3 of the top 5 rated spots in Japan of all Xbox LIVE indie games. Our game engines have been awarded for technical excellence. And we, the developers, have placed #1 in competitive gaming competitions -- relating to the games we make. Read about our story, our awards, our games, and view our blog.



Home | Games | Awards | About | Learn | Blog | Press Kit | Contact
Email:

Xona Games, Xona.com, Xonatech, Saw Tooth Distortion, Evolutionary Prototype (EP), Duality ZF, Decimation X, Decimation X2,
Decimation X3, Decimation X3.5, Decimation X4, Score Rush, Score Rush 2, Score Rush (HTML5), Score Rush MP, and Score Rush Extended (Score Rush EX)
trademarked and copyrighted by Xona Games Inc., Matthew Doucette, and/or Jason Doucette.
© 2000..2005 Saw Tooth Distortion. © Xona.com. © 2008..2010 Xona Games (under Xona.com).
© Xona Games Inc.

We make Intense Retro video games.