I’m Big In China

goldleader-iconAbout four days short of a month after launch, earlier today my small Flash game Gold Leader crossed over 102,000+ visitors, some 151,000+ plays.  Google Analytics believes just under 58,000 of them are actually unique and 45,000 are returning players.  That’s super sweet from a “People played my game!” perspective.  The breakdown on who they are is also pretty interesting.  Basically, I’m big in China, except that to actually be “big” in China you would need to be tremendously huge.

Growth

This is a plot of the game’s ‘load’ event, kicked off right after the preloader finishes and the sponsor splash screen plays:

Gold Leader game loads since (just before) launch.

Gold Leader game loads since (just before) launch.

With any minimal knowledge of the Flash game scene, you can probably basically guess at the story from just glancing at the chart.  For others, it’s important to understand a key characteristic of most Flash games: There is a ridiculous number of game sites out there, and they generally all steal and share each other’s games in an attempt to capture eyeballs from other sites.  Hence, the sponsor requested that Gold Leader not be locked down to their particular site.  The timeline:

  • The game was launched on GameShed.com on January 16th.  Due to the scale of the later hits it’s not noticeable, but the game starts at about a 100 players a day and ramps up a bit.
  • January 21st or so I put the GameShed branded version on Newgrounds and Kongregate.  It sits in judgement for a bit over a day on each, essentially a staging area they use for adventurous users to rate new, unscreened content and determine if and how it’ll be posted to the main page.
  • The game eventually makes it out, even with a reasonable rating on Newgrounds (currently about a 3.25 after 1721 views).  Due to the kind of silly way judgement seems to work though, it never really hits the front page—it’s blocked by games that were posted later and are actually rated lower but got more votes more quickly so they came out of judgement faster and sorted to the top by original posting date.  You have to go to the second page of new games to find Gold Leader, but it’s out there.
  • Around the same time, GameShed also puts the game on FlashGameDistribution.com, a service that portals and arcades use to share Flash game files.  This throws more potential hosts into the mix, with some 95 portals having looked at the game through there as of this moment.
  • Within a day or so, searches like “gold leader flash game” start turning up hundreds of sites hosting the game.  Almost all of this is certainly coming from hosts that pulled the game off either Newgrounds or Kongregate.  I can’t really guess which, though I kind of thing the latter even though the game’s even less prominent there.
  • Play explodes, at least in relative terms.
  • As it drifts of the main pages of all these sites, it goes down pretty rapidly but after a couple weeks is still clocking in a steady 3800 unique visitors per day.

After a while I would have been convinced the steady hits were bots crawling sites and somehow/for some reason loading the SWF or something ridiculous like that, if not for the steady uptick in detailed play stats.  At this point, 7,000 people have played all the way through the entire game, about 13 minutes of play if you can manage to do it straight through, pretty hard to do.

Demographics

Not too surprisingly given what I gathered from reading what few discussions of Flash game play numbers I’ve come across, most of the traffic is from China:

  • China 88,000
  • Romania 2,200
  • USA 2,000
  • Russia 1,200
  • Italy 800
  • Vietnam 750
  • Unknown 700
  • Slovakia 500
  • Germany 400
  • Ukraine 430

And on from there.  The game has been played from at least 127 countries.  My geography/social studies-major sister will no doubt be pleased that I had actually heard of all of them.  In any event, someone from Botswana, Brunei, and a bunch of other barely-heard-of-in-the-US nations have played Gold Leader.  That’s great!

The Romanian and Russian and other Eastern European hits aren’t too surprising.  I don’t actually know, but believe GameShed operates out of Eastern Europe, quite possibly one of those two, so that could easily account for those numbers.

Shame on the British though for not playing more!  Even the French played more!

Rocketship Games Breaches the Great Internet Wall

In any event, China.  A huge portion of the hits are coming from just three Chinese sites: 3366.com4399.com, and 7k7k.com.  Interestingly, the original entry point into China, whichever site it was, probably either lifted the game from GameShed.com or went searching for assets and found them there.  GameShed created icons for their menus and achievement badges with (to me) distinctive higher-resolution purple and grey bars behind the ships, which the Chinese sites seem to be using.

Homepage for 3366.com showing Gold Leader in my personal games-played portfolio.

Fantastically, these sites all have little translation guides telling Chinese language players what inscrutable English symbols to click on to start the game and other required tasks:

Play guide on 3366.com.

Play guide on 3366.com.

Play guide on 3366.com, translated from the original Han.

Play guide on 3366.com, translated from the original Han.

Hacked!

Less fantastically, the Chinese sites have all added their own little preloaders that essentially cut my preloader down to a click-through.  It doesn’t really affect me since I’m not particularly trying to monetize the game, but this tracks with what I’ve read about Chinese game portals cutting out ads from other games.  I can see why developers and sponsors would be annoyed.  That’s a huge percentage of your views to have stolen away.

Way, way more awesomely though (in some sense), at least one site hacked the game.  From 4399.com, I present to you: Gold Leader—Prime Fighter Invincible Version!  The title pretty much says it all.  Incredibly, they altered the bytecode of the game such that you can’t take damage and you can’t fail the missions.  Personally I find it pretty boring to play, but it’s rated a solid half a star better than the standard version on their site…

Either way, that’s ridiculous.  Everything else seems to work fine.  You even get the warnings that you’re in danger of failing, it just doesn’t ever happen.  That’s some scalpel-like precision, especially when you figure the game’s written in Haxe so the bytecode probably even looks and decompiles differently from a game produced in a more standard fashion using AS3 or Flash Builder.

Previously I noted how this experience has made real for me the bandwidth and other resource requirements consumed even on the very very minor end of “Internet scale.”  This development has changed my thinking on cheating.  Previously I’d always figured hacking and cheating couldn’t possibly be a huge concern for any but the most serious games.  That’s completely wrong, you will be hacked and there will be cheaters.  I’m not even rated that highly on this site but they put in what to me seems a non-trivial effort to do so.

Fortunately their players still don’t seem to be actually scoring particularly high or they’re not submitting to the Mochi leaderboard, so that’s still sane.

Games as Communication

Back on the more positive side, 3366.com actually has a steady stream of commenters.  I have little idea what they’re actually saying in detail, the Google Translate version is amazing nonsense about “Wife of this game is too fun” and “Go after an airplane. Do not know the horse of God. The same point is useful only. :o”  But, judging from the emoticons (and Google Translate) they seem to be pretty positive and bearing out the 7.5 rating Gold Leader‘s maintaining there:

Comments on 3366.com.

Comments on 3366.com.

In some ways that’s pretty crazy and almost frustrating, to have this whole non-trivial audience I can’t communicate with—I want to tell them I appreciate it!  I had already started thinking about it earlier, but have definitely now worked out some basic support structures to do localization of future games, swapping in translated game text.  It just seems like all these fans should at least be rewarded by having the menus in their own language.  Most of them may not even realize you can fully configure the controls, which is a bummer.

Beyond that though, it’s actually really satisfying.  One of the best moments of this whole project was an early pre-review from a paid first impressions tester on FlashGameLicense, who ranted at length about its virtues and declared:

The piece reflects and projects legit understanding of what it wants to do, it is evident that it is being made by people who love and play this style themselves, and the fact that it is a rigorous and MEAN shooter, makes it an eminent declaration already.

That pretty much made the whole effort worthwhile right there, much more so than the sponsorship.  Gold Leader is not the greatest thing in game history.  But an awful lot of love and attention was put into making it run great, play well, and be a deserving homage to all the shooters I played endlessly as a kid.  From the minimal aesthetic to the conscious decision to ratchet up the difficulty at the risk of turning away more casual gamers, there was real design intent toward that end.  It was deeply rewarding then to have someone get exactly what the project was all about, be on exactly the same frequency, and really appreciate it.

With these comments and hits though, it turns out there’s a lot of people on that wavelength.  Literally directly opposite from me across the globe, with a completely incompatible language, over what I would otherwise have assumed to be wholly unrelatable backgrounds, we’ve got this in common: We all recognize and love a good old school shoot ’em up.  That I could get this art, this love letter, across so many barriers and into the hands of all these people who would understand and appreciate it is why this, the Internet age, is the greatest of all eras.

Gold Leader @ 50,000

goldleader-iconSometime today Gold Leader crossed 50,000 unique viewers.  Together they’ve played just under 76,000 times over the two weeks it’s been released.

Of course, “unique” is not a strictly literal term.  I’m not sure how Google Analytics determines uniqueness exactly, but people coming back after some time are clearly included.  In some sense that doesn’t matter much in terms of counting eyeballs for ads and such and there’s no other real mechanism without any sort of accounts or such, so that’s the kind of number that generally gets bandied about.

As noted by the stats on the main blog, the game remains much too hard: Only about 14% of all players are beating the first mission objective.  I can only imagine what that’s doing to the repeat plays, or presumed lack thereof.  About 4000 people have loaded the game and not started a mission. I guess it just wasn’t what they’re looking for.

Almost all of the plays actually come from the last week.  The first week after launch (Jan 16) the game was getting a steady thousand views/day or so on GameShed.  Once it went viral to all the ridiculously many Flash sites around the net though, the plays spiked quite dramatically (about Jan 22).  Views are trending down now as the game falls off their front pages, but I really have no idea what the lifetime is.  Hopefully it settles on some sort of steady number of plays and doesn’t bottom out completely though it’s hard to believe that won’t happen given the steady deluge of games hitting the Web.

goldleader-players

Plot of game load events as captured in Google Analytics.

I’ve had some trouble coming up with numbers for typical Flash game plays so I’m not sure how this compares.  Many sponsors don’t allow developers to collect stats, and many developers are cagey about revealing what they do know.  Clearly it’s no Angry Birds or even a moderate hit, but it also certainly doesn’t seem to be the bottom of the barrel either.

Either way, that’s a pretty satisfying number and was actually my admittedly under-informed target: 50,000 players in two weeks.  50,000 people is a lot of people!  I guess it’s not “Internet scale,” but even accounting for some reasonable fraction being repeat players that’s still an absurd amount of people to have played my little shoot ’em up.

To put it in one perspective of interest to me, I’ve published research articles in several high profile venues, most notably in terms of numbers some of the major IEEE magazines such as Internet Computing.  An optimistic readership number I’ve heard for those higher profile venues is 5000 people, and presumably some fraction thereof reading any given individual article.  This is an order of magnitude more!  And it’s god knows how far from putting games up on the Web ten to fifteen years ago, when I was probably optimistically getting a very low couple hundred players, mostly through the Allegro community.

For the most part this is actually not as emotional as some of the early super enthusiastic reviews on FGL, but it’s still really cool and deeply rewarding.  It’s also somewhat educational.  Though fairly obvious beforehand, the data confirms that even for a lower profile game like this, the resources consumed would be pretty substantial for a single host.  If I moved the leaderboard or analytics off Mochi and Google, or provided any kind of multiplayer, online updates, or downloadable content, I would need some serious infrastructure to manage it.  Fortunately, I’m on top of it.  To the future!

Gold Leader: Early Analytics

goldleader-iconOne of the more interesting things to me about modern game design and implementation, particularly of online games, is the ability to heavily instrument them.  For example, tom5760 and I were talking the other day about Team Fortress 2 and how Valve tracks every death in great detail so they can do fancy things like plot heat maps of kill zones on levels or chart kill rates for all the weapons.  Clearly that’s critical for any sort of online, repeat play game like TF2 where you need to keep adding and continually balancing content to keep people coming back.

But it’s also really interesting and useful in general, providing great data for learning and adjusting future game design, and something that never even really occurred to me as a realistic possibility writing games for the late-90s landscape.  The technology and connectivity was only just beginning to be in place for it.

Gold Leader is only instrumented lightly, but it is hooked up with Google Analytics and it’s interesting examining the data (these numbers below are rounded slightly, for no real reason).

Players

Right now the game’s been up for about 60 hours.  Some 140 people have loaded the game a bit over 260 distinct times, and actually started playing a bit under 400 times.  Definitely not lighting the Internet on fire, but it’s still pretty cool to me at least that about 200 people have now played when you factor in FGL commenters.

Somewhat more interesting is how they’re doing.  Here’s the progression of players:

  • 45 have beat the Sensor Grid (60 times).
  • 20 have beat the Assault Command and Interceptors (25 times).
  • 15 have beat the Minelayers (15 times).
  • 10 have beat the narrative mission (the whole game) (10 times).
  • 7 of them have given the survival mode a try (7 times).
goldleader-sensors-achievements

Achievements’ display on GameShed, showing the Sensor Grid.

As a fine grained input on the game design, nearly everyone is failing by missing a mission objective rather than dying.  Only 20% of the failed attempts have been at 0 lives, the rest all have lives remaining when the mission was reported as failed (missed too many Sensors, etc.).  I’m not totally sure what to make of that—is one way or the other in terms of getting players to try again? I have no idea—but it’s really cool to know and think about, and if I were going to do an update would provide a clear update on what to adjust if I wanted to make the game easier, e.g., upping the mission failure threshold but not worrying about the number of lives.

Progression

The total and unique events for the Assault Command and Interceptors are identical and it’s not possible to skip the former and go to the latter, so it seems that anybody who can beat the Assault Command “boss” can beat the Interceptors.  That’s actually really interesting to me, because I don’t consider the boss much of a challenge, it’s basically just an old school “learn the pattern and play safe” fight, and the Interceptors mission can definitely be challenging.

Similarly, most people who can get through the Minelayers can get through to and beat the final Command Group, the next mission.  That I’m happy about, the balancing seems about right.  It’s not 100%, so there is a progression in difficulty.  But, it is only about 75% so it’s not a ridiculous additional challenge.

Only one or two other players (besides myself and tom5760) have achieved a perfect run (no deaths).  Stupidly I’m not explicitly tracking this, but I can sort of figure it out.  One I know for sure because he was logged into GameShed and recorded the achievement.  He’s actually the number one player on the site (has earned the most achievement and high score awards), so that’s not too surprising.  The other is actually a friend of mine who posted such a high score to Mochi that I can’t believe he didn’t beat the mission in one run.  I’m not even sure it’s possible to do otherwise while scoring above ~2750 or so, and he’s just over 3000.

Long Game Repeats

Unfortunately I’m not really logging how far people have played into the survival mode.  I’m sure it’s too hard, even I can’t survive for long, but it would be interesting data to have.

From the data it’s hard to tell people’s behavior once they get into the late stages without putting together some analysis scripts on the raw logs.  “Unique” here means a session, so they could be coming back some time later.  Based on the scoreboard however, if they are they’re mostly not playing up to the same point, though some are.

Difficulty

In general though, the big lesson, really the confirmation, is that the game is pretty hard.  Only 25% of players have made it through the first mission, and only on about 15% of the plays.  Toward the objective of hooking people in and keeping them playing and coming back, it’s clearly too hard.  In so far as that limits the reward the sponsor is getting out of the game and the audience the game and Rocketship Games gains, that’s unfortunate.

However, beyond that concern I can’t say I’m particularly troubled or upset about it.  Many of the reviewers on FGL noted that it was fairly hard, and it was obvious from my own testing.  I’ve never been a fan of the intentionally super hard games out there now (e.g., precision platformers like Super Meat Boy), but early on in development I found myself unexpectedly adopting a definite attitude that the difficulty was part of the aesthetic of the game and its homage to classic early shooters.  To some extent that’ll cost future efforts by hampering the popularity and visibility of this one, but clearly the difficulty objective has been met: Pretty hard—too hard for “casual” gamers—but certainly accessible for more “serious” gamers.

In any event, fantastic data to collect, and this experience has really convinced me to put a lot more thought toward instrumentation in future efforts, particularly in playtesting.  I hadn’t thought I’d be able to get much data so I hadn’t worried about it much here, but in the end enough people beta-tested on FGL that I probably could have gotten a fair bit of data while still in development.  Something to consider in tuning future games.