A developer who shipped his own browser game opened a thread on r/aigamedev offering to play and score every free AI-built game people posted. Not a vibe check: three axes, scores out of ten, a public leaderboard, and a promise to get to every submission. His framing up front was that tooling is not the variable — “the need for human creativity won’t go away when it comes to the soul of a game.”

The rubric:

  • Playability — is it smooth and fun to play
  • Aesthetic — does it look and sound appealing
  • Originality — does it stand out with unique elements
  • Free-to-play only (web, mobile, desktop, Steam), no iOS — a constraint that keeps every entry playable by anyone reading the thread

The scores are sobering. Top of the board is an 8.0, then 7.0 and 6.67. Out of hundreds of submissions, nobody hit a nine. That is what the flood looks like from the reviewing side: a mass of competent sixes and sevens.

The reviews are mechanical, which is why they are usable. A PSX-styled touge-racing roguelike got Playability 6 (“7 if you can make the physics more consistent”), Aesthetic 7, Originality 5 — with specific complaints: the powerups are visually unappealing, do not fit the rest of the game, and do not seem to do much; collisions are inconsistent, sometimes flipping traffic away and once throwing the player off the track.

The dev’s response, appended in edits, is the part worth stealing:

  • Found a shader bug the reviewer’s phone hit and his own newer phone masked — a large performance win once fixed
  • Narrowed the road ~10% and rebalanced traffic, because a real-life road width under a high camera kills the sensation of speed
  • Cut the displayed speed figure ~15%, since the physically accurate number felt slow
  • Reworked the boost and drift system so boost comes from upgrades or cornering instead of free pickups

Then the reviewer turned the exercise into infrastructure: a subreddit and a site, pitched as a Rotten Tomatoes for indie games, open to other reviewers.

Production stopped being the bottleneck, so the bottleneck moved downstream — being played, and being told something specific. What actually improved the games in this thread was not a newer model. It was one stranger writing down that the powerups looked wrong and the collisions were inconsistent, and a dev spending a week acting on it. Published criteria plus a willingness to play is the cheapest quality lever in this ecosystem, and it is the layer everybody skipped.