miHoYo's 'Gamer' AI plays Honkai: Star Rail from screenshots alone: what it can do, and why it isn't a cheat bot
miHoYo's Honkai AI R&D team has published Gamer, an AI agent that plays Honkai: Star Rail by looking at the screen and pressing keyboard and mouse inputs like a person. Players turned it into a meme about AI doing their gacha grind; miHoYo says it is built for research and game testing, not cheating.

An AI just played through Honkai: Star Rail quests the way you do: by watching the screen and pressing keys. miHoYo's Honkai AI R&D team has published a research model called Gamer, together with university co-authors. It looks at screenshots and sends keyboard and mouse input, with no access to the game's code, memory or any special API (project page, arXiv). The research has been trending on X this week, mostly as jokes about finally letting an AI handle the daily gacha grind.
What Gamer actually does
- Pixels in, keystrokes out. The model takes screenshots five times a second and outputs mouse movement and key presses, working out to roughly 30 inputs a second, according to the project page.
- Trained on a lot of play. The team describes more than 10,000 hours of raw gameplay footage, about 1,000 hours of curated Star Rail footage, and around 1.2 million "think" notes plus 223,000 memory notes. Those teach the agent when to stop and reason, and what to remember on long quests (project page).
- Fast enough for real time. Its custom serving setup cut response time from 1,306 ms to about 65 ms on an NVIDIA H200, a roughly 20× speed-up (project page).
The scoreboard
- On two Star Rail side quests it had not been trained on, the final version hit 80.0% and 83.6% of verified quest milestones. The base model it started from scored 0% and 13.9% (NYU Shanghai RITS, citing the paper).
- Across 40 held-out puzzles of seven types, it averaged 49.7%, against 17.1% for the best general-purpose AI model the authors tested (project page).
- In a post on Hugging Face, an author says Gamer handles over 95% of the challenges across several Star Rail main-story chapters in automated testing.
The authors also flag limits. Extra gameplay data stopped helping on games very different from the training set, and one puzzle type got worse after reinforcement learning (RITS). The Star Rail-trained model and data won't be made public "for data security reasons," per the project page and RITS, so outsiders can't check the headline numbers yet.
Why gamers and esports should care
- It's built for QA, not for your rank. miHoYo's page lists game testing, accessibility and human–AI interaction research as the uses. It says the team does not endorse using Gamer for cheating, unauthorised access or anything that undermines fair play. Competitive games already rely on anti-cheat like Riot Vanguard and Easy Anti-Cheat, and screen-reading agents like this are exactly what those teams will be watching.
- Studios are leaning into AI. It follows a week where AI was in the spotlight in esports too, from AI casters pulled from a THE FINALS qualifier recap to Riot opening up esports data through GRID.
- The meme writes itself. For a gacha audience, "the developer built an AI that can do the quests" is a punchline and a question at once: if automated testers clear content faster, will patches ship cleaner? The paper doesn't say, and miHoYo hasn't announced any player-facing feature.
Explore more
Want to get better yourself? Browse coaching and training tools and stats and analytics trackers, or see who builds the tech behind games in industry services.
Building AI, anti-cheat or testing tools for games? List your company on EsportsDock, or reach gamers and esports pros with a sponsored placement.
mihoyo hoyoverse honkai-star-rail ai game-testing research gaming-culture trending
- Gamer project page (miHoYo Honkai AI R&D)
- arXiv paper 2611.18397
- Hugging Face paper page
- NYU Shanghai RITS analysis
The EsportsDock Weekly
The week's esports news that matters for business, new tools worth trying, and the biggest roster moves. One email, no spam, unsubscribe anytime.
In the directory
GRID
Industry Services & AgenciesOfficial in-game data platform supplying esports data to publishers, broadcasters and teams.
dataofficial-dataapiRiot Vanguard
Industry Services & AgenciesRiot's kernel-level anti-cheat.
anti-cheatEasy Anti-Cheat
Industry Services & AgenciesAnti-cheat service from Epic Games.
anti-cheatMore news
Conor McGregor gives his 400 staff the day off for GTA 6: 'Enjoy the game!'
Former UFC champion Conor McGregor told his whole workforce, which he puts at 400 people across several countries, to take launch day off to play Grand Theft Auto VI. It is the most famous name yet in the GTA 6 day-off trend. Here is what he posted and why athletes keep crossing over into gaming.
Dota 2 patch 7.42 is out: six new items, Javelin and Khanda removed, and a Tormentor that now drops loot
Valve released Dota 2 patch 7.42 on 18 November, its first full numbered patch since 7.41. It adds six items including Caduceus, removes Javelin, Helm of the Overlord and Khanda, cuts neutral item tiers from five to four, makes the Tormentor drop a new Greater Horn of Battle, and resets the gold and experience economy. Here are the changes that matter most.
NRG bring back eeiu for VCT Americas 2027: the 2025 champions' new initiator and who is still missing
NRG have officially re-signed Canadian initiator Daniel "eeiu" Vucenovic for the 2027 VCT Americas season, four years after he left the club. He joins Ethan, mada and skuba, leaving NRG one player short of a full five.