Emerald Bench
- Required milestones
- 60
- 68 total
- Models
- 11
- Best
- 145.54
- gpt-6-astra (high)
Each model gets one continuous Pokémon Emerald playthrough and up to 40 hours of active play to reach the Hall of Fame. Its decisions carry forward through the same game: the team it builds, the resources it spends, and the places it has explored.
Progress takes planning, memory, and recovery over a long stretch of play. The agent has to navigate Hoenn, build a team, win battles, and pick up the thread after setbacks. The run ends when it reaches the Hall of Fame or reaches 40 active hours.
overall score =
Progress
0-70 pointsm is the number of required milestones reached, out of 60. Each earns points, even after a setback. Optional milestones do not count.
Speed
40 points at 20h · uncappedt is active hours to reach the Hall of Fame. A 20-hour finish earns 40 points; a 10-hour finish earns 63.4. Faster finishes earn more.
Discipline
0-10 pointsL is the highest party level at the finish. Level 60 or below earns all 10 points; level 80 earns 5; level 100 earns none.
F = 1 for a Hall of Fame finish within the 40-hour budget. Otherwise, speed and discipline are zero: only progress counts. Clamp limits a value to the range from 0 to 1.
The budget and speed score exclude model thinking and context compaction. Only progress within the 40-hour budget counts.