Step 5 Preview: Advancing the Pareto Frontier

(stepfun.com)

27 points | by nateb2022 1 hour ago

3 comments

  • bethekind 5 minutes ago
    > Without any Pokémon-specific optimization, Step 5 Preview has so far sustained progress for more than 3,000 turns and 6 million tokens of interaction. By turn 3,082, it had unlocked Cut, earned three Gym Badges, and defeated Lt. Surge. The run is now roughly one-third of the way through the main story.

    Finally FireRed is being used as a benchmark again! I believe Astra can beat it in 18 hours. Not sure how that compares.

  • Jacques2Marais 48 minutes ago
    • sieve 23 minutes ago
      I regularly hit 200-300M cached reads every day on some of the models I use. It has exceeded 7-800M on a couple of occasions. At $0.04/M, that is $8-12 per day only for cached reads.
  • conception 20 minutes ago
    Huh wonder why they skipped 4?