← back

Stateful environments for vertical agents — Josh Purtell, Synth Labs

1.4K views · Jul 22, 2025 · 6:50 min · Watch on YouTube ↗
Takeaway

Wrap vertical-agent workspaces in resetable stateful environments to enable model swaps, multi-agent, rollbacks, and tree search out of the box.

Summary

  • Josh Purtell (Synth Labs founder) defines stateful environments as engines that compute results external to the agent, exposing only what the agent needs to observe/manipulate — building on the lineage RL Glue → OpenAI Gym → SWE-bench/SWE-agent's 'agent-computer interface'.
  • Argues vertical agents (finance, accounting, health) need stateful environments now because models like Sonnet 3.5 enable long-horizon iteration on artifacts (post-Claude-artifacts era), unlike early LLMs that just calculated sums.
  • Key benefit: containerizing logic into stable code means you can swap to a new model without rewriting agent logic; supports multi-agent setups via network boundaries (same trick as async-work-in-production).
  • Resetable state enables rollbacks and effectively gives you Language Agent Tree Search (LATS, the 2023 paper) for free — agent branches in Minecraft and the best branch wins, avoiding derailment over hundreds of steps.
  • Open-sourced abstractions on GitHub at synth-ai/environments with implementations across academic benchmarks.
agentsreinforcement-learningenvironments
Original description
Hey All - gave a talk on building stateful environments for vertical agents at AI tinkerers and ppl really liked it, happy to do again. Here's the repo - general code that endows environments like Pokemon Red, Minecraft, Swe-Bench, and others with the same interface for development and agent training. github.com/synth-laboratories/Environments

Recorded at the AI Engineer World's Fair in San Francisco. Stay up to date on our upcoming events and content by joining our newsletter here: https://www.ai.engineer/newsletter