AI Agent Struggles to Master Basic Strategy in Slay the Spire Training Run
A developer trained a reinforcement learning agent for 200,000 steps — roughly 14,000 fights — against the Cultist, the simplest enemy in Slay the Spire. Despite extensive training, the agent achieved only a 70% win rate, effectively playing cards at random rather than learning a deliberate strategy. The agent also consistently refused to use block cards, even when energy and cards were available after attacking. Investigations revealed a silent bug had disabled block mechanics, but fixing it did not change the agent's behavior, pointing to a deeper issue with delayed rewards in reinforcement learning. Various reward-shaping experiments and hand-coded heuristics improved HP preservation somewhat, but gains repeatedly degraded during further training.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in