To explore how model building adapts to changing environments, we had participants play “rock‐paper‐scissors” against a computer that played a frequency bias or a player‐dependent bias and then switched. Participants demonstrated their use of prior experience in how quickly they recognized and exploited changes in the computer's play strategy; in general, the more similar the strategies, the more efficient the updating. These findings inform our understanding of previously reported updating impairments in right‐brain damaged patients.