Run log

Agent and model comparison with imge session replay

Berkay DemirbasBerkay Demirbas··2 min read

On a local Studio Store demo, the task was to click Add to cart without choosing a size, select Medium, click Add to cart again, and report the first failure and the final cart count.

The page has two buttons with the same accessible name. The first is a trap. Each run used the imge MCP browser tools and started from a fresh browser session.

ClientModelWall timeFramesCart
Codexgpt-6-luna, low effort~20 s51
CursorComposer 2.5~58 s90
CursorGPT-5.3 Codex Low31.9 s40
CursorClaude Sonnet 5 Thinking High51.6 s51
CursorGrok 4.7 Low41.2 s40
CursorAuto104.2 s40
CursorGemini 3 Flash32.6 s51
CursorGLM 5.2 High39.7 s60
CursorDeepSeek V4.1 Flash Low19.7 s51

The first click failed with “Choose a size first” in every completed run. The cart ended at 1 when the run used the second button, and at 0 when it used the first. Wall time includes CLI startup, MCP initialization, model time, and browser actions. The Codex and Composer times are approximate, taken from log timestamps. The other Cursor times came from a timed runner.

Berkay Demirbas
Creator of imge