Oil · Saintevictoire¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the RoboPaint runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 2h 00m 60% | 09-28 13:09 | 2h 00m | 184 | 26.2M / 191k | $0.413 | deterministic 1, grader_error 0, instance_exact 1, instance_ok 1, missing_trajectory 0, n_actions 66631, video_rendered 1 |
| L✗ 48m 34% | 09-29 12:25 | 48m | 87 | 7.9M / 84k | $0.151 | deterministic 1, grader_error 0, instance_exact 1, n_actions 47197, replay_success 0, video_rendered 1 |
Task instruction (upstream)
Paint the picture shown in /app/target.png (a square crop of Paul Cézanne's Mont Sainte-Victoire, 1902-06) onto the main sheet with brush and oil paints, in at most 659 strokes.
Playback speed
Recorded by us: our reference solution, replayed by the verifier (canvas camera, scene camera, side camera, exact canvas).
What RoboPaint states about this task
| Success criteria | 1. scored at a 1 mm scale against the picture, all after the best single shift of the sheet, at most 5 mm along each axis, inside the central area 8 mm in from the sheet's edges 2. mean CIELAB ΔE <= 8.4 3. p90 ΔE <= 14.0 4. SSIM of L* >= 0.62 5. edge correlation >= 0.29 6. paint IoU >= 0.96 7. at most 659 strokes 8. both fresh-process replays of the trajectory meet this and end in the same state |
| Family | oil |
| Picture | a square crop of Paul Cézanne's Mont Sainte-Victoire, 1902-06 |
| Difficulty | extreme |
| Tier | privileged |
| Continuous Score | 1 - mean ΔE / 20 |
| Grader Facts | name — saintevictoire alpha — truth_alpha.npz n_strokes — 439 source — the reference picture: File:Paul Cézanne - Mont Sainte-Victoire - Google Art Project.jpg (public domain), cropped and downscaled license — Public domain area_mm2 — 51612.8 |
| Scoring | s.score() is served by a separate scoring container: it replays the actions the agent executed since its last reset on the graders' copy and returns the metrics, never images or target data |
| Agent Budget | 7200 s of wall clock per mode |
From our RoboPaint task definitions.
Tags¶
Task DomainManipulation
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.