Skip to content

Handle eraser · wipe c

keepextremetabletop—0m 24s@JamesKrW

Agent runs

Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the DexToolBench runs for every task of a run.

Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run

TrialStartedAgent timeModel requestsTokens in / outEst. costGrade
U✗ 1h 00m 19%09-28 23:361h 00m—11.2M / 118k$0.195deterministic 1, grader_error 0, n_actions 1023, video_rendered 1
L✗ 1h 00m 0%09-29 09:101h 00m—34.1M / 148k$0.461deterministic 1, grader_error 0, video_rendered 1
1 other run(s) of DexToolBench

Codex + GPT-6 Luna, reasoning xhigh (Azure OpenAI API, 2026-09-30 stress test)

TrialStartedAgent timeModel requestsTokens in / outEst. costGrade
U✗ 43m 13%09-30 03:1343m—13.3M / 189k$0.257deterministic 1, grader_error 0, n_actions 651, video_rendered 1
L✗ 1h 00m 0% ⓘ10-01 02:501h 00m—26.8M / 208k$0.403deterministic 1, grader_error 0, video_rendered 1

Task instruction (upstream)

Pick up the handle eraser and move it through the demonstrated motion (wiping the letter C): bring it to each of the 31 goal poses in order.

Playback speed

Recorded by us: SimToolReal's pretrained RL policy replayed in our MuJoCo port of the task, four views (front, side / top, oblique); it reaches 12 of 31 goals here. The green ghost tool is the current goal.

What DexToolBench states about this task
Defined in dextoolbench/trajectories/eraser/handle_eraser/wipe_c.json
Category eraser
Object handle_eraser
Task wipe_c
N Goals 31
Tool Model assets/urdf/dextoolbench/eraser/handle_eraser/handle_eraser.urdf
Table table_narrow_whiteboard.urdf (a whiteboard at the table's edge)
Metric task progress: goals reached / goals (8 grasp-box keypoints within 1.5 cm; 10 s per goal)

From https://github.com/tylerlum/simtoolreal @ 313d5ae.

Measured on the stack we run — MuJoCo 3.3.7 (CPU, bit-exact replay), KUKA iiwa 14 (MuJoCo Menagerie 1b86ece) + Sharpa HA4, 600 Hz physics, 60 Hz control
Harness Task dextoolbench_eraser_handle_eraser_wipe_c
Oracle SimToolReal's pretrained policy, recorded in this scene and replayed: 12/31 goals

Read from run in our MuJoCo port (robot_coding_bench tasks/dextoolbench_eraser_handle_eraser_wipe_c, image rcb-mujoco 0.1.1), 2026-09-28.

Tags

Task DomainManipulation

Why this task is interesting

Not yet written.

Capability notes

Not yet written.

Oracle demo review

Not yet reviewed.

Discussion