Long screwdriver · spin horizontal¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the DexToolBench runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 1h 00m 0% | 10-01 09:03 | 1h 00m | — | 15.9M / 241k | $0.313 | deterministic 1, grader_error 0, n_actions 1487, video_rendered 1 |
| L✗ 58m 0% | 10-01 07:04 | 58m | — | 18.6M / 200k | $0.324 | deterministic 1, grader_error 0, video_rendered 1 |
1 other run(s) of DexToolBench
Codex + GPT-6 Luna, reasoning xhigh (Azure OpenAI API, 2026-09-30 stress test)
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 58m 6% ⓘ | 10-01 05:53 | 58m | — | 16.2M / 263k | $0.350 | deterministic 1, grader_error 0, n_actions 1170, video_rendered 1 |
| L✗ 1h 00m 0% | 09-30 07:27 | 1h 00m | — | 22.6M / 112k | $0.299 | deterministic 1, grader_error 0, video_rendered 1 |
Task instruction (upstream)
Pick up the long screwdriver and move it through the demonstrated motion (spinning it about a horizontal axis): bring it to each of the 31 goal poses in order.
Recorded by us: SimToolReal's pretrained RL policy replayed in our MuJoCo port of the task, four views (front, side / top, oblique); it reaches 31 of 31 goals here. The green ghost tool is the current goal.
What DexToolBench states about this task
| Defined in | dextoolbench/trajectories/screwdriver/long_screwdriver/spin_horizontal.json |
| Category | screwdriver |
| Object | long_screwdriver |
| Task | spin_horizontal |
| N Goals | 31 |
| Tool Model | assets/urdf/dextoolbench/screwdriver/long_screwdriver/long_screwdriver.urdf |
| Table | table_narrow.urdf (plain) |
| Metric | task progress: goals reached / goals (8 grasp-box keypoints within 1.5 cm; 10 s per goal) |
From https://github.com/tylerlum/simtoolreal @ 313d5ae.
Measured on the stack we run — MuJoCo 3.3.7 (CPU, bit-exact replay), KUKA iiwa 14 (MuJoCo Menagerie 1b86ece) + Sharpa HA4, 600 Hz physics, 60 Hz control
| Harness Task | dextoolbench_screwdriver_long_screwdriver_spin_horizontal |
| Oracle | SimToolReal's pretrained policy, recorded in this scene and replayed: 31/31 goals |
Read from run in our MuJoCo port (robot_coding_bench tasks/dextoolbench_screwdriver_long_screwdriver_spin_horizontal, image rcb-mujoco 0.1.1), 2026-09-28.
Tags¶
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.