Hammers In Left Bin¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the RoboLab runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 1h 00m | 09-26 02:00 | 1h 00m | 155 | 14.8M / 86k | $0.214 | grader_error 0, missing_trajectory 1 |
| L✗ 1h 30m | 09-29 08:50 | 1h 30m | 217 | 30.4M / 168k | $0.465 | deterministic 1, grader_error 0, live_success 0, n_actions 3294, replay_success 0, video_rendered 1 |
Task instruction (upstream)
Put the red hammer and black hammer in the left bin
Playback speed
What RoboLab states about this task
| Success predicate | object_in_container |
| Predicate arguments | object: ['red_hammer', 'husky_hammer'] · container: left_bin · logical: all · require_gripper_detached: True |
| Scored subtasks | 1 |
| Subtask predicates | pick_and_place |
| Objects | left_bin right_bin red_hammer husky_hammer cordless_drill spring_clamp |
| Upstream attributes | semantics spatial color |
| Upstream difficulty | simple |
| Episode budget | 180 s |
| Other wordings | vague — Put hammers in the left bin specific — Pick up the red-handled hammer and the black-handled hammer and place both in the left bin |
| Environment class | HammersInLeftBinTask |
| Upstream name | HammersInLeftBinTask |
| Defined in | robolab/tasks/benchmark/tool_organization_left_task.py |
From https://github.com/NVlabs/RoboLab @ v0.3.1.
Tags¶
Task DomainManipulation
Skill primitives in the demo: colorsemanticsspatial
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.