Black Items In Bin¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the RoboLab runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 1h 30m 60% | 09-27 00:47 | 1h 30m | 186 | 21.6M / 93k | $0.291 | deterministic 1, grader_error 0, instance_exact 1, instance_ok 1, n_actions 1317, video_rendered 1 |
| L✗ 1h 30m | 09-29 03:43 | 1h 30m | 255 | 32.9M / 119k | $0.422 | deterministic 1, grader_error 0, live_success 0, n_actions 3394, replay_success 0, video_rendered 1 |
Task instruction (upstream)
Put the black items in the grey bin
No oracle video published upstream — this is the scene it starts from.
What RoboLab states about this task
| Success predicate | object_in_container |
| Predicate arguments | object: ['keyboard', 'remote_control', 'computer_mouse', 'smartphone', 'glasses'] · container: grey_bin · logical: all · require_gripper_detached: True |
| Scored subtasks | 1 |
| Subtask predicates | pick_and_place |
| Objects | ceramic_mug glasses keyboard lizard_figurine marker remote_control smartphone wooden_bowl spoon_big computer_mouse yogurt_cup granola_bars grey_bin |
| Upstream attributes | color sorting |
| Upstream difficulty | simple |
| Episode budget | 120 s |
| Other wordings | vague — Clean up the dark items specific — Identify all black-colored objects on the table and place them into the grey bin |
| Environment class | BlackItemsInBinTask |
| Upstream name | BlackItemsInBinTask |
| Defined in | robolab/tasks/benchmark/black_items_in_bin.py |
From https://github.com/NVlabs/RoboLab @ v0.3.1.
Tags¶
Task DomainManipulation
Skill primitives in the demo: colorsorting
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.