Skip to content

Blocks In Bin

pendingmediumtoys_cleanup——unowned

Agent runs

Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the RoboLab runs for every task of a run.

Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run

TrialStartedAgent timeModel requestsTokens in / outEst. costGrade
U✓ 12m09-27 01:1112m381.6M / 12k$0.030deterministic 1, grader_error 0, instance_exact 1, instance_ok 1, n_actions 850, video_rendered 1
L✓ 18m09-29 07:0818m784.1M / 32k$0.070deterministic 1, grader_error 0, live_success 1, n_actions 776, replay_success 1, video_rendered 1

Task instruction (upstream)

Sort all colored blocks into the bin

toys_cleanup scene
No oracle video published upstream — this is the scene it starts from.
What RoboLab states about this task
Success predicate object_in_container
Predicate arguments object: ['yellow_block', 'red_block', 'green_block', 'blue_block'] · container: grey_bin · logical: all · require_gripper_detached: True
Scored subtasks 1
Subtask predicates pick_and_place
Objects rubiks_cube rubiks_cube_1 rubiks_cube_2 grey_bin lizard_figurine birdhouse yellow_block red_block green_block blue_block lizard_figurine_01
Upstream attributes sorting
Upstream difficulty simple
Episode budget 150 s
Other wordings vague — Put away the colored blocks
specific — Put away the solidly-colored wooden blocks from the table and place them all into the bin
Environment class BlocksInBinTask
Upstream name BlocksInBinTask
Defined in robolab/tasks/benchmark/blocks_in_bin.py

From https://github.com/NVlabs/RoboLab @ v0.3.1.

Tags

Task DomainManipulation

Skill primitives in the demo: sorting

Why this task is interesting

Not yet written.

Capability notes

Not yet written.

Oracle demo review

Not yet reviewed.

Discussion