Carrying in Groceries¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the BEHAVIOR-1K runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✗ 4h 00m 0% | 09-27 06:14 | 4h 00m | 603 | 78.4M / 297k | $1.05 | grader_error 0, missing_trajectory 1 |
| L✗ 4h 00m 0% | 09-27 06:14 | 4h 00m | 831 | 112.1M / 333k | $1.42 | deterministic 1, grader_error 0, live_success 0, n_actions 8577, replay_success 0, video_rendered 1 |
Task instruction (upstream)
Take the sack of groceries out of the car trunk in the garage, bring it to the kitchen, and put both the tomato and the carton of milk into the refrigerator in the kitchen. When you're done, close the car trunk and make sure the refrigerator in the kitchen is closed.
Measured on the stack we run — BEHAVIOR-1K v3.9.2 / OmniGibson 3.9.2 / Isaac Sim 5.1
| Goal predicates | inside open |
| Quantifiers | exists |
| Goal clauses | 3 |
| Objects named in the goal | beefsteak_tomato.n.01 car.n.01 carton__of__milk.n.01 electric_refrigerator.n.01 |
| Objects in the problem | 8 in 7 categories |
| Rooms loaded | corridor_0 garage_0 garden_0 kitchen_0 living_room_0 |
| Demonstrations | 200 teleoperated episodes |
| Mean episode | 7m 56s (14,275 control steps at 30 Hz) |
| Base travel, mean | 37.1 m |
| Gripper travel, mean | left 20.06 m · right 19.41 m |
| Evaluation instances | 20 public test instances (ids 301–320) |
Read from BDDL activity definitions + 2026-challenge-task-instances (licensed download), 2026-09-21.
Tags¶
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.