Skip to content

Bringing Water

pendinghardhouse_single_floorLiving Room, Kitchen3m 15sunowned

Agent runs

Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the BEHAVIOR-1K runs for every task of a run.

Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run

TrialStartedAgent timeModel requestsTokens in / outEst. costGrade
U✗ 4h 00m 0%09-27 07:314h 00m39841.5M / 215k$0.597grader_error 0, missing_trajectory 1
L✗ 4h 00m 0%09-27 11:344h 00m58875.4M / 316k$1.08deterministic 1, grader_error 0, live_success 0, n_actions 11830, replay_success 0, video_rendered 1

Task instruction (upstream)

Retrieve the two bottles from the refrigerator in the kitchen, bring them to the living room, and place both on the coffee table. Make sure the refrigerator is closed when you finish.

Measured on the stack we run — BEHAVIOR-1K v3.9.2 / OmniGibson 3.9.2 / Isaac Sim 5.1
Goal predicates ontop open
Quantifiers forall
Goal clauses 2
Objects named in the goal bottle.n.01 coffee_table.n.01 electric_refrigerator.n.01
Objects in the problem 6 in 5 categories
Rooms loaded corridor_0 dining_room_0 entryway_0 garden_0 kitchen_0 living_room_0 living_room_1
Demonstrations 200 teleoperated episodes
Mean episode 5m 15s (9,438 control steps at 30 Hz)
Base travel, mean 26.25 m
Gripper travel, mean left 9.36 m · right 11.05 m
Evaluation instances 20 public test instances (ids 301–320)

Read from BDDL activity definitions + 2026-challenge-task-instances (licensed download), 2026-09-21.

Tags

Why this task is interesting

Not yet written.

Capability notes

Not yet written.

Oracle demo review

Not yet reviewed.

Discussion