Skip to content

Sorting Books On Shelf

pendingmediumhouse_double_floor_upperLiving Room3m 19sunowned

Agent runs

Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the BEHAVIOR-1K runs for every task of a run.

Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default run

TrialStartedAgent timeModel requestsTokens in / outEst. costGrade
U✗ 4h 00m 0%09-27 10:364h 00m62481.4M / 313k$1.11deterministic 1, grader_error 0, instance_exact 0, instance_ok 1, n_actions 823, video_rendered 1
L✗ 4h 00m 0%09-27 11:004h 00m974134.7M / 325k$1.65deterministic 1, grader_error 0, live_success 0, n_actions 9448, replay_success 0, video_rendered 1

No instruction published upstream

The 2025 carryover tasks ship without instruction text. Watch the demo and write the goal in your own words below, clearly marked as a reconstruction rather than the official goal.

Measured on the stack we run — BEHAVIOR-1K v3.9.2 / OmniGibson 3.9.2 / Isaac Sim 5.1
Goal predicates inside ontop
Quantifiers exists forall forn
Counted quantities 2
Goal clauses 6
Objects named in the goal bookcase.n.01 comic_book.n.01 hardback.n.01 notebook.n.01
Objects in the problem 10 in 6 categories
Rooms loaded living_room_0
Demonstrations 200 teleoperated episodes
Mean episode 4m 18s (7,739 control steps at 30 Hz)
Base travel, mean 10.23 m
Gripper travel, mean left 10.27 m · right 13.84 m
Evaluation instances 20 public test instances (ids 301–320)

Read from BDDL activity definitions + 2026-challenge-task-instances (licensed download), 2026-09-21.

Tags

Why this task is interesting

Not yet written.

Capability notes

Not yet written.

Oracle demo review

Not yet reviewed.

Discussion