Meta-World · Push¶
Agent runs
Each mode of this task runs once per run. Est. cost is tokens at list price (data/prices.yml), never a bill; see the MetaWorld+ runs for every task of a run.
Codex + GPT-6 Luna, reasoning xhigh (ChatGPT login)default runclosed
| Trial | Started | Agent time | Model requests | Tokens in / out | Est. cost | Grade |
|---|---|---|---|---|---|---|
| U✓ 4m | 10-01 12:34 | 4m | — | 573k / 12k | $0.016 | deterministic 1, grader_error 0, missing_trajectory 0, n_actions 60, replay_success 1, video_rendered 1 |
| L✗ 41m | 10-01 12:34 | 41m | — | 7.7M / 101k | $0.165 | deterministic 1, grader_error 0, live_success 0, replay_success 0, video_rendered 1 |
Task instruction (upstream)
Push the object to the target.
Playback speed
Recorded by us: our reference solution, replayed by the verifier (the front camera).
What MetaWorld+ states about this task
| Success criteria | 1. The verifier replays your actions from the frozen start in a separate sandbox (twice, in fresh processes; MuJoCo on the CPU is bit-exact) and applies Meta-World's own success check for push-v3 (evaluate_state) to the state after the last action. A success reached earlier and then lost does not count: end the trajectory while the task is achieved. 2. unlimited (privileged): both fresh-process replays of the handed-in trajectory end in the same state, and the check holds on it 3. limited (standard): the one episode (no reset) is recorded by the service and replays to the same state; the check holds on it live and in the replay |
| Family | metaworld/push |
| Robot | Rethink Sawyer: a 7-DoF arm whose hand is a mocap body (the wrist does not rotate), two-finger gripper |
| Category | Meta-World v3 |
| Instance | Meta-World's reset randomization with seed 0; MuJoCo state, model arrays, env caches and RNG frozen in instance.npz (SHA-256 b0c8e2a871b8…, checked on load) |
| Deliverable | (T, 4) native actions [dx, dy, dz, grip], 1 ≤ T ≤ 500 (Meta-World's max_path_length) |
| Reference Solution | Meta-World's scripted policy for push-v3 (metaworld/policies/, removed from the image), run on this instance up to its first success: 65 actions in solution/oracle.npz (recorded by scripts/metaworldplus/freeze.sh). |
| Limited Mode | Standard-mode twin of metaworldplus-push-i00-privileged: the same instance and success check (Push the object to the target.), served as a robot service (images/metaworld/standard/server_mw.py, protocol eai-standard/2.1, tool module mw_tool). The agent sees camera RGB-D, the robot's own state and the target point; no object poses, no reset; one episode. |
| Oracle | full |
| Base Image | ghcr.io/mll-lab-nu/eai-metaworld:0.1.0 |
| Agent Budget | 3600 s of wall clock per mode |
| Task Dirs | metaworldplus-push-i00-privileged, metaworldplus-push-i00-standard |
From https://github.com/Farama-Foundation/Metaworld @ 59fc34d (Meta-World v3), as defined in our task definitions @ 8c5594a43.
Tags¶
CapabilityControl & Coordination
Task DomainManipulation
Why this task is interesting¶
Not yet written.
Capability notes¶
Not yet written.
Oracle demo review¶
Not yet reviewed.