Billiard break
One cue ball breaks a triangular rack of fifteen balls. The balls scatter and rebound from the cushions.
PHYSICS-AWARE VIDEO GENERATION & REPAIR
PhysLoop:
Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models
1Peking University2ByteDance Seed3University of California, Santa Barbara4Massachusetts Institute of Technology5Universität Hamburg6Hangzhou Normal University
* Equal contributions · ‡ Industry advisor · † Project lead · § Corresponding author
THE FRAMEWORK
Overview
SEE PHYSLOOP IN ACTION
Dataset Examples
Text to video
1 / 7
Tennis balls into a basket
Four tennis balls are thrown toward an open wire basket. The first misses; the last pair collide, leaving three balls in the basket.
Domino chain
An S-shaped domino chain topples in order and knocks down the ornament at its end.
Pendulum phase wave
Fifteen suspended colored pendulums swing at different natural periods, producing a visible phase wave. Keep their connected support frame and individual identities.
Aligned and offset carton stacks
Release two stacks of five open cardboard cartons on a wooden platform: one aligned and one offset. Let gravity and contact determine which stack remains stable.
Cloth over a collapsing stack
A horseshoe magnet removes the steel base of a covered stack. The stack collapses and the cloth slides and settles on the tabletop.
Ball–domino–seesaw chain
A red ball rolls down a wooden ramp, topples six dominoes and actuates a seesaw that launches a blue ball toward a small bucket.
Image to video
1 / 6
Paddle-wheel chain reaction
A falling ball turns a paddle wheel, releasing a second ball down a ramp into the basket.
Silk covers a teapot
A silk cloth settles over the teapot and follows its shape.
Pouring a red drink
A beverage dispenser pours red liquid into a clear glass.
Two tennis balls collide
A blue ball and a yellow ball roll from opposite pipes, meet and separate.
Tennis ball hits a rubber duck
A brown tennis ball rolls out of a black pipe and contacts the yellow rubber duck on a coffee table.
Tennis ball climbs a ramp
A yellow tennis ball rolls out of a black pipe and climbs a cardboard ramp supported by a blue block.
Video repair
1 / 3
Support loss without hovering
Remove the yellow middle support from a five-block stack. The upper pair should tilt and descend as support is lost, while all five blocks remain present.
Three glass impacts and falling shards
One steel ball hits three intact glass panels in order. Contact releases shards that fall and settle on the floor.
A domino chain stops at the gap
A connected outer branch topples while the disconnected inner ring and most front blocks remain standing.
Robot interaction
1 / 3
Sort a labelled parcel
Pick the red-marked shipping carton and place it in the green tray, retaining the two distractor cartons.
Robot pours clear water
Grasp and lift the yellow mug, tilt it over the receiving mug, pour a continuous stream, then upright and withdraw.
Robot folds an opaque towel
Two grippers grasp the back corners of one thick pink cotton towel, lift, fold it in half, release and retract.
EVALUATION
Benchmark Results
| Method | Human (Gen) | Model (Gen) | Task | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Phys. | Real. | Causal | Win | PC | SA | IQ | AQ | Gen | Repair | P-IQ | |
| Video Generation Models | |||||||||||
| Gemini Omni | 3.11 | 3.82 | 3.18 | 18.94 | 20.79 | 39.17 | 71.17 | 50.40 | 49.00 | 14.67 | 31.66 |
| H3 | 3.63 | 4.27 | 3.55 | 44.93 | 22.98 | 38.68 | 68.47 | 50.62 | 53.00 | 18.00 | 28.14 |
| Seedance 2.5 | 3.80 | 4.29 | 3.80 | 53.79 | 21.51 | 38.69 | 67.63 | 50.63 | 73.00 | 19.33 | 48.07 |
| Seedance 2.5 | |||||||||||
| Claude Opus 5 | 3.82 | 3.82 | 3.84 | 64.18 | 20.23 | 36.69 | 67.66 | 49.71 | 71.00 | 78.67 | 53.75 |
| Kimi K3 | 3.63 | 3.69 | 3.69 | 54.41 | 19.90 | 37.32 | 68.54 | 50.42 | 69.00 | 68.67 | 52.04 |
| GPT-6 Astra | |||||||||||
| Gemini Omni | 3.53 | 2.96 | 3.51 | 45.45 | 12.71 | 35.84 | 75.11 | 46.72 | 67.00 | 62.00 | 12.08 |
| H3 | 3.86 | 3.45 | 3.90 | 58.21 | 17.48 | 37.12 | 68.77 | 48.65 | 73.00 | 72.67 | 39.10 |
| w/o Refiner | 3.94 | 2.59 | 3.95 | 34.33 | 12.53 | 34.88 | 72.42 | 45.75 | 80.00 | 60.67 | — |
| GPT-6 Astra + Seedance 2.5 | |||||||||||
| PhysLoop | 4.06 | 3.72 | 4.12 | 75.76 | 15.29 | 36.28 | 69.93 | 48.70 | 85.00 | 86.00 | 52.06 |
CITATION
BibTeX
OPEN DATA
Dataset
| Component | Progress | Status | Hosting | Notes |
|---|---|---|---|---|
| PhysLoop-Gen | Preparing | Not released | Hugging Face (planned) | Generation evaluation; inputs and protocol under review |
| PhysLoop-Repair | Inventory pending | Not released | Hugging Face (planned) | Repair pairs and evaluation protocol under review |
| PhysLoop-100K | Counts pending | Not released | Hugging Face (planned) | Planned training corpus; accepted counts to be verified |
Community
Add with PhysLoop for a group invite.
Discord
