Embedded Files
Open-Ended Embodied Environment
Break Diamond Ore
Swim
Go under Water
Craft Wooden Planks
Good Embodied Interaction (EI)
Good Trajectory (TJ)
Good Velocity(VC)
Good Instruction Alignment (IA)
Poor Embodied Interaction (EI)
Poor Trajectory (TJ)
Poor Velocity(VC)
Poor Instruction Alignment (IA)
Break Snow
Embodiment score from worse to better.
Open-Sora-Plan
AnimateDiff
DynamicCrafter
OpenSora
Lavie
ModelScope
Chop a Tree
Embodiment score from worse to better.
AnimateDiff
DynamicCrafter
Open-Sora-Plan
ModelScope
Lavie
OpenSora
Hunt a Sheep
Embodiment score from worse to better.
Lavie
DynamicCrafter
ModelScope
AnimateDiff
Open-Sora-Plan
OpenSora
Autonomous Driving
Turn Right
Turn Left
Move Forward
Speed Up
Good Perspectivity (PV)
Good Key Element (KE)
Good Safety (SF)
Good Trajectory (TJ)
Poor Perspectivity (PV)
Poor Key Element (KE)
Poor Safety (SF)
Poor Trajectory (TJ)
Turn Right
Embodiment score from worse to better.
EasyAnimate
DynamicCrafter
OpenSora
AnimateDiff
Lavie
ModelScope
Turn Left
Embodiment score from worse to better.
EasyAnimate
Lavie
AnimateDiff
OpenSora
ModelScope
DynamicCrafter
Stop
Embodiment score from worse to better.
DynamicCrafter
Lavie
ModelScope
OpenSora
EasyAnimate
AnimateDiff
Robotic Manipulation
Place the Sponge
Press the Button
Move on Lamp
Push the Handle
Good Embodied Interaction (EI)
Good Trajectory (TJ)
Good Perspectivity (PV)
Good Instruction Alignment (IA)
Poor Embodied Interaction (EI)
Poor Trajectory (TJ)
Poor Perspectivity (PV)
Poor Instruction Alignment (IA)
Close the Gripper
Embodiment score from worse to better.
ModelScope
EasyAnimate
AnimateDiff
Open-Sora-Plan
OpenSora
Lavie
Move the Robot Arm on the side of the Square
Embodiment score from worse to better.
ModelScope
EasyAnimate
AnimateDiff
Open-Sora-Plan
OpenSora
Lavie
Stop
Embodiment score from worse to better.
AnimateDiff
Lavie
Open-Sora-Plan
OpenSora
EasyAnimate
ModelScope
Notes:
All videos are generated by Video Generation Model.
All evaluation results are assessed by the Human Preference Evaluator.
Page updated
Google Sites
Report abuse