Controllable General Domain Cinemagraphs - ComparisonsHomePage
Comparison of Our method with Baselines for Controllable General Domain Cinemagraphs
We compare our method (both with internal model and Wan2.2-5B) with baselines which include: I) Image-to-Video Models - CogVideoX and Wan2.2-5B (pretrained), II) Motion Controllable Image-to-Video Models - DragAnything, Motion-I2V, Time-to-Move, MotionPro, and Diffusion as Shader, III) Our method with only first-last-frame conditioning, and Generative Inbetweening.
For I) and II), we use post-processing to make the videos looping.
Prompt: A makeup artist is applying makeup with a brush on the face of a female celebrity. The scene is static, the makeup artist and celebrity do not move, they remain still in their place. Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
Input
CogVideoX
Wan2.2-5B (Pretrained)
Generative Inbetweening
Motion-I2V
Time-to-Move
MotionPro
Diffusion as Shader
DragAnything
Ours (Wan2.2-5B) [first-last]
Ours (internal) [first-last]
Ours (Wan2.2-5B)
Ours (internal)
Prompt: A dog sits in the same place, rotating only its paw. Static scene, slow motion shot. Static camera Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
Input
CogVideoX
Wan2.2-5B (Pretrained)
Generative Inbetweening
Motion-I2V
Time-to-Move
MotionPro
Diffusion as Shader
DragAnything
Ours (Wan2.2-5B) [first-last]
Ours (internal) [first-last]
Ours (Wan2.2-5B)
Ours (internal)
Prompt: A wide, static shot captures a single, delicate dandelion seed head. The white sphere of pappus is perfectly round and fragile. The dandelion stands on a thin green stem, which remains completely still. The background is a soft, blurry mix of green foliage and what appears to be a weathered brick surface, all of which is unmoving. The only element with any movement is the dandelion seed head itself. It sways gently and continuously, as if caught in an almost imperceptible breeze. The delicate white filaments of the pappus oscillate back and forth in a smooth, subtle, and mesmerizing loop, creating a peaceful contrast between the static world and this single, moving point of light. Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
Input
CogVideoX
Wan2.2-5B (Pretrained)
Generative Inbetweening
Motion-I2V
Time-to-Move
MotionPro
Diffusion as Shader
DragAnything
Ours (Wan2.2-5B) [first-last]
Ours (internal) [first-last]
Ours (Wan2.2-5B)
Ours (internal)
Prompt: Two people in professional suits standing in the same place and shaking hands. The camera remains static in a place. Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
Input
CogVideoX
Wan2.2-5B (Pretrained)
Generative Inbetweening
Motion-I2V
Time-to-Move
MotionPro
Diffusion as Shader
DragAnything
Ours (Wan2.2-5B) [first-last]
Ours (internal) [first-last]
Ours (Wan2.2-5B)
Ours (internal)
Prompt: A scene of two empty swings oscillating due to the winds blowing. The background is covered in snow, and it is a morning scene. The shot is with a static camera. Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
Input
CogVideoX
Wan2.2-5B (Pretrained)
Generative Inbetweening
Motion-I2V
Time-to-Move
MotionPro
Diffusion as Shader
DragAnything
Ours (Wan2.2-5B) [first-last]
Ours (internal) [first-last]
Ours (Wan2.2-5B)
Ours (internal)
Prompt: A girl is casually sitting on the couch in a still posture. She is slowly lifting one of her feet up and down and also rotating her hand, which has a firecracker. Camera remains stationary. Static Camera. Camera locked down at the same place. The video loops back to the beginning of the video after it reaches the end.
