DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization
Ablation Study
Method Comparison:
VSD
VSD + CD
VSD + DDPO
VSD + LRM
VSD + CD + LRM
Teacher
4 samples are displayed for each method and each prompt.
A slow cinematic push in on an ostrich standing in a 1980s kitchen.
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
A middle-aged sad bald man becomes happy as a wig of curly hair and sunglasses fall suddenly on his head.
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Handheld camera moving fast, flashlight light, in a white old wall in a old alley at night a black graffiti that spells "Cool Baby".
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
A breathtaking aurora dances across the night sky, vibrant green and purple hues illuminating snow-covered mountains and a serene lake.
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+CD: 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+DDPO (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+CD+LRM (HPSv2): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+DDPO (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
VSD+CD+LRM (PickScore): 4 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 50 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps
Teacher: DDIM 4 steps