text
If you have ~300+ GB of V-RAM, you can run Mochi from 
If you have ~300+ GB of V-RAM, you can run Mochi from 
mention
@genmo
genmo
new_line
new_line
text
A SOTA model that dramatically closes the gap between closed and open video generation models.  
A SOTA model that dramatically closes the gap between closed and open video generation models.  
new_line
new_line
text
Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  
Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  
new_line
new_line
text
The model incorporates cutting-edge improvements, including:  
The model incorporates cutting-edge improvements, including:  
new_line
text
- SwiGLU feedforward layers  
- SwiGLU feedforward layers  
new_line
text
- Query-key normalization for enhanced stability  
- Query-key normalization for enhanced stability  
new_line
text
- Sandwich normalization for controlled internal activations 
- Sandwich normalization for controlled internal activations 
new_line
new_line
text
What is currently available?
What is currently available?
new_line
text
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  
new_line
new_line
text
What's Coming?
What's Coming?
new_line
text
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
new_line
text
- Enhanced 720p resolution  
- Enhanced 720p resolution  
new_line
text
- Improved motion fidelity  
- Improved motion fidelity  
new_line
text
- Better handling of complex scene warping 
- Better handling of complex scene warping 
If you have ~300+ GB of V-RAM, you can run Mochi from @genmo

A SOTA model that dramatically closes the gap between closed and open video generation models.  

Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  

The model incorporates cutting-edge improvements, including:  
- SwiGLU feedforward layers  
- Query-key normalization for enhanced stability  
- Sandwich normalization for controlled internal activations 

What is currently available?
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  

What's Coming?
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
- Enhanced 720p resolution  
- Improved motion fidelity  
- Better handling of complex scene warping 
❤️
clem akhaliq thomwolf sepal AtAndDev theospeak VDBLOI2024 abhi22 RaphaelLiu viktsys DivaVivy
🔥
sugatoray Aurelien-Morgan AtAndDev abhi22
👀
John6666 AtAndDev
/avatars/39eeff400134ae2d6a48541b7af89dc9.svg
Natwar Upadhyay
Natwar
user
https://cdn-avatars.huggingface.co/v1/production/uploads/630fdd96a119d49bc1e770d5/OpU95S4a8hkM8OUCZq79R.jpeg
Adam
adamo1139
user