text
How about engaging in a creative chat with your favorite video character?  💬
How about engaging in a creative chat with your favorite video character?  💬
new_line
new_line
mention
@chansung
chansung
text
 and I worked on a weekend project combining the benefits of Gemini 1.0 and powerful chat models like Zephyr to demo this. 
 and I worked on a weekend project combining the benefits of Gemini 1.0 and powerful chat models like Zephyr to demo this. 
new_line
new_line
text
We use Gemini 1.0 to produce the personality traits of any character found in an input video. We then prepare a system prompt with the discovered traits to start chatting with an LLM (Zephyr in this case). 
We use Gemini 1.0 to produce the personality traits of any character found in an input video. We then prepare a system prompt with the discovered traits to start chatting with an LLM (Zephyr in this case). 
new_line
new_line
text
Managing a video captioning model is a little out of our expertise, hence Gemini FTW here 😶‍🌫️
Managing a video captioning model is a little out of our expertise, hence Gemini FTW here 😶‍🌫️
new_line
new_line
text
👨‍💻 Code: 
👨‍💻 Code: 
link
https://github.com/deep-diver/Vid2Persona
https://github.com/deep-diver/Vid2Persona
new_line
text
🤗 Demo: 
🤗 Demo: 
resource
https://hf.co/spaces/chansung/vid2persona
space
chansung/vid2persona
https://hf.co/spaces/chansung/vid2persona
How about engaging in a creative chat with your favorite video character?  💬

@chansung and I worked on a weekend project combining the benefits of Gemini 1.0 and powerful chat models like Zephyr to demo this. 

We use Gemini 1.0 to produce the personality traits of any character found in an input video. We then prepare a system prompt with the discovered traits to start chatting with an LLM (Zephyr in this case). 

Managing a video captioning model is a little out of our expertise, hence Gemini FTW here 😶‍🌫️

👨‍💻 Code: https://github.com/deep-diver/Vid2Persona
🤗 Demo: https://hf.co/spaces/chansung/vid2persona
❤️
chansung osanseviero CharlieWells samusenps clem