text
🎥 🤾 Vid2Persona: talk to person from video clip
🎥 🤾 Vid2Persona: talk to person from video clip
new_line
new_line
text
A fun project over the last week with 
A fun project over the last week with 
mention
@sayakpaul
sayakpaul
text
. It has a simple pipeline from extracting traits of video characters to chatting with them.
. It has a simple pipeline from extracting traits of video characters to chatting with them.
new_line
new_line
text
Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!
Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!
new_line
new_line
text
Try it Hugging Face Space and let us know what you think.
Try it Hugging Face Space and let us know what you think.
new_line
text
: 
: 
resource
https://huggingface.co/spaces/chansung/vid2persona
space
chansung/vid2persona
https://huggingface.co/spaces/chansung/vid2persona
new_line
new_line
text
The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
new_line
text
: 
: 
link
https://github.com/deep-diver/Vid2Persona
https://github.com/deep-diver/Vid2Persona
🎥 🤾 Vid2Persona: talk to person from video clip

A fun project over the last week with @sayakpaul. It has a simple pipeline from extracting traits of video characters to chatting with them.

Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!

Try it Hugging Face Space and let us know what you think.
: https://huggingface.co/spaces/chansung/vid2persona

The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
: https://github.com/deep-diver/Vid2Persona
🤗
chansung anonyme789 Chan-Y victor osanseviero xprilion
🤯
anonyme789 Srulikbd osanseviero xprilion