text
Is is time for the open-source AI robots revolution 🚀?
Is is time for the open-source AI robots revolution 🚀?
new_line
new_line
text
With 
With 
mention
@haixuantao
haixuantao
text
 and 
 and 
mention
@Leyo
Leyo
text
 we’ve been playing with a low-cost DJI robot controlled by three local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) and orchestrated by Dora-cs.
 we’ve been playing with a low-cost DJI robot controlled by three local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) and orchestrated by Dora-cs.
new_line
new_line
text
Links to find all the hardware/software we used in the demo:
Links to find all the hardware/software we used in the demo:
new_line
text
- robot control framework – dora-rs: 
- robot control framework – dora-rs: 
link
https://github.com/dora-rs/dora
https://github.com/dora-rs/dora
new_line
text
- speech-to-text model – whisper: 
- speech-to-text model – whisper: 
resource
https://huggingface.co/openai/whisper-base
model
openai/whisper-base
https://huggingface.co/openai/whisper-base
new_line
text
- vision-text model – Idefics2: 
- vision-text model – Idefics2: 
resource
https://huggingface.co/HuggingFaceM4/idefics2-8b-AWQ
model
HuggingFaceM4/idefics2-8b-AWQ
https://huggingface.co/HuggingFaceM4/idefics2-8b-AWQ
new_line
text
-  text-to-speech model – ParlerTTS mini: 
-  text-to-speech model – ParlerTTS mini: 
resource
https://huggingface.co/parler-tts/parler_tts_mini_v0.1
model
parler-tts/parler_tts_mini_v0.1
https://huggingface.co/parler-tts/parler_tts_mini_v0.1
new_line
text
- robot: 
- robot: 
link
https://dji.com/robomaster-s1
https://dji.com/robomaster-s1
new_line
text
- code gist: 
- code gist: 
link
https://gist.github.com/haixuanTao/860e1740245dc2c8dd85b496150a9320
https://gist.github.com/haixuanTao/860e1740245dc2c8dd85b496150a9320
new_line
text
- Larger codebase: 
- Larger codebase: 
resource
https://huggingface.co/datasets/dora-rs/dora-idefics2
dataset
dora-rs/dora-idefics2
https://huggingface.co/datasets/dora-rs/dora-idefics2
new_line
text
- laptop/pc: any with a recent GPU card (our has a RTX 4090)
- laptop/pc: any with a recent GPU card (our has a RTX 4090)
new_line
new_line
text
Enjoy!
Enjoy!
Is is time for the open-source AI robots revolution 🚀?

With @haixuantao and @Leyo we’ve been playing with a low-cost DJI robot controlled by three local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) and orchestrated by Dora-cs.

Links to find all the hardware/software we used in the demo:
- robot control framework – dora-rs: https://github.com/dora-rs/dora
- speech-to-text model – whisper: https://huggingface.co/openai/whisper-base
- vision-text model – Idefics2: https://huggingface.co/HuggingFaceM4/idefics2-8b-AWQ
-  text-to-speech model – ParlerTTS mini: https://huggingface.co/parler-tts/parler_tts_mini_v0.1
- robot: https://dji.com/robomaster-s1
- code gist: https://gist.github.com/haixuanTao/860e1740245dc2c8dd85b496150a9320
- Larger codebase: https://huggingface.co/datasets/dora-rs/dora-idefics2
- laptop/pc: any with a recent GPU card (our has a RTX 4090)

Enjoy!
🔥
SivilTaram KingNish Tonic clefourrier YaTharThShaRma999 victor osanseviero radames BrigitteTousi lunarflu Leyo giux78 clem Violette dodin InferenceIllusionist Abouharga Martins6 jme2791
🚀
Tonic clefourrier YaTharThShaRma999 osanseviero radames BrigitteTousi lunarflu Leyo giux78 clem Violette InferenceIllusionist Martins6 carloscardenas KingNish louisbrulenaudet
🧠
Tonic YaTharThShaRma999 osanseviero BrigitteTousi lunarflu giux78 clem Violette TommyZQ OmbelineM
❤️
KingNish dodin
https://cdn-avatars.huggingface.co/v1/production/uploads/6612aedf09f16e7347dfa7e1/bPYjBXCedY_1fSIPjoBTY.jpeg
Nishith Jain
KingNish
user
/avatars/5aa76acd63f984e3a4057cd3ad8bb0f2.svg
dodin
dodin
user
/avatars/f67ddb9537b755a5fd55ad08fdc9474c.svg
Zhang Qiang
TommyZQ
user
https://cdn-avatars.huggingface.co/v1/production/uploads/65c9236a7cd01b4c7ae5ce7d/CxgHQg942wRCUoQzPTJLX.png
jonathan clark
dadaddy
user