LatinAI (AI Developers from Latin America)

AlexBodner

posted an update 11 days ago

Post

438

🚀🤖𝐃𝐨 𝐀𝐧𝐝𝐫𝐨𝐢𝐝𝐬 𝐃𝐫𝐞𝐚𝐦 𝐨𝐟 𝐄𝐥𝐞𝐜𝐭𝐫𝐢𝐜 𝐌𝐚𝐫𝐢𝐨𝐬?

Discover how we replaced the classic game engine with DIAMOND, a Neural Network that predicts every frame based on actions, noise, and past states. From training on human and RL gameplay to generating surreal hallucinations, this project shows the potential of diffusion models in creating amazing simulations. 🎮

🧵 Dive into the full story in our Twitter thread:
👉 https://x.com/AlexBodner_/status/1871566560512643567
🌟 Don’t forget to follow and leave a star for more groundbreaking AI projects!

rmayormartins

updated a collection about 1 month ago

NLP

Collection

3 items • Updated Nov 25, 2024

marlhex

in LatinAI/speech-accent-es-classifier about 2 months ago

Español: Accento Costa Rica

1

#1 opened about 2 months ago by

marlhex

asoria

posted an update 2 months ago

Post

1809

🚀 Exploring Topic Modeling with BERTopic 🤖

When you come across an interesting dataset, you often wonder:
Which topics frequently appear in these documents? 🤔
What is this data really about? 📊

Topic modeling helps answer these questions by identifying recurring themes within a collection of documents. This process enables quick and efficient exploratory data analysis.

I’ve been working on an app that leverages BERTopic, a flexible framework designed for topic modeling. Its modularity makes BERTopic powerful, allowing you to switch components with your preferred algorithms. It also supports handling large datasets efficiently by merging models using the BERTopic.merge_models approach. 🔗

🔍 How do we make this work?
Here’s the stack we’re using:

📂 Data Source ➡️ Hugging Face datasets with DuckDB for retrieval
🧠 Text Embeddings ➡️ Sentence Transformers (all-MiniLM-L6-v2)
⚡ Dimensionality Reduction ➡️ RAPIDS cuML UMAP for GPU-accelerated performance
🔍 Clustering ➡️ RAPIDS cuML HDBSCAN for fast clustering
✂️ Tokenization ➡️ CountVectorizer
🔧 Representation Tuning ➡️ KeyBERTInspired + Hugging Face Inference Client with Meta-Llama-3-8B-Instruct
🌍 Visualization ➡️ Datamapplot library
Check out the space and see how you can quickly generate topics from your dataset: datasets-topics/topics-generator

Powered by @MaartenGr - BERTopic

AlexBodner

posted an update 2 months ago

Post

2400

💾🧠How much VRAM will you need for training your AI model? 💾🧠
Check out this app where you convert:
Pytorch/tensorflow summary -> required VRAM
or
Parameter count -> required VRAM

Use it in: http://howmuchvram.com

And everything is open source! Ask for new functionalities or contribute in:
https://github.com/AlexBodner/How_Much_VRAM
If it's useful to you leave a star 🌟and share it to someone that will find the tool useful!

1 reply

·

Kukedlc

posted an update 2 months ago

Post

1227

Multilingual Audio Podcast Generator - Gemma 2 + Edge-TTS

Hello Friends, I want to share my latest kaggle notebook to create a podcast of papers (or any pdf) in more than 21 languages. Implements any LLM (use Gemma2-9b-it) and for the TTS edge-tts. I hope it will be useful for you to catch up with the papers that are coming out faster and faster every day!

https://www.kaggle.com/code/eugeniokukes/multilingual-audio-podcast-generator-gemma-tts

1 reply

·

mariagrandury

authored a paper 3 months ago

Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?

Paper • 2409.15334 • Published Sep 8, 2024

asoria

posted an update 3 months ago

Post

2475

📝 I wrote a tutorial on how to get started with the fine-tuning process using Hugging Face tools, providing an end-to-end workflow.

The tutorial covers creating a new dataset using the new SQL Console 🛢 and fine-tuning a model with SFT, guided by the Notebook Creator App 📙.

👉 You can read the full article here:
https://huggingface.co/blog/asoria/easy-fine-tuning-with-hf
asoria/auto-notebook-creator

asoria

posted an update 4 months ago

Post

961

🚀 Excited to share the latest update to the Notebook Creator Tool!

Now with basic fine-tuning support using Supervised Fine-Tuning! 🎯

How it works:
1️⃣ Choose your Hugging Face dataset and notebook type (SFT)
2️⃣ Automatically generate your training notebook
3️⃣ Start fine-tuning with your data!

Link to the app 👉 https://lnkd.in/e_3nmWrB
💡 Want to contribute with new notebooks? 👉https://lnkd.in/eWcZ92dS

AlexBodner

posted an update 4 months ago

Post

1614

💾🧠How much VRAM will you need for training your AI model? 💾🧠
Check out this app where you convert:
Pytorch/tensorflow summary -> required VRAM
or
Parameter count -> required VRAM

Use it in: http://howmuchvram.com

And everything is open source! Ask for new functionalities or contribute in:
https://github.com/AlexBodner/How_Much_VRAM
If it's useful to you leave a star 🌟and share it to someone that will find the tool useful!
More discussion in: https://x.com/AlexBodner_/status/1832054850294812679

AlexBodner

posted an update 4 months ago

Post

1845

💾🧠How much VRAM will you need for training your AI model? 💾🧠
Check out this app where you convert:
Pytorch/tensorflow summary -> required VRAM
or
Parameter count -> required VRAM

Use it in: http://howmuchvram.com

And everything is open source! Ask for new functionalities or contribute in:
https://github.com/AlexBodner/How_Much_VRAM
If it's useful to you leave a star 🌟and share it to someone that will find the tool useful!
More discussion in: https://x.com/AlexBodner_/status/1832054850294812679

1 reply

·

AlexBodner

posted an update 4 months ago

Post

361

💾🧠How much VRAM will you need for training your AI model? 💾🧠
Check out this app where you convert:
Pytorch/tensorflow summary -> required VRAM
or
Parameter count -> required VRAM

Use it in: http://howmuchvram.com

And everything is open source! Ask for new functionalities or contribute in:
https://github.com/AlexBodner/How_Much_VRAM
If it's useful to you leave a star 🌟and share it to someone that will find the tool useful!
More discussion in: https://x.com/AlexBodner_/status/1832054850294812679

asoria

posted an update 4 months ago

Post

820

I've been working on a Space to make it super easy to create notebooks and help users quickly understand and manipulate their data!
With just a few clicks automatically generate notebooks for:

📊 Exploratory Data Analysis
🧠 Text Embeddings
🤖 Retrieval-Augmented Generation (RAG)

✨ Automatic training is coming soon!
Check it out here asoria/auto-notebook-creator
Appreciate any feedback to improve this tool 🤗

AlexBodner

posted an update 4 months ago

Post

1269

Do you know how PCA and SVD are related?
I explained it for everyone in this post!
Go and check it out: https://x.com/alexbodner_/status/1798357519678718062?s=46

AlexBodner

posted an update 4 months ago

Post

3788

💾🧠How much VRAM will you need for training your AI model? 💾🧠
Check out this app where you convert:
Pytorch/tensorflow summary -> needed VRAM
or
Parameter count -> needed VRAM

Use it in: http://howmuchvram.com

And everything is open source! Ask for new functionalities or contribute in:
https://github.com/AlexBodner/How_Much_VRAM
If it's useful to you leave a star 🌟and share it to someone that will find the tool useful!

3 replies

·

AlexBodner

posted an update 4 months ago

Post

1587

💾🧠Want to know how much VRAM you will need for training your model? 💾🧠
Now you can use this app in which you can input a torch/tensorflow summary or the parameters count and get an estimate of the required memory!
Use it in: howmuchvram.com

Also, everything is Open Source so you can contribute in repo: https://github.com/AlexBodner/How_Much_VRAM
Leave it a star⭐