text
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗
new_line
new_line
text
The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by 
The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by 
mention
@danielhanchen
danielhanchen
text
 and 
 and 
mention
@shimmyshimmer
shimmyshimmer
text
  🦥
  🦥
new_line
new_line
text
Link to the base model: 
Link to the base model: 
resource
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
model
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
new_line
new_line
text
Link to the instruct model: 
Link to the instruct model: 
resource
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
model
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
new_line
new_line
text
Link to the dataset: 
Link to the dataset: 
resource
https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr
dataset
louisbrulenaudet/Romulus-cpt-fr
https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr
new_line
new_line
text
Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗

The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by @danielhanchen and @shimmyshimmer  🦥

Link to the base model: https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1

Link to the instruct model: https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct

Link to the dataset: https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr

Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
🔥
danielhanchen kramp osanseviero gabrielmbmb ashutoshzade Gatozu35 lucianosb lastdefiance20
👀
John6666 danielhanchen
❤️
danielhanchen
👍
Tom-Neverwinter
https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/ixLCk0TwaCVyL_nAfrgEs.png
Daniel Han-Chen
danielhanchen
user