text
Do you need a high-quality dataset to train a custom sentence transformer model? Look no further! I've developed a pipeline that leverages an LLM to create a synthetic dataset of negative and positive sentence pairs based on domain-specific anchors.
Do you need a high-quality dataset to train a custom sentence transformer model? Look no further! I've developed a pipeline that leverages an LLM to create a synthetic dataset of negative and positive sentence pairs based on domain-specific anchors.
new_line
new_line
text
Here's what the pipeline offers:
Here's what the pipeline offers:
new_line
text
- **Dataset Generation**: Automatically create synthetic sentence pairs 
- **Dataset Generation**: Automatically create synthetic sentence pairs 
new_line
text
- **Mine hard negatives**: Use an existing embedding model to mine hard negatives 
- **Mine hard negatives**: Use an existing embedding model to mine hard negatives 
new_line
text
- **Model Training**: Train a model using the latest release of Sentence Transformers.
- **Model Training**: Train a model using the latest release of Sentence Transformers.
new_line
new_line
text
Check out this collection (
Check out this collection (
resource
https://huggingface.co/collections/davanstrien/sentence-transformers-from-synthetic-data-66571a6133480d1b70066b70
collection
davanstrien/sentence-transformers-from-synthetic-data-66571a6133480d1b70066b70
https://huggingface.co/collections/davanstrien/sentence-transformers-from-synthetic-data-66571a6133480d1b70066b70
text
) to see an example of what you can achieve with this pipeline. It features a sentence transformer model to detect coding prompt similarities in a 
) to see an example of what you can achieve with this pipeline. It features a sentence transformer model to detect coding prompt similarities in a 
mention
@bigcode
bigcode
text
 dataset. 
 dataset. 
new_line
new_line
text
Excited to get started? Find a tutorial here: 
Excited to get started? Find a tutorial here: 
link
https://github.com/davanstrien/awesome-synthetic-datasets/tree/main/examples/embedding-datasets
https://github.com/davanstrien/awesome-synthetic-datasets/tree/main/examples/embedding-datasets
text
. 
. 
new_line
Do you need a high-quality dataset to train a custom sentence transformer model? Look no further! I've developed a pipeline that leverages an LLM to create a synthetic dataset of negative and positive sentence pairs based on domain-specific anchors.

Here's what the pipeline offers:
- **Dataset Generation**: Automatically create synthetic sentence pairs 
- **Mine hard negatives**: Use an existing embedding model to mine hard negatives 
- **Model Training**: Train a model using the latest release of Sentence Transformers.

Check out this collection (https://huggingface.co/collections/davanstrien/sentence-transformers-from-synthetic-data-66571a6133480d1b70066b70) to see an example of what you can achieve with this pipeline. It features a sentence transformer model to detect coding prompt similarities in a @bigcode dataset. 

Excited to get started? Find a tutorial here: https://github.com/davanstrien/awesome-synthetic-datasets/tree/main/examples/embedding-datasets. 

🧠
lunarflu louisbrulenaudet nickprock KingNish GPT007 osanseviero
🔥
tomaarsen hiauiarau
/avatars/7f64d0458e67578b685206bcda220cbd.svg
Surendar Ganesan
Surendar0701
user