text
Distilabel and synthetic data community interviews - the outcomes
Distilabel and synthetic data community interviews - the outcomes
new_line
new_line
text
We've been doing some interview with community members to understand the needs surrounding synthetic data. Many thanks to the participants. Note that, given they interviewees were sourced from our community, so the results will likely represent that.
We've been doing some interview with community members to understand the needs surrounding synthetic data. Many thanks to the participants. Note that, given they interviewees were sourced from our community, so the results will likely represent that.
new_line
new_line
text
Things distilabel does well
Things distilabel does well
new_line
text
- security and reliability by caching generations and having serializable pipelines.
- security and reliability by caching generations and having serializable pipelines.
new_line
text
- scaling up generation by parallelising inference and Anyscale Ray
- scaling up generation by parallelising inference and Anyscale Ray
new_line
text
- solid implementations of state of the art research papers
- solid implementations of state of the art research papers
new_line
new_line
text
Things to improve
Things to improve
new_line
text
- communication about the fact we support structured generation
- communication about the fact we support structured generation
new_line
text
- customization of existing prompt implementations are difficult
- customization of existing prompt implementations are difficult
new_line
text
- creation of new tasks prove difficult
- creation of new tasks prove difficult
new_line
text
- arguments and parameters for tasks aren't available at first glance
- arguments and parameters for tasks aren't available at first glance
new_line
text
- the learning curve can be steep
- the learning curve can be steep
new_line
text
- more tutorials that represent real-life usage
- more tutorials that represent real-life usage
new_line
new_line
text
Things to note
Things to note
new_line
text
- create small scale and large scale dataset to Millions of records
- create small scale and large scale dataset to Millions of records
new_line
text
- people use synthetic data to move away from frontier model providers
- people use synthetic data to move away from frontier model providers
new_line
text
- people mostly use 7B or 70B models for generating
- people mostly use 7B or 70B models for generating
new_line
new_line
text
Participate here: 
Participate here: 
link
https://github.com/argilla-io/distilabel/issues
https://github.com/argilla-io/distilabel/issues
Distilabel and synthetic data community interviews - the outcomes

We've been doing some interview with community members to understand the needs surrounding synthetic data. Many thanks to the participants. Note that, given they interviewees were sourced from our community, so the results will likely represent that.

Things distilabel does well
- security and reliability by caching generations and having serializable pipelines.
- scaling up generation by parallelising inference and Anyscale Ray
- solid implementations of state of the art research papers

Things to improve
- communication about the fact we support structured generation
- customization of existing prompt implementations are difficult
- creation of new tasks prove difficult
- arguments and parameters for tasks aren't available at first glance
- the learning curve can be steep
- more tutorials that represent real-life usage

Things to note
- create small scale and large scale dataset to Millions of records
- people use synthetic data to move away from frontier model providers
- people mostly use 7B or 70B models for generating

Participate here: https://github.com/argilla-io/distilabel/issues
🤗
Tonic osanseviero gabrielmbmb fynnkroeger
❤️
Tonic Obenlia
🧠
Tonic John6666
🚀
Tonic