Towards Best Practices for Open Datasets for LLM Training
Paper
•
2501.08365
•
Published
•
41
Shayne Longpre
Shayne
AI & ML interests
ML, NLP, Multilinguality, responsible/fair use of intelligent algorithms
Recent Activity
authored
a paper
3 days ago
Towards Best Practices for Open Datasets for LLM Training
upvoted
a
paper
2 months ago
Consent in Crisis: The Rapid Decline of the AI Data Commons
liked
a dataset
4 months ago
PNLPhub/FarsInstruct
Organizations
Shayne's activity
authored
a
paper
3 days ago
upvoted
a
paper
2 months ago
liked
a
dataset
4 months ago
authored
4
papers
7 months ago
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
Paper
•
2406.16746
•
Published
Entity-Based Knowledge Conflicts in Question Answering
Paper
•
2109.05052
•
Published
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Paper
•
2301.13688
•
Published
•
8
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
Paper
•
2007.15207
•
Published
authored
a
paper
9 months ago
authored
a
paper
10 months ago
reacted to
yjernite's
post with 🤗❤️
11 months ago
Post
👷🏽♀️📚🔨 Announcing the Foundation Model Development Cheatsheet!
My first 🤗Post🤗 ever to announce the release of a fantastic collaborative resource to support model developers across the full development stack: The FM Development Cheatsheet available here: https://fmcheatsheet.org/
The cheatsheet is a growing database of the many crucial resources coming from open research and development efforts to support the responsible development of models. This new resource highlights essential yet often underutilized tools in order to make it as easy as possible for developers to adopt best practices, covering among other aspects:
🧑🏼🤝🧑🏼 data selection, curation, and governance;
📖 accurate and limitations-aware documentation;
⚡ energy efficiency throughout the training phase;
📊 thorough capability assessments and risk evaluations;
🌏 environmentally and socially conscious deployment strategies.
We strongly encourage developers working on creating and improving models to make full use of the tools listed here, and to help keep the resource up to date by adding the resources that you yourself have developed or found useful in your own practice 🤗
Congrats to all the participants in this effort for the release! Read more about it from:
@Shayne - https://twitter.com/ShayneRedford/status/1763215814860186005
@hails and @stellaathena - https://blog.eleuther.ai/fm-dev-cheatsheet/
@alon-albalak - http://nlp.cs.ucsb.edu/blog/a-new-guide-for-the-responsible-development-of-foundation-models.html
And also to @gabrielilharco @sayashk @kklyman @kylel @mbrauh @fauxneticien @avi-skowron @Bertievidgen Laura Weidinger, Arvind Narayanan, @VictorSanh @Davlan @percyliang Rishi Bommasani, @breakend @sasha 🔥
My first 🤗Post🤗 ever to announce the release of a fantastic collaborative resource to support model developers across the full development stack: The FM Development Cheatsheet available here: https://fmcheatsheet.org/
The cheatsheet is a growing database of the many crucial resources coming from open research and development efforts to support the responsible development of models. This new resource highlights essential yet often underutilized tools in order to make it as easy as possible for developers to adopt best practices, covering among other aspects:
🧑🏼🤝🧑🏼 data selection, curation, and governance;
📖 accurate and limitations-aware documentation;
⚡ energy efficiency throughout the training phase;
📊 thorough capability assessments and risk evaluations;
🌏 environmentally and socially conscious deployment strategies.
We strongly encourage developers working on creating and improving models to make full use of the tools listed here, and to help keep the resource up to date by adding the resources that you yourself have developed or found useful in your own practice 🤗
Congrats to all the participants in this effort for the release! Read more about it from:
@Shayne - https://twitter.com/ShayneRedford/status/1763215814860186005
@hails and @stellaathena - https://blog.eleuther.ai/fm-dev-cheatsheet/
@alon-albalak - http://nlp.cs.ucsb.edu/blog/a-new-guide-for-the-responsible-development-of-foundation-models.html
And also to @gabrielilharco @sayashk @kklyman @kylel @mbrauh @fauxneticien @avi-skowron @Bertievidgen Laura Weidinger, Arvind Narayanan, @VictorSanh @Davlan @percyliang Rishi Bommasani, @breakend @sasha 🔥
- 1 reply
reacted to
VictorSanh's
post with 👍
11 months ago
Post
An increasing number of engineers and researchers are developing foundational models. Navigating the tools, resources, codebases, and best practices guides is daunting for new contributors.
Introducing the Foundation Model Development Cheatsheet, a succinct guide with 250+ resources & tools for:
📖 sourcing data
🔍 documenting & audits
🌍 environmental impact
🥊 risks & harms eval
🎮 release & monitoring
https://fmcheatsheet.org/
👐 What tools & resources should appear in that cheatsheet? Contributions encouraged!
This is the result of a large collaboration between many organizations promoting open-science, and spearheaded by @Shayne 🔥
Introducing the Foundation Model Development Cheatsheet, a succinct guide with 250+ resources & tools for:
📖 sourcing data
🔍 documenting & audits
🌍 environmental impact
🥊 risks & harms eval
🎮 release & monitoring
https://fmcheatsheet.org/
👐 What tools & resources should appear in that cheatsheet? Contributions encouraged!
This is the result of a large collaboration between many organizations promoting open-science, and spearheaded by @Shayne 🔥
- 2 replies
authored
a
paper
11 months ago
updated
a
dataset
about 1 year ago
authored
a
paper
over 1 year ago
Code link broken in demo
#4 opened over 1 year ago
by
Shayne
authored
a
paper
over 1 year ago
Updates to Flan V2 repo
10
#8 opened almost 2 years ago
by
Shayne
Non-English languages not working
5
#6 opened about 2 years ago
by
diwank
any plans on increasing model's model_max_length?
17
#41 opened almost 2 years ago
by
lovodkin93