38 13 33

Sara Hooker

sarahooker

https://www.sarahooker.me/

AI & ML interests

None yet

Recent Activity

liked a model 20 days ago

CohereForAI/c4ai-command-r7b-12-2024

liked a dataset 20 days ago

CohereForAI/Global-MMLU-Lite

reacted to dvilasuero's post with ❤️ 28 days ago

🌐 Announcing Global-MMLU: an improved MMLU Open dataset with evaluation coverage across 42 languages, built with Argilla and the Hugging Face community. Global-MMLU is the result of months of work with the goal of advancing Multilingual LLM evaluation. It's been an amazing open science effort with collaborators from Cohere For AI, Mila - Quebec Artificial Intelligence Institute, EPFL, Massachusetts Institute of Technology, AI Singapore, National University of Singapore, KAIST, Instituto Superior Técnico, Carnegie Mellon University, CONICET, and University of Buenos Aires. 🏷️ +200 contributors used Argilla MMLU questions where regional, dialect, or cultural knowledge was required to answer correctly. 85% of the questions required Western-centric knowledge! Thanks to this annotation process, the open dataset contains two subsets: 1. 🗽 Culturally Agnostic: no specific regional, cultural knowledge is required. 2. ⚖️ Culturally Sensitive: requires dialect, cultural knowledge or geographic knowledge to answer correctly. Moreover, we provide high quality translations of 25 out of 42 languages, thanks again to the community and professional annotators leveraging Argilla on the Hub. I hope this will ensure a better understanding of the limitations and challenges for making open AI useful for many languages. Dataset: https://huggingface.co/datasets/CohereForAI/Global-MMLU

View all activity

Organizations

sarahooker's activity

upvoted a collection 2 months ago

C4AI Aya Expanse

Collection

Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. • 3 items • Updated 20 days ago • 30

upvoted an article 4 months ago

Article

The Environmental Impacts of AI -- Primer

•

Sep 3, 2024

• 33

upvoted an article 6 months ago

Article

Putting RL back in RLHF

Jun 12, 2024

• 66

upvoted a paper 7 months ago

To Believe or Not to Believe Your LLM

Paper • 2406.02543 • Published Jun 4, 2024 • 32

upvoted a collection 7 months ago

IrokoBench

Collection

a human-translated benchmark dataset for 16 African languages covering three tasks: NLI, MMLU and MGSM • 6 items • Updated May 31, 2024 • 18

upvoted an article 7 months ago

Article

Space secrets security update

May 31, 2024

• 50

upvoted a paper 7 months ago

Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs

Paper • 2402.14740 • Published Feb 22, 2024 • 12

upvoted a collection 8 months ago

C4AI Aya 23

Collection

Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. • 4 items • Updated Dec 3, 2024 • 51

upvoted an article 9 months ago

Article

RAG Empowerment: Cohere C4AI Command-R and Transformers Unveiled

•

Apr 7, 2024

• 10

upvoted 3 collections 9 months ago

upvoted a paper 11 months ago

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model

Paper • 2402.07827 • Published Feb 12, 2024 • 45