size_categories:1M<n<10M language:tn license:cc-by-sa-4.0 setswana corpora region:us
---
license: cc-by-sa-4.0
language:
- tn
tags:
- setswana
- corpora
pretty_name: puodata
size_categories:
- 1M<n<10M
---

# PuoData: A curated corpora for Setswana


## Dataset Curation

| Dataset Name | Kind | Num. of Tokens |
|---|---|---|
| *PuoData* |  |  |
| NCHLT Setswana \cite{eiselen2014developing} | Government Documents | 1,010,147 |
| Nalibali Setswana | Childrens Books | 57,654 |
| Setswana Bible | Book(s) | 879,630 |
| SA Constitution | Official Document | 56,194 |
| Leipzig Setswana Corpus BW | Curated Dataset | 219,149 |
| Leipzig Setswana Corpus ZA | Curated Dataset | 218,037 |
| SABC Dikgang tsa Setswana FB (Facebook) | News Headlines | 167,119 |
| SABC MotswedingFM FB | Online Content | 33,092 |
| Leipzig Setswana Wiki | Online Content | 230,333 |
| Setswana Wiki | Online Content | 183,168 |
| Vukuzenzele Monolingual TSN | Government News | 157,798 |
| gov-za Cabinet speeches TSN | Government Speeches | 591,920 |
| Department Basic Education TSN | Education Material | 708,965 |
| **PuoData Total** | 25MB on disk | **4,513,206** |
| *PuoData+JW300* |  |  |
| JW300 Setswana| Book(s) | 19,782,122 |
| **PuoData+JW300** | 124MB on disk | **24,295,328** |

## Dataset Uses

The dataset was used to train [PuoBERTa](https://huggingface.co/dsfsi/PuoBERTa) and part of the dataset used for [PuoBERTaJW300](https://huggingface.co/dsfsi/PuoBERTaJW300). 

### Citation Information

Bibtex Refrence

```
@article{marivatePuoBERTa2023,
  title={PuoBERTa: Training and evaluation of a curated language model for Setswana},
  author={Vukosi Marivate and Moseli Mots'Oehli and Valencia Wagner and Richard Lastrucci and Isheanesu Dzingirai},
  journal={ArXiv},
}
```