
# Dataset Card for CEIL
 
## Dataset Description

- **Website:** https://aina.bsc.es
- **Point of Contact:** [Carlos Rodríguez-Penagos](carlos.rodriguez1@bsc.es)

### Dataset Summary

Catalan Entity Identification and Linking (CEIL) is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for Machine Learning and Language Model evaluation purposes in Catalan. 
It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K documents. 

CEIL is used under [CC-by](https://creativecommons.org/licenses/by/4.0/) licence. 

This dataset was developed by [BSC LangTech Unit](https://langtech.bsc.es/) as part of the [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina/), to enrich the [Catalan Language Understanding Benchmark (CLUB)](https://club.aina.bsc.es/).


![Prodigy Example](https://huggingface.co/datasets/crodri/ceil/resolve/main/Selection_021.png "Prodigy Example")

### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model

### Languages

The dataset is in Catalan (`ca-ES`).

## Dataset Structure

### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre>

### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one.

### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus.


## Dataset Creation

### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan.

### Source Data

Documents were gathered from various online sources:

- Tweets about different topics, such as catalan independence, coronavirus, benidormfest, vaccines, etc.
- Newswire from nacio digital (Motor) Vilaweb (opinion pieces), Agencia Catalana de Noticies (Economy and Memoria Histórica)
- Various threads from RacoCatalá forum
- Viquipedia articles (woman bios, film synopses, etc.)
- OTHER: Parliament proceedings, restaurant online reviews, etc.

#### Initial Data Collection and Normalization

The word tokenization used to convert offset annotations into CONLL files was done using spacy

#### Who are the source language producers?

Annotation Subcontracted to M47Labs.

Guidelines available at [Zenodo](https://doi.org/10.5281/zenodo.8318188)

### Annotations

#### Annotation process

We adapted the NER labels from  to a token-per-line, multi-column format. 

#### Who are the annotators?

The annotation was entrusted to the company M47 labs through a public tender process.

### Personal and Sensitive Information

No personal or sensitive information included.

## Considerations for Using the Data

### Social Impact of Dataset

We hope this corpus contributes to the development of language models in Catalan, a low-resource language.

### Discussion of Biases

[N/A]

### Other Known Limitations

[N/A]

## Additional Information

### Funding

This work was funded by the [Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya](https://politiquesdigitals.gencat.cat/en/inici/index.html) within the framework of [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina/).

### Licensing information

This work is licensed under a Apache 2.0</a>.

### Citation Information

```


```


### Contributions

[N/A]
annotations_creators:expert-generated language_creators:found multilinguality:monolingual size_categories:unknown language:ca license:apache-2.0 region:us
{"annotations_creators": ["expert-generated"], "language_creators": ["found"], "language": ["ca"], "license": "apache-2.0", "multilinguality": ["monolingual"], "size_categories": ["unknown"], "source_datasets": [], "task_ids": [], "pretty_name": "ceil"}
TAGS
#annotations_creators-expert-generated #language_creators-found #multilinguality-monolingual #size_categories-unknown #language-Catalan #license-apache-2.0 #region-us 


# Dataset Card for CEIL
 
## Dataset Description

- Website: URL
- Point of Contact: Carlos Rodríguez-Penagos

### Dataset Summary

Catalan Entity Identification and Linking (CEIL) is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for Machine Learning and Language Model evaluation purposes in Catalan. 
It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K documents. 

CEIL is used under CC-by licence. 

This dataset was developed by BSC LangTech Unit as part of the Projecte AINA, to enrich the Catalan Language Understanding Benchmark (CLUB).


!Prodigy Example

### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model

### Languages

The dataset is in Catalan ('ca-ES').

## Dataset Structure

### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre>

### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one.

### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus.


## Dataset Creation

### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan.

### Source Data

Documents were gathered from various online sources:

- Tweets about different topics, such as catalan independence, coronavirus, benidormfest, vaccines, etc.
- Newswire from nacio digital (Motor) Vilaweb (opinion pieces), Agencia Catalana de Noticies (Economy and Memoria Histórica)
- Various threads from RacoCatalá forum
- Viquipedia articles (woman bios, film synopses, etc.)
- OTHER: Parliament proceedings, restaurant online reviews, etc.

#### Initial Data Collection and Normalization

The word tokenization used to convert offset annotations into CONLL files was done using spacy

#### Who are the source language producers?

Annotation Subcontracted to M47Labs.

Guidelines available at Zenodo

### Annotations

#### Annotation process

We adapted the NER labels from  to a token-per-line, multi-column format. 

#### Who are the annotators?

The annotation was entrusted to the company M47 labs through a public tender process.

### Personal and Sensitive Information

No personal or sensitive information included.

## Considerations for Using the Data

### Social Impact of Dataset

We hope this corpus contributes to the development of language models in Catalan, a low-resource language.

### Discussion of Biases

[N/A]

### Other Known Limitations

[N/A]

## Additional Information

### Funding

This work was funded by the Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya within the framework of Projecte AINA.

### Licensing information

This work is licensed under a Apache 2.0</a>.






### Contributions

[N/A]
# Dataset Card for CEIL ## Dataset Description

- Website: URL
- Point of Contact: Carlos Rodríguez-Penagos ### Dataset Summary

Catalan Entity Identification and Linking (CEIL) is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for Machine Learning and Language Model evaluation purposes in Catalan. 
It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K documents. 

CEIL is used under CC-by licence. 

This dataset was developed by BSC LangTech Unit as part of the Projecte AINA, to enrich the Catalan Language Understanding Benchmark (CLUB).


!Prodigy Example ### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model ### Languages

The dataset is in Catalan ('ca-ES'). ## Dataset Structure ### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre> ### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one. ### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus. ## Dataset Creation ### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan. ### Source Data

Documents were gathered from various online sources:

- Tweets about different topics, such as catalan independence, coronavirus, benidormfest, vaccines, etc.
- Newswire from nacio digital (Motor) Vilaweb (opinion pieces), Agencia Catalana de Noticies (Economy and Memoria Histórica)
- Various threads from RacoCatalá forum
- Viquipedia articles (woman bios, film synopses, etc.)
- OTHER: Parliament proceedings, restaurant online reviews, etc. #### Initial Data Collection and Normalization

The word tokenization used to convert offset annotations into CONLL files was done using spacy #### Who are the source language producers?

Annotation Subcontracted to M47Labs.

Guidelines available at Zenodo ### Annotations #### Annotation process

We adapted the NER labels from  to a token-per-line, multi-column format. #### Who are the annotators?

The annotation was entrusted to the company M47 labs through a public tender process. ### Personal and Sensitive Information

No personal or sensitive information included. ## Considerations for Using the Data ### Social Impact of Dataset

We hope this corpus contributes to the development of language models in Catalan, a low-resource language. ### Discussion of Biases

[N/A] ### Other Known Limitations

[N/A] ## Additional Information ### Funding

This work was funded by the Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya within the framework of Projecte AINA. ### Licensing information

This work is licensed under a Apache 2.0</a>. ### Contributions

[N/A]
TAGS
#annotations_creators-expert-generated #language_creators-found #multilinguality-monolingual #size_categories-unknown #language-Catalan #license-apache-2.0 #region-us 
 # Dataset Card for CEIL ## Dataset Description

- Website: URL
- Point of Contact: Carlos Rodríguez-Penagos ### Dataset Summary

Catalan Entity Identification and Linking (CEIL) is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for Machine Learning and Language Model evaluation purposes in Catalan. 
It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K documents. 

CEIL is used under CC-by licence. 

This dataset was developed by BSC LangTech Unit as part of the Projecte AINA, to enrich the Catalan Language Understanding Benchmark (CLUB).


!Prodigy Example ### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model ### Languages

The dataset is in Catalan ('ca-ES'). ## Dataset Structure ### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre> ### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one. ### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus. ## Dataset Creation ### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan. ### Source Data

Documents were gathered from various online sources:

- Tweets about different topics, such as catalan independence, coronavirus, benidormfest, vaccines, etc.
- Newswire from nacio digital (Motor) Vilaweb (opinion pieces), Agencia Catalana de Noticies (Economy and Memoria Histórica)
- Various threads from RacoCatalá forum
- Viquipedia articles (woman bios, film synopses, etc.)
- OTHER: Parliament proceedings, restaurant online reviews, etc. #### Initial Data Collection and Normalization

The word tokenization used to convert offset annotations into CONLL files was done using spacy #### Who are the source language producers?

Annotation Subcontracted to M47Labs.

Guidelines available at Zenodo ### Annotations #### Annotation process

We adapted the NER labels from  to a token-per-line, multi-column format. #### Who are the annotators?

The annotation was entrusted to the company M47 labs through a public tender process. ### Personal and Sensitive Information

No personal or sensitive information included. ## Considerations for Using the Data ### Social Impact of Dataset

We hope this corpus contributes to the development of language models in Catalan, a low-resource language. ### Discussion of Biases

[N/A] ### Other Known Limitations

[N/A] ## Additional Information ### Funding

This work was funded by the Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya within the framework of Projecte AINA. ### Licensing information

This work is licensed under a Apache 2.0</a>. ### Contributions

[N/A]
passage: TAGS
#annotations_creators-expert-generated #language_creators-found #multilinguality-monolingual #size_categories-unknown #language-Catalan #license-apache-2.0 #region-us 
# Dataset Card for CEIL## Dataset Description

- Website: URL
- Point of Contact: Carlos Rodríguez-Penagos### Dataset Summary

Catalan Entity Identification and Linking (CEIL) is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for Machine Learning and Language Model evaluation purposes in Catalan. 
It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K documents. 

CEIL is used under CC-by licence. 

This dataset was developed by BSC LangTech Unit as part of the Projecte AINA, to enrich the Catalan Language Understanding Benchmark (CLUB).


!Prodigy Example### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model### Languages

The dataset is in Catalan ('ca-ES').## Dataset Structure### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre>### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one.### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus.## Dataset Creation### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan.