  
# Dataset Card for Janes-Preklop

### Dataset Summary

Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching: the use of words from two 
or more languages within one sentence or utterance.

### Languages

Code-switched Slovenian.

## Dataset Structure

### Data Instances

A sample instance from the dataset - each word is annotated with its language, either `"default"` 
(Slovenian/unclassifiable), `en` (English), `de` (German), `hbs` (Serbo-Croatian), `sp` (Spanish), 
`la` (Latin), `ar` (Arabic), `fr` (French), `it` (Italian), or `pt` (Portuguese).
```
{
    'id': 'tid.397447931558895616', 
    'words': ['Brad', 'Pitt', 'na', 'Planet', 'TV', '.', 'U', 'are', 'welcome', ';)'], 
    'language': ['default', 'default', 'default', 'default', 'default', 'default', 'B-en', 'I-en', 'I-en', 'I-en']
}
```

### Data Fields

- `id`: unique identifier of the example; 
- `words`: words in the sentence;
- `language`: language of each word.

## Additional Information

### Dataset Curators

Špela Reher, Tomaž Erjavec, Darja Fišer.

### Licensing Information

CC BY-SA 4.0.

### Citation Information

```
@misc{janes_preklop,
  title = {Tweet code-switching corpus Janes-Preklop 1.0},
  author = {Reher, {\v S}pela and Erjavec, Toma{\v z} and Fi{\v s}er, Darja},
  url = {http://hdl.handle.net/11356/1154},
  note = {Slovenian language resource repository {CLARIN}.{SI}},
  copyright = {Creative Commons - Attribution-{ShareAlike} 4.0 International ({CC} {BY}-{SA} 4.0)},
  issn = {2820-4042},
  year = {2017}
}
```

### Contributions

Thanks to [@matejklemen](https://github.com/matejklemen) for adding this dataset.
task_categories:token-classification size_categories:1K<n<10K language:sl license:cc-by-sa-4.0 tweets code-mixing code-switching region:us
{"language": ["sl"], "license": "cc-by-sa-4.0", "size_categories": ["1K<n<10K"], "task_categories": ["token-classification"], "dataset_info": {"features": [{"name": "id", "dtype": "string"}, {"name": "words", "sequence": "string"}, {"name": "language", "sequence": "string"}], "splits": [{"name": "train", "num_bytes": 410822, "num_examples": 1104}], "download_size": 623816, "dataset_size": 412672}, "tags": ["tweets", "code-mixing", "code-switching"]}
TAGS
#task_categories-token-classification #size_categories-1K<n<10K #language-Slovenian #license-cc-by-sa-4.0 #tweets #code-mixing #code-switching #region-us 

  
# Dataset Card for Janes-Preklop

### Dataset Summary

Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching: the use of words from two 
or more languages within one sentence or utterance.

### Languages

Code-switched Slovenian.

## Dataset Structure

### Data Instances

A sample instance from the dataset - each word is annotated with its language, either '"default"' 
(Slovenian/unclassifiable), 'en' (English), 'de' (German), 'hbs' (Serbo-Croatian), 'sp' (Spanish), 
'la' (Latin), 'ar' (Arabic), 'fr' (French), 'it' (Italian), or 'pt' (Portuguese).


### Data Fields

- 'id': unique identifier of the example; 
- 'words': words in the sentence;
- 'language': language of each word.

## Additional Information

### Dataset Curators

Špela Reher, Tomaž Erjavec, Darja Fišer.

### Licensing Information

CC BY-SA 4.0.





### Contributions

Thanks to @matejklemen for adding this dataset.
# Dataset Card for Janes-Preklop ### Dataset Summary

Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching: the use of words from two 
or more languages within one sentence or utterance. ### Languages

Code-switched Slovenian. ## Dataset Structure ### Data Instances

A sample instance from the dataset - each word is annotated with its language, either '"default"' 
(Slovenian/unclassifiable), 'en' (English), 'de' (German), 'hbs' (Serbo-Croatian), 'sp' (Spanish), 
'la' (Latin), 'ar' (Arabic), 'fr' (French), 'it' (Italian), or 'pt' (Portuguese). ### Data Fields

- 'id': unique identifier of the example; 
- 'words': words in the sentence;
- 'language': language of each word. ## Additional Information ### Dataset Curators

Špela Reher, Tomaž Erjavec, Darja Fišer. ### Licensing Information

CC BY-SA 4.0. ### Contributions

Thanks to @matejklemen for adding this dataset.
TAGS
#task_categories-token-classification #size_categories-1K<n<10K #language-Slovenian #license-cc-by-sa-4.0 #tweets #code-mixing #code-switching #region-us 
 # Dataset Card for Janes-Preklop ### Dataset Summary

Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching: the use of words from two 
or more languages within one sentence or utterance. ### Languages

Code-switched Slovenian. ## Dataset Structure ### Data Instances

A sample instance from the dataset - each word is annotated with its language, either '"default"' 
(Slovenian/unclassifiable), 'en' (English), 'de' (German), 'hbs' (Serbo-Croatian), 'sp' (Spanish), 
'la' (Latin), 'ar' (Arabic), 'fr' (French), 'it' (Italian), or 'pt' (Portuguese). ### Data Fields

- 'id': unique identifier of the example; 
- 'words': words in the sentence;
- 'language': language of each word. ## Additional Information ### Dataset Curators

Špela Reher, Tomaž Erjavec, Darja Fišer. ### Licensing Information

CC BY-SA 4.0. ### Contributions

Thanks to @matejklemen for adding this dataset.