
# Dataset Card for mC4 Finnish Cleaned

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-instances)
  - [Data Splits](#data-instances)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)

## Dataset Description

- **Homepage:** [Needs More Information]
- **Repository:** [Needs More Information]
- **Paper:** [Needs More Information]
- **Leaderboard:** [Needs More Information]
- **Point of Contact:** [Needs More Information]

### Dataset Summary

mC4 Finnish cleaned is cleaned version of the original mC4 Finnish split.

### Supported Tasks and Leaderboards

mC4 Finnish is mainly intended to pretrain Finnish language models and word representations.



### Languages

Finnish

## Dataset Structure

### Data Instances

[Needs More Information]

### Data Fields

The data have several fields:

- url: url of the source as a string
- text: text content as a string
- timestamp: timestamp as a string
- perplexity_kenlm_full: perplexity of the text calculated by KenLM model

### Data Splits

Train Validation

## Dataset Creation

### Curation Rationale

[Needs More Information]

### Source Data

#### Initial Data Collection and Normalization

[Needs More Information]

#### Who are the source language producers?

[Needs More Information]

### Annotations

#### Annotation process

[Needs More Information]

#### Who are the annotators?

[Needs More Information]

### Personal and Sensitive Information

[Needs More Information]

## Considerations for Using the Data

### Social Impact of Dataset

[Needs More Information]

### Discussion of Biases

[Needs More Information]

### Other Known Limitations

[Needs More Information]

## Additional Information

### Dataset Curators

[Needs More Information]

### Licensing Information

[Needs More Information]

### Citation Information

[Needs More Information]
task_categories:text-generation task_categories:fill-mask task_ids:language-modeling task_ids:masked-language-modeling multilinguality:monolingual size_categories:unknown source_datasets:extended|mc4 language:fi region:us
{"annotations_creators": [], "language_creators": [], "language": ["fi"], "license": [], "multilinguality": ["monolingual"], "size_categories": ["unknown"], "source_datasets": ["extended|mc4"], "task_categories": ["text-generation", "fill-mask"], "task_ids": ["language-modeling", "masked-language-modeling"], "pretty_name": "mC4 Finnish Cleaned"}
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #multilinguality-monolingual #size_categories-unknown #source_datasets-extended|mc4 #language-Finnish #region-us 


# Dataset Card for mC4 Finnish Cleaned

## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information

## Dataset Description

- Homepage: 
- Repository: 
- Paper: 
- Leaderboard: 
- Point of Contact: 

### Dataset Summary

mC4 Finnish cleaned is cleaned version of the original mC4 Finnish split.

### Supported Tasks and Leaderboards

mC4 Finnish is mainly intended to pretrain Finnish language models and word representations.



### Languages

Finnish

## Dataset Structure

### Data Instances



### Data Fields

The data have several fields:

- url: url of the source as a string
- text: text content as a string
- timestamp: timestamp as a string
- perplexity_kenlm_full: perplexity of the text calculated by KenLM model

### Data Splits

Train Validation

## Dataset Creation

### Curation Rationale



### Source Data

#### Initial Data Collection and Normalization



#### Who are the source language producers?



### Annotations

#### Annotation process



#### Who are the annotators?



### Personal and Sensitive Information



## Considerations for Using the Data

### Social Impact of Dataset



### Discussion of Biases



### Other Known Limitations



## Additional Information

### Dataset Curators



### Licensing Information






# Dataset Card for mC4 Finnish Cleaned ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information ## Dataset Description

- Homepage: 
- Repository: 
- Paper: 
- Leaderboard: 
- Point of Contact: ### Dataset Summary

mC4 Finnish cleaned is cleaned version of the original mC4 Finnish split. ### Supported Tasks and Leaderboards

mC4 Finnish is mainly intended to pretrain Finnish language models and word representations. ### Languages

Finnish ## Dataset Structure ### Data Instances ### Data Fields

The data have several fields:

- url: url of the source as a string
- text: text content as a string
- timestamp: timestamp as a string
- perplexity_kenlm_full: perplexity of the text calculated by KenLM model ### Data Splits

Train Validation ## Dataset Creation ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators ### Licensing Information
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #multilinguality-monolingual #size_categories-unknown #source_datasets-extended|mc4 #language-Finnish #region-us 
 # Dataset Card for mC4 Finnish Cleaned ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information ## Dataset Description

- Homepage: 
- Repository: 
- Paper: 
- Leaderboard: 
- Point of Contact: ### Dataset Summary

mC4 Finnish cleaned is cleaned version of the original mC4 Finnish split. ### Supported Tasks and Leaderboards

mC4 Finnish is mainly intended to pretrain Finnish language models and word representations. ### Languages

Finnish ## Dataset Structure ### Data Instances ### Data Fields

The data have several fields:

- url: url of the source as a string
- text: text content as a string
- timestamp: timestamp as a string
- perplexity_kenlm_full: perplexity of the text calculated by KenLM model ### Data Splits

Train Validation ## Dataset Creation ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators ### Licensing Information