
## 🐥 🇧🇷 Canarim Instruct Dataset

<p align="center">
  <img width="250" alt="Camarim Logo" src="https://raw.githubusercontent.com/DominguesM/Canarim-Instruct-PTBR/main/assets/canarim.png">
</p>

<p align="center">
  <a href="https://github.com/DominguesM/Canarim-Instruct-PTBR">[🐱 Github]</a>
</p>

<hr>

## What's Canarim?

Canarim is a dataset with over 300,000 instructions in Portuguese, ranging from simple instructions like "Descreva os efeitos do aquecimento global" to more complex instructions like "Nesta tarefa, você precisa ser capaz de resumir uma determinada lista de pontos-chave" where additional context is provided.

## Why it's called Canarim?


"Canarim" is spoken in some regions of Brazil (mainly by grandparents), and it could be translated as "canarinho," which means "little canary" in English. "Canarim" (is pronounced: kɑnɑrɪm) or canary is a bird very present in Brazilian daily life, living for up to 30 years. Every Brazilian at some point in their life has come across this bird, which is why I chose this name for my project.


## Source Data

This dataset was created through translation and adaptation from the following sources:

* [**dominguesm/alpaca-data-pt-br**](https://huggingface.co/datasets/dominguesm/alpaca-data-pt-br) (*51759 rows*)
* [**cahya/instructions-pt**](https://huggingface.co/datasets/cahya/instructions-pt) (*57692 rows*)
* [**HuggingFaceH4/self_instruct**](https://huggingface.co/datasets/HuggingFaceH4/self_instruct) (*74350 rows*)
* [**HuggingFaceH4/helpful_instructions (self_instruct)**](https://huggingface.co/datasets/HuggingFaceH4/helpful_instructions/viewer/self_instruct/train) (*82612 rows*)
* [**HuggingFaceH4/helpful_instructions (super_natural_instructions)**](https://huggingface.co/datasets/HuggingFaceH4/helpful_instructions/viewer/super_natural_instructions/train) (*50000 rows*)

Totaling 316k lines in the training split and 1519 lines in the test split, all lines must contain an "instruction" and an "output", and may or may not also contain a "context".

There may be translation errors in the data.

## Prompt

Below is the prompt template I am using with this dataset:

```python
def generate_prompt(instruction, input=None):
    if input:
        return f"""Abaixo está uma instrução que descreve uma tarefa, emparelhada com uma entrada que fornece mais contexto. Escreva uma resposta que conclua adequadamente a solicitação.
### Instruções:
{instruction}
### Entrada:
{input}
### Resposta:"""
    else:
        return f"""Abaixo está uma instrução que descreve uma tarefa. Escreva uma resposta que conclua adequadamente a solicitação.
### Instruções:
{instruction}
### Resposta:"""
```

## Examples of prompts

```json
{
    "instruction": "Sugira uma estratégia de marketing eficaz para um programa de TV.",
    "input": "",
    "output": "Uma estratégia de marketing eficaz para um programa de TV é criar um trailer de teaser a ser lançado antes da estréia do programa na televisão e outras plataformas digitais. O trailer de teaser deve ser curto, dinâmico e atraente, a fim de desencadear a curiosidade e o interesse nos espectadores. Ele também deve conter uma linha de tags convincente ou "gancho" que resume a premissa do programa. Além disso, criar uma hashtag associada ao programa de conteúdo da TV e pedir aos espectadores que se juntem à conversa nas mídias sociais."
}
```

```json
{
    "instruction": "Compare os dois assuntos a seguir",
    "input": "Inteligência Artificial e Machine Learning",
    "output": "Inteligência Artificial (IA) e Machine Learning (ML) são campos da ciência da computação que envolvem o desenvolvimento de máquinas inteligentes que podem aprender com dados e executar tarefas de forma autônoma. A IA se concentra no comportamento semelhante ao humano e envolve o desenvolvimento de algoritmos e estruturas de dados que permitem que as máquinas aprendam através do reconhecimento de padrões e do raciocínio lógico. A ML, por outro lado, é um subconjunto de IA que se concentra em ensinar computadores a otimizar tarefas com um certo grau de precisão."
}
```

## License Information

### Overview

The Canarim-Instruct dataset is now licensed under CC-BY-NC (Creative Commons Attribution-NonCommercial). This change is a result of my commitment to ethical data usage and legal compliance, particularly in the realm of derived data and AI-generated content.

### Why CC-BY-NC?

My decision to adopt the CC-BY-NC license comes from a detailed assessment of the origins and intended use of the Canarim-Instruct dataset. Portions of our dataset derive from or are influenced by models from OpenAI (e.g., Self-instruct, Alpaca). In light of this, adherence to specific guidelines on the usage of such data is essential.

The policy of OpenAI limits the use of its model generations for training other models, especially in commercial scenarios. To align with these guidelines and ensure the responsible use of AI-generated data, the CC-BY-NC license was selected as the most appropriate.

### What Does This Mean for Users?

- **Remixing and Adaptation**: Users are free to remix, adapt, and build upon the Canarim-Instruct dataset non-commercially.
- **Credit**: Proper attribution must be given to me as the creator of the dataset, with a link to the license and an indication of any changes made.
- **Non-Commercial Use**: The dataset is not to be used for commercial purposes under this license.

I believe that the CC-BY-NC license strikes a balance between open accessibility and the legal and ethical considerations surrounding AI-generated data. My aim is to create an environment where the community can utilize this valuable resource for research and development while respecting the boundaries set by the origins of the data and relevant policies.

## Citation

If you want to cite **Canarim Instruct PTBR dataset**, you could use this:

```
@misc {maicon_domingues_2023,
	author       = { {Maicon Domingues} },
	title        = { Canarim-Instruct-PTBR-Dataset (Revision c2de751) },
	year         = 2023,
	url          = { https://huggingface.co/datasets/dominguesm/Canarim-Instruct-PTBR-Dataset },
	doi          = { 10.57967/hf/0983 },
	publisher    = { Hugging Face }
}
```
language:pt license:cc-by-nc-4.0 doi:10.57967/hf/0983 region:us
{"language": "pt", "license": "cc-by-nc-4.0", "dataset_info": {"features": [{"name": "instruction", "dtype": "string"}, {"name": "input", "dtype": "string"}, {"name": "output", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 113100060, "num_examples": 316413}, {"name": "test", "num_bytes": 687328, "num_examples": 1519}], "download_size": 63510092, "dataset_size": 113787388}}
TAGS
#language-Portuguese #license-cc-by-nc-4.0 #doi-10.57967/hf/0983 #region-us 


##  🇧🇷 Canarim Instruct Dataset

<p align="center">
  <img width="250" alt="Camarim Logo" src="URL
</p>

<p align="center">
  <a href="URL Github]</a>
</p>

<hr>

## What's Canarim?

Canarim is a dataset with over 300,000 instructions in Portuguese, ranging from simple instructions like "Descreva os efeitos do aquecimento global" to more complex instructions like "Nesta tarefa, você precisa ser capaz de resumir uma determinada lista de pontos-chave" where additional context is provided.

## Why it's called Canarim?


"Canarim" is spoken in some regions of Brazil (mainly by grandparents), and it could be translated as "canarinho," which means "little canary" in English. "Canarim" (is pronounced: kɑnɑrɪm) or canary is a bird very present in Brazilian daily life, living for up to 30 years. Every Brazilian at some point in their life has come across this bird, which is why I chose this name for my project.


## Source Data

This dataset was created through translation and adaptation from the following sources:

* dominguesm/alpaca-data-pt-br (*51759 rows*)
* cahya/instructions-pt (*57692 rows*)
* HuggingFaceH4/self_instruct (*74350 rows*)
* HuggingFaceH4/helpful_instructions (self_instruct) (*82612 rows*)
* HuggingFaceH4/helpful_instructions (super_natural_instructions) (*50000 rows*)

Totaling 316k lines in the training split and 1519 lines in the test split, all lines must contain an "instruction" and an "output", and may or may not also contain a "context".

There may be translation errors in the data.

## Prompt

Below is the prompt template I am using with this dataset:



## Examples of prompts





## License Information

### Overview

The Canarim-Instruct dataset is now licensed under CC-BY-NC (Creative Commons Attribution-NonCommercial). This change is a result of my commitment to ethical data usage and legal compliance, particularly in the realm of derived data and AI-generated content.

### Why CC-BY-NC?

My decision to adopt the CC-BY-NC license comes from a detailed assessment of the origins and intended use of the Canarim-Instruct dataset. Portions of our dataset derive from or are influenced by models from OpenAI (e.g., Self-instruct, Alpaca). In light of this, adherence to specific guidelines on the usage of such data is essential.

The policy of OpenAI limits the use of its model generations for training other models, especially in commercial scenarios. To align with these guidelines and ensure the responsible use of AI-generated data, the CC-BY-NC license was selected as the most appropriate.

### What Does This Mean for Users?

- Remixing and Adaptation: Users are free to remix, adapt, and build upon the Canarim-Instruct dataset non-commercially.
- Credit: Proper attribution must be given to me as the creator of the dataset, with a link to the license and an indication of any changes made.
- Non-Commercial Use: The dataset is not to be used for commercial purposes under this license.

I believe that the CC-BY-NC license strikes a balance between open accessibility and the legal and ethical considerations surrounding AI-generated data. My aim is to create an environment where the community can utilize this valuable resource for research and development while respecting the boundaries set by the origins of the data and relevant policies.

If you want to cite Canarim Instruct PTBR dataset, you could use this:


##  🇧🇷 Canarim Instruct Dataset

<p align="center">
  <img width="250" alt="Camarim Logo" src="URL
</p>

<p align="center">
  <a href="URL Github]</a>
</p>

<hr> ## What's Canarim?

Canarim is a dataset with over 300,000 instructions in Portuguese, ranging from simple instructions like "Descreva os efeitos do aquecimento global" to more complex instructions like "Nesta tarefa, você precisa ser capaz de resumir uma determinada lista de pontos-chave" where additional context is provided. ## Why it's called Canarim?


"Canarim" is spoken in some regions of Brazil (mainly by grandparents), and it could be translated as "canarinho," which means "little canary" in English. "Canarim" (is pronounced: kɑnɑrɪm) or canary is a bird very present in Brazilian daily life, living for up to 30 years. Every Brazilian at some point in their life has come across this bird, which is why I chose this name for my project. ## Source Data

This dataset was created through translation and adaptation from the following sources:

* dominguesm/alpaca-data-pt-br (*51759 rows*)
* cahya/instructions-pt (*57692 rows*)
* HuggingFaceH4/self_instruct (*74350 rows*)
* HuggingFaceH4/helpful_instructions (self_instruct) (*82612 rows*)
* HuggingFaceH4/helpful_instructions (super_natural_instructions) (*50000 rows*)

Totaling 316k lines in the training split and 1519 lines in the test split, all lines must contain an "instruction" and an "output", and may or may not also contain a "context".

There may be translation errors in the data. ## Prompt

Below is the prompt template I am using with this dataset: ## Examples of prompts ## License Information ### Overview

The Canarim-Instruct dataset is now licensed under CC-BY-NC (Creative Commons Attribution-NonCommercial). This change is a result of my commitment to ethical data usage and legal compliance, particularly in the realm of derived data and AI-generated content. ### Why CC-BY-NC?

My decision to adopt the CC-BY-NC license comes from a detailed assessment of the origins and intended use of the Canarim-Instruct dataset. Portions of our dataset derive from or are influenced by models from OpenAI (e.g., Self-instruct, Alpaca). In light of this, adherence to specific guidelines on the usage of such data is essential.

The policy of OpenAI limits the use of its model generations for training other models, especially in commercial scenarios. To align with these guidelines and ensure the responsible use of AI-generated data, the CC-BY-NC license was selected as the most appropriate. ### What Does This Mean for Users?

- Remixing and Adaptation: Users are free to remix, adapt, and build upon the Canarim-Instruct dataset non-commercially.
- Credit: Proper attribution must be given to me as the creator of the dataset, with a link to the license and an indication of any changes made.
- Non-Commercial Use: The dataset is not to be used for commercial purposes under this license.

I believe that the CC-BY-NC license strikes a balance between open accessibility and the legal and ethical considerations surrounding AI-generated data. My aim is to create an environment where the community can utilize this valuable resource for research and development while respecting the boundaries set by the origins of the data and relevant policies.

If you want to cite Canarim Instruct PTBR dataset, you could use this:
TAGS
#language-Portuguese #license-cc-by-nc-4.0 #doi-10.57967/hf/0983 #region-us 
 ##  🇧🇷 Canarim Instruct Dataset

<p align="center">
  <img width="250" alt="Camarim Logo" src="URL
</p>

<p align="center">
  <a href="URL Github]</a>
</p>

<hr> ## What's Canarim?

Canarim is a dataset with over 300,000 instructions in Portuguese, ranging from simple instructions like "Descreva os efeitos do aquecimento global" to more complex instructions like "Nesta tarefa, você precisa ser capaz de resumir uma determinada lista de pontos-chave" where additional context is provided. ## Why it's called Canarim?


"Canarim" is spoken in some regions of Brazil (mainly by grandparents), and it could be translated as "canarinho," which means "little canary" in English. "Canarim" (is pronounced: kɑnɑrɪm) or canary is a bird very present in Brazilian daily life, living for up to 30 years. Every Brazilian at some point in their life has come across this bird, which is why I chose this name for my project. ## Source Data

This dataset was created through translation and adaptation from the following sources:

* dominguesm/alpaca-data-pt-br (*51759 rows*)
* cahya/instructions-pt (*57692 rows*)
* HuggingFaceH4/self_instruct (*74350 rows*)
* HuggingFaceH4/helpful_instructions (self_instruct) (*82612 rows*)
* HuggingFaceH4/helpful_instructions (super_natural_instructions) (*50000 rows*)

Totaling 316k lines in the training split and 1519 lines in the test split, all lines must contain an "instruction" and an "output", and may or may not also contain a "context".

There may be translation errors in the data. ## Prompt

Below is the prompt template I am using with this dataset: ## Examples of prompts ## License Information ### Overview

The Canarim-Instruct dataset is now licensed under CC-BY-NC (Creative Commons Attribution-NonCommercial). This change is a result of my commitment to ethical data usage and legal compliance, particularly in the realm of derived data and AI-generated content. ### Why CC-BY-NC?

My decision to adopt the CC-BY-NC license comes from a detailed assessment of the origins and intended use of the Canarim-Instruct dataset. Portions of our dataset derive from or are influenced by models from OpenAI (e.g., Self-instruct, Alpaca). In light of this, adherence to specific guidelines on the usage of such data is essential.

The policy of OpenAI limits the use of its model generations for training other models, especially in commercial scenarios. To align with these guidelines and ensure the responsible use of AI-generated data, the CC-BY-NC license was selected as the most appropriate. ### What Does This Mean for Users?

- Remixing and Adaptation: Users are free to remix, adapt, and build upon the Canarim-Instruct dataset non-commercially.
- Credit: Proper attribution must be given to me as the creator of the dataset, with a link to the license and an indication of any changes made.
- Non-Commercial Use: The dataset is not to be used for commercial purposes under this license.

I believe that the CC-BY-NC license strikes a balance between open accessibility and the legal and ethical considerations surrounding AI-generated data. My aim is to create an environment where the community can utilize this valuable resource for research and development while respecting the boundaries set by the origins of the data and relevant policies.

If you want to cite Canarim Instruct PTBR dataset, you could use this: