# myanimelist-embeddings

This dataset is every non-empty anime synopsis from [MyAnimeList.net](https://myanimelist.net) ran
through the `embed-multilingual-v2.0` embedding model from [Cohere AI](https://cohere.com).

## Sample code for searching for anime

Install some dependencies
```
pip install cohere==4.4.1 datasets==2.12.0 torch==2.0.1
```

Code heavily inspired by the [Cohere Wikipedia embeddings sample](https://huggingface.co/datasets/Cohere/wikipedia-22-12-simple-embeddings#search)
```python
import os

import cohere
import torch
from datasets import load_dataset

co = cohere.Client(
    os.environ["COHERE_API_KEY"]
)  # Add your cohere API key from www.cohere.com

docs_stream = load_dataset(
    f"abatilo/myanimelist-embeddings", split="train", streaming=True
)

docs = []
doc_embeddings = []

for doc in docs_stream:
    docs.append(doc)
    doc_embeddings.append(doc["embedding"])

doc_embeddings = torch.tensor(doc_embeddings)

while True:
    query = input("What do you want to see?: ")

    response = co.embed(texts=[query], model="embed-multilingual-v2.0")
    query_embedding = response.embeddings
    query_embedding = torch.tensor(query_embedding)

    # Compute dot score between query embedding and document embeddings
    dot_scores = torch.mm(query_embedding, doc_embeddings.transpose(0, 1))
    top_k = torch.topk(dot_scores, k=3)

    for doc_id in top_k.indices[0].tolist():
        print(docs[doc_id]["title"])
        print(docs[doc_id]["synopsis"], "\n")
```

## Sample search queries

### high schoolers with super powers fight evil
```
What do you want to see?: high schoolers with super powers fight evil
Kigurumi Sentai Quiltian
Twin schoolgirls transform into their superhero aspects to save the world from an evil cabal of would-be dictators, but they can only fight for justice by having a lot of sex.

(Source: ANN)

Kekkaishi
Yoshimura Sumimura comes from a long line of "Kekkaishi," individuals who have supernatural abilities and are able to destroy evil creatures called Ayakashi that venture into the human realm from time to time. The Ayakashi are demons that look to feast on the power emanating from the land of Karasumori, which also happens to be where Yoshimura's high school is located. Now, Yoshimura must fight to protect his beloved school and hometown. Although, if it were up to him, he would rather be baking cakes than fighting off the ugly characters that show up at night.

Thankfully, Yoshimura isn't the only one helping to keep the baddies at bay. His childhood friend and neighbor, Tokine Yukimura, joins him in this righteous battle. Despite the fact that they are from rival clans, these two make a fantastic team. And teamwork is something vital to fighting the evil that is closing in, as the Ayakashi attack in waves, looking to claim the land as their own, and a shadowy organization looks on, ready to pounce when the time is right...

Shiritsu Araiso Koutougakkou Seitokai Shikkoubu
Kubota Makoto and Tokitoh Minoru (characters from Kazuya Minekura's manga Wild Adaptor—though no reference is made to the darker storyline of WA in this light-hearted anime)—are the muscle of their high school's all-powerful student council. They defend the student body from disorder—generated by both humans and demons—while avoiding their classes.

(Source: ANN)
```

### a pokemon trainer wants to be the very best
```
What do you want to see?: a pokemon trainer wants to be the very best
Pokemon
Pokémon are peculiar creatures with a vast array of different abilities and appearances; many people, known as Pokémon trainers, capture and train them, often with the intent of battling others. Young Satoshi has not only dreamed of becoming a Pokémon trainer but also a "Pokémon Master," and on the arrival of his 10th birthday, he finally has a chance to make that dream a reality. Unfortunately for him, all three Pokémon available to beginning trainers have already been claimed and only Pikachu, a rebellious Electric-type Pokémon, remains. However, this chance encounter would mark the start of a lifelong friendship and an epic adventure!

Setting off on a journey to become the very best, Satoshi and Pikachu travel across beautiful, sprawling regions with their friends Kasumi, a Water-type trainer, and Takeshi, a Rock-type trainer. But danger lurks around every corner. The infamous Team Rocket is always nearby, seeking to steal powerful Pokémon through nefarious schemes. It'll be up to Satoshi and his friends to thwart their efforts as he also strives to earn the eight Pokémon Gym Badges he'll need to challenge the Pokémon League, and eventually claim the title of Pokémon Master.

[Written by MAL Rewrite]

Pokemon Best Wishes!
As with both the Advanced Generation and Diamond & Pearl series before it, the Best Wishes! series begins with only Satoshi, headed off to the Isshu region, located far away from Kanto, Johto, Houen, and Sinnoh, with his Pikachu. After he meets up with the new trainer and rival Shooty and the region's Professor Araragi, he gains traveling companions in Iris, a girl from a town known for its Dragon Pokémon, and Dent, Pokémon Connoisseur and the Grass Pokémon specialist of the three Sanyou City Gym Leaders.

Pokemon Sun & Moon
After his mother wins a free trip to the islands, Pokémon trainer Satoshi and his partner Pikachu head for Melemele Island of the beautiful Alola region, which is filled with lots of new Pokémon and even variations of familiar faces. Eager to explore the island, Satoshi and Pikachu run wild with excitement, quickly losing their way while chasing after a Pokémon. The pair eventually stumbles upon the Pokémon School, an institution where students come to learn more about these fascinating creatures.

At the school, when he and one of the students—the no-nonsense Kaki—have a run-in with the nefarious thugs of Team Skull, Satoshi discovers the overwhelming might of the Z-Moves, powerful attacks originating from the Alola region that require the trainer and Pokémon to be in sync. Later that night, he and Pikachu have an encounter with the guardian deity Pokémon of Melemele Island, the mysterious Kapu Kokeko. The Pokémon of legend bestows upon them a Z-Ring, a necessary tool in using the Z-Moves. Dazzled by their earlier battle and now in possession of a Z-Ring, Satoshi and Pikachu decide to stay behind in the Alola Region to learn and master the strength of these powerful new attacks.

Enrolling in the Pokémon School, Satoshi is joined by classmates such as Lillie, who loves Pokémon but cannot bring herself to touch them, Kaki, and many others. Between attending classes, fending off the pesky Team Rocket—who themselves have arrived in Alola to pave the way for their organization's future plans—and taking on the Island Challenge that is necessary to master the Z-Moves, Satoshi and Pikachu are in for an exciting new adventure.

[Written by MAL Rewrite]
```

### hunting demons with swords
```
What do you want to see?: hunting demons with swords
Grandeek
This is a tale of swords and sorcery as the young warrior-woman Tia Allbright and her hapless assistant, Luke, battle demon assassins in a fantasy land.

Tia arrives on the island of Marcleida with her trusted sword 'Grandeek,' which holds a spirit within that helps her on her quests. She is soon turned away however. Determined to get on the island, Tia searches for a way past the fences that guard the entrance, as another stranger arrives on the island to take on a mysterious job. Someone has been killing the inhabitants of the island and has the ability to appear and disappear at will. Seems the sword 'Aihorn' has been stolen and the spirit that resides within it seeks vengenance on those who killed its master 50 years before.

As Tia makes her way inside the island, it becomes clear that both she, and the stranger, are after the sword Aihorn, hoping to bring to an end its bloody goal. But the sword has the ability to possess the person who wields it - putting Tia and the stranger at a great disadvantage.

Based on the manga by Kohime Ohse, Tia and Grandeek will have to face their most difficult challenge yet...

(Source: AnimeNfo)

Bemubemu Hunter Kotengu Tenmaru
Adventures of a demon slayer Tenmaru.

Karasu Tengu Kabuto
500 years ago in the Tensho Era of Japan, a man was born who defied the will of a demon; a man who had gods of good on his side; a man destined to battle evil....his name was Kabuto. Somehow, Kuroyasya Douki, the vile Black Night Demon, escaped his prison in hell and returned to the earthly plane to wreak vengeance on the family-line of Kabuto. None can escape his deadly magic and masterful skills with the blade; however, the gods of the North, West, East, and South band together to help Kabuto stand for Justice. With the questionable help of a diabolical talking sword that his own father forged, Kabuto may live another day to see his own sons born....
```
task_categories:text-classification task_categories:summarization size_categories:10K<n<100K language:en license:mit region:us
{"language": ["en"], "license": "mit", "size_categories": ["10K<n<100K"], "task_categories": ["text-classification", "summarization"], "pretty_name": "MyAnimeList Embeddings"}
TAGS
#task_categories-text-classification #task_categories-summarization #size_categories-10K<n<100K #language-English #license-mit #region-us 

# myanimelist-embeddings

This dataset is every non-empty anime synopsis from URL ran
through the 'embed-multilingual-v2.0' embedding model from Cohere AI.

## Sample code for searching for anime

Install some dependencies


Code heavily inspired by the Cohere Wikipedia embeddings sample


## Sample search queries

### high schoolers with super powers fight evil


### a pokemon trainer wants to be the very best


### hunting demons with swords

# myanimelist-embeddings

This dataset is every non-empty anime synopsis from URL ran
through the 'embed-multilingual-v2.0' embedding model from Cohere AI. ## Sample code for searching for anime

Install some dependencies


Code heavily inspired by the Cohere Wikipedia embeddings sample ## Sample search queries ### high schoolers with super powers fight evil ### a pokemon trainer wants to be the very best ### hunting demons with swords
TAGS
#task_categories-text-classification #task_categories-summarization #size_categories-10K<n<100K #language-English #license-mit #region-us 
 # myanimelist-embeddings

This dataset is every non-empty anime synopsis from URL ran
through the 'embed-multilingual-v2.0' embedding model from Cohere AI. ## Sample code for searching for anime

Install some dependencies


Code heavily inspired by the Cohere Wikipedia embeddings sample ## Sample search queries ### high schoolers with super powers fight evil ### a pokemon trainer wants to be the very best ### hunting demons with swords
passage: TAGS
#task_categories-text-classification #task_categories-summarization #size_categories-10K<n<100K #language-English #license-mit #region-us 
# myanimelist-embeddings

This dataset is every non-empty anime synopsis from URL ran
through the 'embed-multilingual-v2.0' embedding model from Cohere AI.## Sample code for searching for anime

Install some dependencies


Code heavily inspired by the Cohere Wikipedia embeddings sample## Sample search queries### high schoolers with super powers fight evil### a pokemon trainer wants to be the very best### hunting demons with swords