
# tokenizers metrics

This dataset contains metrics about the huggingface/tokenizers package.

Number of repositories in the dataset: 11460
Number of packages in the dataset: 124

## Package dependents

This contains the data available in the [used-by](https://github.com/huggingface/tokenizers/network/dependents)
tab on GitHub.

### Package & Repository star count

This section shows the package and repository star count, individually. 


Package             |  Repository
:-------------------------:|:-------------------------:
![tokenizers-dependent package star count](./tokenizers-dependents/resolve/main/tokenizers-dependent_package_star_count.png)  |  ![tokenizers-dependent repository star count](./tokenizers-dependents/resolve/main/tokenizers-dependent_repository_star_count.png)

There are 14 packages that have more than 1000 stars.

There are 41 repositories that have more than 1000 stars.


The top 10 in each category are the following:

*Package*

[huggingface/transformers](https://github.com/huggingface/transformers): 70475

[hankcs/HanLP](https://github.com/hankcs/HanLP): 26958

[facebookresearch/ParlAI](https://github.com/facebookresearch/ParlAI): 9439

[UKPLab/sentence-transformers](https://github.com/UKPLab/sentence-transformers): 8461

[lucidrains/DALLE-pytorch](https://github.com/lucidrains/DALLE-pytorch): 4816

[ThilinaRajapakse/simpletransformers](https://github.com/ThilinaRajapakse/simpletransformers): 3303

[neuml/txtai](https://github.com/neuml/txtai): 2530

[QData/TextAttack](https://github.com/QData/TextAttack): 2087

[lukas-blecher/LaTeX-OCR](https://github.com/lukas-blecher/LaTeX-OCR): 1981

[utterworks/fast-bert](https://github.com/utterworks/fast-bert): 1760

*Repository*

[huggingface/transformers](https://github.com/huggingface/transformers): 70480

[hankcs/HanLP](https://github.com/hankcs/HanLP): 26958

[RasaHQ/rasa](https://github.com/RasaHQ/rasa): 14842

[facebookresearch/ParlAI](https://github.com/facebookresearch/ParlAI): 9440

[gradio-app/gradio](https://github.com/gradio-app/gradio): 9169

[UKPLab/sentence-transformers](https://github.com/UKPLab/sentence-transformers): 8462

[microsoft/unilm](https://github.com/microsoft/unilm): 6650

[EleutherAI/gpt-neo](https://github.com/EleutherAI/gpt-neo): 6431

[moyix/fauxpilot](https://github.com/moyix/fauxpilot): 6300

[lucidrains/DALLE-pytorch](https://github.com/lucidrains/DALLE-pytorch): 4816


### Package & Repository fork count

This section shows the package and repository fork count, individually. 

Package             |  Repository
:-------------------------:|:-------------------------:
![tokenizers-dependent package forks count](./tokenizers-dependents/resolve/main/tokenizers-dependent_package_forks_count.png)  |  ![tokenizers-dependent repository forks count](./tokenizers-dependents/resolve/main/tokenizers-dependent_repository_forks_count.png)

There are 11 packages that have more than 200 forks.

There are 39 repositories that have more than 200 forks.


The top 10 in each category are the following:

*Package*

[huggingface/transformers](https://github.com/huggingface/transformers): 16158

[hankcs/HanLP](https://github.com/hankcs/HanLP): 7388

[facebookresearch/ParlAI](https://github.com/facebookresearch/ParlAI): 1920

[UKPLab/sentence-transformers](https://github.com/UKPLab/sentence-transformers): 1695

[ThilinaRajapakse/simpletransformers](https://github.com/ThilinaRajapakse/simpletransformers): 658

[lucidrains/DALLE-pytorch](https://github.com/lucidrains/DALLE-pytorch): 543

[utterworks/fast-bert](https://github.com/utterworks/fast-bert): 336

[nyu-mll/jiant](https://github.com/nyu-mll/jiant): 273

[QData/TextAttack](https://github.com/QData/TextAttack): 269

[lukas-blecher/LaTeX-OCR](https://github.com/lukas-blecher/LaTeX-OCR): 245

*Repository*

[huggingface/transformers](https://github.com/huggingface/transformers): 16157

[hankcs/HanLP](https://github.com/hankcs/HanLP): 7388

[RasaHQ/rasa](https://github.com/RasaHQ/rasa): 4105

[plotly/dash-sample-apps](https://github.com/plotly/dash-sample-apps): 2795

[facebookresearch/ParlAI](https://github.com/facebookresearch/ParlAI): 1920

[UKPLab/sentence-transformers](https://github.com/UKPLab/sentence-transformers): 1695

[microsoft/unilm](https://github.com/microsoft/unilm): 1223

[openvinotoolkit/open_model_zoo](https://github.com/openvinotoolkit/open_model_zoo): 1207

[bhaveshlohana/HacktoberFest2020-Contributions](https://github.com/bhaveshlohana/HacktoberFest2020-Contributions): 1020

[data-science-on-aws/data-science-on-aws](https://github.com/data-science-on-aws/data-science-on-aws): 884

    
license:apache-2.0 github-stars region:us
{"license": "apache-2.0", "pretty_name": "tokenizers metrics", "tags": ["github-stars"], "dataset_info": {"features": [{"name": "name", "dtype": "string"}, {"name": "stars", "dtype": "int64"}, {"name": "forks", "dtype": "int64"}], "splits": [{"name": "package", "num_bytes": 95, "num_examples": 2}, {"name": "repository", "num_bytes": 1893, "num_examples": 42}], "download_size": 5046, "dataset_size": 1988}}
TAGS
#license-apache-2.0 #github-stars #region-us 

tokenizers metrics
==================


This dataset contains metrics about the huggingface/tokenizers package.


Number of repositories in the dataset: 11460
Number of packages in the dataset: 124


Package dependents
------------------


This contains the data available in the used-by
tab on GitHub.


### Package & Repository star count


This section shows the package and repository star count, individually.



There are 14 packages that have more than 1000 stars.


There are 41 repositories that have more than 1000 stars.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 70475


hankcs/HanLP: 26958


facebookresearch/ParlAI: 9439


UKPLab/sentence-transformers: 8461


lucidrains/DALLE-pytorch: 4816


ThilinaRajapakse/simpletransformers: 3303


neuml/txtai: 2530


QData/TextAttack: 2087


lukas-blecher/LaTeX-OCR: 1981


utterworks/fast-bert: 1760


*Repository*


huggingface/transformers: 70480


hankcs/HanLP: 26958


RasaHQ/rasa: 14842


facebookresearch/ParlAI: 9440


gradio-app/gradio: 9169


UKPLab/sentence-transformers: 8462


microsoft/unilm: 6650


EleutherAI/gpt-neo: 6431


moyix/fauxpilot: 6300


lucidrains/DALLE-pytorch: 4816


### Package & Repository fork count


This section shows the package and repository fork count, individually.



There are 11 packages that have more than 200 forks.


There are 39 repositories that have more than 200 forks.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 16158


hankcs/HanLP: 7388


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


ThilinaRajapakse/simpletransformers: 658


lucidrains/DALLE-pytorch: 543


utterworks/fast-bert: 336


nyu-mll/jiant: 273


QData/TextAttack: 269


lukas-blecher/LaTeX-OCR: 245


*Repository*


huggingface/transformers: 16157


hankcs/HanLP: 7388


RasaHQ/rasa: 4105


plotly/dash-sample-apps: 2795


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


microsoft/unilm: 1223


openvinotoolkit/open\_model\_zoo: 1207


bhaveshlohana/HacktoberFest2020-Contributions: 1020


data-science-on-aws/data-science-on-aws: 884



### Package & Repository star count


This section shows the package and repository star count, individually.



There are 14 packages that have more than 1000 stars.


There are 41 repositories that have more than 1000 stars.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 70475


hankcs/HanLP: 26958


facebookresearch/ParlAI: 9439


UKPLab/sentence-transformers: 8461


lucidrains/DALLE-pytorch: 4816


ThilinaRajapakse/simpletransformers: 3303


neuml/txtai: 2530


QData/TextAttack: 2087


lukas-blecher/LaTeX-OCR: 1981


utterworks/fast-bert: 1760


*Repository*


huggingface/transformers: 70480


hankcs/HanLP: 26958


RasaHQ/rasa: 14842


facebookresearch/ParlAI: 9440


gradio-app/gradio: 9169


UKPLab/sentence-transformers: 8462


microsoft/unilm: 6650


EleutherAI/gpt-neo: 6431


moyix/fauxpilot: 6300


lucidrains/DALLE-pytorch: 4816 ### Package & Repository fork count


This section shows the package and repository fork count, individually.



There are 11 packages that have more than 200 forks.


There are 39 repositories that have more than 200 forks.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 16158


hankcs/HanLP: 7388


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


ThilinaRajapakse/simpletransformers: 658


lucidrains/DALLE-pytorch: 543


utterworks/fast-bert: 336


nyu-mll/jiant: 273


QData/TextAttack: 269


lukas-blecher/LaTeX-OCR: 245


*Repository*


huggingface/transformers: 16157


hankcs/HanLP: 7388


RasaHQ/rasa: 4105


plotly/dash-sample-apps: 2795


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


microsoft/unilm: 1223


openvinotoolkit/open\_model\_zoo: 1207


bhaveshlohana/HacktoberFest2020-Contributions: 1020


data-science-on-aws/data-science-on-aws: 884
TAGS
#license-apache-2.0 #github-stars #region-us 
 ### Package & Repository star count


This section shows the package and repository star count, individually.



There are 14 packages that have more than 1000 stars.


There are 41 repositories that have more than 1000 stars.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 70475


hankcs/HanLP: 26958


facebookresearch/ParlAI: 9439


UKPLab/sentence-transformers: 8461


lucidrains/DALLE-pytorch: 4816


ThilinaRajapakse/simpletransformers: 3303


neuml/txtai: 2530


QData/TextAttack: 2087


lukas-blecher/LaTeX-OCR: 1981


utterworks/fast-bert: 1760


*Repository*


huggingface/transformers: 70480


hankcs/HanLP: 26958


RasaHQ/rasa: 14842


facebookresearch/ParlAI: 9440


gradio-app/gradio: 9169


UKPLab/sentence-transformers: 8462


microsoft/unilm: 6650


EleutherAI/gpt-neo: 6431


moyix/fauxpilot: 6300


lucidrains/DALLE-pytorch: 4816 ### Package & Repository fork count


This section shows the package and repository fork count, individually.



There are 11 packages that have more than 200 forks.


There are 39 repositories that have more than 200 forks.


The top 10 in each category are the following:


*Package*


huggingface/transformers: 16158


hankcs/HanLP: 7388


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


ThilinaRajapakse/simpletransformers: 658


lucidrains/DALLE-pytorch: 543


utterworks/fast-bert: 336


nyu-mll/jiant: 273


QData/TextAttack: 269


lukas-blecher/LaTeX-OCR: 245


*Repository*


huggingface/transformers: 16157


hankcs/HanLP: 7388


RasaHQ/rasa: 4105


plotly/dash-sample-apps: 2795


facebookresearch/ParlAI: 1920


UKPLab/sentence-transformers: 1695


microsoft/unilm: 1223


openvinotoolkit/open\_model\_zoo: 1207


bhaveshlohana/HacktoberFest2020-Contributions: 1020


data-science-on-aws/data-science-on-aws: 884