Spaces:
Runtime error
Runtime error
mwitiderrick
commited on
Commit
·
2b76624
1
Parent(s):
65f69f7
Update app.py
Browse files
app.py
CHANGED
@@ -12,7 +12,7 @@ DeepSparse is sparsity-aware inference runtime offering GPU-class performance on
|
|
12 |
The pipelines are similar to Hugging Face pipelines but are faster because they have been pruned and quantized. SparseML Named Entity Recognition Pipelines integrate with Hugging Face’s Transformers library to enable the sparsification of a large set of transformers models.
|
13 |
### Inference
|
14 |
Here is sample code for a token classification pipeline:
|
15 |
-
```
|
16 |
from deepsparse import Pipeline
|
17 |
pipeline = Pipeline.create(task="ner", model_path="zoo:nlp/token_classification/distilbert-none/pytorch/huggingface/conll2003/pruned80_quant-none-vnni")
|
18 |
inference = pipeline(text)
|
|
|
12 |
The pipelines are similar to Hugging Face pipelines but are faster because they have been pruned and quantized. SparseML Named Entity Recognition Pipelines integrate with Hugging Face’s Transformers library to enable the sparsification of a large set of transformers models.
|
13 |
### Inference
|
14 |
Here is sample code for a token classification pipeline:
|
15 |
+
```python
|
16 |
from deepsparse import Pipeline
|
17 |
pipeline = Pipeline.create(task="ner", model_path="zoo:nlp/token_classification/distilbert-none/pytorch/huggingface/conll2003/pruned80_quant-none-vnni")
|
18 |
inference = pipeline(text)
|