Harsh-7300 commited on
Commit
a6b69c6
·
verified ·
1 Parent(s): b3a892c

Update tokenizer.json

Browse files
Files changed (1) hide show
  1. tokenizer.json +7 -0
tokenizer.json CHANGED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "do_lower_case": true,
4
+ "strip_accents": false,
5
+ "pad_token_id": 0,
6
+ "wordpieces_prefix": "##"
7
+ }