Token IDS to Text
#6
by
nihalani
- opened
Could we get a reverse button or something similar to take token ids to text as well. Would be usefull when trying to debug data flow during model training
Is there a way to run the tokenizer-playground on a CLI from a laptop? Because I need to batch process data.