Passing list of inputs to tokenize
In this tutorial (Processing the data - Hugging Face Course), they pass a collection of inputs into Tokenizer.tokenize(). But when I try to pass a list of texts, I get an error, and the source code (transformers/tokenization_utils.py at main · huggingface/transformers · GitHub) suggests it only accepts one input. So how do I tokenize lots of items at once as they seem to do in the tutorial?
2022-05-09T16:28:22Z
Can you post your code?