Amharic NLP - Train BERT-style model
@israelHere is a thread where we can collaborate on work to pre-train a BERT-style model for Amharic on OSCAR data.One thing I have noticed on a lot of NLP efforts is it has a high barrier to entry. I believe the documentation needs to be so clear that anyone (with minimum data science knowledge) coming after us has to be able to implement the process with easy to follow step by step instructions.Thanks
2021-02-25T06:43:46Z
Please DM me.
2021-02-27T21:20:05Z
@yjernitethis part has some issues in my jupiterdef tokenize_function(examples):
    return tokenizer(examples["text"])when called fromtokenized_datasets = datasets.map(tokenize_function, batched=True, 
num_proc=4, remove_columns=["text"])File “”, line 2, in tokenize_functionNameError: name ‘tokenizer’ is not defined
2021-03-01T00:17:18Z
Are you talking about the Colab you shared in another thread? Did you run the cells in order? Looks like you haven’t runtokenizer = AutoTokenizer.from_pretrained(model_checkpoint)yet