`add_prefix_space=True` option for the BPE tokenizer
Hello,I understand that when I add theadd_prefix_space=Trueoption in the BPE tokenizer statement, the tokenizer will add a space in the beginning of every sequence.Is there some specific advantages of using theadd_prefix_space=Trueoption for BPE tokenizer (compared to when I don’t use the option)? All my sequences start without a space in the beginning.Thanks,