How to perform tokenization on an ONNX model in JS?
I’ve exported a custom PyTorch-based Transformer model into ONNX to run it on NodeJS. However, the exported model seems to expectinput_idsdirectly (and not raw text).Is there any way I can perform tokenization in JS?