Best way to perform paragraph embeddings?
Hi,I would like to create embeddings for medium-sized paragraphs.In all the examples given in huggingface feature extraction models, only sentences are given to the tokenizers.What is the best strategy to achieve that ?What are the recommended parameters for the tokenization ?Would you recommend some models in particular ?Many thanks,Pierre
2024-03-01T04:02:15Z
Any update here ?