Produce similar embeddings to another model with BERT
I have a dataset in the form(input_text, embedding_of_input_text), whereembedding_of_input_textis an embedding of dimension 512 produced by another model (DistilBERT) when given as inputinput_text.I would like to fine-tuneBERTon this dataset such that it learns to produce similar embeddings (i.e. a kind of mimicking).Furthermore, by default BERT returns embeddings of dimension 768, while hereembedding_of_input_textare embeddings of dimension 512.Which is the correct way to to that within the HuggingFace library?