Some weights of BertModel were not initialized from the model checkpoint at text_model/German_Semantic_V3b and are newly initialized: ['embeddings.position_embeddings.weight']

#2
by caochengchen - opened

Why does this warning appear?
from sentence_transformers import SentenceTransformer

model = SentenceTransformer("aari1995/German_Semantic_V3b", trust_remote_code=True)

sentences = [
"Ein Mann übt Boxen",
"Ein Affe praktiziert Kampfsportarten.",
"Eine Person faltet ein Blatt Papier.",
"Eine Frau geht mit ihrem Hund spazieren."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)

[4, 4]

Hi - feel free to ignore.
So generally it is because those are replaced by Alibi (and therefore are not used).

All the best

aari1995 changed discussion status to closed

Sign up or log in to comment