Dimensions in hkunlp/instructor-large
Hi anyone knows how many dimensions does a vector have in instruct-large?
2023-08-18T11:47:03Z
768I couldn’t find this answer online and Bing hallucinated one. So I just downloaded the model and ran it from langchain. Here are all the details:HuggingFaceInstructEmbeddings(client=INSTRUCTOR((0): Transformer({‘max_seq_length’: 512, ‘do_lower_case’: False}) with Transformer model: T5EncoderModel(1): Pooling({‘word_embedding_dimension’: 768, ‘pooling_mode_cls_token’: False, ‘pooling_mode_mean_tokens’: True, ‘pooling_mode_max_tokens’: False, ‘pooling_mode_mean_sqrt_len_tokens’: False, ‘pooling_mode_weightedmean_tokens’: False, ‘pooling_mode_lasttoken’: False})(2): Dense({‘in_features’: 1024, ‘out_features’: 768, ‘bias’: False, ‘activation_function’: ‘torch.nn.modules.linear.Identity’})(3): Normalize()), model_name=‘hkunlp/instructor-large’, cache_folder=None, model_kwargs={}, encode_kwargs={}, embed_instruction='Test query: ', query_instruction='Test query: ')