Hugging Face's logo

DongfuJiang
/
Qwen2.5-0.5B-Instruct

Text Generation
Transformers
Safetensors
English
qwen2_chunking
chat
conversational
Inference Endpoints
Model card Files Community
DongfuJiang commited on
Commit
bb28139
·
verified ·
1 Parent(s): 6d4560e

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +2 -2
config.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "architectures": [
3
- "Qwen2ForCausalLM"
4
  ],
5
  "attention_dropout": 0.0,
6
  "bos_token_id": 151643,
@@ -11,7 +11,7 @@
11
  "intermediate_size": 4864,
12
  "max_position_embeddings": 32768,
13
  "max_window_layers": 21,
14
- "model_type": "qwen2",
15
  "num_attention_heads": 14,
16
  "num_hidden_layers": 24,
17
  "num_key_value_heads": 2,
 
1
  {
2
  "architectures": [
3
+ "Qwen2ChunkingForCausalLM"
4
  ],
5
  "attention_dropout": 0.0,
6
  "bos_token_id": 151643,
 
11
  "intermediate_size": 4864,
12
  "max_position_embeddings": 32768,
13
  "max_window_layers": 21,
14
+ "model_type": "qwen2_chunking",
15
  "num_attention_heads": 14,
16
  "num_hidden_layers": 24,
17
  "num_key_value_heads": 2,