3 contributors

History: 21 commits

yangapku

update batch inference

33ae36b over 1 year ago

assets
update modeling_qwen.py over 1 year ago
examples
update react_prompt.md over 1 year ago
.gitattributes

1.52 kB

update model over 1 year ago
LICENSE

6.9 kB

update batch infer over 1 year ago
NOTICE

2.7 kB

update batch infer over 1 year ago
README.md

32.9 kB

Update README.md over 1 year ago
cache_autogptq_cuda_256.cpp

8.4 kB

update kernels over 1 year ago
cache_autogptq_cuda_kernel_256.cu

52 kB

update kernels over 1 year ago
config.json

910 Bytes

update model over 1 year ago
configuration_qwen.py

2.35 kB

softmax_in_fp32 over 1 year ago
cpp_kernels.py

1.92 kB

update kernels over 1 year ago
generation_config.json

249 Bytes

update default generate hyperparams over 1 year ago
model-00001-of-00008.safetensors

1.96 GB
LFS

update model over 1 year ago
model-00002-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00003-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00004-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00005-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00006-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00007-of-00008.safetensors

2.02 GB
LFS

update model over 1 year ago
model-00008-of-00008.safetensors

1.33 GB
LFS

update model over 1 year ago
model.safetensors.index.json

19.5 kB

update model over 1 year ago
modeling_qwen.py

57.6 kB

update batch inference over 1 year ago
qwen.tiktoken

2.56 MB

update model over 1 year ago
qwen_generation_utils.py

14.6 kB

update model over 1 year ago
tokenization_qwen.py

9.62 kB

update tokenization.py over 1 year ago
tokenizer_config.json

173 Bytes

format over 1 year ago