Hugging Face's logo

numen-tech
/
Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation
MLC-LLM
English
code
codeqwen
chat
qwen
qwen-coder
conversational
4-bit precision
Model card Files Community
numen-tech commited on
Commit
865c1e7
·
1 Parent(s): d427ffb

Add weights

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +15 -0
  2. config.json +5 -0
  3. merges.txt +0 -0
  4. ndarray-cache.json +0 -0
  5. params_shard_0.bin +3 -0
  6. params_shard_1.bin +3 -0
  7. params_shard_10.bin +3 -0
  8. params_shard_100.bin +3 -0
  9. params_shard_101.bin +3 -0
  10. params_shard_102.bin +3 -0
  11. params_shard_103.bin +3 -0
  12. params_shard_104.bin +3 -0
  13. params_shard_105.bin +3 -0
  14. params_shard_106.bin +3 -0
  15. params_shard_107.bin +3 -0
  16. params_shard_108.bin +3 -0
  17. params_shard_109.bin +3 -0
  18. params_shard_11.bin +3 -0
  19. params_shard_110.bin +3 -0
  20. params_shard_111.bin +3 -0
  21. params_shard_112.bin +3 -0
  22. params_shard_113.bin +3 -0
  23. params_shard_114.bin +3 -0
  24. params_shard_115.bin +3 -0
  25. params_shard_116.bin +3 -0
  26. params_shard_117.bin +3 -0
  27. params_shard_118.bin +3 -0
  28. params_shard_119.bin +3 -0
  29. params_shard_12.bin +3 -0
  30. params_shard_120.bin +3 -0
  31. params_shard_121.bin +3 -0
  32. params_shard_122.bin +3 -0
  33. params_shard_123.bin +3 -0
  34. params_shard_124.bin +3 -0
  35. params_shard_125.bin +3 -0
  36. params_shard_126.bin +3 -0
  37. params_shard_127.bin +3 -0
  38. params_shard_128.bin +3 -0
  39. params_shard_129.bin +3 -0
  40. params_shard_13.bin +3 -0
  41. params_shard_130.bin +3 -0
  42. params_shard_131.bin +3 -0
  43. params_shard_132.bin +3 -0
  44. params_shard_133.bin +3 -0
  45. params_shard_134.bin +3 -0
  46. params_shard_135.bin +3 -0
  47. params_shard_136.bin +3 -0
  48. params_shard_137.bin +3 -0
  49. params_shard_138.bin +3 -0
  50. params_shard_139.bin +3 -0
README.md CHANGED
@@ -1,3 +1,18 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
1
  ---
2
  license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4/blob/main/LICENSE
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - code
9
+ - codeqwen
10
+ - chat
11
+ - qwen
12
+ - qwen-coder
13
+ base_model: Qwen/Qwen2.5-Coder-32B-Instruct
14
+ base_model_relation: quantized
15
+ library_name: mlc-llm
16
  ---
17
+
18
+ 4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) for use with the [Private LLM app](https://privatellm.app/).
config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "quantization_config": {
3
+ "bits": 4
4
+ }
5
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18460e741bab5f49dbeddf4b9a619ea5d1545c1afce6b11072868819d2462bf1
3
+ size 389283840
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04dc53f5770cb14796ba46d791f8ef9de203f26cfd2765124f75b884fe39ac4c
3
+ size 70778880
params_shard_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7dbcb9fe034880e535445876ffe261918b0e8a67037f6ea7b225c440ec986be2
3
+ size 18350080
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:049e64cabf687db2519f0f913206413215f2dc0160d0687bc4d33955b4adc7dc
3
+ size 70778880
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e43e97610c59819d2e12e85c5c5e2251cd208f7d02eec5cc73c70ee0aba6f01
3
+ size 141557760
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99ff7c004d3fd88452bd4ef70d586f056ca618e8ca45a8b9293eff16fd528888
3
+ size 18350080
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0478015dd4c9adb1d5e9d59730206069962372a19d2d130a7dec37e446fb70ee
3
+ size 20760576
params_shard_104.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5432cbcac0f7541294a3a1c2be37850762829c39c9d0d8e9aaeb0e7d4a7a9714
3
+ size 70778880
params_shard_105.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c73306170a6c8b55a6f14709c902e5d03ffd1e3208b8debf51a681fa8f47056
3
+ size 141557760
params_shard_106.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69299c0040e7fe86a6af8bded7180395211b66c284cac9a6d085bffe0b04ee4e
3
+ size 18350080
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27a02fe22c6ada19d0b65d1a2d0793b09d6c6981f0e631f7b7008680e26c4712
3
+ size 20760576
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10635a164ddf95581eee4409bc44eed3b41bc5b7f2ccd8b7f891fd3e4b6e0d15
3
+ size 70778880
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc84462394d689ff629f32497dfea19f26683a5aaf1edaaa5674be4cb832de9c
3
+ size 141557760
params_shard_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2464d59bd09acbae48f7f6bcd05eaf1aad9bb36fe3f4b50fb5da1aa1f06a9b29
3
+ size 20760576
params_shard_110.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7fbe8a66a7ddd24bf91228471c107f7f5ced9378f566f5b40cb37be0d941b8f
3
+ size 18350080
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e4061462735f63710b7fe1f3be6e1c1497b4581249486d9b287b5c7ac8f33c8
3
+ size 20760576
params_shard_112.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c7d76b1f337d3e7fbeaace855e21646d61cfab9a8da242a423e948238a6e135
3
+ size 141557760
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e946965d7f61ed2215bbf6143530a931931e646e7203a43f3aa7badf02819de
3
+ size 18350080
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e229218283b1f9a5060b9f2ec3aa39dedb76ffe63ad7f1f8751d209479014dd1
3
+ size 70778880
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37e6eeb6333174c2bf479c74a912c5bc36a6827c3ef3b3649340f3bbf700823b
3
+ size 32055296
params_shard_116.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f21be6c80d40a35cac6ff5538b4014c3e1993b9ae88d3e0fa356b52d7b55721d
3
+ size 70778880
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d42c4adf8fb32b1bb6fb4a052e37e09d4e0169d07ee741cbf963945968f07870
3
+ size 141557760
params_shard_118.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee5a1c4cbdda0bfab44ad119d68caafbf9066d7f45addbd18a42a7fd6a8f6846
3
+ size 27815936
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a578f4da1783be21135c2e3d3d1d4f47e7119b1eb8f1f98768318556e856b04
3
+ size 70778880
params_shard_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b359e975e2be390c6bb665d48c5dc9afc0c0988640aad161a28ff16da8fc421
3
+ size 70778880
params_shard_120.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:156c0c5cc000f4f6156cc88f199804b34c1e4257f04a2d567bb62e7e358842ac
3
+ size 141557760
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae3c95a9b5e1e2c9fbc71fdd294a60e7a3a8b3c31162ea2179acfb0cd9d8cea4
3
+ size 18350080
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adf41e9191d97f76bbea26f27141a109f19205f8751eecd97f7c7daed3e62879
3
+ size 20760576
params_shard_123.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9068d5b8e00cf484cab05c5117b8123dea0e8baad0466e9ae43fe0f5fbb8c90
3
+ size 70778880
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05cefcbd715f319ef0821a0d26cfc5e2ce7a03034896aaa2e64de347e2d972fb
3
+ size 141557760
params_shard_125.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b005d08f92c560399e130c65c1dab598b0129414aa450e10b9b9e977563bde0
3
+ size 18350080
params_shard_126.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b845c47c1fba9efaf6cf4b72f5d7bdf220b47e7377fb7aa7951146011eabbc0a
3
+ size 20760576
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da76908fbce0746afd0207ffca95107eaf81ba8f97fab1a51271ec11963a9a6c
3
+ size 70778880
params_shard_128.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c210aa14bbefb096ab895159911eaec00a22dc42789ae460662fdba340a28cf
3
+ size 141557760
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a77997c81863f3ee7325a2d6633ef4132ea3511ac1afe87182fab2b6ba079c3d
3
+ size 18350080
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fb49b768c8194f5d07b1ff8e94c6766292e075e0b557b11a4116df9931936d6
3
+ size 141557760
params_shard_130.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b802c439e20263e043cc7d53b65aebec795aca5423fac834115cbd84b8f9d23
3
+ size 20760576
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76cdf248d48e7289d2a584a9d16108d3af2b484a10b17dadbd0046df95c5c0b3
3
+ size 32454656
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c175e51f2e0b723905d8e00d6fa040f4b64eb865f362b10038489481be36dd5
3
+ size 70778880
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4ce7b51198e24a2691d87e4cee629074e049a305828b75b968395254cecd184
3
+ size 70778880
params_shard_134.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba38537bd77bf6fbcbde3b876829015286e5bd7f968e1ddf1f68aeeef3669413
3
+ size 141557760
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:537b73c50ccc8a336868d510d7321bceda06d13b01f5d2e88b218281b524b6c8
3
+ size 18350080
params_shard_136.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:296078b923cfa6f32819298cdf106b6b4c110bf3d3006614724c14085b7bf458
3
+ size 22992896
params_shard_137.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e1d15c56fd891ab27edf6d4f618166e2ac148a6a73a43e56f8ebba1f475e19c
3
+ size 70778880
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffe872bce3ccf36d803daa3f975c876b6d0d02fc262c4b0e5d82c32b9e546030
3
+ size 141557760
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7a5d749f5af39e4c7d02f00b9a41f414386b2b735bb464e7d0b12bc1ddcd6ab
3
+ size 18350080