-
-
-
-
-
-
Inference status
Active filters:
web-llm
mlc-ai/Mistral-7B-Instruct-v0.2-q3f16_1-MLC
Updated
•
28
•
4
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f16_1-MLC
Updated
•
286
•
1
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f32_1-MLC
Updated
•
2.75k
•
1
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f16-MLC
Updated
•
13
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f32-MLC
mlc-ai/phi-1_5-q0f32-MLC
mlc-ai/phi-1_5-q4f32_1-MLC
Updated
•
100
•
1
mlc-ai/phi-2-q0f32-MLC
mlc-ai/phi-2-q4f32_1-MLC
Updated
•
79
•
1
mlc-ai/NeuralHermes-2.5-Mistral-7B-q3f16_1-MLC
mlc-ai/Qwen-7B-Chat-q4f16_1-MLC
Updated
•
10
•
2
mlc-ai/Qwen-7B-Chat-q4f32_1-MLC
mlc-ai/Qwen-1_8B-Chat-q4f16_1-MLC
Updated
•
15
•
1
mlc-ai/Qwen-1_8B-Chat-q4f32_1-MLC
Updated
•
7
•
1
mlc-ai/Qwen-14B-Chat-q4f32_1-MLC
Updated
•
12
mlc-ai/CodeLlama-7b-hf-q4f16_1-MLC
Updated
•
18
mlc-ai/CodeLlama-7b-hf-q4f32_1-MLC
mlc-ai/CodeLlama-13b-hf-q4f16_1-MLC
mlc-ai/CodeLlama-13b-hf-q4f32_1-MLC
mlc-ai/CodeLlama-34b-hf-q4f16_1-MLC
mlc-ai/CodeLlama-34b-hf-q4f32_1-MLC
mlc-ai/CodeLlama-7b-Instruct-hf-q4f16_1-MLC
Updated
•
11
mlc-ai/CodeLlama-7b-Instruct-hf-q4f32_1-MLC
mlc-ai/CodeLlama-13b-Instruct-hf-q4f16_1-MLC
mlc-ai/CodeLlama-13b-Instruct-hf-q4f32_1-MLC
mlc-ai/CodeLlama-34b-Instruct-hf-q4f16_1-MLC
mlc-ai/CodeLlama-34b-Instruct-hf-q4f32_1-MLC
mlc-ai/CodeLlama-7b-Python-hf-q4f16_1-MLC
mlc-ai/CodeLlama-7b-Python-hf-q4f32_1-MLC
mlc-ai/CodeLlama-13b-Python-hf-q4f16_1-MLC
Updated
•
12