Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
PowerInfer
Inference Endpoints
Misc with no match
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
19
Full-text search
Edit filters
Sort: Trending
Active filters:
PowerInfer
Clear all
PowerInfer/ReluLLaMA-7B-Predictor
Updated
Dec 18, 2023
•
5
PowerInfer/ReluLLaMA-13B-Predictor
Updated
Dec 18, 2023
PowerInfer/ReluFalcon-40B-Predictor
Updated
Dec 18, 2023
roleplaiapp/SmallThinker-3B-Preview-Q2_K-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q3_K_M-GGUF
Text Generation
•
Updated
1 day ago
•
18
roleplaiapp/SmallThinker-3B-Preview-Q3_K_L-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q4_0-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q4_K_S-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation
•
Updated
1 day ago
roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF
Text Generation
•
Updated
1 day ago
•
18
roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF
Text Generation
•
Updated
1 day ago
•
18
roleplaiapp/SmallThinker-3B-Preview-IQ3_M-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-IQ3_XXS-GGUF
Text Generation
•
Updated
1 day ago
•
17
roleplaiapp/SmallThinker-3B-Preview-IQ4_NL-GGUF
Text Generation
•
Updated
1 day ago
•
18
roleplaiapp/SmallThinker-3B-Preview-IQ4_XS-GGUF
Text Generation
•
Updated
1 day ago
•
17