Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

9,578

Full-text search

Active filters: 8-bit

prithivMLmods/OpenMath-8B-GGUF

Text Generation • Updated Nov 30, 2024 • 370 • 7

tiiuae/Falcon3-10B-Instruct-1.58bit

Text Generation • Updated 15 days ago • 189 • 11

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 7.81k • 18

MikeRoz/TheDrummer_Behemoth-123B-v1.1-8.0bpw-h8-exl2

Updated Oct 27, 2024 • 8 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 99 • 18

jasonmcaffee/flan-t5-large-samsum

Text2Text Generation • Updated May 17, 2023 • 19 • 2

rycont/kakaobrain__kogpt-6b-8bit

Text Generation • Updated May 30, 2023 • 37 • 2

Droidfanat/llama-2-7b-custom-russian

Text Generation • Updated Sep 22, 2023 • 155 • 3

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2, 2024 • 50 • 6

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 596 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.69k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 75 • 1

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16, 2024 • 53 • 12

ecastera/eva-mistral-catmacaroni-7b-spanish

Text Generation • Updated Jan 29, 2024 • 18 • 2

MaziyarPanahi/MetaMath-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 132 • 1

Phanh2532/GAMA-Tiny-Code-Generator

Updated Feb 21, 2024 • 20 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 451 • 49

MaziyarPanahi/BioMistral-7B-SLERP-GGUF

Text Generation • Updated Feb 19, 2024 • 115 • 4

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3, 2024 • 22 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 283 • 5

MaziyarPanahi/34b-beta-GGUF

Text Generation • Updated Mar 4, 2024 • 121 • 4

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 152 • 6

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21, 2024 • 9 • 1

Vision-CAIR/MiniGPT4-Video

Updated Jul 24, 2024 • 20 • 30

Volko76/Qwen1.5-0.5B-French

Updated Apr 11, 2024 • 3 • 1

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 2.36M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 30.7k • 125

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 30.7k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 61.6k • 166

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 2.4M • 78