Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

4-bit precision

Inference Endpoints

Mixture of Experts

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

561

Full-text search

Active filters: AWQ

xDAN-AI/xDAN-L1-Chat-RL-v1-awq

Text Generation • Updated Dec 25, 2023

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • Updated Mar 2, 2024 • 47 • 1

solidrust/WestLake-7B-v2-AWQ

Text Generation • Updated Feb 29, 2024 • 19 • 4

solidrust/WestLake-7B-v2-laser-AWQ

Text Generation • Updated Feb 27, 2024 • 19 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Feb 9, 2024 • 27 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Feb 9, 2024 • 28 • 1

MaziyarPanahi/Smaug-72B-v0.1-AWQ

Text Generation • Updated Feb 29, 2024 • 28 • 3

MaziyarPanahi/WizardLM-70B-V1.0-AWQ

Text Generation • Updated Feb 10, 2024 • 27 • 1

MaziyarPanahi/LongAlign-13B-64k-AWQ

Text Generation • Updated Feb 11, 2024 • 27 • 2

MaziyarPanahi/samantha-1.1-westlake-7b-AWQ

Text Generation • Updated Feb 13, 2024 • 27

ONS-AI-RESEARCH/ONS-SOLAR-10.7B-AWQ

Text Generation • Updated Feb 15, 2024 • 15

solidrust/samantha-1.1-westlake-7b-laser-AWQ

Text Generation • Updated Sep 3, 2024 • 17 • 1

solidrust/dolphin-2.6-mistral-7b-dpo-laser-AWQ

Text Generation • Updated Sep 3, 2024 • 18 • 2

bigquant/Senku-70B-AWQ-4bit-GEMM

Text Generation • Updated Feb 20, 2024 • 13 • 1

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 27 • 7

solidrust/bagel-dpo-7b-v0.4-AWQ

Text Generation • Updated Sep 3, 2024 • 16

solidrust/bagel-7b-v0.4-AWQ

Text Generation • Updated Sep 3, 2024 • 16

solidrust/Senzu-7B-v0.1-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 18 • 1

solidrust/Senzu-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 19 • 1

solidrust/Neural-Story-7B-instruct-v0.2-AWQ

Text Generation • Updated Sep 3, 2024 • 15

solidrust/Ignis-7B-DPO-Laser-AWQ

Text Generation • Updated Sep 3, 2024 • 16

solidrust/Ignis-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 16

solidrust/Tiger-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 25

solidrust/Aeryth-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 15

solidrust/Panda-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 12

solidrust/Gecko-7B-v0.1-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 14

solidrust/Valor-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024

solidrust/Tanuki-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 14

solidrust/Gecko-7B-v0.1-AWQ

Text Generation • Updated Sep 3, 2024 • 14

solidrust/samantha-1.1-westlake-7b-AWQ

Text Generation • Updated Feb 29, 2024 • 15