Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

25,367

Full-text search

Active filters: 8-bit

meituan/DeepSeek-R1-Block-INT8

Text Generation • Updated 15 days ago • 3.69k • 33

mlx-community/QwQ-32B-8bit

Text Generation • Updated 9 days ago • 1.98k • 11

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated 2 days ago • 84k • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.57M • 84

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 1.52k • 173

mlx-community/DeepSeek-R1-Distill-Qwen-32B-MLX-8Bit

Updated 16 days ago • 348k • 12

mlx-community/Qwen2.5-7B-Instruct-1M-8bit

Text Generation • Updated Jan 26 • 230 • 3

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 1.1M • 2

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-8bit

Text Generation • Updated Feb 3 • 293 • 2

neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated 15 days ago • 3.76k • 7

mlx-community/Phi-4-mini-instruct-8bit

Text Generation • Updated 9 days ago • 960 • 2

Undi95/QwQ-RP-LoRA

Updated 7 days ago • 13 • 2

mlx-community/qwq-bakeneko-32b-8bit

Text Generation • Updated 1 day ago • 18 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 252 • 20

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 206 • 27

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 29 • 1

Qwen/Qwen-7B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 387 • 8

Qwen/Qwen-14B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 107 • 6

Qwen/Qwen-1_8B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 247 • 5

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4, 2024 • 29 • 17

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 896 • 2

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 1k • 1

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 90 • 7

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 148 • 26

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 115 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 133 • 2

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 270 • 4

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 320 • 9

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 972 • 52

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 319 • 3