Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,483

Full-text search

Active filters: 4-bit

Qwen/QwQ-32B-AWQ

Text Generation • Updated 3 days ago • 76.2k • 86

secemp9/TraceBack-12b

Text Generation • Updated about 14 hours ago • 439 • 22

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 7 days ago • 10.2k • 20

mlx-community/QwQ-32B-4bit

Text Generation • Updated 9 days ago • 3.71k • 25

unsloth/gemma-3-27b-it-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 9.49k • 9

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 26 days ago • 43.3k • 71

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 5 days ago • 1.42k • 6

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 169k • 38

mlx-community/DeepSeek-R1-4bit

Updated 16 days ago • 15.6k • 22

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated Jan 30 • 1.22k • 10

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 24k • 24

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 7 days ago • 168k • 40

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 191k • 30

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation • Updated about 22 hours ago • 307 • 3

unsloth/gemma-3-4b-it-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 1.03k • 3

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated 2 days ago • 84k • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.57M • 84

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18, 2024 • 52.5k • 18

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated 15 days ago • 32.2k • 40

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 28 days ago • 353k • 24

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 1.1M • 2

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 5 days ago • 32.9k • 21

FINGU-AI/RomboUltima-32B

Text Generation • Updated Feb 2 • 153 • 3

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 320 • 2

unsloth/Phi-4-mini-instruct-unsloth-bnb-4bit

Text Generation • Updated 12 days ago • 2.87k • 9

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 9 days ago • 168 • 2

ritvik77/Medical_Doctor_AI_LoRA-Mistral-7B-Instruct_FullModel

Text Generation • Updated 4 days ago • 28 • 2

unsloth/gemma-3-12b-it-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 797 • 2

unsloth/gemma-3-1b-it-bnb-4bit

Text Generation • Updated 1 day ago • 603 • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 175 • 219