Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,452

Full-text search

Active filters: llama-cpp

prithivMLmods/Sombrero-QwQ-32B-Elite10-Fixed-Q2_K-GGUF

Text Generation • Updated 4 days ago • 60 • 10

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated 18 days ago • 300 • 4

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3, 2024 • 808 • 65

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • Updated Oct 28, 2024 • 2.17k • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 129 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 29 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 734 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 347 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 1.18k • 2

darwin2025/claude-3.5-sonnet-distill-llama-3.2-1b-lora-F16-GGUF

Updated 22 days ago • 1.56k • 3

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

Updated 20 days ago • 1.56k • 13

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated 24 days ago • 166 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated 18 days ago • 133 • 2

Yuma42/Llama3.1-IgneousIguana-8B-Q4_K_S-GGUF

Updated 4 days ago • 31 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated 2 days ago • 49 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 689 • 4

NikolayKozloff/csmpt7b-Czech-GGUF

Updated Apr 6, 2024 • 82 • 4

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10, 2024 • 46 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 1.61k • 21

DavidAU/Rosa_v1_3B-Q6_K-GGUF

Updated Apr 12, 2024 • 20 • 2

ybelkada/TinyLlama-1.1B-Chat-v1.0-Q4_0-GGUF

Updated Apr 12, 2024 • 49 • 2

DavidAU/SOLAR_Uncensored_Luna_10.7B-Q6_K-GGUF

Updated Apr 13, 2024 • 127 • 2

DavidAU/SOLAR_Uncensored_LimaRP_10.7B-Q6_K-GGUF

Updated Apr 13, 2024 • 30 • 2

DavidAU/bagel-dpo-7b-v0.5-Q6_K-GGUF

Updated Apr 15, 2024 • 12 • 1

DavidAU/Mistral-7B-Erebus-v3-Instruct-32k-Q6_K-GGUF

Updated Apr 16, 2024 • 145 • 2

DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF

Text Generation • Updated Apr 21, 2024 • 552 • 4

Bessa/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 48 • 1

djward888/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 24 • 2

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 27 • 1

hus960/openbuddy-mistral2-7b-v20.3-32k-Q4_K_M-GGUF

Text Generation • Updated Apr 23, 2024 • 23 • 1