Hugging Face's logo
Xuan-Son Nguyen's picture
51 56 32

Xuan-Son Nguyen

ngxson
asmodun's profile picture RobinsAIWorld's profile picture AthulSathyapal's profile picture
·
https://blog.ngxson.com

AI & ML interests

Doing AI for fun, not for profit

Recent Activity

updated a model about 6 hours ago
ngxson/gemma-3-4b-pt-Q4_0-GGUF
published a model about 6 hours ago
ngxson/gemma-3-4b-pt-Q4_0-GGUF
new activity about 20 hours ago
ggml-org/gguf-my-repo:URGENT: CVE's/vulns Present, Update Dependencies
View all activity

Organizations

Hugging Face's profile picture Blog-explorers's profile picture Hugging Face TB Research's profile picture ggml.ai's profile picture Hugging Face Discord Community's profile picture Consumer AI Edge Hackathon (Meta, Hugging Face, Pytorch, Scaleway & Unaite)'s profile picture Mistral AI Game Jam's profile picture gg-hf-g's profile picture

Posts 4

view post
Post
3012
A comprehensive matrix for which format should you use.

Read more on my blog post: https://huggingface.co./blog/ngxson/common-ai-model-formats

| Hardware        | GGUF      | PyTorch                | Safetensors              | ONNX  |
|-----------------|-----------|------------------------|--------------------------|-------|
| CPU             | ✅ (best) | 🟡                      | 🟡                       | ✅    |
| GPU             | ✅        | ✅                      | ✅                       | ✅    |
| Mobile          | ✅        | 🟡 (via executorch)     | ❌                       | ✅    |
| Apple silicon   | ✅        | 🟡                      | ✅ (via MLX framework)   | ✅    |
View all Posts

Articles 4

Article
30

Common AI Model Formats

View all Articles

Collections 3

Papers 1