Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,203

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 12 days ago • 652k • • 1.31k

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 10.9k • 334

NANI-Nithin/K2-Horizon-MoVA-36B-A4B-GGUF

Text Generation • 37B • Updated 8 days ago • 33.9k • 25

SC117/Spark-X2.5-4B-abliterated-FIT-GGUF

Text Generation • 4B • Updated 6 days ago • 15.3k • 14

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 450k • 849

TokenRhythm/NeoHorse-1-9B-GGUF

Text Generation • 9B • Updated 4 days ago • 4.43k • 10

Jab1718/qwen3.8-flash-coder-26gb-gguf

Text Generation • 43B • Updated 1 day ago • 3.46k • 10

TokenRhythm/NeoHorse-1-4B-GGUF

Text Generation • 4B • Updated 3 days ago • 3.66k • 8

chenyumo/moziAI-35B-A3B-MOE-MTP

Text Generation • 36B • Updated 3 days ago • 17.3k • 16

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 44.8k • 181

SC117/Qwen3.8-27B-Uncensored-FIT-GGUF

Text Generation • 27B • Updated 14 days ago • 11k • 16

jan1k/Qwen3.6-35B-A3B-Uncensored-Genesis-Final-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated 7 days ago • 1.64k • 5

prithivMLmods/OxCoder-9B-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 5.07k • 5

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 2.26k • 63

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 125k • 781

apto-as/Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Nov 10, 2024 • 411 • 3

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.19k • 343

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 25.8k • 152

prithivMLmods/Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 27 days ago • 24.3k • 5

Jackrong/Qwen-Tool-Calling-Template-Fix

Text Generation • Updated 20 days ago • 1 • 18

UltimateIntent/Gemory-26B-A4B-GGUF

Text Generation • 25B • Updated 6 days ago • 17.7k • 23

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 9.67k • 10

maerong3/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated Aug 6, 2025 • 15.5k • 6

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 318 • 32

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 23.6k • 60

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.91k • 77

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 9.7k • 21

ISTA-DASLab/Qwen3.5-4B-GGUF-GSQ

Text Generation • 4B • Updated May 26 • 818 • 5

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 7.78k • 29

Verdugie/Fable-Therapy-9B

Text Generation • 9B • Updated Aug 5 • 658 • 7