MLX Quantisations for Qwen 3.8 2B
🏗️ Building on HF
Siddh Jagani
SiddhJagani
AI & ML interests
Building local AI systems, LLM tools, RAG infrastructure, and MLX model deployments.
Recent Activity
liked a model 6 days ago
Cactus-Compute/whistle liked a model 7 days ago
neuphonic/neudecide liked a model 10 days ago
FermionResearch/Phonon-2Organizations
MLX Quantisations for Qwen 3.8 9B
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 23 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 19 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 25 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 18
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 198 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 44 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 35 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 30
MLX Quantisations for Qwen 3.8 4B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 30 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 26 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 29
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 46 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 55 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 71
MLX Quantisations for Qwen 3.8 2B
MLX Quantisations for Qwen 3.8 4B
MLX Quantisations for Qwen 3.8 9B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 30 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 26 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 29
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 23 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 19 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 25 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 18
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 46 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 55 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 71
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 198 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 44 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 35 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 30