mgoin/Qwen3-4B-speculator.dflash2
1B • Updated • 216 • 2
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated a model 1 day ago
vllm-project/Kimi-K3.1-Pro-pruned75 published a model 1 day ago
vllm-project/Kimi-K3.1-Pro-pruned75 updated a model 23 days ago
nm-testing/Qwen3.8-27B-MXFP6A8Organizations
mgoin/Qwen3.8-2.4T-A95B-NVFP4-pruned75
Text Generation • 349B • Updated • 50 • 1
mgoin/Qwen3.8-2.4T-A95B-NVFP4-pruned94
Text Generation • 124B • Updated • 26
mgoin/Kimi-K3-pruned75
Image-Text-to-Text • 737B • Updated • 296 • 2
mgoin/GLM-5.2-speculator.dspark-preview
Text Generation • 4B • Updated • 193 • 61
mgoin/GLM-5.2-speculator.dspark-block16
Text Generation • 4B • Updated • 76 • 2
mgoin/Qwen3-8B-speculator.dspark-reasoning
Text Generation • 2B • Updated • 70
mgoin/Qwen3-8B-speculator.dflash
Text Generation • 2B • Updated • 53
mgoin/Qwen3-8B-speculator.dspark
Text Generation • 2B • Updated • 152
mgoin/Qwen3.6-35B-A3B-2Bit-GSQ-ct
Image-Text-to-Text • 35B • Updated • 21
mgoin/Qwen3-0.6B-MXFP8
0.6B • Updated • 562
mgoin/GLM-4.6-FP8-BLOCK
Text Generation • 357B • Updated • 19
mgoin/Qwen3-0.6B-NVFP4
0.6B • Updated • 142
mgoin/mlperf-inference-llama3.1-8b-data
Updated
mgoin/Llama-3.1-8B-Instruct-FP8-BLOCK
8B • Updated • 19
mgoin/SEMIKONG-70B-W4A16-G128
71B • Updated • 9
mgoin/llama-4-tiny-random
Text Generation • 6.69M • Updated • 23
mgoin/Qwen1.5-14B-Chat-GPTQ
Text Generation • Updated • 2
mgoin/pixtral-12b
Image-Text-to-Text • 13B • Updated • 155 • 1
mgoin/Llama-3.2-1B-Instruct-FP8-ATTN
1B • Updated • 24
mgoin/Llama-3.2-1B-Instruct-FP8-dynamic-ATTN
1B • Updated • 24
mgoin/Pixtral-Large-Instruct-2411
Updated
mgoin/Qwen2.5-Coder-32B-Instruct-fp8
Updated
mgoin/nemotron-3-8b-chat-4k-sft-hf
Text Generation • 9B • Updated • 34
mgoin/llava-onevision-qwen2-7b-ov-hf-bnb-full-4bit
Image-Text-to-Text • 8B • Updated • 31
mgoin/MiniCPM-Llama3-V-2_5-int4
Visual Question Answering • 9B • Updated • 8
mgoin/DeepSeek-Coder-V2-Lite-Instruct-FP8
16B • Updated • 38
mgoin/Mixtral-8x7B-Instruct-v0.1-FP8
47B • Updated • 6
mgoin/Nemotron-nemo-checkpoints
Updated
mgoin/Minitron-4B-Base-FP8
Text Generation • 4B • Updated • 19 • 3