Ideal Sampling parameters please

#8
by Narutoouz - opened

Model is nice,
I am getting around 40 tokens/s on m4 max macbook pro.

Here is the pelican riding a bicycle svg
I used oq4e quant mlx community, not as good as qwen's svg, but I am not sure of the sampling parameters.. maybe using that will give better results.

Screenshot 2026-11-21 at 11.50.11 AM

When I put reasoning to max
it took 11 min to generate this SVG
well this is competitive with qwen 3.8 27b.
image
Sampling parameters seems to be
Temp = 1
Top P = 1
reasoning effort = max

Narutoouz changed discussion status to closed
Narutoouz changed discussion status to open
  • Guys anybody know the exact sampling parameters to get best performance for this model on apple silicon?
  • also Tell which mlx quant is loseless and give best results on apple silicon

Sign up or log in to comment