NVFP4 in MLX: the converter loses quality
Key takeaways
NVFP4 is a TWO-LEVEL format. mlx-lm never sets the second level: global_scale appears zero times in mlx_lm and zero times in mlx.nn.
That one unset parameter costs 2.31% perplexity, and
leanzero.hashnode.dev9 min read