Quantization Compiler Cuts Gemma 4 E2B KL 12x
LookAtMyQuant 2 assigns each part of a model its own compression code. On Gemma 4 E2B it gets 12 times lower KL than Q4_K_M at the same file size.
LookAtMyQuant 2 assigns each part of a model its own compression code. On Gemma 4 E2B it gets 12 times lower KL than Q4_K_M at the same file size.