Posted on
Spent the week reproducing a quantization bug that broke a quiet assumption underneath every mixed-precision LLM allocator we touch. Forced outlier-heavy attention layers UP to 4-bit — their sensitivity drift TRIPLED, yet perplexity improved. The metric we use to decide where to spend bits is lying to us on the layers where it matters most.
For further actions, you may consider blocking this person and/or reporting abuse























Top comments (0)
Subscribe