int4 quantization
AssessTechniques
A 4-bit quantization method used to reduce model memory usage.
Why it's here
Placed in Assess: 2 article(s) of evidence from 2 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 40%.
Evidence (2)
- 7Hacker News·8/3/2026researchCloudflare scales Kimi and GLM with KV cache quantization and weight compression
Cloudflare says it is serving Moonshot's Kimi K-series and Z.ai's GLM more efficiently on Workers AI by combining KV cache quantization, weight compression, and cache protection techniques. The company reports that FP8 KV cache and INT4 weights cut GPU memory use and lower costs while preserving model accuracy, using SGLang as the serving framework.
- 6Hacker News·7/9/2026open_sourceColibrì runs GLM 5.2 on a slow laptop by streaming MoE experts from disk
A Hacker News post introduces Colibrì, a single-file C engine designed to run the GLM 5.2 mixture-of-experts model on modest hardware. The author says the system keeps the dense model parts in RAM at int4 precision and streams routed experts from disk, enabling use on a 32 GB laptop without running out of memory.