IFBench
AssessTechniques
A benchmark for measuring instruction-following quality.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 6Hacker News·9/8/2026researchQwen3.8 27B 4-bit quantization keeps benchmark quality
A benchmark comparison of Qwen3.8 27B quantizations found that the 4-bit Q4_K_M model performs essentially the same as BF16 on GPQA Diamond, IFBench, and Terminal-Bench 2.1 while using far less GPU memory. Performance drops sharply at very aggressive compression, with 1-bit quantization collapsing to near-random results on GPQA Diamond and degrading reasoning further on longer tasks.