DiScoFormer
HoldLanguages & Frameworks
A transformer model for estimating both density and score of a data distribution.
Why it's here
Placed in Hold: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 0 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 6Hugging Face Blog·6/29/2026researchDiScoFormer unifies density and score estimation in one transformer
Hugging Face highlights DiScoFormer, a transformer-based model that estimates both a distribution’s density and score from a sample in a single forward pass. The approach uses a shared backbone with separate heads and a consistency loss, and the authors show that attention can reproduce kernel density estimation as a special case while extending it to higher-dimensional settings.