Masked Language Modeling
AssessTechniques
A training method that masks input tokens and trains the model to predict the missing text or sequence pieces.
Why it's here
Placed in Assess: 2 article(s) of evidence from 2 source(s), led by research-stage coverage, with 2 in the last 30 days. Confidence 37%.
Evidence (2)
- 7Hugging Face Blog·7/28/2026model_releaseLiquidAI releases LFM2.5 encoders for fast long-context CPU inference
Hugging Face announced two new encoder models, LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, designed for long-context inference with strong accuracy and low latency on CPU. The models support up to 8,192 tokens, are trained with masked language modeling, and are positioned for use cases such as classification, intent routing, safety filtering, and PII detection.
- 7The New Stack·7/23/2026researchNvidia releases JEPA-DNA genomic foundation model
Nvidia has released JEPA-DNA on Hugging Face, a genomic foundation model that combines masked language modeling with a latent-space predictive objective. Built on DNABERT-2, it is intended for non-commercial research tasks such as feature extraction, linear probing, continual pre-training, and zero-shot scoring of DNA sequence changes.