Mask-Predict: Parallel Decoding of Conditional Masked Language Models — mentioned by jaaustin

Mon, 20 Oct 2025 15:19:18 GMT

To my knowledge this connection was first noted in 2021 in https://arxiv.org/abs/2107.03006 (page 5). We wanted to do text diffusion where you’d corrupt words to semantically similar words (like “quick brown fox” -> “speedy black dog”) but kept finding that masking was easier for the model to uncover. Historically this goes back even further to https://arxiv.org/abs/1904.09324, which made a generative MLM without framing it in diffusion math.

Paper and discussion history. A mention is not an endorsement.

Mask-Predict: Parallel Decoding of Conditional Masked Language Models — HN submission

Thu, 05 Sep 2019 13:30:18 GMT

Mask-Predict: Parallel Decoding of Conditional Masked Language Models

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Mask-Predict: Parallel Decoding of Conditional Masked Language Models · HackerPapers discussions

Mask-Predict: Parallel Decoding of Conditional Masked Language Models — mentioned by jaaustin

Mask-Predict: Parallel Decoding of Conditional Masked Language Models — HN submission