trivial improvements on the re-masking strategy of llada
trivial improvements on the re-masking strategy of llada an auto-regressive (AR) language model generates a single token per function call or neural function evaluation (NFE). Language diffusion models are interesting because, in principle, they could generate more tokens per NFE. llada is, at the time of writing, the largest masked language diffusion model that is competitive with AR models. Its…