neural mutual information estimation in masked sequence models
a neural estimator learns pairwise conditional mutual information from pretrained masked diffusion models, enabling faster parallel decoding by identifying independent variable subsets.
ai