mpnet (masked and permuted pre-training network)

This is a new pre-training method that combines the advantages of both autoregressive and autoencoding methods.