luke (entity-aware, self-supervised learning for language understanding)

This model incorporates an entity embedding matrix in addition to the token embedding matrix, thus providing entity-level understanding.