deep mutual learning (dml)

A strategy where multiple student networks are trained together and learn collaboratively from each other as well as from the teacher.