Diverse + Multi ethnic = Hard to unify
Diverse and multi ethnic groups tend to run on a different structural value which make them also have several different interests that may contradict each other. This different interest make the groups more prone to conflicts so it became harder for the empire to unify