Fermi level determines charge carrier population according to the integral over density of states times Fermi Dirac distribution. Therefore, saying that the position of Fermi level is higher (lower), relative to middle of band gap, is just the mathematical description of saying you have more electrons (holes), relative to the intrinsic state, in the system. Dopants in the system increase the concentration of electrons or holes.