I believe the answer is: Sensory deprivation and a lack of experiences can harm the developing brain.
During the development period, the brain would learn to utilize all available parts of our body to enchance our survival mechanism. In this period, creating a sensory deprivation would trick the brain into thinking that we do not possess those sense in the first place, which would prevent the brain from achieving its true potential.