I think you meant "growing" too large?
And, no, food isn't the only factor.
Recently for example available education plays an important role: people often decide not to have more children to provide a better (costly) education to the ones they have already.