That is because the size determines the structure social relations will take. The more people there are the more various structures can be made, and vice versa. People have their roles in the society and stick to them or don't stick to them, either way, people are social beings and don't exist outside of a society.