Serfs/Peasants would live on the protected land of the lord's manor in exchange for food and goods. The serfs/peasants basically fueled the manor and created self sufficiency, to the point where some lords even forbade Serfs/Peasants to leave their estate.
Hope this helped you