That is because the lords were the owners of the land where they lived. Villages were usually found on land owned by lords who answered to the kings of the entire region. The lords would provide protection from foreign incursions but in return the people would give the lord things like manufactured goods or produce or similar things.