People that tend to have the lowest self esteem are most normally bullied, unloved, have no attention, no friends, and no one there for them.
Now dont think thats its only these people, several wealthy kids have low self esteem, adults have low self esteem, and so on.