I think the most likely reason that family and friends frequently become targets of aggression is that "they're there", that is, they are present when you come home from work, or when something happens and might just accidentally encounter us in a bad mood.