Testosterone would be your answer to this question.
Just like estrogen is the reason as to why women have more feminine characteristics. It’s because they make more estrogen than a man does.
Men make more testosterone than women, so therefore they will have more masculine features than women.