maybe he had issues with his father growing up? and so his perspective on men may be that somewhere in the back of his head he'll remember the issue that he had with his father
example: if the characters dad abandoned him, then maybe that character thinks of all men as abanders, & men who might be just like his dad,