Well, maybe and maybe not. Sure, he's making life worse for everyone due to his jealousy and his wish to find who the father of Pearl is. On the other hand, she is an adulteress so she hates him because of something that she did to herself. Sure, nowadays adultery is fairly common and nobody cares, but at that point in time it was a big deal and people would even go to jail for it. Even though she did it while she thought he was dead, it was still something taboo as it was not common for women to remarry after their husband would die.