Helmer's self esteem depends on the people believe that he is not influenced by his wife.
Step-by-step explanation:
He says to his wife that he will not listen to her decisions as he doesn't want people to think that he is under his wife's influence. He says it will be hard for him to deal with people in his office if they get to know that he let's his wife take decisions.
He wants to show other that he has the authority. This is the good example of male chauvinism in the society and how women are not taken seriously in any aspect.