He thinks the women's loud conversation is distracting his crew from their work and thereby endangering the ship. He's helping the women escape from slavery, and if he were caught, he would be severely punished. He's afraid that another ship he's seen is about to hit his ship.