He was forced out of the colony.
Roger Williams did not agree with punishing people for breaking the rules of the church. As a result of his argument with church leaders in Plymouth, he was expelled from the colony and went on to establish a new colony in Rhode Island