From what I remember, Hitler was a dictator. This means that he wasn't an ordinary leader - he was a powerful one. He went with what he wanted. They probably couldn't attack him without the right weapons. They needed to prepare themselves for a powerful war.