Answer:
As long as the water is boiled/purified properly, it is fine to cook with it. But in some cities, the water is not safe as it contains some pollutants and other toxins that could be bad.
I would recommend using a water purifier/filtrating it.