Yes they do. The belly button is the scar left by an umbilical cord, and dogs, like most mammals are born with umbilical cords. When dogs are born, their cords are still attached to the placenta, and the mother chews it off and usually eats it. Which is really gross.