Answer:
If the ball were thrown from the ground or even landed at an equal height (40m here), then yes, the time would be a 1:1 ratio of flight to fall.
But the ball is thrown from a height of 40m, so it will take longer to hit the ground.
For example, while it may take, say, 3 seconds to go up to its max height and 3 seconds to reach it's original height again, it may take 4 more seconds to finally reach the ground.