the one that presented the biggest obstacle to the workers who built the panama Canal is : Mosquitoes and Tropical diseases.
Back then, we still haven't developed an efficient method to deal with Malaria. A lot of workers that worked to built panama Canal got infected with Malaria and slowed down the Canal's develpment
hope this helps