Answer: Caves are generally formed due to the dissolution of rocks such as limestone, dolomite and gypsum and the area also sometimes shows karst topography.
The area where the caves are found in Florida are mostly limestone. Limestones when comes in contact with water, gets dissolved, thereby produces an underground passage which is commonly termed as caves.
This is the only reason why caves are found to exist in Florida.