The rock dwelling lizards would lose their hiding/refuge places from other prey and also for shade from the intense sun so their prey would be able to capture them easily which could result in over eating of them and then their decimation and resultant loss of sustainable food for the prey thus resulting in dying off of the prey as well or migration to other areas where the rocks still existed and the lizards.