According to the speaker the most like cause for the trees to blow down is because of the ice storm. He intends to imagine that some boys might have done that but then he realises it is impossible because swinging does not leave the branches like that.