Because the pole absorbs the heat quite readily, literally sucking the warmth from your tongue faster than your body can supply it. The saliva on your tongue then freezes (provided it is below freezing), with the resulting ice latching onto the flagpole and your very porous tongue.
Hope that helps you w/ ur question:)