Answer:
From the warm glove to your cold hand
Heat from the glove will be transferred to your cold hand which had less heat. Heat does NOT like gradients, so it will flow from where there is more heat to where there is less until the heat across the surface is even.