It is because the metal conducted heat faster than it feels colder than the wood, which conducted heat slower. Even tho they are similar temperatures. The metal will feel colder than the wood because of the thermal conductivity of the metal, compared to the wood.