The reason wearing multiple thin layers will keep you warmer than a single thicker layer is because warm air is trapped between the layers acting as an insulator. If you were then to remove a layer you would reduce the amount of heat trapped which would cool you down.