A physical change occurs when a material changes state, these can include color, luster, melting/boiling point, hardness etc. Since the boiling point of water is changing state therefore it is a physical change
The temperature of a glass does not change state, it is just heated due to the boiling water