The speaker is saying that the person's thoughts when they have left or died will still be remembered as love. He is comparing her thoughts to other things that die but are still remembered and often used in a romantic setting. Therefore, when the woman is gone, her thoughts and love will still exist within the person that received them.