Answer: He seems to have a liking to you, if you feel like you should avoid him or want nothing to do with him, then you should tell him to his face, it doesn't matter if he would feel sad, like if nobody wants you then they don't want you, so say that to him if you wanna avoid him, and don't be scared to do it either, also don't joke about it, situations like these can get serious and it could end up probably affecting you, so just avoid him if you want to and do what I said earlier.
Explanation: I hope this helps you.