Does he know its causal play? are there any chances of a LTR with this person? if there are maybe you got an emotion or two mixed up, and maybe feeling abit deeper then you thought you would have? Maybe you see something in this person then you had in the others and might want to experience more, you said that this is abit harder play then ususal.

ive played one time and felt the same way and it was causal play, i needed to separate my true feelings for that person and chilax. For me there wasnt any other then a play partner but maybe for you their might be, but becareful!