letting go

How do you let go of someone who was only yours for a moment in time?I find myself thinking of him a lot more then I should. Its my world is somehow intertwined with his. I still can feel his presence he is no where to be found... So tell me how do you let go of something that was never yours to begin with