I would let him keep all the distance he wants--for ever.

Don't you deserve to find someone who's really into you? This guy is not him.