I don't necessarily subscribe to the "once a cheater, always a cheater" mentality, B U T .......it would be severely un-wise of ANYONE to not be a bit on guard, yeh?
Having said that, I think you SHOULD (mostly) let it go until or IF he gives you reason to be suspicious of his behaviour.