Do you think it might have something to do with you being pregnant? I know a few guys who are worried about having sex while their partner is pregnant, thinking they might injure the baby (yes, I know they can't, but there ARE actually guys who believe that). Have you asked him about it? If not, that might be a question you want to ask (about him being worried/scared/whatever b/c you're pregnant)....