Nothing's wrong, maybe you're just too nervous or too tired (physically)... try to get into a relaxed state, or if you are indeed tired, just fool around in bed till you both get so hot and turned on...
You can get limp also if your not turned on enough... so make sure you're steaming hot..