This is completely unacceptable behavior and needs to stop. The ex has not let him go and he hasn't let her and her family go. A break up doesn't have to be a complete cut off but there is way too many interactions between these two and the fact that you don't know when half of it is happening is a red flag. You are his new wife and it feels like you are being pushed aside and gaslighted. You may trust him but I don't trust her. If she needs things done in her apartment she needs to find a way that doesn't involve your husband because she is no longer his responsibility, you are. She is exerting a level of control over him that would make any woman uncomfortable. A part of me feels like even if they haven't been intimate this has already emotionally gone too far. You are sharing your husband. You need to set boundaries and if he continues to cross them you need to be prepared to follow through with consequences. I would also recommend therapy to some extent to figure out how to improve your self worth and figure out why you are okay with letting this happen. You are a kind person and show empathy towards his exes situation but it has gone too far.