Although your extensive description may lead to think these circumstances are very specific, this situation is typical of relationships at work.
I'd just keep work and private life separated. Over the years I observed that this is the best way to keep things good at work and have a happy relationship outside.