Honest communication with him is your answer. If he's just that, too busy, and doesn't really have the time, then you two have different expectations/ incompatible. Have to talk this out and discover if there can be changes and if not, then a decision has to be made.