Is it too late to say the right thing?

its never too late! just forget all the time and remember the good and tell him in all your entirety how you feel! you only live once and you don't want to have lives with what 'could have been' haunting your mind! it sounds like you need to go somewhere in the relationship, you're in limbo, you must tell him and either be that way or not. Don't let it go without knowing what could be possible! good luck!