This is driving me nuts. Some help please?

Tell him that you need to talk to him, express your feelings and ask him if this is the way he wants it to be. You know, stuff like that. Also you could say that if his girlfriend is so special she wouldn't mind you hanging around him.