I can't make him love me...?

Recently I (21 years old he's 26) became involved with a guy and let him move in with me until he got back on his feet. It lasted 3weeks. Everynight he came in at 3-6 in the morning. And twice in those 3weeks he didn't come him for 4 days. I recently moved his items to his cousins house (while he was gone 4 those 4days). After I kicekd him out he said he still wants to be with me. I want to be with him to, but even tho he swore on the bible that he isn't cheating and neva has. I can't put up with the layin out all night (by the way he says he is just sitting outside @ 5 in the morning). I stopped by today and asked if he wanted to be with me. He said that I've told him that I don't want to be with him. so he is not gonna answer that question. and he said "You are cool, I'm not gona answer that question anymore!" I said ' so thats a no, got in the car and left. Question: Do you think this is something that I should let go or should make the break-up offical so he can't try 2 come back