Well i don't know exactly how to tell you this so i am just going to start by saying that this is my opinion and this is based on experiences that i have had.

You want to know what's up with "us" (meaning you and him) but i'm sorry to say that there is no "us" and there never was.

You said that you were talking on the telephone and it was easy to talk to him. You then went to a party with him and had sex?

Why would you do that?

Never did the words relationship come out of either one of your mouths so the word "us" cannot be applied to either one of you two being together.

I believe that my mother said it best when she says "he ain't gonna buy the cow when he gets the milk for free"

Now when you say that you went out with him a few more times i wonder what you guys did. Did the two of you have sex? Not that its my business (but you did write for advice) but if you were then i hate to say it but it sounds like a booty call.

He hangs out with a whole different group than yours and he isn't trying to make any contact with you. That sounds to me like he is trying to give you clues that he isn't as into "us" as you are.

My advice? If you want to know if anything can ever come about between the two of you just come right out and ask him. Be blunt if you want to know specifics. If you want to keep playing guessing games then continue to just date occasionally and wait for him to make a move.

Whatever you do try to hold off on anything that important until you know the facts.

Good luck =)