Dawn Pope
Do realize that being distant and having aspergers isn't always the same.
For me personally, those things you mention would be stuff I get really worked up about
If my gf wants a hug because it makes her happy, I want to know why that is, why she isn't happy, if it might be my fault, what I can do to make sure she doesn't feel sad the next time.
And don't think that because he might have aspergers, you can't talk to him about stuff like that.
If you ask me, if it troubles you so much that he doesn't want to give you answers etc. doesn't want to kiss you but does want to make love and all those other things. Look at yourself if it is a future you want yourself to have.
Just because he has aspergers doesn't mean he can't try to have good contact with you, from what I read here most of us (if I may use that sentence) seem to want to make a lot of effort, just don't really know how to.
Keep in mind that the most important thing in a relationship is that you yourself are happy, how selfish this might sound... If it doesn't seem like he wants to change and this bothers you a lot, look at what is best for you because a relationship won't work if it comes from just one side, it will start to feel like a job until an inevitable burnout
To keep it from being an entirely depressed post. If you do want to work for it, you're gonna have to pop it through his thick skull that this isn't the path to happiness. Just because he has aspergers doesn't mean he is some tender flower that will snap because you accidentally make eye contact with him. Treat him like a human being and not like a diagnosis. Yes it's great that you take effort in making sure to communicate in a way that is pleasant to him, but don't allow that to keep you from delivering the message.
I'm kinda turning this into a ramble, I hope you get the point I'm trying to make so if anything is unclear, don't feel afraid to ask and I hope I didn't offend you with anything.
Ps. If there is one thing I have seen in relationships from friends, is that a relationship based on trying to fix the others problems won't work. Have a relationship with him for your own happiness, don't be with him to make him happy (I don't know if this is the case but it kind of sounds like this to me, no offense, it's just an interpretation so please don't get mad)