This AS person sounds like he's not ready for a (typically romantic) relationship. If he already lived together with you, and then moved back with his parents of all things, either you should be with him and the parents, or you should be moving on with your life. You can stay friends with him.
I mean, unless you really enjoy him living with his parents AND being long distance from him- especially after living with him for awhile. You seem to want touch and he doesn't want touch. That is a big deal. Sure, it's okay to give a person a time to get into these things.
But when you start doing more adult things like moving in together or even considering it, there are other adult things that need to be part of the process of having developed already.
This relationship seems to the point where he should take the "risk" of being touched and touching or you and him should already be at an understanding that he doesn't like to be touched before having moved in living together prior. This is assuming that he really does have these preconceived notions which he very well could- but you have to be okay with all these important aspects and the combination of the way they are. It is not unreasonable to not feel comfortable and not be okay with it. You are okay to want touching, but especially at this point in your relationship, and you are not able to get that from him. He seems too immature for you.