Well I'm 30 and have aspergers too, but I'm nervous too be around women.
I have no problems casually talking to women or even having deep conversations with them. I just get anxious when I start wondering if I should ask them for a date. I hate it so much and it makes me not want to socialize some days because I want to avoid burning myself out but at the same time I am worried potential social opportunities are being missed.