The positive take away here is... you did it! Keep it rolling, and next time you meet someone, try again.
There could be lots of reasons why the woman you mentioned always says no and none of them are necessarily related to you. When I'm invited to places, say with new work colleagues, I usually politely decline as it's just not my thing. Sadly some people read more into it. It's difficult to explain that in not being rude, I have to have alone time, particularly to fulfill my required engagement with my special interests.
This lady may be similar, she just may have fulfilled her socialisation quotient for that day. She also may just prefer her own company in general and doesn't want to compromise. Nothing personal, just maybe the way she is.