These kind of relationships are quite hard, but you said something that is actually vital - your Aspie is 'authentic'. That is the reason relationships with us are worth it, because most of us do authentic as if our lives depend on it, and authentic is something you can trust.
I feel like there's a huge life lesson right here.
I married a Narcissist and someone I highly suspect is Psychopathic (ASPD). I thought he was the love of my life. He ended up being the most highly skilled manipulator and one of the most deceptive people I've ever known. After him, I said I just wanted to be with someone who was kind, who treated me well.
For lack of a better reference, my Aspie is exactly that. He's authentic, honest, and trustworthy. He's kind, treats me well, and takes care of me.
He's not at all like my ex-husband. The thing about a Psychopath/Narcissist is they make it easy. They mimic you and project exactly what you've always wanted. But there's a huge price to pay for it. It gets really hard, really abusive, and devastatingly soul-destroying pretty soon after you're hooked in.
With my Aspie, it's a lot more work, it's harder to connect, but I know he's there for me. I trust him. I trust that he genuinely loves me. It can be infuriatingly frustrating, but when I look at why I've been unhappy and why I left, every single reason could be attributed to an Aspie trait.
And that's why I wonder if, with a different frame of reference and a different perspective, if it would help me understand him and find workarounds. And focus on when we laugh, when we do have a good time. Because he's authentic, he's big-hearted, and he's gentle.