Real fighting isn't a game or a controlled sport.
The most important thing about fighting is being comfortable with deliberately damaging and hurting people, and not stopping if you are hurt in the process.
People with "Dark Triad" personality traits have a huge advantage there, and are also highly over-represented among bullies.
You have two different paths from here:
1. Solve your immediate problem
2. Prepare for the future by choosing a set of activities that will be fun, good for you in general, and perhaps help your fighting skills.
I suppose you imagine that it's practical to do both for something that's already in progress, but you're wrong.
^^This^^
At some point, even within the confines of a dojo, you will have to spar with someone. You WILL get hit hard, tossed onto the mat, get pinned in some very uncomfortable positions, and injured. Count on that. With that comes a bit of acceptance of that reality, as well as, the mental drive to just absorb the pain and keep at it. To quote Sylvester Stallone,
"Life,...it's not how hard you get hit, it's how hard you can be hit and still get up." Self-control and discipline. On the other hand, you too, will have that opportunity to do the same to your sparing partner, so again, you have to prepare yourself mentally for potentially injuring another person, even someone you might like. Hesitancy and holding back will always give the other person the advantage.
As
@Hypnalis suggested, a real "street fight",...there are NO rules. Sometimes it's a "bite, scratch, and kick" scuffle,...and other times, someone's getting hurt seriously. Sometimes someone pulls out a weapon unexpectedly. Someone WILL finish the conflict,...you just make sure it's you.
Sometimes you run across that 1-3% of population that are true sociopaths and psychopaths that have no hesitancy to hurt you mental or physically. They only see you as "prey". As an autistic, who others perceive as "different", many people will see you as "prey". I think you already have a sense for that, so make sure that you are not.
So, again, having some martial arts training will teach you a lot about yourself, get your mindset right, and give you skills. Hopefully, you never have to use them in the real world,...and most people don't,...but the training goes well beyond the dojo in terms of self-confidence, discipline, and self-control.