I wish I could get those closest to me to answer for me, because I would probably laugh for 40 minutes straight at how much I drive them nuts.
Off the top of my head, the primary thing I'd say annoys people about me is my tendency to correct literally everything. My best friend will say something, and my tendency is so predictable that he follows it up immediately with "Don't 'actually...' me" to preempt my inevitable corrections.
I'm the "actually..." guy.
In my defense, people should be more careful with what they say.