My youngest brother seems to have it, seems to be a classic case. In fact, when I first started researching it (because I thought it might explain some of my son's peculiarities), what struck me was how much my brother fit the bill on all of the diagnostic criteria. We've never spoken directly about it, but lately he has been diagnosing his friends with Aspergers and has suggested that my son has mild Aspergers, so I suspect that he has worked it out for himself and done some research.
I was the only child in my family with delayed speech development, but apparently in my maternal grandfather's family a lot of the boys have delayed speech development. But no low-functioning autism as far as I am aware. My Uncle (mother's brother) was always weird, always acted like a big kid, acted inappropriately with children, never had a proper job. He was huge, never did any sport or exercise but he was about 3 times as strong as an average man. He spoke very formally, and it took him forever to get through a sentence because of a dreadful stutter. Never had friends outside of his dodgy friends at the "vintage car club". He loved "gadgets" and was very good with the technology of the time that I was growing up (70s) and we spent a lot of time at my grandmother's house (where he still lives). He had an enormous collection of pens and keys. He had a bunch of what looked like about 50 keys, and he could tell you the story behind each of them. He used to apply for jobs that he wasn't even remotely qualified for, land himself an interview, and always made sure that he scored a pen with the company name and logo on it. My mother went through her whole life blaming herself because she dropped him on his head when he was a baby, but in hindsight it probably had nothing to do with that.
My son, who recently turned 5, shows some traits. It is difficult to be objective, but lately he seems to be "growing out" of some of them. He and his baby sister are like polar opposites, like night and day, but they love each other to death. Where I am based now I can't get a proper assessment done, so I concentrate on giving him a happy and stable environment.
My father had traits of just about every mental or neurological disorder I can think of. I don't think even a psychiatric version of Gregory House would have been able to work him out. I'm not going to try. More likely schizophrenia or bipolar than Aspergers though.