I do remember thinking that, it hit me the first time in junior school I was maybe 8 or 9? I remember I worked out an order of precedence in my class and believed myself to be 3rd from the bottom.
Then I also remember realising I was not attractive, in any conventional way. That felt sad.
In secondary school I usually had a friend, and that was enough for me really. I wasn't always happy, but I got by ok, there wasn't a bullying culture fortunately.
Mostly what I was puzzled by all my life was my isolation, I seemed to put in more effort than many but never gained a friendship group that lasted, basically looking back, because I didnt keep in touch with people or know how to.
My sister was similar so I did have a person to turn to, that always helped. And as I got older I felt more confident at work and that helped too. I always enjoyed having work I felt was useful and usually I had some great colleagues. Mostly I also found some interests that were absorbing and where I could socialise to some extent.
In terms of being liked, or not, I think I learned in my family to be cautious about speaking out, my father was very critical. In a way though this protected me, I became a quiet observer. I probably drew little attention.
I do remember realising I could at times be too harsh on others, which was disturbing, and I worked out that if you are hard on yourself, you may be being hard on others too. I've tried to soften that.