One nice thing about college is you generally choose what you're studying, which means you're often in a room full of other people who find that topic interesting unlike high school where it's just a total mix of everyone and everything. That means you're more likely to connect with people based on shared interests, and that can make things a lot easier!
As others have mentioned, a 2 year age difference won't be noticeable. You're an adult now and the decades blend together, so you're a "20 something" or a "30 something" etc. Plenty of people change their minds and switch schools (I did it twice) and some go back for a degree later in life for a career change. It's not an issue at all.
Also, my experience was that social stuff is just not as important in college as it was in high school. It's a unique opportunity to make lifelong friends who share your interests, but I felt like socializing was a lot more "optional" in that environment than in high school. It was perfectly acceptable for someone to have the attitude "I'm here to study, not spend my tuition money on parties". Yes, lots of people want to let loose and party, especially first year, and there are plenty of people who think social stuff is the most important thing but you can choose to participate in that or not.
If you want to keep to yourself and focus on your studies, there is a good chance you will find that other people who are like-minded will gravitate to you and you'll end up making similarly nerdy friends that you genuinely connect with, which is so much better than people who are only friends with your fake party mask. Be yourself. If there are any clubs you find interesting, definitely join them!
And a tip for dorm living: bring a really good pair of noise cancelling headphones for when you want to study, but try not to wear them so much that nobody can ever talk to you