I never "miss" people, either, not even my family. But of course when someone says, "Ooohhhh, I miiiissed you!", it won't go over very well to say, "I didn't exactly miss YOU, but I still think you're a nice person!"
One time a lady asked me if I was sad that my mother-in-law had left (after staying at my house for two weeks). My response was delayed while I considered that I either had to lie and say the acceptable thing, or say, "No, I'm not sad she left". Before I got a single word out, though, she launched into a lecture about how she hoped her daughter-in-law never said such a thing about her. Sigh...
I have a mixture of feelings about friends. Part of me desires no further interaction than what I have with my husband and kids (even that can be too much). But then I really do miss that intellectual connection I've had with close friends.
Interestingly, some of my closest friends have been those from other cultures. I'm drawn to them, possibly because the cultural barrier removes the stress of social expectations.
Having been burned so many times in the past - you know I naively expect everybody else to be tolerant and sincere, too! - makes me extra reticent to put out effort.