Okay my two cents worth. I own a Harley and I also just bought a Triumph Speedmaster. I like both bikes because they are so different. The Speedie was about half the price of my Harley and is just as much fun to ride, just in a different way. As for the people, I know a lot of people who ride Harley's and do not look down at others who ride different bikes. If I had my choice (and a lot more money) I would buy a couple more bikes that are different from my Harley and Triumph. Maybe a sport bike, the Speed Triple would be a good choice, or something else completely different from what I already have. Why, because it would be fun to ride something totally different. My first bike was a Honda in England about 30 years ago. I now own a Harley because I can now afford one and they are cool bikes to ride.
If someone buys a Harley just to be a part of a social crowd, what is wrong with that. Your typical 45 year old male or female is not going to buy a rice rocket and hang out with a bunch of 20 somethings, not because they do not like the 20 somethings, but because they probably don't have a lot in common, and probably don't have the backs to ride an uncomfortable bike for a long period of time. Also they probably have kids at home about the same age and want to get away from them for a while.
Anyway, enjoy riding and socializing with whoever you like and don't worry about who rides what kind of bike. If you see an old guy on a Harley and you think it is a cool looking bike, let him know. You might be surprised when that old guy on the Harley is friendly and tells you what a cool Triumph you have.
