In maybe, middle school, a friend said it was very geeky/nerdy to join chess club and that it doesnt help your social status.
But other than that, I've never seen anyone view chess negatively, especially if they are adults.
In fact, my brother has a chess set in his place, and when guests come, sometimes they demand to play, my brother sometimes tries his best to refuse (ironically), but it's amazing that so many are interested when they SEE the board.
That's the thing about chess---everyone will want to play it if it's handy and in close proximity, they just won't always go after it (like online, or by buying their own chess set). Same with backgammon, table tennis, foozball, darts, pool, bowling.
Also playing chess by yourself, is sort of like ma--you know, everyone does it but few would want to see it in public. They expect a partner.
Some mock me for playing chess, some mock me for studying chess, and others could care less. I seem to get all reactions.