I think it's just strength of association. they hear weed, and it conjures images of hippies and stoners because that's just what it's been tied to culturally for most of our upbringing, while the long and varied usages throughout history are kinda lost on most people