Will past job experience in the cannabis industry reflect poorly on my resume?

So I was having a conversation with a coworker of mine about trying to find a new job. Marijuana legalization is on the ballot for my state and I’ve always been interested in trying to get a job at a dispensary and possibly try to make a career out of it. He said that I should be careful because if I go for a different job in the future, they will see that on my resume and won’t bother hiring me. Says there is a stigma. While I understand what he is saying, to me I don’t see why it would reflect poorly. If I end up getting a management position at a dispensary, is that not still management experience? I feel as long as I can pass a drug test for any future jobs then it shouldn’t be an issue.

usa jobs
usa jobs resume
usa hotel jobs
usajobs
usa jobs federal government
usa job in ksa
usa jobs
usa jobs login
usa jobs gov
usajobs.gov
www.usajobs.gov
usajobs.com
usajobs
usajobs.gov official