I don't understand my feelings towards marijuana.?

I smoke it and I enjoy it but I'm scared of being considered a stoner for some reason.. my bf smokes and it worries me every time he does it and i don't know why exactly. I've thought about it so much and I'm not sure if its just the weed or if its something else. He used to smoke every single day and that is a little much in my opinion and I told him that it bothers me that he's doing that. But Like its every time he goes to smoke with his friends. Maybe I'm just jealous of him hanging out with his friends. He lives an hour and a half away and i don't get to see him that much so I'm beginning the think its not the weed but that I'm not there with him to have fun and i get jealous of the people who get to see him all the time. but it gets even worse when he's smoking with them. I'm kind of new to smoking too. What is your opinion? I feel like I'm some crazy possessive person.