Boyfriend and sperm problem?

my boyfriend and I usually end up getting frisky when we hang out, once or twice a week typically. lately it seems like the amount of sperm he produces is way less.. he smokes a lot of weed. is it that, or is it a frequency thing? I'm not doing anything wrong. it just makes me feel like I'm less pleasurable now!