Likely there is a chance of side effects but I would think they are less drastic than those of some of the pharma treatments.
I have used cannabis for many years after working around nuclear material and had NO problems of fertility with our 2 kids. (Was a bit of a concern given exposures)