If they get fertilized, seeds will sprout out and the potency is gone.

Fertilizing only when seeds needed for new babies else they have to be isolated.