You are right. Until isolated and purified from the seeds, the concentration in individual seeds is not up to a lethal level. An average human adult would need to ingest like 7 to 8 of the seed in order for the ricin toxicity to be pronounced.