You have to trust them on how they use it, but you can track that via steemd. You can just as easily withdraw your delegation if you disagree.

I did this with some that flagged a certain Mr H who has been abusing the system for ages. I did flag him directly and got some retaliation.