Sort:  

But its not that simple

Try talking to people who flagged you if they can simply unflag you. Should work