there are more people of the second group, but the people belonging to the first group have a louder voice and their actions are brutal

I agree with this however the loudest voices garner the most attention (a societal issue of the majority) and with their visible position, quell many of those trying. They make them feel impotent to change anything.

It takes only 1 man to destroy the world nowadays, but millions to save the world.

Many people are required. They need not be the greatest, nor the most talented but, they must take action.