It's definitely not that simple, despite what some politicians and religions might want us the think. I think there are very few truly evil people out there, but if they can swing enough people to whatever they are pushing it leads to conflict. The voting system encourages this belief as you can't generally give half a vote to a candidate you sort of like (although some voting systems allow something like this).

I tend to think that the extremes of anything could be bad and it's best to find a middle way that causes least harm to everyone. That doesn't mean I won't stand up for things I believe in.