A few reasons why the downvote pool exists:

• It's been requested for a very long time by a lot of people. Even before the downvote pool was added, users were already downvoting. Adding a pool was a logical step.
• Top 20 witnesses already agreed to it in HF21, I don't think they can be persuaded to flip flop on their stance unless there's some major issue with it.
• It took a lot of coding and man hours to implement it, it would have been a waste of time to remove it all of a sudden?
• Downvoting is part of a healthy system, it's a measure to deter abusers and express disagreement.

Perhaps you should reconsider how you view the downvote pool and use it. So my answer to remove the downvote pool is no.