It does seem rather undemocratic to allow (typically particularly wealthy) people to effectively decide where tax dollars will be allocated outside of the voting system.

This article can be read to suggest that decreasing the tax deduction might well lead to a decrease in charitable giving, at least for those in a lower tax bracket. It might matter less or not at all for higher brackets.