I was actually about to suggest something similar, and in fact the number I was thinking is 20%. You are right -- it ought to cost something to downvote, but not so much that it discourages downvote completely.

It may be a bit complicated to implement the follow-up adjustment of karma, so I'm not too strong on that.