Mandatory reason code is probably one of the better ideas. It'll be hard for trolls to bs a downvote reason on the spot, and even if they can it will probably look bs'd. It might not solve the problem, but at least we will know when we are being downvoted by someone for now reason.

I also like the idea of there being some sort of expandable downvote history or something. That would be pretty good as well.