Here´s an idea.
Comments with downvotes are like spam.
Comments with upvotes are like good email.
Train spam filter with comments.
Use auto karma for comments with few votes, maybe they were just late to the conversation.
Comments with little votes get boosted or downgraded based on spammyness.