What happens when I downvote?

Will the author see it and discredit me or will I see no posts or fewer of this author, or maybe something third?