This article investigates whether constituents are able to accurately infer their senators’ votes when the senator frequently votes against the party line. We find that when senators repeatedly vote against the party line, constituents’ ability to correctly identify their senators’ votes drops precipitously while levels of misinformation rise. We then show that citizens represented by senators who tend to vote against the party line are also less able to connect their policy positions with their evaluations of those senators. These findings indicate that there is substantial variation across senators in the ability of their constituents to hold them accountable for their votes while in office. Constituents simply know less about the positions taken by moderate senators and have a harder time aligning their levels of policy agreement with a senator with their evaluation of that senator if she frequently votes against her party.