Verified Voting Logo
Edit Your PreferencesContact VerifiedVoting.orgAbout VerifiedVoting.org
Verified Voting HomeJoin - Help us do this work!Donate - Help us do this work!Take Action Today!Endorse the resolution!
Printer Friendly Version

See information for:

The Verified Voting Foundation engages in educational activities permitted by IRC Section 501(c)(3). Please visit VerifiedVoting.org for info about 501(c)(4) lobbying activities. You can also visit Vote Trust USA, a project of the Verified Voting Foundation. Also, check out our blog and twitter feed.

E-Mail This Page

Home   »  Take Action  »  Resources  »  Election Audits  »  How Effective is an ...


How Effective is an Occasionally-Used Paper Ballot?

by Justin MooreDepartment of Computer Science, Duke University

Several critics of voter-verified paper ballots have claimed that a paper ballot is useless if only a small portion of voters bother to verify its correctness. If the accuracy of a large tally -- the end-of-day totals, in our case -- cannot be verified by a spot check of a small sample -- a portion of the paper ballots -- then the entire public polling industry is in for quite a shock! A sample of a few thousand people is often used to gauge the opinion of several million, so why not use a portion of the paper ballots to verify the correctness of the count?

So just how effective is a voter-verified paper ballot? Well, in addition to serving as the ballot of record, even when the electronic record is lost (see: Carteret County, North Carolina), we can calculate the odds that a malfunctioning machine will be discovered by a small percentage of the voters who are verifying their ballot correctly. We say "verifying their ballot correctly" since it has come to our attention that it is possible for an error on a printed ballot to escape the notice of the voter.

Here is the set-up for our calculation. In it, we have

  • N, the number of voters who cast ballots on the malfunctioning machine;

  • M, the percentage of votes that the machine is modifying, either due to an honest error in its program or screen calibration, or through malicious tampering (an attacker);

  • V, the percentage of voters who manage to verify their paper ballot correctly;

  • D, the odds that at least one of the voters will discover a discrepancy between what they entered into the computer and the paper ballot they are given;

  • C, the number of ballots that are actually changed.
[Machine modifies 1% of the votes]

Here, we graph N on the X-axis, D on the left-hand Y-axis, and C on the right-hand Y-axis. In this graph, M is set to 1%: the machine makes a mistake on a random 1% of the ballots. The way we read these graphs by looking at a given number of voters, and reading the odds that at least one of them will have noticed a problem, and how many votes will have been changed by that point.

For example, after 1000 voters the machine has probably changed 10 votes (our 1%). Even if only 5% of the voters -- 1 out of 20 -- verify their ballot correctly, there is 40% chance that someone has noticed something is wrong. If 1 out of 10 verify theirs correctly, there is about a 2 in 3 chance that someone has caught the machine making a mistake. If 1 out of 3 voters manage to verify their ballot correctly, there is over a 96% chance that someone has noticed something is wrong.

For a large county like Guilford County, NC -- with over 200,000 voters taking part in the last election -- even if only 1 out of 100 people examine their ballot for mistakes, there is only a 1 in 587 million chance that the problem will escape notice. And with the machine making a mistake on 1 out of every 100 ballots, that means only 2,000 votes will be incorrect; less than half of the number of votes lost in Carteret County in 2004.

[Machine modifies 5% of the votes]

Here, we see a situation in which the machine is making a mistake on 5% of the votes. By the time 1000 people have cast their votes, there is over a 90% chance that the mistake will be caught. If 1 out of 3 people verify their ballot correctly, there is only a 1 in 16 million chance the the problem will go unnoticed.

[Machine modifies 10% of the votes]

An investigation in Pennsylvania discovered that the UniLect Patriot DRE is unreliable and unable to count votes accurately. This is the same model of machine that lost over 4,500 votes in Carteret County, NC. It is also used in Burke County, NC, which recorded an unusually high percentage of voters who went to the polls but did not cast votes, even in state-wide and federal races (Governor, U.S. Senate, President, etc). It is possible that up to 10% of the votes in Burke County were recorded incorrectly or not at all.

If Burke had used voter-verified paper ballots, even if only 1 out of 20 people verified them correctly, there is a 99.6% chance that the mistakes would have been caught after only 1000 votes.

[Machine modifies 25% of the votes]

In short, even if a paper ballot is used infrequently and verified correctly a small percentage of the time, is leads to an incredibly high likelihood that machine errors will be caught. The cost-benefit tradeoffs of a voter-verified paper ballot trail are tremendous.

-jdm

Announcements

August 26, 2010
On India’s Electronic Voting Controversy
August 25, 2010
Pac-Man for president: Hack highlights e-voting flaws
August 6, 2010
Voting Technology Research Gets In-Depth
July 27, 2010
State Election Officials: Recountable Process A Must for Overseas Voters
July 20, 2010
Online Voting: All That Glitters Is Not Gold (Unless You're a Vendor)
June 21, 2010
Voting Without A Net In South Carolina
June 17, 2010
Voting results in New Jersey should not be mysterious
June 16, 2010
Verified Voting Calls for Recountable, Auditable Voting Systems Following South Carolina Primary
June 16, 2010
Voting integrity groups call for investigation of South Carolina voting systems in wake of unexpected primary results in Democratic US Senate race
June 15, 2010
On the South Carolina Primary
May 23, 2010
Benefits, risks of e-mail ballots weighed
May 4, 2010
PA - Team 4: Security Concerns About Voting Machines Remain
April 26, 2010
California Assembly committee endorses UC Berkeley statistician's election auditing method
March 8, 2010
Feds Move to Break Voting-Machine Monopoly
March 2, 2010
Is the Internet the Right Place for Our Ballots? Election Administration and Voting Rights Thought Leaders Weigh in on the Future of Overseas Voting at Summit 2010
February 25, 2010
Minnesota Civic Groups Refute Recount Claims
February 17, 2010
Groups and Election Officials Warn Department of Justice that Voting Machine Vendor Merger will Inflate Costs to Taxpayers, Threaten Election Accuracy and National Security
February 11, 2010
Fla. justices uphold local election law
February 3, 2010
NJ Judge Issues Mixed Order on Use of E-voting Machines
February 1, 2010
Ruling Issued in Rutgers–Newark Law School’s Constitutional Litigation Clinic Challenge to NJ's Electronic Voting Machines

Get E-Mail Alerts




Important Links

  • VVBlog: Check out the latest news and commentary at our blog.
  • Election Day Problems?
    Call 1-866-OUR-VOTE
  • Find Your Polling Place: Vote411.org
  • Questions? Contact Us
  • Vote Trust USA - national resource for state-based organizations supporting verifiable elections, a Verified Voting Foundation project


  • "The core of our American democracy is the right to vote. Implicit in that right is the notion that that vote be private, that vote be secure, and that vote be counted as it was intended when it was cast by the voter. And I think what we're encountering is a pivotal moment in our democracy where all of that is being called into question." (more here)

    Kevin Shelley, former
    California Sec. of State





    Verified Voting Foundation, Inc., is a 501(c)(3) nonprofit corporation.

    © Copyright 2008, Verified Voting Foundation, Inc. All rights reserved, although reprint permission granted for nonprofit purposes with attribution to Verified Voting Foundation, Inc.


    Privacy    Site Map