Building a Voter File
Blue Leader has written an ongoing series, entitled Building a Voter File. The entries are listed below:
Building a Voter File Part 1: From the Raw Data Up
Submitted by Blue Leader on Mon, 07/07/2008 - 15:28Karl Rove got your mom's phone number the other day. Not directly, but through a mutual acquaintance--probably a secretary of state. Both parties--and plenty of other organizations besides--are engaged in creating massive stores of information on voters all across the country. This is their story.
Building a Voter File Part 2: Appending
Submitted by Blue Leader on Mon, 07/07/2008 - 20:14Once the data is (yes, is, prescriptivists--I went there) in a standardized format, we move from the realm of "interesting" into "faintly creepy". The information from Secretaries of State or state parties is generally pretty innocuous--name, address, maybe phone number or age. The appended consumer data, on the other hand, is more unsettling. There's nothing on there that would do real damage if anyone knew it--no credit card numbers, nothing that people could use to steal your identity--but it can be kind of strange to think who realizes that you own two dogs and a cat.
Building a Voter File Part 3: Using the Information
Submitted by Blue Leader on Tue, 07/08/2008 - 19:27Once you've gone through this process, you should have a list with millions of entries, each containing personal and consumer information--ideally for every registered voter, and all non-registered adults. So what can you do with it? Plenty.
Once it's compiled, the data has to be accessed. Various people can be granted different levels of access--making the whole file available to any volunteer would raise serious privacy concerns, not to mention possibly giving access to rival campaigns or, god forbid, the other party. For low-level volunteers, this access can be extremely limited, while higher-level operatives can be granted more generous permissions. Broader access can be granted through a web interface like the DNC's Votebuilder, RNC's Voter Vault, or Catalist's Q-tool. Using some relatively simple Boolean logic, you can create lists of all the people in a state, district or precinct who share certain characteristics--for example, you might want to find all registered black voters under the age of 40. With a certain (ever-diminishing) amount of inaccuracy, this is a trivial list to pull.
As you can imagine, this is extremely useful. You can use these tools to do everything from create walk lists for your volunteers to pull samples for polls or blanket a state with direct mail. Which is why these files are considered so valuable, and why making them is big business--with big consequences.
Building a Voter File Part 4: Improving the Data
Submitted by Blue Leader on Wed, 07/09/2008 - 18:13Of course, once you have a file for a given state, the work is not over. Even keeping the file at its current state, let alone improving it, will be an ongoing process.
First of all, from the day it goes up, the data gets staler and staler. Ideally, every state in the union will be undergo the entire process frequently--especially for states with hot races in election years.
Aside from regular rejuvenation, however, a file can be improved upon through contact with reality. No matter how diligent the Secretary of State, certain problems on a file will slip through the cracks. People will move, die, or get convicted; phone numbers will change, or go bad; party registrations will be altered. All of these changes can be captured by a well-tuned field organization, and appended to the file, so that as election day gets closer the file can asymptotically approach perfection (this is a somewhat idealized picture; bear with me).
When volunteers go out and canvass neighborhoods or phone bank, they can verify if an address is attached to the right name or whether or not a phone number is good; they can also gather information that is simply unavailable from other sources, like a person's top issue priorities. All of this information is gathered, centralized, and scanned in, so that the state voter file is as up-to-the-minute as possible. In the past, this was done by hand (when it was done at all); now, the use of new technologies like computers, palm pilots and bar coding of responses has greatly increased the efficiency of doorknocking and other field techniques.
Building a Voter File Part 5: Tutorial Part 1
Submitted by Blue Leader on Tue, 07/15/2008 - 18:32I think that the best way to illustrate this process might be to go through an example. Over the next couple days, we're going to build a sample voter file, from the ground up. I'll try to skimp on the technical details as much as I can get away with, but this will inevitably contain some actual programming. So: let's begin!
Building a Voter File Part 6: Tutorial the Second
Submitted by Blue Leader on Wed, 07/16/2008 - 18:54So, we've decided to try and build a voter file for Adams County in Ohio. We've downloaded the information we need from the secretary of state, and figured out what's in the file. But all we have now is a massive text file. What's the next step?
Building a Voter File (Unfiled): Vote History
Submitted by Blue Leader on Fri, 07/18/2008 - 10:55[Editor's note: If you're reading the Building a Voter File series in order, you should be aware that this particular entry is not part of the main sequence; thus, Errata. I will return to the tutorial in short order.]
As Dirty D points out, I can indeed lay out some cautionary tales regarding the construction of vote history. This can be an extremely important field, too, so if you're using vote history it behooves you to be an active consumer. Ask questions of your vendor, and don't be shy about digging into the data.
Building a Voter File: Early Voting
Submitted by Blue Leader on Mon, 10/13/2008 - 11:45As the election approaches, I thought I'd write a little more about the uses of the voter file in this particularly busy time. It's a very different operation than it is in the earlier stages, when you're setting up your file. By the time October rolls around, moving as much information into and out of the voter file as possible becomes paramount. There are a couple of ways that files get used late in the game that don't show up earlier; today, appropos of last night's discussion, we're going to focus on early voting.
Building a Voter File: New Registrants
Submitted by Blue Leader on Mon, 10/20/2008 - 13:23As promised earlier, I'm focusing on the way voter files are used during the runup to an election. Last week we covered early voting; this week, it's time to focus on new registrants. Follow me to the magical land of beneath the fold...
Building a Voter File: Night of the Living Appends
Submitted by Blue Leader on Mon, 10/27/2008 - 14:19Consumer data is one of the most frustrating areas of voter file design, especially if you're interested in transparency or an open-source methodology. Large parts of the voter file process use publically available data, and can be duplicated by any group with relatively low levels of equipment and technical skill (for example, witness my tutorial effort, which I absolutely promise to get back to after the election). There's no such ability for data appends. After the jump I'll explain why.














Recent comments
3 min 9 sec ago
3 min 12 sec ago
3 min 18 sec ago
10 min 4 sec ago
10 min 9 sec ago
10 min 12 sec ago
10 min 57 sec ago
11 min 2 sec ago
11 min 13 sec ago
11 min 26 sec ago