Showing posts with label Nate Silver. Show all posts
Showing posts with label Nate Silver. Show all posts

Wednesday, November 7, 2012

Early Report Card, Where Is the Accountability?, The Biggest Story of the Night, The Future of the Grand Old Party

The final votes have not been counted and Florida has not been officially called yet - it will be days and possibly weeks before I can accurately assess my performance, but based on the initial returns, we had a solid night of projections.

For the Presidency:
* 49 out of 50 states were called correctly.  Florida is still unknown, but appears likely to go for President Obama in the end, which would make it my lone miss in the state projections - if it goes for Romney, then I would be perfect.  Florida was one of three states (Colorado and Virginia being the others) that I felt were within the reasonable margin of accuracy of my projections.
* On the popular vote, President Obama currently leads by 2.3% versus my projection of 0.9% or a 1.4% absolute error if that vote total holds.  Many of the uncounted votes are in California, with another decent-sized chunk in Arizona and Oregon and a small smattering in some other states, so, on balance, the margin and my error are likely to increase slightly.
* In the Senate, I missed 2 races - in Montana and North Dakota where Democrats pulled off modest upsets.  In both cases, polling was pretty scant and the races were hard to call.
* In the House, there are a number of House races still undecided.  The current margin of 232-192 with 11 races outstanding appears to track extremely closely to my projection of a 239-196 House.  If 7 of 11 outstanding races break for the GOP, my call will be perfect.  Democrats appear to be faring slightly better than that and may win 5 or 6 of the races, which would give me an error of 1 to 2.
* Overall, my calls were highly accurate - 98% in the Electoral College, 94% in the Senate and 98-100% in the House.
* What error there was had a persistent bias in favor of the GOP - both of the Senate races, the state of Florida in the Presidential race and the likely margin in the House all represent races where I had projected GOP wins but Democrats won.  This is ironic when you consider the discussion of polling - all of which leads me to want to discuss:

When Will the Talking Heads Take Responsibility?
I can't tell you how many articles I read from conservative commentators this year about how there was a left-wing media conspiracy to "weaponize" polls by using polling samples so out of whack with what the actual electorate was going to be that they were designed to be wrong and create a false perception of a Democratic lead.

Nate Silver, a man I greatly admire (and who, incidentally, appears to have slightly bested me in the Presidential race by calling all 50 states correctly in addition to calling the popular vote nearly spot on, although he did miss the same 2 Senate races that I did - Nate does not project the House) has been pillared with personal attacks and accusations of being a shill for the left - in spite of the fact that like me, he has a logical and fully divulged model for projecting these races that is set up well before the election and not changed throughout the cycle.

These charges were irresponsible, baseless and clearly wrong.

Now, I call on the media to do its job and call on those who made these charges to explain themselves.

The polling firms did a great job this election cycle, just as they did in the past two Presidential races and deserve credit for doing a complex job extremely well.

As noted, if anything, there was a right-leaning bias in the polling, which led to my slightly right-leaning bias in my projections (apparently Nate is better than me at teasing these effects out.)

I work hard to make accurate projections and am proud of what I do.  I'd put my accuracy the last two cycles (97% of states called correctly through the past two cycles) up against their fact-free hot air. 

I call on all of those who made those charges to make public apologies.  Given how they appear to operate, I'm not holding my breathe.  But certainly we should stop having to give air time to this sort of garbage in future election cycles.

The Untold Story of the Night
In the hubbub of the Presidential race, lost except in passing mention in the media reports were some astounding and encouraging results in state ballot initiatives.

First and foremost, an issue that frequent readers know I am passionate about made a massive step forward.

In Maryland, Maine and Washington, voters chose to legalize gay marriage in those respective states and in Minnesota, voters rejected a constitutional amendment to ban gay marriage.  These are the first 4 instances of voters either approving gay marriage or rejecting an anti-gay marriage amendment.  They all happened in the same night and while Maryland is among the bluest states, Maine, Washington and Minnesota are far more mainstream.  And this is 4 victories on one night after 32 ballot box defeats for gay marriage over the past 8 years.

Does this mean that gay marriage will be legal in all 50 states soon?  Probably not.  But it will now be legal in 9 states and the District of Columbia and is clearly entering the mainstream.

In 2004, gay marriage was a wedge issue used by Karl Rove to win swing states for George W. Bush.  In 2012, it is well within the mainstream.  Those who are on the wrong side of history will be remembered for it.

Also of major significance was the move by voters to legalize marijuana in Colorado and Washington.  Not medical marijuana, mind you, all marijuana.  This will be a complicated and dicey issue given current federal drug laws, which have not been repealed.  But it is a major strike for individual liberties.  That such an initiative could pass in swing-state Colorado shows just how out of touch both parties are with evolving public opinion.  President Obama would be wise to keep federal hands out of this issue in these two states that have made a clear, democratic choice.

Both ballot initiatives speak to the shifting social mores and the strong belief in individual liberties of both Generation X and Millennials.  This shift speaks to an opportunity for a party to step in and be the true party of individual liberties.  Could it be:

A Reimagined GOP
Barry Goldwater once warned Ronald Reagan of the unholy alliance between economic conservatives and the moral majority.  Goldwater was never comfortable with the GOP embracing a social philosophy that so severely constricted individual liberties by opposing abortion, fighting the "war on drugs", opposing gay rights and generally trying to impose "traditional values" on the rest of society.

Reagan did not listen and from a political strategy standpoint, he was probably right for the time.
Republicans won 3 straight Presidential elections from 1980 to 1988 and it took a severe recession and a center-left Democrat to unseat.

Republicans have now lost 4 of the last 6 elections and won a majority of the vote only once.

In 2004, 75% of voters were white.  In 2008, it was 74%.  This year, it was 72%.  It seems highly likely in 2016, it will be 70% or less as hispanic populations continue to expand.

Mitt Romney won 59% of the white vote, but bombed with the other groups, getting only 27% of the Latino vote, 25% of the Asian-American vote and 7% of the African-American vote.

This means that every 1% expansion in the Latino vote would translate into a 0.5% loss in popular vote margin for the GOP.  And that Latino vote is expanding by about 2% of the electorate per cycle.

So the strategy of winning a ton of white votes is a decay function.

The GOP has to figure out a strategy to reach minority voters.  Some of it is about issues but a lot of it is about outreach and tone.  George W. Bush won 40% of the Latino vote in 2004.  Ronald Reagan won 25% of the black vote in 1984.  These aren't majorities, but if Romney had won these percentages, he would have swung a 2% popular vote loss to 1.6% popular vote win, a margin that may well have swung the election.

Secondly, the GOP are getting scorched with younger votes.  Members of Gen X and Gen Y (those 44 and under) went for President Obama by 14%.

And here is the opening I am speaking of above.  These generations have been called the "me" generation.  They are starting to earn money and like the idea of lower taxes and less government involvement in their lives.  They COULD be conservatives.  But they detest social conservatism.  They are the reason that marriage equality and drug legalization initiatives are passing.

If the GOP could once again become the true party of liberty, rather than the party that wants the government out of your wallet, but in your bedroom, they might have a compelling argument to make and be able to build a coalition that could win again.

They have 4 years to figure it out.


Saturday, October 20, 2012

The 2012 Map: Still Advantage Obama Despite Gallup Poll Results, Celebrating Milestones

Days Until the Election: 17
Projected Popular Vote Total: Obama +1.1% (Obama up 2.1% since last week)
Projected Electoral Vote Total: Obama 286, Romney 252 (Obama down 8 since last week)
Current Betting Odds: Obama 61%, Romney 39% (unchanged since last week)






The fundamental situation in the Presidential race didn't change in the past week and that's bad news for Mitt Romney, as, in my estimation, he is still behind in the electoral college.  Romney picked up a very narrow lead in Virginia and New Hampshire in my projection and lost Colorado, netting him 8 electoral votes, but lost ground in the popular vote polling.

First, a few notes on the popular vote.  The Gallup poll has been the subject of a lot of press of late, with it showing a 7% lead for Mitt Romney on Thursday, a 6% lead for him on Friday and a 6% lead again today.  Gallup is among the most established and respected polling firms in the country, so it would be foolish to ignore their results, but they do cause me to scratch my head in light of the other polling results that we are seeing from established tracking polls.  The Investor's Business Daily poll (which many have pointed out over the past 8 years was the closest to projecting the outcome in 2004, although it was mid-pack in accuracy in 2008) shows Obama up by 2%.  Rasmussen, which has long been accused of being a right-leaning polling firm, shows Romney up by 1%.  The Reteurs/Ipsos tracking poll shows Obama up by 3%, Rand has Obama up by 3% as well and Romney is up 2% in the UPI poll.

In short, of the 6 tracking polls covering the race, 5 of them have the range somewhere between Obama +3% and Romney +2% and Gallup has Romney at +6%. 

Additionally, several non-tracking national polls came out in the past week that validated the range of the other 5 tracking polls - a Battleground poll this week showed Obama +1%, an ABC News/WP poll showed Obama +3% and a Hartford Courant poll showed Obama +3%.

Clearly, one of two things is going on:
(1) The Gallup Sample is dramatically different from the other polls in terms of their assumption around likely voters
(2) Gallup had a few days which were just a statistical anomaly that will even itself out over the course of the next week

In the case of #1, we would have to determine which likely voter model we believe in order to determine if Gallup is right or if the rest of the polling universe is right.

In the case of #2, the effect of weighting and averaging the polls that I use in my statistical model would largely take care of the outlier.

So is the Gallup poll dramatically different in sample selection?  It does not appear so from its internals.  One of the things that is observable is that the Gallup poll appears to be a lot less stable than other national polls which leads me to believe that they normalize their data a lot more.

Bear in mind, the Gallup poll has a margin of error at a 95% confidence interval of +/-3%, meaning that 6% is actually within the margin of error (if you add 3% to Obama's total and subtract 3% from Romney's, which is the correct way to measure these margins, you get an even race.)

As far as my projection goes, I see no reason to discount the results from the Gallup poll in my measures but also no reason to give it more weight than any other national poll.

At the state level, I think it is safe with scarcely more than 2 weeks and 1 debate to go to narrow the field to states that truly have a real chance of switching.  Let me do the rundown of all the competitive states:
All the solid/strong states - assume these are gone.  Indiana, South Dakota and Missouri are out of reach for the Democrats - Obama won't even try for them.  Ditto that New Mexico, Washington and Connecticut for the Republicans.  So, let's start by striking the left and right hand columns from consideration.

Of the states within 10 points, here is my rundown of the real prospects:
Montana - nobody is spending any money here or campaigning here and Obama lost it last time.  I consider it out of reach for him.
North Carolina - the Obama campaign is cutting back on media buys here and isn't making campaign stops.  I think the crown jewel of his 2008 victory and the site of the 2012 DNC is gone for the Dems.
Arizona - a state that was utterly uncompetitive in 2008 given John McCain's home field advantage keeps flirting with being competitive.  But Obama isn't campaigning or spending much there.  I think this one will stay in GOP hands.

Florida - still hotly contested by both parties with tons of ad spending and candidates criss-crossing the state.  This one is still up for grabs.
Virginia - both campaigns are fighting hard here and it is extremely close.  Still up for grabs.
New Hampshire - given it only has 4 electoral votes, I'm shocked at how much both campaigns are investing here.  Definitely still competitive.
Colorado - among the closest in the nation and still very much up-for-grabs.  A large Mormon population helps Romney but a large Hispanic population helps Obama.
Wisconsin - I will leave this on the competitive list since the state still appears very close in the polls.  It doesn't seem that the Romney camp is fighting too hard for this one though.
Ohio - definitely the lynchpin of the campaign and one fought heavily over by both sides.  Obama has a small but clear edge here, but this is still competitive.
Nevada - similar demographics to Colorado create a similar campaign dynamic.  Also, the hard-hit economy makes it a prime Romney target.  Still competitive.
Iowa - still up for grabs and attracting campaign dollars and visits.

Pennsylvania - the prospect of winning here for the first time since 1988 is quite a sexy idea for the GOP, but they aren't investing heavily here and I think this one stays Democratic unless Obama collapses in the next couple of weeks.
Michigan - this one once appeared competitive but keeps slipping away for the GOP.  It will stay Democratic.
Oregon - Romney is investing nothing here.  It stays in Obama's column.
Minnesota - same as Oregon, Minnesota is competitive in theory only.  It will stay Democratic.

So we are left with a battlefield of 8 states: Florida, Virginia, New Hampshire, Colorado, Wisconsin, Ohio, Nevada and Iowa.

Obama starts with a base of 237 Electoral Votes, Romney 206.
The true battlegrounds have the following electoral votes (in rank order):
Florida - 29
Ohio - 18
Virginia - 13
Wisconsin - 10
Colorado - 9
Nevada - 6
Iowa - 6
New Hampshire - 4

Let's look at the path's to victory for each candidate:
For Obama:
(1) Win Big
The easiest path is win the two biggest prizes.  If he takes Florida and Ohio, it's over.  He gets 284 electoral votes.

(2) Win Easiest
The states where he holds the strongest leads are Wisconsin, Ohio, Nevada and Iowa.  They have a collective 40 electoral votes, which would give the President 277 electoral votes.  So, he could even afford to lose either Iowa or Nevada and still have 271 electoral votes.  Wisconsin, Ohio +1 seems like Obama's easiest path

For Romney:
(1) 3 Biggies Plus 1
Florida, Ohio and Virginia would get Romney to 266.  Win any other state and he is at 270.  New Hampshire would seem like the easiest state to claim in this electoral map.  Maybe that's why he is investing there.

(2) Win the Closest
If you go down the rank order, to get to 270, he needs Florida, Virginia, New Hampshire, Colorado and Wisconsin to put him over the top at 271 electoral votes.

So what strategy are the campaigns investing in?

Both candidates have been criss-crossing Florida and Virginia, states that Romney will need in both strategies and ones that Obama needs in strategy #1.

We'll see where they spend time as the campaign closes.

Site Milestones
My last post was my 500th on this blog.  September was the most-read month ever for this site and October is only 100 viewers away from surpassing September, something it seems almost sure to do today.

I'm hardly Nate Silver in terms of fame in projecting elections, but I would note that we were almost as good as Nate in 2008 (this site predicted 48 out of 50 states correctly, Nate picked 49 of them right.  We called the popular vote exactly correctly as well.)  But it's nice to know that thousands of people every month are reading and enjoying what I do.

Thanks for reading and for telling your friends about us.