Polling, like everything else, is moving online
It turns out initial Markey-Kennedy survey was no outlier
HE’S NOT EVEN officially running, but we now have two polls showing Rep. Joe Kennedy III with a sizable lead over Sen. Ed Markey in the Democratic primary for US Senate. The first, from Change Research, showed Kennedy with an eye-popping 17 point lead. That margin raised questions about how seriously to take an online poll from a newer pollster using unfamiliar methods. But over the weekend, a Boston Globe / Suffolk University poll found a similar dynamic, showing Kennedy with a 14 point lead head-to-head against Markey and a 9 point edge when all candidates were included.
The pair of polls illustrates two important lessons in polling. First, online polls are here to stay and cannot be ignored. Second, it’s impossible to tell an outlier from the start of a new trend.
The reluctance to embrace unfamiliar online polls is understandable. The track record for most online pollsters is still very short, and methods are almost as numerous as the pollsters themselves. Some, like YouGov, have been at it for a while, and have a track record of reliability for their approach. Others, like Change, are newer, and we don’t have enough to really know what to expect from them. What we have seen from Change — several presidential primary polls showing Elizabeth Warren outpolling Joe Biden — is quite different from virtually everyone else, phone or online.
Although their name and their methods are new, Change should not be easily dismissed. They employ a staff of serious people and have major investment dollars and supporters behind them. They have signed up candidates and campaigns across the country, and are beginning to form media partnerships for polling. We had Change’s chief growth officer on The Horse Race last week to discuss the Senate polls and more.
The Globe poll suggests the Change survey is at least close to the mark. The Globe crosstabs also provide a tidy explanation for Markey’s woes. His favorables are at a tepid 59 percent among likely Democratic primary voters, who should be his strongest supporters. Kennedy, on the other hand, is viewed favorably by 73 percent of the same group. Just 6 percent hold an unfavorable view. Kennedy’s appeal extends beyond the restless youth that have propelled many challengers to office. In fact, the 38-year-old’s support is highest among voters over age 65, although support varies only a little by age.
Our bottom line has been: unless there is some problem with the data, pollsters should publish their unusual looking results, even if they seem to be outliers. The alternative leads to pollsters “herding” towards a consensus view of a race. When everyone looks over their shoulders, nobody sees what’s ahead.
And very often, an unusual or unexpected result is showing something new about the electorate. In 2016, we found New Hampshire voters swinging hard toward Trump in the final days after a steady Clinton lead for months. We also were the first to show voters souring on the charter school expansion question ballot question, which went from 25 points up to 25 points down in the months leading up to voting.
Outliers and all, online polling is here to stay. Very low response rates and rising costs mean the days of live interviewer telephone polling as the clear gold standard are over. Today, a significant portion of elections and policy polling is done using a rapidly proliferating number of online polling methods. Many media outlets have current or recent partnerships with online pollsters such as YouGov, Morning Consult, Ipsos, and others.
We at The MassINC Polling Group already produced a lot of online polling, both for private clients and public consumption. We have conducted extensive side-by-side experiments and have found specific online methods to be comparable to telephone polling on a variety of measures. We are now confident enough in our approach to recommend it freely and publish the results without hesitation.Though it’s far too early to know how the Senate race will unfold, we are now pretty confident in its current shape. As for the race for the future of polling, both online and phone polling are viable, and should each be taken seriously.
Steve Koczela and Rich Parr are the president and research director of the MassINC Polling Group. The polling group is a for-profit subsidiary of MassINC, the publisher of CommonWealth.