How accurate are ACT’s poll ratings? Part 2

Note: this post originally appeared on ‘Douglas to Dancing’, a blog I maintained from 2007-9 on the ACT New Zealand political party. The blog was an extension of the thesis I wrote about the Act Party in 2007, From Douglas to Dancing: explaining the lack of success of ACT New Zealand and evaluating its future prospects (PDF).

ACT is polling at 2% or less in opinion polls – 1% according to Saturday’s Fairfax poll. Three weeks out from election day, this must be discouraging for ACT supporters. Is this picture an accurate reflection of what the party will gain on election day? Or is it underestimating support for ACT? In part 2 of my report, I examine whether a reverse “Bradley effect” could be underestimating support for ACT in opinion polls.

Because I’m interested in historical comparisons, the best resource would be a database averaging the various polls taken in election years. Lacking this, I decided to look at two polls with data easily available. An interactive graphic is available for the Herald-Digipoll, which shows polling results for ACT going back to before the 1999 election, while Roy Morgan has published polls available from just before the 2005 election. A disclaimer: I’m not a statistician and this is an informal experiment. Here is what I found:

  • In 1999, the final Herald-Digipoll put ACT at around 8.5% in the final poll before election day. This was a downwards trend: the party had over 10% support in the previous two polls. On election day, ACT received 7% of the party vote.
  • In 2002, the final Digipoll put ACT at 8% support. On election day, this turned out to be 7.1% of the party vote. Previous polls had put ACT lower, however, at around 6%.
  • In 2005, the final Digipoll put ACT at around 1.4%. Previous polls had put ACT higher, however, at around 2%. The final Roy Morgan poll before the 2005 election placed ACT on 3% support; the penultimate poll recorded 2.5%. On election day 2005, ACT received a 1.5% share of the party vote.

Results? Remember, I don’t claim this to be a scientific exercise. Yet on looking at these numbers, it seems that if anything, opinion polls close to election days seem to overestimate support for ACT, not underestimate it! The only time a final poll before election day put ACT below what it actually received was in 2005 – and the Digipoll then only put ACT a tiny fraction lower. This could be ominous for ACT indeed: with the party only reaching 1-2% in most polls, the election day result could be lacklustre to say the least. If history repeats itself, the latest 2008 Roy Morgan poll, which put at ACT at 3.5%, could be as much a “false hope” as the 2.5-3% ratings the company had for ACT last time around.

Why could this be? I can think of two plausible reasons off the top of my head:

  • The stigma effect no longer applies to ACT as strongly as it once did – if it ever did. Memories of the 1980s have faded. Moreover, ACT has shed any racist overtones it had by playing down its “One Law for All” message. Is anyone really afraid of saying he or she supports ACT? Is it any “worse” than supporting National?
  • ACT supporters are perhaps actually overrepresented in opinion polls, due to the fact that they are likely to be older and thus more likely to be at home when rung by polling companies. Younger voters are more likely to use mobile phones only and therefore not be picked up in polls. Yet despite a small but vocal ACT on Campus group, they are the voters less likely to be ACT supporters. (By the same token, we could expect younger Green voters to be underestimated in opinion polls).

My conclusion is this: if the polls are “wrong”, this is not likely to be in ACT’s favour. If polls put ACT on 1-2%, it’s most likely because ACT is at 1-2%. Or worse.

You may also like...

2 Responses

  1. stuartwil says:

    Hi Geoffrey

    I know you prefaced you comments by saying that you are not a statistician, but I think you should leave the commentary on polling to people who are a little more informed.

    Your statement:
    “ACT supporters are perhaps actually overrepresented in opinion polls, due to the fact that they are likely to be older and thus more likely to be at home when rung by polling companies”
    shows your complete ignorance of polling techniques. Polling firms use quotas to ensure that they obtain a representative sample – once we have enough old people in the sample we stop ringing them, while young people are more difficult to contact due to the prevalence of cell phone only households, we continue to ring until we reach quota, or weight responses.

    There is an argument that the green vote is actually over stated, due to the low turn out of younger voters which is not factored into the some of the demographic models that some NZ pollsters use.

    As you are student of political science, I would suggest that you take a few undergrad papers in opinion polling before you express an opinion on something you know little about.

    Regards
    Stuart Wilson
    Director
    Lysander Research

  2. Hi Stuart,

    It’s tempting to fight fire with fire. I welcome genuine feedback, but I don’t think it’s fair to make patronising comments to me, especially when your own background is hardly an independent one. I am upfront about my research interest in ACT, you should be upfront about your partisan one.

    To clarify, Lysander Research is a front for ACT. I found the following information revealing (source: http://groups.google.com/group/nz.general/browse_thread/thread/fc7dff3374919d2f?pli=1)

    “There is a website lysanderresearch.com that never seems to work. They seem to have done “polling” for Dick Quax who stood for Parliament as an ACT Party candidate. Now they appear to be doing “polling” for Rodney Hide. The pollster was evasive when I asked if he was connected with a polical party. So if Lysander Research phones anyone, ask if they are polling for ACT. And where’s their office and why don’t they have a website that works.”

    “Companies Office records show the involvement of a Stuart Wilson in
    Lysander Research Ltd. A whois lookup for lysanderresearch.com shows the registrant as Stuart Wilson, ACT NZ, Suite 5, Level 2, 309 Broadway, Newmarket.”

    “Thanks, I thought as much. I did ask the interviewer if he was
    connected with a political party and he said no. A typical ACT liar.”

    It sounds like your own polling methods are somewhat questionable. And your criticism of my commentary does not even focus on the key point: ACT has polled better in opinion polls immediately before elections since 1999 than it actually does on election day. I do not need to have taken “a few undergrad papers in opinion polling” before making this observation.

    The statement you chose to critcise was merely an attempt at a possible, plausible explanation for this phenomenon. Notice that I caged this with “perhaps”, precisely because this was merely a supposition.

    As for your explanation of polling company methods – my “completely ignoran[t]” view is this. Ringing landlines to “reach quota” doesn’t replace actually ringing mobiles – you are just getting youth who have access to landlines, which is not the same thing. Given overseas pollsters ring mobiles using random dialling techniques, I’m surprised your company doesn’t do this.

    And seeing you are a professional, please offer some supporting evidence about your “argument” about the Green vote being overstated by “some” polling companies.

    Regards,

    Geoffrey

Suchen Sie einen Übersetzer?Geoffrey Miller Translations
+