Sue's Blog

Monday, October 03, 2011

Polling Standards - I am awaiting a reply from MQO - based on MRIA standards.

Today in response to Liberal leader Kevin Aylward's assertion that the MQO poll was bought and paid for - MQO released a statement countering the claims.

Part of the MQO rebuttal follows:

MQO Research is an accredited Gold Seal member of the only national research organization, Marketing Research and Intelligence Association (MRIA). Every piece of research carried out by the firm meets and exceeds the Code of Conduct and Good Practice put in place by MRIA. The same is true of the recent election polling done in Newfoundland and Labrador. 

So in the spirit of fairness - I viewed the MRIA standards and followed up with a call to Carolyn O'Keefe - President of MQO. I got her answering machine so I left a message.

I have asked her to supply the following to me:

In order to preserve public confidence in public opinion research-a science of mutual importance to the Media and Market Research industries-please consider our following recommendations before releasing survey data to the public:
1) Please include the following key facts in the report:
  • Sample size, and population surveyed (who was included)
  • Sponsor of study (who commissioned the research)
  • Survey method (e.g. telephone, on-line, intercept)
  • Timing (when the survey was done)
  • Statement of sample error/margin of error (i.e. "+/- 2.5% 19 times out of 20")
2) Please make the following facts available to the public upon request (if not included in report):
  • Name of practitioner (company conducting research)
  • Sampling method (e.g. random, custom list)
  • Weighting procedures (statistical weights, if used)
  • Exact wording and order of questions
3) Always differentiate between scientific (most public opinion polls) and non-scientific studies (reader/viewer polls or other "self-selection" methodologies).
4) Where appropriate, use the caveat that research is not necessarily predictive of future outcomes, but rather captures opinion at one point in time.

Additional Standards for Reporting on Qualitative Research
Additional considerations should be adhered to when reporting on qualitative research observations (such as focus groups, or other small sample in-depth research).
5) Clearly defined recruiting specifications (i.e. product usage, party affiliation, specific demographic specifications, etc...)
6) Inclusion of statement of non-projectability. Results of qualitative research are not statistically projectable to the population at large.
7) Qualitative reporting should not include percentages or precise proportions. Expressions such as some, most, or a few, may be used.

I have not received a return telephone call yet. 

No comments: