--- title: "Getting Nowhere Fast: The Impact of Speeders in Multi-Country Studies" description: "Getting Nowhere Fast: The Impact of Speeders in Multi-Country Studies" image: https://info-profiles.kantar.com/hs-fs/file-3334889913-jpg/blog-files/speedometer.jpg --- - - - - [mailto:info@gmi-mr.com](mailto:info@gmi-mr.com) [![Kantar-Logo-Small-Use-Black](https://info-profiles.kantar.com/hs-fs/hubfs/logos/Kantar-Logo-Small-Use-Black.png?width=119&name=Kantar-Logo-Small-Use-Black.png)](http://www.lightspeedresearch.com) - [Home](http://www.lightspeedresearch.com/) - [Sample Audiences](http://www.lightspeedresearch.com/sample-audiences/) - [Quality Suite](http://www.lightspeedresearch.com/sample-audiences/quality-suite/) - [Panel Profiling](http://www.lightspeedresearch.com/sample-audiences/panel-profiling/) - [B2B Panels](http://www.lightspeedresearch.com/sample-audiences/business-to-business-panels/) - [Custom Panels](http://www.lightspeedresearch.com/sample-audiences/custom-panels/) - [Millennial Panel](http://www.lightspeedresearch.com/sample-audiences/vice-voices/) - [Research Solutions](http://www.lightspeedresearch.com/research-solutions/) - [Quick Turn Surveys](http://www.lightspeedresearch.com/research-solutions/lightspeed-quick-turn-surveys/) - [Survey Design](http://www.lightspeedresearch.com/research-solutions/survey-design/) - [Tracking Research Design](http://www.lightspeedresearch.com/research-solutions/tracking-research-design/) - [Integrated Technology Solutions](http://www.lightspeedresearch.com/research-solutions/integrated-technology-solutions/) - [Data Processing](http://www.lightspeedresearch.com/research-solutions/data-processing/) - [Ad Tracker](http://www.lightspeedresearch.com/research-solutions/ad-tracker/) - [Survey Programming](http://www.lightspeedresearch.com/research-solutions/ad-tracker/) - [Sample Only Services](http://www.lightspeedresearch.com/research-solutions/sample-only-services/) - [Data Services](http://www.lightspeedresearch.com/data-services) - [Data Appends](http://www.lightspeedresearch.com/data-services/data-appends/) - [Mobile](http://www.lightspeedresearch.com/mobile/) - [Mobile Solutions](http://http://www.lightspeedresearch.com/mobile/) - [Resource Center](http://www.lightspeedresearch.com/resource-center/) - [Events](http://www.lightspeedresearch.com/resource-center/events/) - [Demos](http://www.lightspeedresearch.com/resource-center/demos/) - [Case Studies](http://www.lightspeedresearch.com/resource-center/case-studies/) - [Blog](https://blog.lightspeedresearch.com/) - [General Inquiries](http://www.lightspeedresearch.com/contact-us/general-inquiries/) - [About Us](http://www.lightspeedresearch.com/about-us/) - [Leadership Team](http://www.lightspeedresearch.com/about-us/leadership-team/) - [Press Releases](http://www.lightspeedresearch.com/about-us/news-press-releases/) - [Why Lightspeed](http://www.lightspeedresearch.com/about-us/why-lightspeed/) - [Careers](http://www.lightspeedresearch.com/about-us/careers/) - [Regions](http://www.lightspeedresearch.com/about-us/regions/) - [Awards](http://www.lightspeedresearch.com/awards/) - [Contact Us](http://www.lightspeedresearch.com/contact-us/) # Kantar's Profiles Blog # Getting Nowhere Fast: The Impact of Speeders in Multi-Country Studies Posted by [Jon Puleston](https://info-profiles.kantar.com/author/jon-puleston) on Dec 11, 2012 ![](https://info-profiles.kantar.com/hubfs/Blog_Authors/Jon_Puleston.jpg) - [Tweet](https://twitter.com/share) **Part 4 in our series, [So Many Variables, So Little Time:](http://www.gmi-mrblog.com/data-quality/so-many-variables-so-little-time-a-practical-guide-to-what-to-worry-about-when-conducting-multi-country-studies/) A practical guide to what to worry about when conducting multi-country studies** ![Speeders](https://info-profiles.kantar.com/hs-fs/file-3334889913-jpg/blog-files/speedometer.jpg?width=264&height=263&name=speedometer.jpg "speedometer")Almost everybody speeds. Regardless of the country we are fielding the survey in, speeding issues are probably the biggest general problem we face when conducting online research. In our recent paper, *[Dimensions of Online Survey Data Quality: What Really Matters?](http://www.gmi-mr.com/uploads/file/PDFs/gmi_formatted_whitepaper_DimensionsWhatReallyMatters.pdf)*, we presented research that shows that 85 percent of the respondents sped through at least one question. The paper details the results of two large-scale multi-country survey experiments interviewing more than 11,000 respondents in 15 countries that tested this factor, along with several others, in a treatment versus control group approach. Our goal was to understand the impact of speeders on the quality of survey data, and how to deal with this issue to accurately compare data across countries. We found, as we expected, that speeding variance did increase as respondents progressed through the survey. It averaged 4% on the first few questions and rose to around 8% at the end, which ranked this factor as the highest source of overall variance. We found also that it is the younger age groups and men who tend to answer survey questions faster. **National Differences in Speeding** At first glance, it appeared that some nationalities speed through surveys a lot more than others. But when relative reading and comprehension times in different countries are taken into account as part of the significant differences in average completion time, it becomes clear that thinking times are remarkably similar country to country. Across all countries, we saw a rapid decay in thinking time given to questions presented in repetition. The first time the question was asked, it received 7 seconds of thought on average. The second time, it got 5, and for the third and subsequent instances, the question got an average of 2 seconds of thought. For simple yes-no questions like “are you aware of this brand” thinking time averaged about 1 second, but if presented in a multi-choice list, thinking time dropped to less than 1 second. Comparing answers from the slowest and fastest halves of the sample, it was evident that there were significant differences in answers for binary (30% variance) and multiple choice (40 % variance) questions. On likert scale questions, speeding tended to bias data toward the positive, and was more pronounced in questions where there was natural disagreement. The root cause of speed-related data variance is declining thinking time. Our experiments have shown that speeding has significant impact on data across all countries, and that, because everybody speeds, simply removing all speeders from the sample is not an option. So, what can researchers do, aside from removing the most egregious speeders? Our hypothesis was that the answer is rooted in how we ask the questions. To test this hypothesis, we asked respondents two questions that were identical, except that one was phrased in a personal context and one in an impersonal context. Respondents answering the question phrased as, “Thinking about yourself, how much do you feel the following words describe you?” invested 70% more time than those who answered the question phrased as, “How much do the following words describe this brand?” Applying the concept to likert scale questions, respondents spent nearly 50% more time answering the question phrased in a personal context. The phrasing lesson is clear for all types of questions: the more you can contextualize a question in the mind-set of the respondent the more effort respondents will put into thinking about their answers. Taking a more creative approach to survey design is our most effective, indeed perhaps our only, weapon to battle speeding. *This is part 4 in a series. If you would like to read more, visit:* *Part 1: [So Many Variables, So Little Time: A practical guide to what to worry about when conducting multi-country studies](http://www.lightspeedresearchblog.com/data-quality/so-many-variables-so-little-time-a-practical-guide-to-what-to-worry-about-when-conducting-multi-country-studies/)* *Part 2: [Vive la Difference, the impact of cultural factors on multi-country studies](http://www.lightspeedresearchblog.com/data-quality/vive-la-difference/)* *Part 3: [Pants on Fire: Testing Untruthfulness](http://www.lightspeedresearchblog.com/data-quality/pants-on-fire-testing-untruthfulness/)* - See more at: http://www.ls-gmi.com/data-quality/getting-nowhere-fast-the-impact-of-speeders-in-multi-country-studies/#sthash.L2kO165K.dpuf Topics: [Blog Post](https://info-profiles.kantar.com/topic/blog-post) ### Subscribe to Email Updates ### Recent Posts ### Posts by Topic - [Marketing Research (46)](https://info-profiles.kantar.com/topic/marketing-research) - [Market Research (28)](https://info-profiles.kantar.com/topic/market-research) - [Marketing Research Data (28)](https://info-profiles.kantar.com/topic/marketing-research-data) - [modern surveys (27)](https://info-profiles.kantar.com/topic/modern-surveys) - [Mobile (26)](https://info-profiles.kantar.com/topic/mobile) - [Data Driven Marketing (21)](https://info-profiles.kantar.com/topic/data-driven-marketing) - [Market Research Trends (18)](https://info-profiles.kantar.com/topic/market-research-trends) - [Consumer Insights (17)](https://info-profiles.kantar.com/topic/consumer-insights) - [Online Sampling (15)](https://info-profiles.kantar.com/topic/online-sampling) - [Survey Design (15)](https://info-profiles.kantar.com/topic/survey-design) - [Blog Post (13)](https://info-profiles.kantar.com/topic/blog-post) - [Data Quality (13)](https://info-profiles.kantar.com/topic/data-quality) - [Digital Data Collection (12)](https://info-profiles.kantar.com/topic/digital-data-collection) - [Financial Services (11)](https://info-profiles.kantar.com/topic/financial-services) - [APAC (10)](https://info-profiles.kantar.com/topic/apac) - [Healthcare Research (10)](https://info-profiles.kantar.com/topic/healthcare-research) - [data series (10)](https://info-profiles.kantar.com/topic/data-series) - [Video (9)](https://info-profiles.kantar.com/topic/video) - [Digital Consumer (8)](https://info-profiles.kantar.com/topic/digital-consumer) - [data append (8)](https://info-profiles.kantar.com/topic/data-append) - [marketing research best practices (8)](https://info-profiles.kantar.com/topic/marketing-research-best-practices) - [mobile first (8)](https://info-profiles.kantar.com/topic/mobile-first) - [mobile marketing research (8)](https://info-profiles.kantar.com/topic/mobile-marketing-research) - [Research Quality (7)](https://info-profiles.kantar.com/topic/research-quality) - [marketing research technologies (7)](https://info-profiles.kantar.com/topic/marketing-research-technologies) - [marketing research trends (7)](https://info-profiles.kantar.com/topic/marketing-research-trends) - [thought leadership (7)](https://info-profiles.kantar.com/topic/thought-leadership) - [Ask the Expert (6)](https://info-profiles.kantar.com/topic/ask-the-expert) - [Context (6)](https://info-profiles.kantar.com/topic/context) - [Panels (6)](https://info-profiles.kantar.com/topic/panels) - [Social Media (6)](https://info-profiles.kantar.com/topic/social-media) - [data enrichment (6)](https://info-profiles.kantar.com/topic/data-enrichment) - [Innovation (5)](https://info-profiles.kantar.com/topic/innovation) - [MRX Trends (5)](https://info-profiles.kantar.com/topic/mrx-trends) - [Sourcing (5)](https://info-profiles.kantar.com/topic/sourcing) - [behavioral data (5)](https://info-profiles.kantar.com/topic/behavioral-data) - [Big Data (4)](https://info-profiles.kantar.com/topic/big-data) - [Honesty Detector (4)](https://info-profiles.kantar.com/topic/honesty-detector) - [Lightspeed FSG (4)](https://info-profiles.kantar.com/topic/lightspeed-fsg) - [Millennials (4)](https://info-profiles.kantar.com/topic/millennials) - [Online access panels (4)](https://info-profiles.kantar.com/topic/online-access-panels) - [Privacy (4)](https://info-profiles.kantar.com/topic/privacy) - [Respondent experience (4)](https://info-profiles.kantar.com/topic/respondent-experience) - [media buying (4)](https://info-profiles.kantar.com/topic/media-buying) - [mobile surveys (4)](https://info-profiles.kantar.com/topic/mobile-surveys) - [questionnaire design (4)](https://info-profiles.kantar.com/topic/questionnaire-design) - [Brand Advertisting (3)](https://info-profiles.kantar.com/topic/brand-advertisting) - [Infographics (3)](https://info-profiles.kantar.com/topic/infographics) - [Survey Engagement (3)](https://info-profiles.kantar.com/topic/survey-engagement) - [data search (3)](https://info-profiles.kantar.com/topic/data-search) - [disABILITYincites Partnership (3)](https://info-profiles.kantar.com/topic/disabilityincites-partnership) - [gdpr (3)](https://info-profiles.kantar.com/topic/gdpr) - [qualitative research (3)](https://info-profiles.kantar.com/topic/qualitative-research) - [quant vs. qual (3)](https://info-profiles.kantar.com/topic/quant-vs-qual) - [validation (3)](https://info-profiles.kantar.com/topic/validation) - [Amazon (2)](https://info-profiles.kantar.com/topic/amazon) - [Communities (2)](https://info-profiles.kantar.com/topic/communities) - [Customized Advertising (2)](https://info-profiles.kantar.com/topic/customized-advertising) - [Dynamic Sourcing (2)](https://info-profiles.kantar.com/topic/dynamic-sourcing) - [Emerging Markets (2)](https://info-profiles.kantar.com/topic/emerging-markets) - [Emotional Insights (2)](https://info-profiles.kantar.com/topic/emotional-insights) - [Holidays (2)](https://info-profiles.kantar.com/topic/holidays) - [Marketing & Insights Event (2)](https://info-profiles.kantar.com/topic/marketing-insights-event) - [Mobile Advertising (2)](https://info-profiles.kantar.com/topic/mobile-advertising) - [Mobile Banking (2)](https://info-profiles.kantar.com/topic/mobile-banking) - [Mobile Purchasing (2)](https://info-profiles.kantar.com/topic/mobile-purchasing) - [Prediction (2)](https://info-profiles.kantar.com/topic/prediction) - [Survey Health Score (2)](https://info-profiles.kantar.com/topic/survey-health-score) - [Survey Length (2)](https://info-profiles.kantar.com/topic/survey-length) - [Trackers (2)](https://info-profiles.kantar.com/topic/trackers) - [Voice Technology (2)](https://info-profiles.kantar.com/topic/voice-technology) - [facial coding (2)](https://info-profiles.kantar.com/topic/facial-coding) - [minipoll (2)](https://info-profiles.kantar.com/topic/minipoll) - [online surveys (2)](https://info-profiles.kantar.com/topic/online-surveys) - [panelist engagement (2)](https://info-profiles.kantar.com/topic/panelist-engagement) - [research on research (2)](https://info-profiles.kantar.com/topic/research-on-research) - [smart speaker (2)](https://info-profiles.kantar.com/topic/smart-speaker) - [visualization (2)](https://info-profiles.kantar.com/topic/visualization) - [weighting data (2)](https://info-profiles.kantar.com/topic/weighting-data) - [Clients (1)](https://info-profiles.kantar.com/topic/clients) - [Data Breach (1)](https://info-profiles.kantar.com/topic/data-breach) - [Device Agnostic (1)](https://info-profiles.kantar.com/topic/device-agnostic) - [Ecommerce (1)](https://info-profiles.kantar.com/topic/ecommerce) - [Empathetic Questioning (1)](https://info-profiles.kantar.com/topic/empathetic-questioning) - [Multicultural Research (1)](https://info-profiles.kantar.com/topic/multicultural-research) - [PCs (1)](https://info-profiles.kantar.com/topic/pcs) - [Political Profiler (1)](https://info-profiles.kantar.com/topic/political-profiler) - [Predictive Analytics (1)](https://info-profiles.kantar.com/topic/predictive-analytics) - [Research Skills (1)](https://info-profiles.kantar.com/topic/research-skills) - [Science of Prediction (1)](https://info-profiles.kantar.com/topic/science-of-prediction) - [Talent Management (1)](https://info-profiles.kantar.com/topic/talent-management) - [US election (1)](https://info-profiles.kantar.com/topic/us-election) - [audience targeting (1)](https://info-profiles.kantar.com/topic/audience-targeting) - [eWallets (1)](https://info-profiles.kantar.com/topic/ewallets) - [emerging talent (1)](https://info-profiles.kantar.com/topic/emerging-talent) - [esomar (1)](https://info-profiles.kantar.com/topic/esomar) - [health tech (1)](https://info-profiles.kantar.com/topic/health-tech) - [location services (1)](https://info-profiles.kantar.com/topic/location-services) - [nonprobabliity samples (1)](https://info-profiles.kantar.com/topic/nonprobabliity-samples) - [probability samples (1)](https://info-profiles.kantar.com/topic/probability-samples) - [social listening (1)](https://info-profiles.kantar.com/topic/social-listening) see all © 2018, Lightspeed LLC - [Site Map](http://www.lightspeedresearch.com/site-map/) - [Privacy Policy](http://www.lightspeedresearch.com/privacy-policy/) - [Terms of Use](http://www.lightspeedresearch.com/terms-of-use/) [![Lightspeed](https://info-profiles.kantar.com/hs-fs/hubfs/Lightspeed-Sep2016/images/logo_orange_footer.png?width=124&name=logo_orange_footer.png "Lightspeed")](http://www.lightspeedresearch.com)[![](https://info-profiles.kantar.com/hs-fs/hubfs/logos/LightspeedHealth_Footer_Logo_orange_rollover.png?width=200&name=LightspeedHealth_Footer_Logo_orange_rollover.png)](http://www.lightspeed-health.com)[ ![](https://info-profiles.kantar.com/hs-fs/hubfs/logos/FSG_Footer_1.png?width=201&name=FSG_Footer_1.png)](http://www.lightspeedfsg.com)