A dozen years ago, while working for Nielsen, I had the good fortune to work on the development of a service with YAHOO! Inc. that helped improve ad targeting on its main website. This was a very successful early Big Data research service that used purchase panel data in conjunction with YAHOO! surfing behavior. The surfing activity of a group defined from Nielsen’s purchase data was then scored against all YAHOO! visitors to improve ad placement on the site. Additionally, Nielsen offered a test and control approach to assess the ROI of the campaign. This was an innovative research service that provided inputs that made marketing activities more efficient.
Yesterday I attended a notable presentation, Extract the True Value of Research with Big Data and Machine Learning, at the 2014 CASRO annual conference. Presented by Doug Miller (Vice President of Analytics at Rock Fuel, Inc.), he illustrated well for me the current state of the art in Big Data and the changes that it will bring to the market research function. The impressive advances on both the media buying side, via the development of programmatic buying, and the ad placement side, with increasingly complex and comprehensive techniques that constantly update and refine ad targeting models, have pushed us close to the ultimate goal of one-to-one marketing. A fundamental shift has occurred here, marketing research in these Big Data marketing machines is embedded in the process and not a separate activity. That said, you have research that helps refine and improve the effectiveness of the advertising as we had in the Nielsen example, but now it is conducted as an integral, real-time component of the marketing activity.
Marketing research has long held a position as an independent auditor with a mission to seek out the consumer truths. Marketing agencies that did their own research were regarded as ‘foxes guarding the henhouse.’ In the fast paced world of Big Data, there may not be a place for an independent market research function -- I wonder if the MR fraternity will embrace these new marketing agencies or ignore them? We need to acknowledge that the future definition of MR firms will be blurred and the ultimate goal of our industry should be to ensure the automated research processes used in many Big Data applications adhere to the MR Code of Ethics.
Media targeting and ROI analysis will become a fully integrated part of the marketing agency function, rather than an activity performed by researchers. The watchdog will be the role of the corporate MR staff rather than an independent MR agency. We can embrace this as a positive development for the MR function in general. By viewing this like a production line that has been sped up to increase efficiency, companies will soon realize that if mistakes are made a lot of product can be wasted, if no one is watching. The future MR professional will be part data scientist, part quality control manager.
