BY: CHRIS FERNEYHOUGH, SVP TECHNOLOGY PRACTICE – VISION CRITICAL

The idea of respondents completing questionnaires on mobile devices has long been “the next big thing” in online research, however, like many “next big things”, most of us have been waiting for it to actually happen. However, with the explosion of mobile Internet usage over the last few months, it looks like that time is rapidly approaching.

At the recent ESOMAR event in Chicago, we had the opportunity to present our paper “Best Practices In Mobile Research”. As I mentioned in a previous blog entry, Internet usage on mobile devices is gaining traction. This was supported by the research we did for our paper as we found that members of our national panels are already receiving survey invitations on their smartphones, meaning that if they want to complete the questionnaire right then and there, they can click the invitation link which will then open the questionnaire on their mobile browser. And we aren’t the only ones to witness this. We’ve had clients tell us that they’ve been contacted by respondents who have tried to complete questionnaires on their mobile devices.

The problem with respondents trying to complete questionnaires on their smartphone is that online questionnaires are almost always designed for the traditional desktop internet experience. Obviously, this results in a number of complications. For example, some question types require scripting that is automatically disabled by smartphone manufacturers (“Other, specify” being an example) meaning that respondents can get stuck at a question, unable to advance because their response option won’t work properly.

Another issue is the limited screen space on a mobile device. These small screens can make reading (and responding) to a question very difficult due to the amount scrolling that might be required. As those of us who use the mobile web can attest to, scrolling a webpage that has not been formatted for mobile devices is not only extremely frustrating, but respondents could easily misinterpret a question if they choose not to fully scroll.
That’s the bad news. The good news is that when done properly, there are many benefits to mobile research. This includes higher response rates, getting access to respondents who aren’t typically at a computer, more timely responses, etc.

And here’s more good news: in our ESOMAR paper we found that the answers provided by respondents on their mobile device do not vary significantly from the answers provided by those answering the same questionnaire on a desktop.

Furthermore, a sizeable proportion of those who completed the questionnaire on their mobile device said they are more likely to complete questionnaires if they are provided with the opportunity to complete the questionnaire on their mobile device. Of course there are some caveats to these findings, (which I’m not going to get into here – you’ll have to read the paper), but these results suggest that mobile data collection is a viable data collection technique which needs to be addressed by market researchers now, rather than later.