Opportunities and Limitations of Digital Tools for Research
Utilizing digital tools to collect and analyse data has become commonplace in social science and communication research. In many cases, their use has become transformative, enabling researchers to collect data on a far wider scale and at a much faster speed, while not having to travel as they used to in the past – which is obviously suited to the “new normal” of the COVID-19 era, for better or worse.
While many of us have heard of and even used such tools, there is a lot of room for thoughtful discussion on their role. How exactly have digital tools transformed research? Are there any limitations to using them? Do they have the potential to help us conduct more impactful research?
We reached out to three Rain Barrel associates and asked them these questions. From different locations around the world, they all have applied digital tools to their work. Here are some of their insights:
Safa Shahkhalili is a Toronto-based international development consultant with expertise in research and writing, policy development, partnerships, outreach and podcasting. She has conducted remote interviews using platforms such as Zoom, Google Meets, and Whatsapp. She has also used SurveyMonkey and sli.do to conduct surveys. While these tools are useful, she notes they must be used intentionally:
As researchers, the more data gathering tools we have in our toolbox, the greater the chance that we can design accessible and context appropriate interactions. While digital tools such as Survey Monkey, Zoom, and social media platforms are all useful, success ultimately depends on the researcher's ability to wisely choose the right digital tool or combination of tools. This means being conscious of the power dynamics involved in the research and aware of any barriers that may need to be overcome. That said, in my experience there is no substitute for face to face interactions.
Emily Cholette is a strategic communications and monitoring and evaluation specialist whose work – currently based in Dakar – focuses on human trafficking, labor migration, human rights and youth participation. She has used a combination of digital research tools, such as Hootsuite, Buffer, Google Analytics, Microsoft Forms, Facebook A/B split testing, to collect and analyse qualitative and quantitative data on the impact of online campaigns. Her past projects include IOM X Asia, Delta 8.7, and currently, IOM X West Africa (also known as Waka Well), and Migrants as Messengers.
Emily stresses both the value and limitations of digital tools:
Digital tools have been very helpful. Considering the global and regional nature of the positions I've held, they have enabled me to collect valuable information without having to travel every time data is needed. But obviously there are some limitations, especially in terms of collecting qualitative data. Meeting in person is far superior for establishing trust with respondents, and makes it easier to understand nuances in their responses. Another limitation, especially with online surveys, is survey fatigue. People have no incentive to actually respond to multiple surveys, which results in low response rates and, ultimately, insufficient data.
Digital tools help us collect, analyse, and visualize data for social science, working remotely while continuing to collaborate in other ways. There is still a need for face-to-face research that compliments data collected remotely. But in this time of pandemic when protective measures are needed, digital tools help us keep social science research going and even stimulate innovation.
Marie Angeline Aquino-Tiongco is a public health professional living in New York who specializes in global health. She is particularly experienced in maternal and child health, child protection and education. Her work on birth registration and health systems integration, for example, has relied heavily on the use of digital tools. She shared how she and other Rain Barrel associates have been using digital tools such as Zoom, WhatsApp, UReport, and other apps, to undertake research:
In this age of digitalization, there are so many data streams available to almost everyone who has access to the Internet and owns a mobile phone. As researchers, it is important to be able to quickly adapt and leverage these tools and platforms. Do they have the potential to help us conduct more quality research? Definitely! They create more opportunities for engaging with communities and help improve coordination across systems, sectors, and stakeholders.
Currently, with a Rain Barrel team working on a COVID-19 Risk Communication and Community Engagement project in Africa, we are using Zoom for Key Informant Interviews with UNICEF focal points, government stakeholders, development partners and experts in the field as part of a Rapid Assessment. We have also utilized data from UReport surveys previously conducted by the UNICEF country office.
While digital tools have been extremely useful for her research, especially during the current coronavirus pandemic, she notes their limitations:
The use of online data collection tools like SurveyMonkey and Google Survey is nothing new for social science and scientific research. But they are of limited use when gathering data at the community level in remote settings with limited or no access to the Internet.
In such cases, actual in-person data collection may still be necessary. This is even more true for qualitative research methods that require multiple participants (e.g., community-based causal mapping and focus groups), which can be challenging when conducted via conference calls with shaky connectivity.
A few things should be considered when transitioning to remote data-collection:
1. provide ethical, safety and data collection training for local officials or health workers
2. create partnerships and recruit volunteers at the community level
3. design incentives and compensation for participants
4. invest in tools or devices for communities that do not have the proper technology.
At Rain Barrel Communications, while recognizing the limitations of deploying digital tools for research, we view them as inescapable and welcome them as value-adding allies for evidence based, effective communication initiatives and campaigns.
Do you have any experience or thoughts on this topic that you would like to share? We would love to hear from you.
You can read more about Rain Barrel Associates here: https://www.rainbarrelcommunications.com/our-network