Choosing the right Ecological Momentary Assessment (EMA) platform for your research can be a challenging task. The landscape of available platforms is vast, and while many options exist, it can often be difficult for researchers to assess the specific features and potential limitations of each. Navigating this complexity is a common hurdle when embarking on EMA studies. For researchers seeking guidance, the article “Selecting an Ecological Momentary Assessment Platform: Tutorial for Researchers”, published in the Journal for Internet Medical Research (JMIR) in 20241, offers an insightful review of the EMA platform landscape as it stood around that time.
Following our previous blog post which addressed the questions raised in Textbox 1 of that JMIR article, we now turn our attention to 11 key considerations brought forward by the authors. Here, we explore each of these from our perspective, highlighting how our platform is designed to meet the diverse needs of academic research teams.
Consideration 1: Location
The location of the developer can significantly influence the practicalities of your EMA study. As Henry et al. note, “The developer’s location may influence the language or languages of the participant and researcher platform interfaces and instructional materials. In addition, developer location may impact the timing of support from developers and dictate the location of the data storage”. Researchers should ask:
Are Platform Features and Instructions Available in (My Language or Languages)? It’s crucial that both participant and researcher-facing elements, along with support materials, are accessible in the required languages.
Polygon is built with global compatibility in mind. Our platform supports all languages and alphabets for the infrastructure, interface, surveys, and responses. We ensure that both your study team and your participants can interact with the platform in their preferred language.
Will You Be in Office While (My Study) Is Live, so That I Can Receive Support, if Needed? Timely support is essential, and time zone differences can impact response times.
At Polygon, we are committed to providing exceptional support. You will be assigned a dedicated project manager as your direct point of contact, ensuring efficient communication. We pride ourselves on our quick response times to support requests. We already work with researchers across various time zones and are dedicated to providing the assistance you need when you need it.
Consideration 2: Developer Involvement
The level of support required from developers can vary depending on the complexity of the study and the technical expertise of the research team. Henry et al. highlight that researchers should consider “the support (type and quantity) you will need from developers at the beginning and throughout the life span of your study”. Key questions include:
How Much Support Will You Provide at the Beginning of (My Study)? Some developers may program the study on your behalf, while others provide resources for the research team to set it up.
At Polygon, we work closely with you to set up your study. This includes assisting with study design, questionnaire review and the complete coding of your study. We facilitate the rapid implementation of a pilot study environment, so you can thoroughly test your EMA protocol. By taking responsibility for implementing your EMA infrastructure, your team can focus on other aspects of your study that require your expertise.
How Much Support Will You Provide Throughout the Life Span of (My Study)? Ongoing support and response times to queries are critical, especially when technical issues arise.
Our commitment to support extends throughout your study. You will have a direct point of contact for any queries, and we pride ourselves on our quick response times. We understand the importance of timely assistance to ensure the smooth running of your research.
Consideration 3: Sample Characteristics
The characteristics of your participant sample should inform the user experience (UX) of the EMA platform. As the JMIR article points out, “depending on factors, including participant age range and level of cognitive functioning, it may be critical to implement an easy-to-navigate and visually appealing UX”. Additionally, for high-risk samples, specific features may be necessary. Key questions are:
Is Your Participant UX Optimized for (My Sample Characteristics)? An intuitive and engaging UX can impact survey compliance and minimise dropout.
At Polygon, we have extensive UX expertise, and are glad to put that expertise to good use when developing all our tools. Additionally, through extensive customisation options, we can tailor the visual elements of the platform to suit your specific sample characteristics.
What Features Support Platform Use With High-Risk Samples? Features like flagging concerning responses can be crucial for participant safety.
Polygon’s platform includes robust messaging capabilities and customisable live dashboards for both research and clinical purposes. The clinician dashboard can be configured to track responses and flag concerning answers, facilitating timely follow-up. Our platform can also be set up to send triggered notifications to designated team members or clinicians based on specific response patterns.
Consideration 4: Onboarding
The process of enrolling participants into the study can vary, and the platform should offer suitable options based on the sample and research team's capabilities. Henry et al. advise researchers to “Determine whether you will enroll participants in person or virtually, factoring in the technical skills of your team members and sample, and assess the relative fit of platform onboarding options”. Key questions include:
How Can Participants Enroll in (My Study)? Consider the ease and accessibility of the enrolment process for your participants.
Polygon offers flexible onboarding options that can be conducted remotely or virtually. We support various methods, including email, SMS, QR codes, website links, and more, ensuring a convenient and efficient process for your participants, regardless of their location or technical skills.
Can or Must Participants Provide Consent Through the Platform? Electronic consent (e-consent) can streamline the onboarding process.
Yes, Polygon supports electronic consent (e-consent). The e-consent forms are fully or partially customisable to meet your study’s specific requirements.
Consideration 5: Survey Design
The platform should support the necessary survey design features to effectively capture the data needed for your research. Henry et al. emphasize the importance of considering “which design features are required for your surveys to be maximally effective, user-friendly, and tailored to your sample”. Key questions are:
Does the Platform Offer (My Prioritized Survey Display Options)? This includes the ability to display text, images, audio, or video.
All display options are possible with Polygon, including text, image, audio, video, and more.
Does the Platform Offer (My Prioritized Survey Response Options)? Consider the types of responses required, such as single-choice, multiple-choice, Likert scales, or free text, as well as features like branching logic.
Because our EMA platform leverages all functionalities of our Advanced Survey Infrastructure and our Geospatial & Social Network Infrastructure. As a result, we have great flexibility to implement the questionnaire that is needed. Our platform supports a wide array of item response options, including select one, select many, visual analogue scales, interactive maps, free text, image, audio, video, and geotag. Furthermore, Polygon offers full branching logic capabilities, allowing participant responses to dictate subsequent items and even trigger future surveys.
Consideration 6: Sampling Scheme and Scheduling
The platform must support your study's chosen sampling scheme and allow for appropriate scheduling of surveys. Henry et al. advise researchers to “Determine the sampling scheme for your study and whether the platform supports your sampling scheme”. Key questions include:
Which Sampling Schemes Are Supported by the Platform?
We support all sampling schemes and scheduling options, including interval contingent, signal contingent, event contingent designs, or a combination thereof.
What Aspects of the Alarm or Notification System Are Modifiable? Customisation can help engage participants without overwhelming them.
Our platform offers a comprehensive suite of alarm delivery methods (phone calls, SMS text messages, and push notifications) with extensive customisation options for text (content, font, emphasis, colour, size) and sound (type or vibration). The alarm duration and frequency are fully programmable.
Can Survey Scheduling Vary Based on Participant Personal Preferences, or Is Scheduling Fixed Across Participants? Personalised scheduling can improve compliance.
You have full control over the scheduling of your alarms. With Polygon’s platform, you can ask participants when they would like to receive prompts, and scheduling can be individually adapted consequently.
Does the Platform Require Wi-Fi or Cellular Data to Function? The platform's reliance on connectivity can impact participation, especially if participants have limited data access.
With Polygon, surveys can be deployed and completed while offline, ensuring data is captured even without constant internet connectivity.
Consideration 7: Dashboards
Dashboards can be valuable tools for monitoring study progress and participant data. Henry et al. note that researchers should “consider whether a dashboard is a priority. The key question is:
Do You Offer Dashboards, What Are Their Capabilities, and to What Extent Are They Customizable? Consider the information needed and who will need access.
We have live dashboards that we can fully customise. A research dashboard is available with capabilities to manage sampling schemes, message participants, track compliance, visualise data, and search data. A clinician dashboard is also available to track responses, flag concerning responses, and message participants.
Consideration 8: Viewing Results
Understanding how and when data are uploaded and downloaded is crucial for data management. Henry et al. advise researchers to “Consider how and how often data should be uploaded to the server and downloaded by your research team”. Key questions include:
When and How Are User Results Uploaded?
Data can be configured to upload based on connectivity or other triggers.
In What File Format Are User Results Downloaded?
Data can be downloaded anytime through our dashboard, and the format and structure of the data exports are csv files by default, but this can be discussed and potentially customised.
What Information Is Provided in Data Exports? What Structure Are the Data Exports? Is the Output Customizable?
All data and metadata are exported, so all information required to be compatible with guidelines like STROBE-GEMA or CREMA (see the article) is available, including response time, missing data, and compliance. The structure of the data exports is customisable.
Consideration 9: Security, Privacy, and Data Management
These are paramount considerations for any research involving human participants. Henry et al. stress the importance of understanding “security, privacy, and data management requirements as they relate to your country and institution”. Key questions include:
How Are the Platform and Data Secured? Inquire about features like two-factor authentication and data encryption.
We use servers with the highest security standards. To ensure the security of personal information, we employ SSL Protocols (Secure Sockets Layer), automatic backup, and firewalls. We are committed to maintaining a high level of confidentiality by incorporating the latest technological innovations to ensure the privacy of your transactions. The data is hosted where the client wants it to be, we have servers all over the world. Finally, nominal data are saved separately from responses, for optimal security.
How Does the Platform Maintain User Privacy? Understand what information is stored, where, and for how long, as well as data de-identification processes.
The way we collect information is in full compliance with the Personal Information Protection and Electronic Documents Act (PIPEDA, Canada), the Act Respecting The Protection Of Personal Information in the Private Sector (Quebec Privacy Law), and the General Data Protection Regulation (GDPR - European Regulation 2016/679). We have a high-standard Confidentiality policy that you can find here.
How Are Data Managed? Consider data storage location and retention policies.
See details in our Confidentiality policy.
Consideration 10: Pricing and Cost Structure
Budgetary constraints are always a factor in research. Henry et al. advise researchers to “Before meeting with developers, know your budget”. Key questions include:
What Is Your Pricing and Cost Structure? Platforms can have various models, including per-user fees or flat rates.
Our cost structure is project-based, and we take the time to work with you to clearly define your needs before providing a fair quote. Importantly, our price is fixed and not dependent on the number of participants or questions, allowing you to scale your study without additional platform costs. There are no setup nor license fees, and we provide all the necessary support.
What Additional Features Do You Offer and Are They Included in the Price? Understand the costs associated with extra features you may need.
Our project-based quote aims to be comprehensive, including the support needed for your study. Specific costs for advanced or custom features would be discussed during the initial consultation to ensure transparency. We also offer a series of complementary services and are possibly able to help you in other aspects of your study, beyond the EMA protocol.
Consideration 11: Future Directions of Your Study and Research Program
Looking ahead, it’s important to choose a platform that can adapt to your evolving research needs. Henry et al. recommend considering “The next steps for the platform (eg, financial viability and developments) and your study and research program (eg, the need for additional features)”. Key questions include:
How Long Do You Expect the Platform to Be Operational? Platform stability is crucial, especially for longitudinal studies.
Polygon has been around since 2011, and we have a long term vision for all our tools, that we continuously maintain and update, often in collaboration with research teams who provide insights for innovation.
How Could the Platform Adapt to the Evolving Needs of (My Laboratory)? Consider the platform's capacity for future development and integration of new features.
Our platform allows for full customisation, and we are open to discussing and potentially building out features that may not be presently included. Our flexible architecture is designed to adapt to the evolving needs of research programs, and all advances to our system are shared with all clients. Coupled with our capacity to connect to our ASI and GSI survey platforms, we provide a comprehensive infrastructure for complex research protocols.
By addressing these 11 key considerations, researchers can make informed decisions when selecting an EMA platform. Polygon is committed to providing a flexible, customisable, and supportive environment for your ecological momentary assessment studies.
Contact us to discuss your project and explore how Polygon can help you achieve your EMA research goals.
References:
