|Articles|November 10, 2022
Implementing Numeric Rating and Visual Analog Scales in an eCOA Solution
Despite prevalent use in electronic devices, NRS and VAS are often implemented suboptimally.
Advertisement
Because the numeric rating scale (NRS) and visual analog scale (VAS) are frequently used in clinical outcome assessments (COAs), these (along with the verbal rating scale, which is not addressed here) are commonly migrated to electronic devices for use by trial participants to collect endpoint data. Despite their prevalence and the existence of migration best practice recommendations,1-3 we frequently see suboptimal implementation of these response scale types that could compromise a measure’s psychometric properties and trial outcomes. This article is a primer on the implementation of the NRS and VAS on eCOA systems and includes tips for ensuring your eCOA provider can accommodate best practice recommendations.
An NRS consists of numbers representing an ordered continuum of some attribute. The NRS typically includes verbal descriptors/anchors at the ends. Respondents select the number that reflects their perceived state.1 While the range on NRSs has varied,4 the most common is the 0-10 NRS.1
FDA’s patient-reported outcomes (PRO) guidance5 defines the VAS as a line of a fixed length (on paper, typically 100mm; eCOA uses 101 distinct response points, regardless of line length), with verbal anchors at the extreme ends, and no descriptors of the scale’s intermediate positions. Typically, no numbers are presented at the anchor positions. Respondents are asked to place a mark on the line corresponding to their perceived state.1
While both NRS and VAS have been used in endpoint measures to support labeling claims,6-8 a recent review9 suggests superiority of NRS over VAS in pain measures due to ease of administration and scoring, higher acceptability, and psychometric property retention. Further, while FDA guidance suggested VRS, VAS, and NRS are all suitable to measure pain,10 more recent guidance11 states the NRS is the most appropriate measure of pain intensity. In fact, FDA’s Patient-Focused Drug Development draft guidance3 states that FDA does not recommend the use of a VAS.11 These regulatory recommendations, as well as concern about VAS comprehension, are reasons why novel instrument developers may select other response scales over the VAS. Finally, the Critical Path Institute’s (C-Path’s) PRO Consortium recommends avoiding the VAS when developing de novo PRO measures and encourages use of other response scales appropriate to the measure’s content and the patient population.1,13
Regardless, because both NRS and VAS are frequently used in COAs and need to be implemented in eCOA solutions, it is imperative to follow best practice recommendations for faithful migration to retain a scale’s measurement properties. Figure 1 below shows examples of an NRS and VAS that align with best practice recommendations.1-3
Can your eCOA provider follow best practice recommendations?
Although VAS and NRS are common, some eCOA providers struggle to implement them according to best practice recommendations and offer unacceptable suggestions and/or formatting (e.g., NRS response options wrapped over multiple lines), incorrectly insisting that VAS lines must be 100mm long despite extensive comparability evidence,14 and displaying numeric values associated with a VAS response. In part, eCOA providers should be assessed based on the provider’s study-design capabilities.
Sponsors are urged to choose providers who demonstrate their system’s ability to accommodate complex designs, conditional logic, a user-friendly interface, and faithfully migrated measures. Sponsors are cautioned to scrutinize the capabilities of providers with no proven experience in eCOA data collection in clinical trials who propose non-clinical, generic data capture systems such as commercial online survey tools to capture eCOA data. The functionality required to display scales according to best practice recommendations, let alone complex solution design or custom report generation, is often not available in those generic systems. Those basic limitations could lead to deviations from eCOA best practice recommendations and result in low-quality data that compromises trial outcomes.
Ensuring your eCOA provider is aware of and has experience in implementing eCOA best practice recommendations is pivotal to collecting data that appropriately measures endpoints and withstands regulatory scrutiny.
Authored on behalf of Critical Path Institute’s eCOA Consortium by Celeste A. Elash, Vice President, eCOA Science, YPrime; and Anna Chilongo, eCOA Project Manager, ICON plc
References
- ePRO Consortium. Best Practices for Electronic Implementation of Response Scales for Patient-Reported Outcome Measures. Available at
https://c-path.org/programs/ecoac/epro-overview/best-practice-documents - Byrom, B.; Muehlhausen, W. Electronic Patient-Reported Outcome Measures: An Implementation Handbook For Clinical Research. 2018.
- Mowlem, F.D.; Elash, C.A.; Dumais, K.M.; Haenel, E.; Olt, J.; Kalpadakis-Smith, A.V.; James, B.; O’Donohoe, P.; Balestrieri, G.; Becker, K.;. Newara, M.C.; Kern, S. on behalf of the Electronic Clinical Outcome Assessment (eCOA) Consortium. Best Practices for Paper to Electronic Migration of Patient-Reported Outcome Measures. Manuscript in preparation.
- Haefeli, M.; Elfering, A. Pain assessment. European Spine Journal 15, Suppl 1(Suppl 1): S17-24 (2006). doi: 10.1007/s00586-005-1044-x. Epub 2005 Dec 1. PMID: 16320034; PMCID: PMC3454549.
- U.S. Food and Drug Administration. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. 2009. Available at
https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-reported-outcome-measures-use-medical-product-development-support-labeling-claims - Gnanasakthy, A.; Mordin, M.; Clark, M. A Review of Patient-Reported Outcome Labels in the United States: 2006 to 2010. Value in Health 15, 437-442 (2012).
- Gnanasakthy, A.; Mordin, M.; Evans E. A Review of Patient-Reported Outcome Labeling in the United States (2011–2015). Value in Health 20, 420-429 (2017).
- Gnanasakthy, A.; Norcross, L.; DeMuro Romano, C.; Carson RT. A Review of Patient-Reported Outcome Labeling of FDA-Approved New Drugs (2016-2020): Counts, Categories, and Comprehensibility. Value in Health 25(4), 647-655 (2022). doi: 10.1016/j.jval.2021.10.006. Epub 2021 Dec 24. PMID: 35365309.
- Safikhani, S.; Gries, K.S.; Trudeau, J.J; Reasner, D.; Rudell, K.; Coons, S.J.; Bush, E.N.; Hanlon, J.; Abraham, L.; Vernon, M. Response scale selection in adult pain measures: Results from a literature review. Journal of Patient-Reported Outcomes 2, 40 (2018).
https://doi.org/ 10.1186/s41687-018-0053-6 . - U.S. Food and Drug Administration. Guidance for Industry Analgesic Indications: Developing Drug and Biological Products. Draft Guidance. 2014. Available at
https://www.fdanews.com/ext/resources/files/02/02-05-14-Analgesic.pdf - U.S. Food and Drug Administration. Development of Non-Opioid Analgesics for Acute Pain; Draft Guidance for Industry. 2022. Available at
https://www.fda.gov/regulatory-information/search-fda-guidance-documents/development-non-opioid-analgesics-acute-pain-draft-guidance-industry - Celeste A. Elash. Personal communication.
- U.S. Food and Drug Administration. Patient-Focused Drug Development: Selecting, Developing, or Modifying Fit-for-Purpose Clinical Outcome Assessments. 2022. Available at
https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-focused-drug-development-selecting-developing-or-modifying-fit-purpose-clinical-outcome - Byrom, B.; Elash, C. A.; Eremenco, S.; Bodart, S.; Muehlhausen, W.; Platko, J. V.; Watson, C; Howry, C. Measurement Comparability of Electronic and Paper Administration of Visual Analogue Scales: A Review of Published Studies. Therapeutic Innovation & Regulatory Science 56(3), 394–404 (2022).
https://doi.org/10.1007/s43441-022-00376-2
Articles in this issue
almost 3 years ago
Mobilizing and Maintaining Clinical Trials in Midst of Waralmost 3 years ago
The Implications of Inflation for Drug Developmentalmost 3 years ago
Implementing Numeric Rating and Visual Analog Scales in an eCOA Solutionalmost 3 years ago
‘Dogma’ About Innovation vs. Access Impeding EU Fixes for Rare Diseasesalmost 3 years ago
When Does Patient Centricity Equal Burden?almost 3 years ago
Applied Clinical Trials November 2022 Issue (PDF)almost 3 years ago
The State of Data FAIRification in Clinical Researchalmost 3 years ago
“Culture of Quality” In Actionalmost 3 years ago
FDA Expands Oversight of Cell and Gene Therapiesalmost 3 years ago
Anticipating Careless Responders in Survey Design and Analysisabout 3 years ago
Towards a Global Implementation of eConsent in Clinical TrialsNewsletter
Stay current in clinical research with Applied Clinical Trials, providing expert insights, regulatory updates, and practical strategies for successful clinical trial design and execution.
Advertisement
Related Articles
- Bias Starts Early in Research. So Can AI.
August 25th 2025
- Future-Proofing Trial Protocols to Avoid CRLs
August 15th 2025
Advertisement
Advertisement
Trending on Applied Clinical Trials Online
1
Using AI Trial-Matching Tools to Accelerate Patient Access
2
Pfizer, BioNTech’s Comirnaty Shows Strong Immune Response in Phase III Trial for COVID-19
3
Beyond the Algorithm: How Human-Centered AI Design Can Drive Clinical Trial Success
4
Summit Therapeutics’ Bispecific Antibody Shows Positive Survival Trend in Non-Small Cell Lung Cancer
5