Transitioning from Paper to Electronic Medical Records in Austrian Helicopter Emergency Medical Services: A Usability Evaluation
Main Article Content
Keywords
digital health, electronic health records, emergency medical services, air ambulances, user-centered design
Abstract
Introduction: This study examines the development and usability evaluation of an electronic documentation application specifically designed for the Austrian Helicopter Emergency Medical Service (HEMS). The primary objective is to assess how HEMS crew members, accustomed to paper-based documentation, perceive the usability of the electronic system.
Method: The application was developed using React Native and tailored to the unique demands of the high-stress environment characteristic of HEMS. No existing digital documentation solutions were analyzed or incorporated; instead, the design was grounded entirely in evidence-based practices. The development process underwent iterative refinement based on user feedback in collaboration with a HEMS crew member. A total of thirty healthcare professionals were recruited through convenience and purposive sampling methods. Usability was evaluated using the System Usability Scale (SUS), complemented by qualitative insights obtained from open-ended questions.
Results: The findings indicate an average System Usability Scale (SUS) score of 79.92. Notably, older and more experienced users, as well as those possessing advanced digital skills, provided favorable ratings for the application. Conversely, younger and less experienced users exhibited lower levels of satisfaction. The qualitative analysis revealed four primary themes: automation and integration, the need for improvement and adaptation, a positive disposition towards the application, and prioritization of simplification and efficiency despite existing concerns.
Conclusion: This study underscores the necessity for ongoing optimization within digital healthcare applications, highlighting the critical alignment with user needs. Future developments should prioritize not only technical enhancements but also the optimization of the overall user experience.
References
[2]Bickmann P, Froböse I, Grieben, C. An mHealth Application in German Health Care System: Importance of User Participation in the Development Process. Journal of Medical Systems. 2024;48(1):20. https://doi.org/10.1007/s10916-024-02042-6.
[3] Grigg E, Palmer A, Grigg J, et al. Randomised trial comparing the recording ability of a novel, electronic emergency documentation system with the AHA paper cardiac arrest record. Emergency Medicine Journal.2014;31(10):833‒839. https://doi.org/10.1136/emermed-2013-202512.
[4] Mullins A, O’Donnell R, Mousa M, et al. Health Outcomes and Healthcare Efficiencies Associated with the Use of Electronic Health Records in Hospital Emergency Departments: a Systematic Review. Journal of Medical Systems.2020;44(12):200. https://doi.org/10.1007/s10916-020-01660-0.
[5] Smith J, Jakobsson A, Kain VJ, Kandasamy Y, Bragg R. Neonatal electronic resuscitation app documentation (NeRD): Electronic documentation compared to written documentation. Journal of Neonatal Nursing. 2023;29(2):290‒295. https://doi.org/https://doi.org/10.1016/j.jnn.2022.07.013.
[6] Thielmann B, Schnell J, Böckelmann I, Schumann H. Analysis of Work Related Factors, Behavior, Well-Being Outcome, and Job Satisfaction of Workers of Emergency Medical Service: A Systematic Review (in English). International Journal of Environmental Research and Public Health. 2022;19(11):6660. https://doi.org/10.3390/ijerph19116660.
[7] ÖAMTC. Flugrettung. https://www.oeamtc.at/thema/flugrettung/#zahlen-16099094. Accessed September 2, 2024).
[8] ÖAMTC. Flugrettung. https://web.helirescue.at/flugrettungsbetreiber/oeamtc-flugrettung/ Aaccessed September 2, 2024.
[9] Martins AI, Santinha G, Almeida AM, et al. Consensus on the Terms and Procedures for Planning and Reporting a Usability Evaluation of Health-Related Digital Solutions: Delphi Study and a Resulting Checklist (in English). Journal of Medical Internet Research. 2023;25. https://doi.org/10.2196/44326.
[10] Golzar J, Noor S, Tajik O. Convenience Sampling. International Journal of Education & Language Studies. 2022;1(2):72‒77. https://doi.org/10.22034/ijels.2022.162981.
[11] Campbell S, Greenwood M, Prior S, et al. Purposive sampling: complex or simple? Research case examples. Journal of Research in Nursing. 2020;25(8):652-661. https://doi.org/10.1177/1744987120927206.
[12] Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. International Journal of Medical Informatics. 2019;126:95-104. https://doi.org/https://doi.org/10.1016/j.ijmedinf.2019.03.018.
[13] Cazañas A, de San Miguel A, Parra E. Estimating Sample Size for Usability Testing, Enfoque UTE. 2017;8:172-185.
[14] Pannucci CJ, Wilkins EG. Identifying and avoiding bias in research (in English). Plastic and Reconstructive Surgery. 2010:126(2):619‒625. https://doi.org/10.1097/PRS.0b013e3181de24bc.
[15] Wei Y, Zheng P, Deng H, et al. Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis (in English). Journal of Medical Internet Research. Review. 2020;22(12:e21687. https://doi.org/10.2196/21687.
[16] Llorens-Vernet P, Miró J. Standards for Mobile Health-Related Apps: Systematic Review and Development of a Guide (in English). JMIR mHealth and uHealth. 2020;8(3):e13057. https://doi.org/10.2196/13057.
[17] Wills P. Colour Therapy: An Introductory Guide to the Healing Power of Colour. Element, 2000.
[18] Kaiser PK. Physiological response to color: A critical review. Color Research & Application. 1984;9(1):29‒36. https://doi.org/https://doi.org/10.1002/col.5080090106.
[19] Gupta R. Color therapy in mental health and well being." International Journal of All Research Education and Scientific Methods (IJARESM). 2455‒6211, 2021.
[20] Weisenmiller EM. A study of the readability of on-screen text. Virginia Polytechnic Institute and State University, 1999.
[21] Chandran S, Al-Sa’di A, Ahmad, E. Exploring user centered design in healthcare: a literature review. In: 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), 2020: IEEE, 1‒8.
[22] Wronikowska MW, Malycha J, Morgan LJ, et al. Systematic review of applied usability metrics within usability evaluation methods for hospital electronic healthcare record systems. Journal of Evaluation in Clinical Practice. 2021:27(6):1403‒1416. https://doi.org/10.1111/jep.13582.
[23] Gao M, Kortum P, Oswald FL. Multi-language toolkit for the system usability scale. International Journal of Human–Computer Interaction. 2020;36(20):1883‒1901.
[24] Brooke J. SUS-A quick and dirty usability scale. In: P Jordan, B Thomas, B Weerdmeester (eds.). Usability evaluation in industry. London, UK: Taylor & Francis, 1996, 189‒194.
[25] Schreier M. Qualitative content analysis in practice. Sage Publications Ltd., 2012.
[26] Lewis JR, Sauro J. Item benchmarks for the system usability scale. Journal of Usability Studies. 2018:13(3).
[27] Melnick ER, Dyrbye LN, Sinsky CA, et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clinic Proceedings. 2020; 95(3):476‒487, https://doi.org/10.1016/j.mayocp.2019.09.024.
[28] Sauro J, Lewis JR. Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann, 2016.
[29] Gesulga JM, Berjame A, Moquiala KS, Galido A. Barriers to Electronic Health Record System Implementation and Information Systems Resources: A Structured Review. Procedia Computer Science. 2017;124:544‒551.https://doi.org/10.1016/j.procs.2017.12.188.
