Nursing Outlook
Volume 55, Issue 6 , Pages 282-288.e2 , November 2007

Outcomes assessment of clinical information system implementation: A practical guide

References 

  1. In:  Kohn LT,  Corrigan JM,  Donaldson MS editor. To Err is Human: Building a Safer Health System. Washington, DC: National Academy Press; 1999;
  2. U.S. Department of Health & Human Services. HIPAA: Medical Privacy—National Standards to Protect the Privacy of Personal Health Information. Available at: http://www.hhs.gov/ocr/hipaa/. Accessed December 23, 2006.
  3. U.S. Department of Health & Human Services. The national health information infrastructure. Available at: http://aspe.hhs.gov/sp/nhii/. Accessed December 23, 2006.
  4. Office of the National Coordinator for Health Information Technology. E-Prescribing. Available at: http://www.hhs.gov/healthit/e-prescribing.html. December 23, 2006.
  5. American Health Information Management Association. The role of the Personal Health Record in the EHR. Available at: http://library.ahima.org/xpedio/groups/public/documents/ahima/bok1_027539.hcsp?dDocName=bok1_027539. Accessed December 23, 2006.
  6. Arlotto P, Oakes J. Return on Investment. Chicago, IL: Healthcare Information and Management Systems Society; 2003;
  7. Hunt ECH, Sproat SB, Kitzmiller RR. The nursing informatics implementation guide. New York, NY: Springer; 2004;
  8. Friedman CP, Wyatt JC. Evaluation methods in medical informatics. New York, NY: Springer; 1997;
  9. Ammenwerth E, Kaiser F, Wilhelmy I, Hofer S. Evaluation of user acceptance of information systems in health care—the value of questionnaires. Studies in Health Technology & Informatics. 2003;95:643–648
  10. Wyatt JC, Wyatt SM. When and how to evaluate health information systems?. Int J Med Inf. 2003;69:251–259
  11. Friedman CP, Wyatt JC. Evaluation Methods in Biomedical Informatics. New York, NY: Springer; 2006;
  12. Berkenstadt H, Yusim Y, Katznelson R, Ziv A, Livingstone D, Perel A. A novel point-of-care information system reduces anaesthesiologists’ errors while managing case scenarios. Eur J Anaesthesiol. 2006;23:239–250
  13. Giles LC, Whitehead CH, Jeffers L, McErlean B, Thompson D, Crotty M. Falls in hospitalized patients: can nursing information systems data predict falls?. CIN: Computers, Informatics, Nursing. 2006;24:167–172
  14. Desikan P, Koram MR, Trivedi SK, Jain A. An evaluation of the effectiveness of the laboratory information system (LIS) with special reference to the microbiology laboratory. Indian J Pathol Microbiol. 2005;48:418
  15. Upperman JS, Staley P, Friend K, Neches W, Kazimer D, Benes J, et al. The impact of hospital wide computerized physician order entry on medical errors in a pediatric hospital. J Pediatr Surg. 2005;40:57–59
  16. Kilbridge PM, Welebob EM, Classen DC. Development of the Leapfrog methodology for evaluating hospital implemented inpatient computerized physician order entry systems. Qual Saf Health Care. 2006;15:81–84
  17. Han YY, Carcillo JA, Venkataraman ST, Clark RS, Watson RS, Nguyen TC, et al. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116:1506–1512
  18. Friedman CP, Abbas UL. Is medical informatics a mature science? (A review of measurement practice in outcome studies of clinical systems). Int J Med Inf. 2003;69:261–272
  19. Shortliffe EH, Perreault LE, Wiederhold G, Fagan LM. Medical Informatics: Computer applications in health care and biomedicine. 2nd ed. New York, NY: Springer; 2001;
  20. Nelson L, Taylor F, Adams M, Parker DE. Improving pain management for hip fractured elderly. Orthop Nurs. 1990;9:79–83
  21. Stoop AP, Berg M. Integrating quantitative and qualitative methods in patient care information system evaluation. Methods Inf Med. 2003;4:458–462
  22. Neville D, Gates K, Tucker S, et al. Towards an evaluation framework for electronic health records initiatives: An annotated bibliography and systematic assessment of the published literature and program reports. Available at: http://www.nlchi.nf.ca/pdf/bio_feb04.pdf. Accessed December 23, 2006.
  23. Van Der Meijden MJ, Tange HJ, Troost J, Hasman A. Determinants of success of inpatient clinical information systems: a literature review. J Am Med Inform Assoc. 2003;10:235–243
  24. Mekhjian HS, Kumar RR, Kuehn L, Bentley TD, Teater P, Thomas A, et al. Immediate benefits realized following implementation of physician order entry at an academic medical center. J Am Med Inform Assoc. 2002;9:529–539
  25. Classen D. Medication safety: Moving from illusion to reality. JAMA. 2003;289:1154–1156
  26. Bates DW, Leape LL, Cullen DJ, Laird N, Petersen LA, Teich JM, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280:1311–1316
  27. Nuckolls JG. Process improvement approach to the care of patients with type 2 diabetes. Postgrad Med. 2003;113(suppl):53–62
  28. Toth-Pal E, Nilsson GH, Furhoff AK. Clinical effect of computer generated physician reminders in health screening in primary health care—a controlled clinical trial of preventive services among the elderly. Int J Med Inf. 2004;73:695–703
  29. Fung KW, Vogel LH. Will decision support in medications order entry save money? (A return on investment analysis of the case of the Hong Kong hospital authority). AMIA Annual Symposium Proceedings. 2003;244–254
  30. Krohn R. In search of the ROI from CPOE. J Healthc Inf Manag. 2003;17:6–9
  31. Taylor R, Manzo J, Sinnett M. Quantifying value for physician order-entry systems: a balance of cost and quality. Healthc Financ Manage. 2002;56:44–48
  32. Nielsen J. Usability engineering. San Diego, CA: Morgan Kaufman; 1993;
  33. Doll WJ, Torkzadeh G. The measurement of end-user computing satisfaction. MIS Quarterly. 1988;12:259–274
  34. Hatcher M. Impact of information systems on acute care hospitals: results from a survey in the United States. J Med Syst. 1998;22:379–387
  35. Lee F, Teich JM, Spurr CD, Bates DW. Implementation of physician order entry: user satisfaction and self- reported usage patterns. J Am Med Inform Assoc. 1996;3:42–55
  36. Harper B, Slaughter L, Norman K. Questionnaire administration via the WWW: A validation and reliability study for a user satisfaction questionnaire. Paper presented at WebNet 97, Association for the Advancement of Computing in Education, Toronto, Canada. Available at: http://www.lap.umd.edu/QUIS/index.html. Accessed December 23, 2006.
  37. Mazzoleni MC, Baiardi P, Giorgi I, Franchi G, Marconi R, Cortesi M. Assessing users’ satisfaction through perception of usefulness and ease of use in the daily interaction with a hospital information system. Proceedings/AMIA Annual Fall Symposium. 1996;752–756
  38. Hatcher M. Survey of acute care hospitals in the United States relative to technology usage and technology transfer. J Med Syst. 1997;21:323–337
  39. Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. J Am Med Inform Assoc. 2005;12:505–516
  40. Galanter WL, Polikaitis A, DiDomenico RJ. A trail of automated safety alerts for inpatient digoxin use with computerized physician order entry. J Am Med Inform Assoc. 2004;11:270–277
  41. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163:1409–1416
  42. Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA. 2005;293:1197–1203
  43. Turner CL, Casbard AC, Murphy MF. Barcode technology: its role in increasing the safety of blood transfusion. Transfusion. 2003;43:1200–1209
  44. Delpierre C, Cuzin L, Fillaux J, Alvarez M, Massip P, Lang T. A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach?. Int J Qual Health Care. 2004;16:407–416
  45. Erstad TL. Analyzing computer based patient records: a review of literature. J Healthc Inf Manag. 2003;17:51–54
  46. Glaser JP, DeBor G, Stuntz L. The New England Healthcare EDI Network. J Healthc Inf Manag. 2003;17:42–50
  47. Newell LM, Christensen D. Who’s counting now? (ROI for patient safety IT initiatives). J Healthc Inf Manag. 2003;17:29–35
  48. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in health and medicine. New York, NY: Oxford University Press; 1996;
  49. Phillips JJ, Phillips PP. Action: Measuring Return on Investment. Vol 3. Alexandria, VA: American Society for Training & Development; 2001;
  50. Chaiken BP. Clinical ROI: Not just costs versus benefits. J Healthc Inf Manag. 2003;17:36–41
  51. Snyder-Halpern R, Wagner MC. Evaluating return-on-investment for a hospital clinical information system. Comput Nurs. 2000;18:213–219
  52. Corley ST. Electronic prescribing: a review of costs and benefits. Top Health Inf Manage. 2003;24:29–38
  53. Polit DF, Beck CT. Nursing Research: Principles and Methods. 7th ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2004;
  54. Overhage JM, Tierney WM, Zhou XH, McDonald CJ. A randomized trial of “corollary orders” to prevent errors of omission. J Am Med Inform Assoc. 1997;4:364–375
  55. Cook TD, Campbell DT. Quasi-Experimentation: Design & Analysis Issues for Field Settings. Boston, MA: Houghton Mifflin; 1979;
  56. Barnes R. Motion and Time Study: Design and Measurement of Work. 7th ed. Hoboken, NJ: Johns Wiley & Sons, Inc; 1980;
  57. Aday LA. Designing and Conducting Health Surveys: A comprehensive guide. 2nd ed. San Francisco, CA: Jossey-Bass; 1996;
  58. Dix A, Finlay J, Abowd G, Beale R. Human-computer Interaction. 3rd ed. London: Prentice Hall Europe; 2003;
  59. Preece J, Rogers Y, Sharp H. Interaction design: beyond human-computer interaction. New York, NY: John Wiley & Sons; 2002;
  60. Ammenwerth E, Iller C, Mansmann U. Can evaluation studies benefit from triangulation? (A case study). Int J Med Inf. 2003;70:237–248
  61. Blignaut PJ, McDonald T, Tolmie CJ. Predicting the learning and consultation time in a computerized primary healthcare clinic. Comput Nurs. 2001;19:130–136
  62. Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001;345:965–970
  63. Manfredini R, Boari B, Smolensky MH, et al. Seasonal variation in onset of myocardial infarction—a 7-year single-center study in Italy. Chronobiol Int. 2005;22:1121–1135

PII: S0029-6554(07)00206-0

doi: 10.1016/j.outlook.2007.09.003

Nursing Outlook
Volume 55, Issue 6 , Pages 282-288.e2 , November 2007

Article Tools