Introduction: With funding from a grant from NIH/NIAAA (#1R44AA016724-01A1), we created an online medical student curriculum on alcohol abuse. To assess mastery of clinical concepts, we developed a novel method of conducting remote live standardized patient interviews using Google chat, where a trained staff member is the SP. In advance of a summative evaluation in Spring 2010, we conducted a pilot test to assess utility of the case and gather student feedback.

Project Description/Methods: We developed a standardized patient case, Cynthia Stewart, who presents with insomnia and is diagnosed with alcohol abuse. Five third year students interviewed Cynthia during a 45 minute Google chat. Students completed the online courses, then performed a second SP interview. Clinical skill competency was measured using a 13 item done/not done checklist completed by both the SP and an independent reviewer. Interpersonal skills were evaluated by the SP using a 9-item checklist and a 5 point Likert scale. Student self-assessment, assessment of the SP by the student, and patient notes were also collected.

Outcomes: Clinical skill competency rose modestly from pre-test (64%) to post-test (77%). Interpersonal skills rose modestly from pre-test (2.65) to post-test (3.22). Student self-assessment of interpersonal skills were much higher (4.03 pre and 4.11 post) than those assessed by the SP. Students had a favorable view of the SP performance (3.90 post experience). All students correctly identified alcohol abuse on the patient notes.

Students were asked usability questions about the standardized patient experience. Eighty percent (4/5) agreed or strongly agreed that the interviewing process was a valuable learning experience, that the SP interviews were consistent pre/post experience, and that the patient case was typical of a real patient. All students (n=5) agreed or strongly agreed that the SP interview via Google chat was an interesting way to practice clinical skills. Students provided open-ended feedback on ways to increase the difficulty of the SP case.

Conclusions: Students were able to improve clinical skills through a chat-based SP interview. The data allows the development team to refine the patient case and conduct a more thorough evaluation with a larger n.