Idea: For medical students in the pre-clinical years, Standardized Patients (SPs) can help the learner integrate medical science knowledge into a clinical framework. A remote SP experience, where the encounter occurs via the Internet in comparison to traditional “face-to-face” encounters, could offer many advantages.

Why the Idea was Necessary: A pool of remote SPs could be potentially less expensive, and more available. Also, the remoteness may offer an opportunity for more variety in patients and the anonymity may offer other benefits. Although there is an abundance of experience with the utilization of SPs in a live context, the concept of utilizing remote SPs is novel. There are few standards to guide educators interested in utilizing SPs remotely.

What Needs to be Done: We seek to determine the parameters that would define a successful remote SP encounter. We seek to reach consensus regarding the implementation of a remote SP experience from leaders in medical education innovation.

Evaluation Plan: A modified Delphi approach will be used to gather feedback. After explaining the theory behind the “remote” SP encounter, we will then use iterative rounds of discussion to create the framework on which to build our “remote” SP experience. As an example, we will reach consensus on learner-patient interaction technology as follows: Round 1 will present options for modes of delivery (chat, video, discussion boards, or other technology) and elicit further suggestions. Based on responses, we will ask participants to rate the importance of the mode of delivery in Round 2. Discussions will continue until a general consensus is reached on the optimal mode of delivery of the proposed remote SP experience. Additional consensus will be sought in terms of how to integrate remote SPs into other educational approaches (such as TBL), the value of being able to engage a diverse population of SPs, and the value and potential of anonymity.

Future Development: Once the framework of the remote SP program is developed, we will create, integrate, and evaluate the use of remote SP to impart knowledge and clinical skills training in medical school education via our NIAAA funded project.

Clinical skills assessment exams using Standardized patients (SPs) are an established component of medical school education, including the current USLME Step 2 CS exam™. The authors have developed a novel method for conducting SP encounters using web-based chat technology (e.g. Google® chat). “Remote Live Standardized Patient” (RLSP) interviews are conducted entirely online. The interview requires active learner participation focused on clinical skills, and represents a unique solution to teaching specific skills and affecting behavior. We are not aware of other educators using chat for this purpose. We have been pilot testing chat-based OSCE-style exams1,2 since 2007. In 2009 we have begun using RLSPs to teach skills, as well as evaluate them. The instructional RLSP key components include an interactive SP actor, an EMR like interface, and a “Hats Off” mode, which allows the student learner to “ask a preceptor” or research information during the encounter. Each learner’s performance is evaluated by standardized measures and by the RLSP actor feedback. This interactive, responsive web environment allows the RLSP interview to simulate a broad spectrum of learner/patient encounters, from initial screening through diagnosis and treatment.

Advantages include 1) decreased SP training cost and time commitment, 2) more flexible SP scheduling and recruiting since all encounters occur online, 3) elimination of face-to-face constraints of verisimilitude errors and correlation of actor physical appearance compared to the “patient”, and 4) instant availability of chat conversation transcripts for review and learner feedback. Potential limitations include missing the “whole person” experience afforded by face-to-face encounters, including the ability to assess body language and demonstrate physical exam skills. Since face-to-face SP encounters also suffer from realism limitations (i.e. the actor does not typically have the “patient's” presenting symptoms), we feel that the advantages of an RLSP balance and actually outweigh the drawbacks.

Use of web-based chat or its equivalent may have significant appeal to the current generation of Internet-savvy medical students. The RLSP experience appears to be a viable alternative to the traditional face-to-face SP interview, allows cost savings, and prepares students for Step 2 CS-style exams.

USE OF A REMOTE, LIVE STANDARDIZED PATIENT TO ASSESS MASTERY OF CLINICAL SKILLS ON ALCOHOL ABUSE AND DEPENDENCE Susan Wilhelm, PhD, T Bradley Tanner, MD, and Mary P Metcalf, PhD, MPH Clinical Tools Inc, Chapel Hill, NC, USA Introduction: With funding from a NIH/NIAAA grant (#1R44AA016724– 01A1), we created an online medical student curriculum on alcohol abuse. To assess mastery of clinical concepts, we developed a novel method of conducting remote live standardized patient (SP) interviews using Google® chat, with a trained staff member as the SP. In advance of a summative evaluation in 2010, we conducted a pilot test to assess the utility of the case and gather student feedback. Methods: We developed a standardized patient case, Cynthia Stewart, who presents with insomnia and is diagnosed with alcohol abuse. Five third-year students interviewed Cynthia during a 45-minute Google® chat experience. Students completed eight online courses, then performed a second SP interview. Clinical skill competency was measured using a 13-item done/not done checklist completed by both the SP and an independent reviewer. Interpersonal skills were evaluated by the SP using a 9-item checklist and a 5- point Likert scale. Student self-assessment, assessment of the SP by the student, and patient notes were also collected. Results: Clinical skill competency rose modestly from pre-test (64%) to post-test (77%). Interpersonal skills rose modestly from pre-test (2.65) to post-test (3.22). Although sample size (n
5) was too small for determination of statistical significance, the results are encouraging for future studies. Student self-assessment of interpersonal skills were much higher (4.03 pre and 4.11 post) than those assessed by the SP. A majority of students (80%) rated the SP performance as very good or excellent. All students correctly identified alcohol abuse as a possible differential diagnosis on patient notes. We obtained usability feedback about the standardized patient post-experience. Eighty percent (4/5) agreed or strongly agreed that the interviewing process was a valuable learning experience, that the SP interviews were consistent pre/post experience, and that the patient case was typical of a real patient. All students (n
5) agreed or strongly agreed that the SP interview via Google® chat was an interesting way to practice clinical skills. Students provided open-ended feedback on ways to increase the difficulty of the SP case. Conclusions: Students were able to improve clinical skills through a chat-based SP interview. Improvements in advance of a more thorough evaluation with a larger n include refinements to the patient case and assessments and creation of a second SP case to increase variability pre/post experience.

Background: With support from NIAAA (#4R44AA016724-02) we are developing an online curriculum to educate and enhance clinical skill development in Year 2 to 4 medical students on at risk drinking and alcohol use disorders. Objective: Medical students were surveyed to understand learning preferences regarding the topics covered and the case-based learning environment. Program Description: Recruited through a convenience sampling approach, medical students (n=17) completed an on-line survey regarding their interests and perceived needs. Quantitative analyses of responses to multiple choice and 1-5 point Likert scale questions guided development of a case-based online curriculum. Program Evaluation Outcome: Students felt inadequately prepared [1=not prepared, 5=fully prepared] to address the following: ability to treat alcohol use disorders in patients with other addictions (1.65), ability to treat alcohol use disorders (1.76), ability to treat alcohol use in patients at risk for alcohol use disorders (1.76), ability to triage alcohol use disorder patients to appropriate treatment areas (2.00), recognition and treatment/proper referral of relapse to alcohol use disorders (1.88). Students were most interested in learning more about [1=uninterested, 5=very interested]: brief interventions (3.94), co-morbidities (3.94) and case studies representing a variety of patient experiences (4.41). Students would likely use an optional live remote Standardized Patient learning experience [1=strongly disagree, 5=strongly agree] (3.41) and would like to have the option available to them (3.53). A Web-based case interface (4.12) and online chat discussion with the patient (3.94) were preferred. Students preferred to learn clinical skills in multiple short cases compared to one long case (77%). Conclusions: Medical students identify many deficits in their knowledge and skills especially those skills that would be essential in any practice. They express interest in an experience using a live remote standardized patient which would focus on alcohol intervention skills training.

With support from NIAAA (#4R44AA016724-02) we are developing an online curriculum to educate and further clinical skill development in Year 2 to 4 medical students on at risk drinking and alcohol disorders. Through a convenience sampling approach, fifteen medical school faculty took an on-line survey to obtain preference information regarding case-based instruction. Almost all of the faculty (n=14) preferred multiple short cases to cover one topic, rather than one long case in a module. In a course with both didactic and case information, half of the faculty (n=7) preferred three cases per one hour course. When presenting the case to students, 66.7% (n=10) preferred that information be general. To enhance clinical skill development, we queried respondents as to their preferences for using a remote live Standardized Patient (SP) interview within the learning experience. Fourteen out of fifteen (93%) felt that an online SP experience would be an interesting way to teach skills and 87% (13/15) would be willing to use the online SP with their students. Faculty preferred that students receive basic patient case information online through the website (80%; 12/15) and an Internet chat (i.e. Google or Skype) was rated high for conversing with the live SP. We queried about potential topics. Respondents showed a clear interest in supplementing their teachings with materials on assessment and screening (80%, n=12), providing brief interventions (87%, n=13), common co-morbidities of alcohol use disorders (80%, n=12), and referring patients for treatment (87%, n=13). Based on their experience with medical students, the respondents felt that medical students would be interested in learning more about the biology behind addiction (80%, n=12), co-morbid diseases associated with long-term alcohol use (67%, n=10), and recognizing abuse in health case professions (80%, n=12). Support for the planned curriculum including the method of providing online learning was high.

1. Objectives:
   1. The presenters will discuss the development of an Internet based educational program designed to teach medical students about alcohol use disorders.
   2. The presenters will discuss the research methods and results of a pilot study with medical students to measure the effectiveness of a prototype module.
   3. The presenters will discuss the implications of the research results as they relate to medical student education.
2. Content (Topics):
   1. Research hypotheses and aims (Obj 1)
   2. Development of curriculum plan and prototype module (Obj 1)
   3. Research methods and results of effectiveness pilot study with the target audience (Obj 2)
   4. Implementation of research results (Obj 3)
3. Teaching Strategies:
   We will employ both didactic and case based learning approaches to educate medical students about alcohol use disorders. The outcome measures will assess learning and will emphasize clinical experience.
   

Alcohol use disorders continue to be a growing problem in the United States. Fifty-three percent of Americans consume alcohol on a regular basis (SAMHSA, 2006). Approximately 6% of those users meet the criteria for alcohol abuse or dependence (SAMHSA, 2005); 3% of the U.S. population. Currently, alcohol use disorders are only covered superficially in many medical schools. Future physicians may lack the necessary knowledge and skills to effectively screen, assess, and intervene with patients with alcohol use disorders. The topic of alcohol dependence is a topic well-suited to teach medical students about the role of practicing physicians in substance abuse treatment, complicated multi-disciplinary treatment issues, complex biological and social basis of addictions, and how new treatments are developed and moved into practice. During Phase I of the grant, we are developing a curriculum plan for a suite of modules on these issues as they relate to alcohol abuse and dependence with input from a focus group of medical school professionals with experience in substance abuse education. The prototype module entitled "Overview of Alcohol Use Health Issues" was developed and is undergoing usability and pilot testing with medical students in their 2nd through 4th years of study. More in-depth pilot testing will assess the impact of the pilot module on the attitudes, self-efficacy, and intended behavior of medical students, as well as changes in knowledge and satisfaction with the module material.