App-based serious gaming for training of chest tube insertion: study protocol for a randomized controlled trial
Trials volume 18, Article number: 56 (2017)
Chest tube insertion is a standard intervention for management of various injuries of the thorax. Quick and accurate execution facilitates efficient therapy without further complications. Here, we propose a new training concept comprised of e-learning elements as well as continuous rating using an objective structured assessment of technical skills (OSATS) tool. The study protocol is presented for a randomized trial to evaluate e-learning with app-based serious gaming for chest drain insertion.
The proposed randomized trial will be carried out at the Department of Orthopedics and Traumatology at Heidelberg University in the context of regular curricular teaching for medical students (n = 90, 3rd to 6th year). The intervention group will use e-learning with the serious gaming app Touch Surgery (TM) for chest drain insertion, whereas the control group uses serious gaming for an unrelated procedure. Primary endpoint is operative performance of chest drain insertion in a porcine cadaveric model according to OSATS.
The randomized trial will help determine the value of e-learning with the serious gaming app Touch Surgery (TM) for chest drain insertion by using the OSATS score. The study will improve surgical training for trauma situations.
Trial Registration Number, DRKS00009994. Registered on 27 May 2016.
Chest tube insertion is an established minimally invasive surgical intervention in treatment of acute trauma patients bearing injuries of the lungs and thorax. It is the gold standard with regards to emergency care of pneumothorax or serial rib fractures as well as lesions of pulmonary vessels resulting in a hematothorax . Chest tube insertion is equally performed in preclinical care and the clinical setting, yielding the need for procedural proficiency of physicians in both the field and the in-hospital emergency setting. Anatomical knowledge of the structures involved, an accurate positioning and standardized execution are crucial to a treatment, which is as quick and accurate as possible. Correct chest tube insertion facilitates efficient therapy without time loss or further complications that are potentially lethal because of the intervention’s vicinity to vital organs . Thus, there is a need for a comprehensive training and assessment prior to the emergency situation that enables both versed physicians and novices to acquire proficiency in chest tube insertion. Early and decisive training using a tool as such might standardize handling of these emergency situations and could translate to improved trauma care and outcome. E-learning has been shown to be a valuable asset to surgical training [3–5]. Since computer games are believed to be commonplace for today’s students and their experience potentially enables them to profit from different approaches, the concept of ‘serious gaming’ is subject to training research [6–9]. Since serious games have already been evaluated in various situations within the framework of surgery, our aim is to expand the investigation of this multimedia training approach to trauma medicine and standard emergency interventions.
To advance and standardize training success without straining staff and resources, we use an objective structured assessment of technical skill (OSATS) for chest tube insertion to standardize expert rating . The OSATS tool for chest drain insertion was developed based on key steps of correct chest tube insertion, originally published by Hutton et al., which were modified and amended by a team of trauma and general surgeons . Ten representative procedural steps can be evaluated separately using a 5-point Likert scale complemented by detailed formulation of performance levels. Trainee’s performance in sub-steps adds up to a maximum total score of 50 points and a minimum score of 10 points, respectively.
The OSATS is used in a randomized controlled trial (RCT) investigating a serious gaming approach for training of chest tube insertion for medical students in a standardized and structured setting with the validated surgical training app Touch Surgery™ (TS) (Kinosis Ltd., London, UK) . The study protocol for the RCT is described in the present manuscript.
Methods and Design
Primary objective of this study is to evaluate training outcome of a structured chest drain training curriculum that comprises elements of serious gaming. Both operative and time-dependent performances of participants are analyzed. Secondary goals include character profiling concerning previous experience and specific extracurricular activities. Thus, participants particularly benefiting from the presented training concept as well as obstacles and positive impulses when training with standardized E-learning platforms might be identified. Evaluation of serious gaming elements in student teaching is also performed to evaluate the potential establishment of such modalities in medical school curricula.
This is a registered prospective, single-center, rater-blinded, two-arm, parallel-group randomized controlled trial (DRKS00009994).
Setting and participants
This study is carried out in the training center of the Department of Orthopedics and Traumatology at Heidelberg University. This study is conducted in the context of regular curricular teaching for medical students during their clinical years (3rd to 6th year) at Heidelberg University.
Inclusion and exclusion criteria
The inclusion criterion mandates that participants are medical students in their clinical years (3rd–6th year) at Heidelberg University who have completed their 18th year of age. Previous participation in surgical training courses including insertion of chest drains is not an exclusion criterion but will be recorded and analyzed.
Blocked randomization, stratified by gender, is used to randomly assign participants to each group (1:1 ratio), resulting in one intervention and one control group. Randomization is performed by an employee not involved in training, rating or data collection regarding the present study using opaque, sealed envelopes. As student recruitment to the study will be completed before randomization, any influence of randomization results or subsequent task assignments is considered minimal.
Training is conducted according to the structured training curriculum outlined in Fig. 1 (study protocol flow chart) and supervised by experienced surgeons not involved in the randomization or analysis of study results. Students participate in two training sessions lasting 120 min each. At the beginning of the first session and after a theoretic introduction to the procedure, participants in groups 1 and 2 are asked to study the E-learning material assigned to them until they reach an overall app-based score of 100% on performance of the assigned module. Intervention group students use the TS module “Chest Drain Insertion,” while participants in the control group are asked to practice the unrelated module “Central Venous Catheter Insertion.” Control group participants otherwise attend every introduction and assessment included in the training sequence. Performance of the assigned training modules will be monitored to ensure adherence to each group-specific protocol. As this study is conducted in the context of the regular curriculum, dropouts, if any, are expected to be very few. Additionally, we created a highly efficient curriculum. This results in a short intervention period facilitating reduction of attrition bias as suggested by Little et al. .
Participants perform chest drain insertion on an accordingly prepared porcine model during the second training session. Performance is videotaped and rated by two different raters on-site using the modified OSATS tool for chest drain insertion (Table 1). The raters are blinded to the training status of the participants. An additional video-based evaluation is performed by a blinded rater according to the same scoring tool. The modified OSATS for chest drain insertion was evaluated in a pilot study and showed good construct validity for distinction between experience levels. Unblinding of raters or employees involved in data analysis and interpretation is not intended. To prevent selection bias, baseline characteristics including age, year of studies, previous experience, gender and hobbies will be compared. Baseline testing on a porcine model is not performed as the hypothesis is that the proposed curriculum, consisting of multimedia training material only, will directly improve performance. The aim of the training curriculum and study is to prepare novices for their first performance of chest drain placement. Baseline testing on a real model could disguise the effect of the training curriculum.
Primary outcome measure
Primary endpoint is operative performance chest drain placement according to the standardized and evaluated OSATS scoring tool as measured by direct observation by the blinded raters during the course. Gaussian distribution of the total score can be assumed.
Operative performance by gender- and experience-dependent subgroup analyses, time-dependent performance, correlation with extracurricular activities and hobbies, subjective self-assessment as well as possible differences and bias between on-site and video ratings are examined as secondary endpoints .
Mean and standard deviation in case of continuous data, with absolute and relative frequencies for categorical parameters, are used to describe the distributions of all parameters of interest. Possible differences of the primary outcome and OSATS score will be tested using analysis of covariance with intervention group as factor, participants’ self-attributed expertise score as covariate and OSATS score after intervention as dependent variable. Secondary endpoints will be descriptively analyzed according to their respective distribution with t-tests in case of continuous data and chi-square test in case of categorical data. Multiple imputation will be applied to compensate for any missing data. If it is found to be appropriate, graphical statistical methods will be deployed to illustrate findings.
Sample size determination
According to results of the pilot study with an identical primary endpoint and conducted in a similar context, group size was determined to be 45 participants randomized to each group. The OSATS for chest drain insertion evaluated in the pilot study will be used as primary endpoint with a relevant mean difference of 3 ± 5 points in the scoring system. Differences can be detected with a significance level α = 0.05 and a power of 1-β = 0.8. Intervention group sizes will exceed this determined sample size.
This study aims to teach important aspects of trauma surgery to medical students using elements of serious gaming. We believe this approach proves additionally beneficial to outcome when teaching today’s digitally experienced medical trainees. Our hypothesis is both that participants will profit from the supplemented training curriculum and that the modified OSATS tool can subsequently objectify their improved skill level. This study will therefore help to investigate potential improvements of current curricula by serious gaming and may even provide a reliable training control for medical trainees with the modified OSATS aiming at a safe execution of this crucial emergency procedure. Serious gaming might as a result be integrated into modern medical school curricula for surgical residents as well. Further investigations and outcomes of this study will increase the available knowledge about criteria to be met in order to ensure optimal surgical training for trauma situations.
The randomized controlled trial recruitment and conduction of assessments are planned from June to December 2016. Data analysis and evaluation will be performed subsequently. Final results of this study will be published.
Miller KS, Sahn SA. Chest tubes. Indications, technique, management and complications. Chest. 1987;91(2):258–64.
Menger R, Telford G, Kim P, Bergey MR, Foreman J, Sarani B, Pascual J, Reilly P, Schwab CW, Sims CA. Complications following thoracic trauma managed with tube thoracostomy. Injury. 2012;43(1):46–50.
Pape-Koehler C, Immenroth M, Sauerland S, Lefering R, Lindlohr C, Toaspern J, Heiss M. Multimedia-based training on Internet platforms improves surgical performance: a randomized controlled trial. Surg Endosc. 2013;27(5):1737–47.
Nickel F, Brzoska JA, Gondan M, Rangnick HM, Chu J, Kenngott HG, Linke GR, Kadmon M, Fischer L, Muller-Stich BP. Virtual reality training versus blended learning of laparoscopic cholecystectomy: a randomized controlled trial with laparoscopic novices. Medicine (Baltimore). 2015;94(20):e764.
Nickel F, Hendrie JD, Bruckner T, Kowalewski KF, Kenngott HG, Muller-Stich BP, Fischer L. Successful learning of surgical liver anatomy in a computer-based teaching module. Int J Comput Assist Radiol Surg. 2016;11(12):2295–2301. Epub 2016 Feb 12.
Cowan B, Sabri H, Kapralos B, Moussa F, Cristancho S, Dubrowski A. A serious game for off-pump coronary artery bypass surgery procedure training. Stud Health Technol Inform. 2011;163:147–9.
Nosek TM, Cohen M, Matthews A, Papp K, Wolf N, Wrenn G, Sher A, Coulter K, Martin J, Wiesner GL. A serious gaming/immersion environment to teach clinical cancer genetics. Stud Health Technol Inform. 2007;125:355–60.
Shewaga R, Knox A, Ng G, Kapralos B, Dubrowski A. Z-DOC: a serious game for Z-plasty procedure training. Stud Health Technol Inform. 2013;184:404–6.
Verdaasdonk EG, Dankelman J, Schijven MP, Lange JF, Wentink M, Stassen LP. Serious gaming and voluntary laparoscopic skills training: a multicenter study. Minim Invasive Ther Allied Technol. 2009;18(4):232–8.
Faulkner H, Regehr G, Martin J, Reznick R. Validation of an objective structured assessment of technical skill for surgical residents. Acad Med. 1996;71(12):1363–5.
Hutton IA, Kenealy H, Wong C. Using simulation models to teach junior doctors how to insert chest tubes: a brief and effective teaching module. Intern Med J. 2008;38(12):887–91.
Sugand K, Mawkin M, Gupte C. Validating Touch Surgery: A cognitive task simulation and rehearsal app for intramedullary femoral nailing. Injury. 2015;46(11):2212–6.
Little RJ, D'Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, Frangakis C, Hogan JW, Molenberghs G, Murphy SA, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355–60.
Nickel F, Hendrie JD, Stock C, Salama M, Preukschas AA, Senft JD, Kowalewski KF, Wagner M, Kenngott HG, Linke GR, et al. Direct observation versus endoscopic video recording-based rating with the objective structured assessment of technical skills for training of laparoscopic cholecystectomy. Eur Surg Res. 2016;57(1–2):1–9.
Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, Dickersin K, Hrobjartsson A, Schulz KF, Parulekar WR, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.
Schulz KF, Altman DG, Moher D, Group C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9(8):672–7.
The trial was supported by the Heidelberg Surgery Foundation. We acknowledge the financial support of the Deutsche Forschungsgemeinschaft and Ruprecht-Karls-Universität Heidelberg within the funding program Open Access Publishing. The funders play no role in the study design, collection, management, analysis and interpretation of data or the final report and its publication, nor do they have ultimate authority over any of these actions.
Availability of data and materials
Access to all data sets and statistical code will be granted individually upon request. The previously developed OSATS scoring sheet will be made publically available (Table 1).
Study conception and design: FN, CB, MF, PH, BPM-S, MCT. Acquisition of data: CB, MCT, PH. Data monitoring and statistical analysis: TB. Analysis and interpretation of data: MF, FN, BPM-S. Drafting of manuscript: MF, FN, K-FK, TB. Critical revision: BPM-S, MCT, PH. All authors read and approved the final version (1.2) of this manuscript. Authorship eligibility guidelines according to the ICMJE were followed. The use of professional writers is not intended.
The authors declare that they have no competing interests.
Consent for publication
Written informed consent for participation and publication of the acquired anonymous data will be obtained from each participant.
Ethics approval and consent to participate
Ethical approval was obtained by the Ethics Committee of the University of Heidelberg Medical Faculty prior to the beginning of the study (Ethikkommission I der Medizinischen Fakultät Heidelberg, S-174/2016). This trial was registered with the German Clinical Trials Register (DRKS) in Freiburg, a primary registry within the WHO Registry Network, Germany, on 27 May 2016 with the trial registration number DRKS00009994. The CONSORT extension for non-pharmacological interventions and SPIRIT guidelines for implementation of study protocols were followed (Fig. 2 and additional file 1) [15, 16]. Written informed consent will be obtained from each student. In the event that a participant’s physical or mental health becomes jeopardized because of participation in the present study, the participant will be dismissed immediately and excluded from the study. All protocol modifications will be registered with the DRKS, published in the final paper and communicated to the participants.
About this article
Cite this article
Friedrich, M., Bergdolt, C., Haubruck, P. et al. App-based serious gaming for training of chest tube insertion: study protocol for a randomized controlled trial. Trials 18, 56 (2017). https://doi.org/10.1186/s13063-017-1799-5
- Chest tube insertion
- Serious gaming