Article Text
PDF
Abstract
Objective The aim of this study was to determine the experience with, and the feasibility of, point-of-view video recordings using eye-tracking glasses for training and reviewing neonatal interventions during the COVID-19 pandemic.
Design Observational prospective single-centre study.
Setting Neonatal intensive care unit at the Leiden University Medical Center.
Participants All local neonatal healthcare providers.
Intervention There were two groups of participants: proceduralists, who wore eye-tracking glasses during procedures, and observers who later watched the procedures as part of a video-based reflection.
Main outcome measures The primary outcome was the feasibility of, and the proceduralists and observers’ experience with, the point-of-view eye-tracking videos as an additional tool for bedside teaching and video-based reflection.
Results We conducted 12 point-of-view recordings on 10 different patients (median gestational age of 30.9±3.5 weeks and weight of 1764 g) undergoing neonatal intubation (n=5), minimally invasive surfactant therapy (n=5) and umbilical line insertion (n=2). We conducted nine video-based observations with a total of 88 observers. The use of point-of-view recordings was perceived as feasible. Observers further reported the point-of-view recordings to be an educational benefit for them and a potentially instructional tool during COVID-19.
Conclusion We proved the practicability of eye-tracking glasses for point-of-view recordings of neonatal procedures and videos for observation, educational sessions and logistics considerations, especially with the COVID-19 pandemic distancing measures reducing bedside teaching opportunities.
- COVID-19
- neonatology
- technology
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
What is already known on this topic?
Recording and reviewing neonatal stabilisation during video-based observations provides numerous educational benefits.
The COVID-19 pandemic led to a decline in opportunities for bedside teaching as well as training opportunities for students and residents.
Eye-tracking methodology allows researchers to objectively measure gaze patterns of healthcare providers from a first-person view.
What this study adds?
The eye-tracking methodology was introduced during the COVID-19 pandemic to enable healthcare staff to witness procedures remotely while still having a first-person view.
It is feasible to use eye-tracking glasses for point-of-view recordings and video reflections of neonatal procedures.
Eye tracking has the potential to involve healthcare staff in more procedures and close significant gaps in learning neonatal procedures.
Background
Many countries introduced social distancing interventions to prevent the spread of the novel SARS-CoV-2.1 2 This response inevitably led to a decline in bedside teaching3 and training opportunities4 for students and residents. Innovative technologies might facilitate the training of healthcare providers and students without direct bedside attendance.4 There are currently numerous available options for maintaining procedural proficiency, such as webinars, virtual simulation and videoconferences.5 6 Besides supporting procedural proficiency, recording and reviewing neonatal stabilisation provides numerous educational advantages.7 8 However, allowing medical students and trainees to benefit from this opportunity during the COVID-19 pandemic can be challenging. Furthermore, providers attending video-based observations on neonatal stabilisation anticipated that reviewing other procedures at the neonatal intensive care unit (NICU), most importantly, neonatal intubations, would also be beneficial for improving the quality of neonatal care.7 The use of modern eye-tracking glasses with the option of real-time recording and streaming has recently emerged as a revolutionary method in procedural education.9–11 The eye-tracking methodology allows researchers to objectively measure healthcare providers’ gaze patterns from a first-person view, thereby understanding the clinical reasoning process during task performance.12–14 Furthermore, the eye-tracking methodology may also aid in the proper documentation of clinical information, as accurate and complete documentation of physiological parameters during neonatal stabilisations continues to be a challenge.15 The practice of eye tracking for reviewing purposes has not yet been studied and may improve medical education during the pandemic. This research project aimed to determine the experience with, and the feasibility of, point-of-view video recordings using eye-tracking glasses for training and reviewing neonatal interventions in the NICU. This project focused on video summarisation of point-of-care neonatal interventions during COVID-19, especially while complying with social distancing measures, and analysing, discussing and improving individual approaches and strategies for different neonatal procedures.
Methods
This observational prospective single-centre study was conducted at the Leiden University Medical Center in a single-room NICU ward from September to November 2020 and was designed and described following the Strengthening the Reporting of Observational Studies in Epidemiology guidelines for observational studies.16 All neonatal healthcare providers (physician assistants, residents, fellows, attendees) were eligible to participate in the study. There were two groups of participants: (A) proceduralists, who wore eye-tracking glasses during procedures, and (B) observers who later watched the procedures as part of a video-based reflection. The procedures included endotracheal intubation, minimally invasive surfactant therapy (MIST), and umbilical catheter insertion. Proceduralists and healthcare professionals present in the room gave their consent for the recording, and parental consent was obtained to use the footage during observations. After providing consent, proceduralists were equipped with mobile eye-tracking glasses (VPS 19, Viewpointsystem, Vienna, Austria). The recording started after glasses calibration according to the manufacturer’s recommendations. On the conclusion of the neonatal procedure, each proceduralist filled in a questionnaire to assess eye-tracking glasses’ usability throughout said procedure. The neonatal procedures were carried out using the local medical equipment and following the standard operating practices.
Video-based reflection on neonatal procedures
The principal investigator of this study prepared and chaired the video-based observations. All healthcare staff of the NICU were invited to join as observers. During video reflections, recordings of the eye-tracker in a point-of-view first-person perspective were reviewed to evaluate care quality. Observers watched the full point-of-view video without audio and with the possibility to pause to discuss any potential issue. If available, videolaryngoscopy (InfantView, Vyaire, Chicago, Illinois, USA) recordings were integrated with the eye-tracking recording using the same format as during video reflections on neonatal stabilisation, performed weekly at the local NICU.8 Healthcare staff openly addressed both what went right and what could be improved. To conclude the video reflection, healthcare staff discussed what they had learnt. Videos were also streamed online via Microsoft Teams (Microsoft, Redmond, Washington, USA) for healthcare staff working from home.
Eye-tracking glasses
VPS 19 European CE-certified eye-tracking glasses (Viewpointsystem) were used to measure the proceduralists’ visual field. The glasses include binocular eye-tracking cameras that record a real-time point-of-view first-person perspective and participants’ gaze behaviour at a sampling rate of 30 frames per second. The eye tracker has a 70° field of view and includes a 9 df sensor with a three-axis accelerometer, magnetometer and gyroscope. The front camera records in full high definition (1080p). This study did not require audio recording. The glasses weigh 43 g. The eye-tracking glasses were connected with a USB-C cable to a smart unit with a Linux-based operating system, which can be used to record and stream videos. All recordings were pseudonymised and labelled with a unique study ID.
Primary outcome
The primary outcome was the feasibility of, and the proceduralists and observers’ experience with, the point-of-view eye-tracking videos as an additional tool for bedside teaching and video-based observation. Proceduralists and observers filled in a questionnaire to evaluate their experience, the feasibility and potential limitations of wearing eye-tracking glasses.
Secondary outcomes
The secondary outcome was gauging how time consuming the set-up and calibration phase of the device was. In addition, we asked observers to report what they had learnt during the procedures.
Questionnaire
Both proceduralists and observers were asked to give feedback on the point-of-care video recording using a short questionnaire. For proceduralists, the questionnaire consisted of 14 questions about the feasibility of the eye-tracking glasses, perceived distractibility, discomfort while wearing the glasses and experienced impact on performance. Observers answered seven questions about their experience with the eye-tracking recordings (see online supplemental appendix), rating all items on a scale from 1 (‘strongly disagree’) to 5 (‘strongly agree’). A supplementary open-ended question was used to describe what they had learnt from the video-based observation. On-site participants completed a paper-pencil questionnaire, while participants joining the video-based observation online submitted their questionnaire through a SurveyMonkey link (SurveyMonkey, San Mateo, California, USA).
Supplementary video
Statistical analysis
Descriptive analysis was used to describe the study sample. A one-sample Wilcoxon signed-rank test was performed to test whether proceduralists’ subjective experience with eye-tracking glasses was different from 3 (=the scale median), whereas one-sample t-tests were used to analyse observers’ ratings. For the one-sample t-test, which is the main analysis, an a priori power analysis predicted that a total sample size of 34 participants would give sufficient power (0.80) to detect significant effects at the alpha level of 0.05 by medium effect size (Cohen’s d=0.50). All quantitative analyses were performed with SPSS V.24.0 (IBM). The level of significance was set at p<0.05 (two tailed). Observers’ responses to what they had learnt from the recordings were analysed qualitatively using content analysis.
All parents of recorded children signed a written informed consent for the use of the recordings for educational and scientific purposes.
Results
We conducted 12 point-of-view recordings (figure 1) on 10 different patients undergoing neonatal intubation (n=5), MIST (n=5) and umbilical line insertion (n=5). With these recordings, we conducted nine video-based observations (three on-site only and six on-site and online simultaneously) with a total of 88 observers filling in the questionnaire after the video-based observation. We included a short video clip with parts of recordings of a neonatal intubation, an umbilical line insertion and a MIST procedure as online supplemental material.
Snapshot of an eye-tracking video showing a healthcare provider performing positive pressure ventilation. The white circle indicates the visual focus of the provider.
Patients
The recordings were performed on 10 patients with a median gestational age of 30.9±3.5 weeks at the time of the procedure and a weight of 1764 g. The diagnoses were asphyxia, prematurity, respiratory distress syndrome, double outlet right ventricle or transposition of the great arteries. Indications for procedures were presumed sepsis, necrotising enterocolitis, increased oxygen demand, atelectasis, respiratory insufficiency due to prematurity and preparation for surgery. Videolaryngoscopy was required in 10 intubation/MIST procedures.
Proceduralists’ responses
All 12 proceduralists agreed to participate and completed the questionnaire. None of them removed the eye-tracking glasses during the procedures. The use of the glasses was perceived as feasible and non-hindering, as indicated by proceduralists’ responses that were largely different from the scale median (figure 2). Proceduralists also reported no discomfort related to the glasses or performance alteration, neither positively nor negatively. The set-up and calibration duration of the eye-tracking glasses ranged from 1 to 10 min, with a mean time of 3.5 min.
Proceduralists’ subjective experience with the eye-tracking glasses during procedures. *P<0.05 (Wilcoxon signed-rank test).
Additionally, qualitative feedback from proceduralists included statements such as ‘the glasses did not bother at all’, ‘…were a good experience’, but also that if used for an extended period (eg, during umbilical line insertion), ‘the battery and smart unit were getting hot and heavy to wear’.
Observers’ responses
We conducted nine video-based observations with a total of 88 observers. Three observations (29 observers) were held on-site and another six in a combined on-site (51 observers) and streaming (8 observers) format. The video reflections lasted from 20 to 30 min, with a mean duration of 22.1 min. The use of point-of-view recordings was perceived feasible. The median score of most questionnaire items was significantly different from the scale median (figure 3). Observers deemed the point-of-view recordings an educational benefit for them and the recordings an educational tool during COVID-19. In addition, there were no significant differences in responses between on-site and online observers. Qualitative feedback on what observers had learnt from the recordings included logistical issues, equipment and medication and awareness (see table 1).
Observers’ subjective experience with point-of-view recordings during audits. *P<0.05 (one-sample t-test). NICU, neonatal intensive care unit.
Qualitative feedback on what observers had learnt after reviewing the recordings
Discussion
Until now, video reflections on neonatal stabilisation at the Leiden Medical University Center were carried out with cameras installed in the room.7 The eye-tracking methodology was introduced during the COVID-19 pandemic for healthcare staff to witness procedures remotely while still having a first-person view. Our findings suggest the feasibility of wearing eye-tracking glasses during neonatal procedures and using recordings for subsequent video reflections with the healthcare staff. Former studies regarding the feasibility of wearing eye-tracking glasses in real neonatal resuscitation scenarios17 and simulated neonatal airway management scenarios14 yielded similar results. Most participants reported that wearing eye-tracking glasses was not disturbing or uncomfortable, in line with previous findings in simulation-based trainings.14 In another study concerning eye-tracking in a paediatric trauma simulation, participants declared tolerating the glasses after a few minutes without being subjectively affected.13
Furthermore, most observers stated that point-of-view video recordings could facilitate (virtual bedside) education during COVID-19 and perceived discussing the recordings from a first-person perspective as highly beneficial. We also found that both on-site and online observers rated the eye-tracking recordings as an additional educational experience, particularly in medical training. Eye-tracking technology has been a tool for laparoscopic surgery and the learning process of square knot tying. The first-person perspective gives trainees the possibility to identify critical areas, memorise the visual attention and adopt the experts’ gaze patterns.18 A study by Brunye et al determined the eye fixation behaviour of experts and novices.10 Analysing the experts’ procedures helped novices and students learn better strategies for successful interventions. Moreover, experts underlined the importance and need for innovative technology in order to offer trainees valuable education19 in times of COVID-19.
While we only recorded videos for a later review, it would have been possible to stream procedures for other professionals to assist from another room or their homes, as this option was proven to be practicable and inexpensive.20–22 We found no significant difference between online and on-site video-based reflections as both alternatives were judged ‘equally good’. However, the online group consisted of only eight participants. Increasing this group could be an interesting next step to improve virtual bedside training. During the procedure, the supervisor could guide the trainee while maintaining distance thanks to the first-person view. Observers mentioned many key learning points, such as the overall logistics. In the first video-based reflection, as the proceduralist had to look over his/her shoulder to see the monitor, the staff discussed changing the proceduralist positioning to see the baby and the monitor from the same perspective. Adopting the new positioning in the six following recordings turned out to be more comfortable for the proceduralist and had an immediate effect on the video-based discussion. Furthermore, this technology could have a substantial educational benefit for nursing procedures, especially in single-room NICUs, where it might be more challenging to learn from other colleagues than open bay wards.
Limitations
As this was a feasibility study and reviewing neonatal stabilisation videos was already common among the local healthcare staff, it is difficult to generalise the results. The local NICU team was familiar with regular video-based reflections and was very supportive in creating a safe learning environment, even when conducting remote video-based reflections. However, this may be more challenging in NICUs where it is not common to hold team video-based reflections. Additional (multicentre) studies are needed to show the transfer to other NICUs. Observers also mentioned that the head of the patient was not always visible during intubations. Therefore, we reported the issue to the manufacturer, and the problem was solved within a month. While we did not include audio in our recordings, many observers recommended it for future video reflections. It was also mentioned that recording the vital signs monitor would also be helpful. At the moment, it is not possible to record the first-person view, the videolaryngoscope monitor, as well as the vital monitor with one device. However, the glasses might serve as an alternative view of what the participant is seeing in situations where another technology such as a videolaryngoscope is not available (ie, mouth and pharynx of the patient). A limitation for this at the moment is the fact that the video recording unit is over the eye level, which might make it difficult to see every detail of the pharynx. Therefore, new technology is necessary to improve this aspect and to review point-of-view neonatal procedures. Furthermore, eye-tracking glasses are still very expensive with one-time costs of about €10.000, depending on the company researchers choose.
Conclusions
We were able to show that it is feasible to use eye-tracking glasses for point-of-view recordings of neonatal procedures and use videos for reflections and educational sessions. Overall, observers stated that reviewing first-person videos has educational benefits, especially during the COVID-19 pandemic with social distancing measures reducing bedside teaching and logistics improvement opportunities.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication
Ethics approval
The local IRB ‘Medisch-Ethische Toetsingscommissie’ committee in Leiden granted the exempt status for this study (ID: N20.135).
Acknowledgments
We acknowledge the support of healthcare providers at the Leiden Medical University Center in conducting this study. Viewpointsystem provided a non-restricted financial support for open-access charge.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @None
Contributors MW, MCB and ABP conceptualised and designed the study. MW drafted the initial manuscript, collected and analysed the data and finalised the manuscript. MCB, SJ, RV, RSGMW, VB, EL and ABP collected the data and reviewed and revised the manuscript. PG helped with analysing the data. PG and AB critically reviewed and revised the manuscript for important intellectual content. All authors approved the final manuscript as submitted and agreed to be accountable for all aspects of the work.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.