Simulcast Journal Club October 2018


Introduction :  

Simulcast Journal Club is a monthly series that aims to encourage simulation educators to explore and learn from publications on Healthcare Simulation Education.  Inspired by the ALiEM MEdIC Series, each month we publish a case and link a paper with associated questions for discussion.  We moderate and summarise the discussion at the end of the month in pdf and podcast format, including opinions of experts from the field. 

For the journal club to thrive we need your comments!  Some participants report feeling nervous about their initial posts, but we work hard at ensuring this is a safe online space where your thoughts are valued and appreciated.  To ensure this, all posts are reviewed prior to posting.  We look forward to learning from you. 

Journal Club (1)

Title :  “Homeostasis 

Brad panted as he raced up the last of the hospital stairs and into the hallway.  Nitin had gone to help with the arrest 15 minutes earlier but when he’d called for backup his voice had been laced with fear.  

As Brad walked into the patients’ room he kept quiet and surveyed the lay of the land.  With resignation he realised he’d seen this scene too many times in his career.   A messy resuscitation, stressed out staff, poor quality chest compressions, noise. 

He supressed the urge to voice frustration.  Contain the emotion.  They’re doing their best. 

But that wasn’t true, he thought, this wasn’t their best.  These were smart, capable people who cared about their patients.  And they sucked at resuscitation.  Annual competencies just couldn’t keep ward staff skilled enough at CPR when a child might arrest on them once in a career. 

He placed a supportive hand on Nitin’s shoulder and smiled grimly. 

“What do we need?” he asked. 

The Article : 

Cheng, A., Nadkarni, V., Mancini, M., Hunt, E., Sinz, E., Merchant, R., Donoghue, A., Duff, J., Eppich, W., Auerbach, M., Bigham, B., Blewer, A., Chan, P. and Bhanji, F. (2018). Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation, 138(6). 

 

Discussion :  

This month we’re moving journal club from debriefing to look more at curriculum development.  In August 2018, Cheng et al published this extensive, open access document providing a detailed look at current evidence about what works in Resuscitation Education. 

For our journal clubbers, please share your perspectives on the paper, and if you don’t have any specific thoughts :  

  • How does this paper reflect or diverge from the reality of your resuscitation training? 
  • Do the principles outlined in this article ring true? 
  • What would be barriers towards implementing these strategies? 

 

References : 

Cheng, A., Nadkarni, V., Mancini, M., Hunt, E., Sinz, E., Merchant, R., Donoghue, A., Duff, J., Eppich, W., Auerbach, M., Bigham, B., Blewer, A., Chan, P. and Bhanji, F. (2018). Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation, 138(6). 

 


About Ben Symon

Ben is a Paediatric Emergency Physician at The Prince Charles Hospital in Brisbane and a Simulation Educator at Lady Cilento Children's Hospital. He currently teaches on a variety of paediatric simulation based courses on paediatric resuscitation, trauma and CRM principles. Ben has a growing interest in encouraging clinical educators to be more familiar with simulation research.


Leave a comment

Your email address will not be published. Required fields are marked *

18 thoughts on “Simulcast Journal Club October 2018

  • Eve Purdy

    Hey Ben,

    Thanks for bringing up such an important paper. We covered it in this week’s “Educators Get Educated” meeting as well on the Gold Coast! It certainly is…comprehensive and I appreciated the alternate summary and infographic publications with the option to dive deep into a few topics that I was particularly interested in. Thanks to the authors for this massive effort.

    To be honest though, I am a bit disappointed that we didn’t get a more juicy chapter in the Nimali and Nitin saga…

    Fortunately, my resuscitation training in an Emergency Medicine residency has consisted of many of the evidence-based suggestions that these authors put forward including:

    -mastery learning: from PGY1-PGY5 we engage in simulation rounds every week. We develop graded responsibility and eventually become the teachers.
    -spaced practice: when learning central lines as PGY2s we have 5 x 2hr sessions over the course of the summer building on everything from setup to needle control to the full procedure.
    -feedback and debriefing: a strength of our program is our daily feedback sessions at the end of each shift and informal debriefing of resus cases that we have led
    -assessment: this is something that is being developed and becoming more and more part of our reality with CBME

    We don’t:
    -do as much contextual training (i.e. practicing with the teams that we work with on a regular basis)
    -innovative learning methods unless sought out on your own

    I would expect that the level of education for specialists in resuscitation should be touching on many of these high quality indicators. I am glad that they didn’t feel entirely foreign. Although we should continue to make efforts to improve emergency medicine resident education, the bigger question becomes how can we raise the bar as teams in our hospital in the ED and beyond. In my experience ACLS and BLS has been the effort to at least make a bar that must be met by hospital administrators. This training modality does not use many (any?) of these evidence-based best practices. So the debate about where we go from here is where things get very interesting….In my mind this paper basically shows that ACLS/BLS – as delivered in my experience – must undergo significant changes if they are going to remain relevant. So if it doesn’t actually teach resuscitation skills effectively, what does mandatory training do?

    -signals to employees that we think it’s important that they know how to do CPR, even if it doesn’t give them the skills
    -exerts control over employees which is part of a bigger institutional effort to standardize behaviour and maintain power (beyond resuscitation)
    -makes big bodies money and more powerful/recognized (they have an ongoing vested interest in this rather than supporting contextualized grassroots training)
    -allows people who teach the courses (and who are most likely to be in resuscitation scenarios) to engage in some of the best practices (mastery learning, spaced repetition)

    Will mandatory BLS/ACLS remain in place even if it doesn’t start to incorporate more of these best practices? Probably…at least for quite some time because:

    -as the article points out, unlearning is hard and probably even more challenging for institutions than for individual learners.
    -the best practices are expensive and necessitate tireless champions and interested learners
    -it is easily measured in a tick box
    -institutions hire individuals and it is easier to incentivize them

    Bigger questions we need to be considering are a bit more philosophical and probably shouldn’t be coming from a resuscitationist…what is the value add of training for everyone? There are potentially more important things that we should be spending money on from an training perspective outside of high risk areas (ED, periop, ICU). Some of these interventions have the ability to reduce costs compared to current training (which I think should be the goal for most places in the hospital) but some of the interventions might significantly increase the price tag. We need to be mindful of the fact that there is an opportunity cost to everything and we must carefully consider if we will be taking away from other more high yield topics in non-resuscuation areas of the hospital. The “contextualization” aspects brought up in this paper MUST be at the forefront of our minds as we work with hospitals and our colleagues to improve training to a level that is appropriate for the roles that people are in.

    • Ben Symon Post author

      Hi Eve, thanks so much for starting the conversation.
      It was great to hear from someone who can identify so many of these innovations having been already incorporated in your practice, I wish I could say the same.
      I was particularly intrigued by your points at the end : 1) Unlearning is harder for institutions than learners, 2) Best practices are expensive and need champions 3) Current practices involve tick boxes 4) Mandatory competencies allow incentivisation.

      Interesting thoughts, as well as your question about training everyone. It’s an interesting thought, particularly relevant in paeds where a cardiac arrest is exceptionally rare. I still think good quality CPR in particularly is a valid expectation of every hospital staff member, but I agree there is an opportunity cost in prioritising that as an annual review over other things. Hmm…. much to think about!

      • Eve Purdy

        Thanks for prompting me to clarify a few thoughts.

        1) Unlearning is hard for everyone (institutions and individuals) but likely harder for for institutions because of the inertia and bureaucracy associated with large organizations. So even if we all agree that we should be doing things differently, actually affecting that change at the institutional level will be slow to happen.
        2) Best practices aren’t *necessarily* more expensive than the way that we are already doing things but certainly many of the interventions they suggest might be. We have to be mindful of the cost-benefit ratio with any new and existing intervention. Champions are necessary for any variety of change!
        3) Certainly many places that I work in Canada to be hired I have to have ACLS, ATLS, PALS, US training etc. These are tick boxes to satisfy employment but this article shows us that those checks do not guarantee any type of long term learning, ability to apply skills within a new group, or ongoing competence.
        4) Mandatory tick boxes (see 3) are easy for organizations to measure. I.e. you don’t get hired or you don’t get paid unless you have done this mandatory training. It certainly isn’t a high level of intrinsic motivation but is enough that we all do it, and continue to do it, despite knowing that it is potentially a waste of time. In my mind though these extrinsic measures really target the wrong kind of motivation. What would be really neat would be to incentivize individual units to sort out what is the best way to train their employees for what is needed.

        Yes, CPR is a universal skill that we should all know about and many should be able to perform. Should everyone be able to bag-valve mask, probably not. I think just important however, is identifying people who should not be performing CPR (and not penalizing them for it but identifying what other important roles they can play). We have all seen older, or smaller, or less physically capable colleagues that are not the people that make the most sense to task with this job.

        • Christina Choung

          Hi Eve & Ben,
          Really great comments, and definitely on the pulse! The healthcare organization I work for is actually looking into the very issue of maintaining competency in resuscitation versus “ticking off the box,” as Eve has mentioned. Those of us in the sim department were quite excited when this paper was published, as it was “evidence” for what we have been preaching.
          Currently, I would say that our resuscitation education does not look like this across the board. It varies widely, depending on the department. We don’t have one centralized education department, therefore each department sort of does its own thing. On a more positive note, I have been seeing more departments move towards this model – its in its infancy, but more and more people have been asking for the sim department’s assistance to provide 4-6 of the 8 suggested key elements in this paper.
          That being said, widespread implementation does become a question of cost and resources – as the authors of the paper mention several times under the “implementation issues” headings. The specific costs and resources which stand in the way, IMHO, are competing priorities, and having the right people for certain tasks. As mentioned:
          1) Where does resuscitation sit in the hierarchy of ever-competing priorities in any healthcare department? Surely in the ED and for those on the code team, it’s a no-brainer. But how about for those on general wards? In clinics? In residential care? Do we do an assessment of areas with the highest rates of cardiac/respiratory arrest, and focus on those? Typically those are the areas with the highest acuity and complexity, with the greatest amount of educational need.
          2) Who does the actual implementation of these suggestions? We have two ideas, none of which is perfect… I’m hoping others have other ideas. The first is that this work falls within the realm of the distributed network of educators throughout the institution, as they know each department’s culture and needs best – they know the context and can tailor education to it. However, many do not possess the educational skills required, or have the confidence in their abilities, to implement these suggestions. Faculty development is great, but educator turnover is high and we can never keep on top of it, and they too, have their own competing needs. The second option is to have a position specifically for sim/resuscitation practice. I think this is the ideal, however this person wouldn’t know the local contexts as well – especially in larger institutions. I think this person could work with the local educator to fill that gap, and I think this option is best. But that requires adding a new FTE/position – and is expensive. Which leads to…
          3) I hate to say this, but it’s often the elephant in the room… in many instances, saving people is more costly than not. Ugh, I feel gross even saying it. But, IRL when it comes to administrators, it can often boil down to dollars and cents. Funding positions which ultimately cost the institutions more can be very challenging, uphill battles.

          On a more positive note, I do think this paper is brilliant. Although explicitly cautioned in the opening paragraphs to not generalize, I’ve been calling it “a primer for adult education and maintenance of competency”. I especially like the first figure, on the second page of the article. And, as Eve also mentioned, the accompanying infographics have been very helpful – in my conversations with others, I typically use the infographic with the 8 key elements as a jumping-off point.

  • Susan Eller

    Hello Ben,

    Like Eve – I was also disapointed that you left us hanging with Nimali and Nitin saga… 😉

    I laughed when Adam said on Twitter that he would give a gold star to anyone who got through all 41 pages. Then I had to laugh at myself when I realized it was 30 pages of content, with over 400 references. Such a stellar group of researchers, authors and educators who contributed to this… comprehensive review of resuscitation education. I really liked the flow of each topic: background, definitions, summary of evidence, suggestions for improvement, and implementation issues.

    Some of the topics were familiar to me, Mastery learning, feedback and debriefing, contextual learning, and assessment. I probably took a deeper dive into some of the topics that challenge our institution: spaced practice and innovative educational strategies. I think that the logistical challenges of spaced practice are one of our greatest hurdles for some learning groups. It is one thing to have a group of learners who have simulation scheduled once a month to schedule resuscitation practice in at regular intervals – this is the case with our residents, and perhaps medical students. However, the nurses, pharmacists, or respiratory therapists usually only are scheduled for CPR or ACLS once every two years. Implementation of spaced practice not only requires learning management systems, but in some cases contract negotiations with certain learner populations. In terms of the gamification – I concur that it can be used to enhance knowledge or decision-making skills, but does not adequately address the issue of hands-on practice of the high quality CPR or other skills such as defibrillation.

    Like Eve, Christina and yourself, I am not a big fan of this education existing as tick- box, or something that needs to be done in order to make the regulatory agency happy. Which is sadly what happens sometimes to those groups who don’t use it on a regular basis and so don’t live with the daily value. One of the great things about the ECC conference is the time devoted to hearing the survivor stories. It is great for those of us who teach resuscitation skills, but we are probably not the ones who benefit most from those stories.

    I do have to confess that at times I was experiencing a little cognitive overload. Like Eve and Christina, I appreciated the graphic at the beginning, so that I could have a visual frame of reference, or framework, to re-orient myself to the various articles. I might have wished that it was broken down into 8 smaller articles for each of the key elements, but that probably is an individual preference. It made me sorry that I had missed the educational summit in 2017, as I would have loved a chance to hear the topic group experts and have a chance for questions.

    • Ben Symon Post author

      OK I think I need to offer a formal apology for no romance this month. I couldn’t find a way to combine CPR Education and Romance without sounding vaguely disrespectful :p I will solemnly work harder on it next month.

  • Shannon McNamara

    Thanks for starting a great discussion! In reading Eve, Christina, and Susan’s comments, I identify with many of the same challenges of being stuck in an economically driven tick-box system. From the structure of the JC questions presented:

    How does this paper reflect or diverge from the reality of your resuscitation training?

    -Though I do my best to teach a lot of awesome resuscitation sim courses, my ACLS experience has been that I need to supply my employer with a card, and I need to get one quickly and cheaply in my free time. There are many businesses that will do that for me, as quickly as possible. I am guilty of buying really terrible sim courses for ACLS. I would be ashamed to run one like that, but I’ll take whatever I can get as a learner.

    Do the principles outlined in this article ring true?

    -As an educator, I absolutely agree with the educational principles outlined for high quality education and outcomes. As a somewhat frenzied ER doc, I would like the fast food of resus education – quick and cheap. I would prefer that the time that ACLS (etc) takes is factored into my employment, and not an extra thing that I’m required to do on my off time.

    What would be barriers towards implementing these strategies?

    -ACLS (etc) is BIG business. Doing it well is not incentivized – quick and cheap is. Though I am 100% on board with the educational modalities listed, I don’t know how to incentivize the unlearning and huge mindset and financial investment shift that would need to happen.

    -In an ideal world: I would do an in situ ACLS (etc) case every day or every week at the beginning of the shift with my team. This would be factored into my work day and I would be paid for it. This would be tracked. We would get rigorous performance based feedback. Then I would get all my merit badges.

    Another point not mentioned here is the role of human factors (or perhaps it was and I missed it – there’s a whole sim fellowship in this paper, y’all!). We can’t just educate ourselves into great resuscitation. We need to innovate in our clinical spaces to make it easier. I appreciate Betsy Hunt’s recent updates on using a CPR coach, an innovative role to improve performance, and the Hicks / Petrosniak team on their trauma human factors work. Education is essential, but it only goes so far. We need human centered systems designed to fill in the inevitable gaps.

    • Ben Symon Post author

      Hi Shannon, great to hear from you! It’s an interesting conflict, this tension between economic efficiency, bureaucratic data requirements and achieving tangible proficiency in a technical skill. In some ways it makes sense, in other ways, it seems like the whole wheel needs to be rethought. Surely there would be a way to address all of these things in a way that becomes more patient focused? I notice that both yourself and Christine allude to slight undercurrents that economic efficiency might not be the same thing as saving lives.
      Sad though, if our institutions have become such behemoths that their drive for checkboxes outrides their drive for quality care.
      I wonder what kind of incentives might bring hospitals to the table to this sort of agenda? I guess the AHA Statement itself is a start.

      • Shannon McNamara

        “I wonder what kind of incentives might bring hospitals to the table to this sort of agenda? I guess the AHA Statement itself is a start.”

        Helpful framing, Ben! Overall, I think institutions aren’t opposed to quality care, I think the boat is just very very very large and difficult to steer in a new direction. My big challenge with this paper is that it’s basically saying that the entire ACLS industry (in the US at least) is doing it wrong, but doesn’t have the teeth attached to change it. I have a feeling there’s a grand plan to add teeth in the long game and that this statement is only a start. At what point and how to we acknowledge that the current ACLS training industry is likely broken and start over? Unfortunately the drive for online only courses is not promising in that direction.

        • Ben Symon Post author

          It’s tricky hey, the sheer enormity of the implications of this paper.
          I see it as a mission statement and a call to action, and I hope that the next step in this conversation is to break those changes down into incremental small steps.
          I agree this can seem insurmounatable, but I’ll bet in 10 years we’ll look back and find that Resuscitation Education has changed.

        • Christina Choung

          Great question! I honestly think if the shift from mere tick boxes to competency – as is happening with the Royal College here in Canada, I believe – comes to fruition, we’ll see more cries for practice opportunities and spaced learning. I’m not sure what it’s like in other countries, but over here accreditation through Accreditation Canada often has the ability to change practice. I would LOVE to see education modalities and offerings included in part of the accreditation process!

  • Jesse Spurr

    Hello JC team.
    I am going to be super brief, as I have little to add to the reflections thus far. So:
    1) I think this is one of those ‘gateway drug’ type articles that will hopefully serve as a conduit to some great educational theory and learning science for a whole lot of clinical educational enthusiasts and hopefully even some hospital administrators. I liken this to ‘The Human Factor’ paper by Hicks and Petrosoniak featured on JC a few months back in that it provides a one stop shop to refer people interested in going down and educational rabbit hole.
    2) In fitting with contextual learning, spaced practice and other instructional design features outlined by Adam and colleagues, this is a really interesting complimentary paper from Resuscitation Sep 2018 “Hospitals with more-active participation in conducting standardized in-situ mock codes have improved survival after in-hospital cardiopulmonary arrest”. https://www.clinicalkey.com.au/#!/content/playContent/1-s2.0-S0300957218309080?returnurl=https:%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0300957218309080%3Fshowall%3Dtrue&referrer=https:%2F%2Fwww.jwatch.org%2Fna47661%2F2018%2F10%2F05%2Fmock-codes-save-lives%3Fijkey%3DZOXytCPuV Well worth the read if not just to confirm our own biases! Thanks to James French @Grade1View (https://twitter.com/grade1view) for pushing this paper in front of me.

  • NEMAT ALSABA

    Thanks Ben for choosing such a masterpiece of an article!

    Thanks to the authors for a well written and designed article. Nice flow and complemented with a great summary and infographic. I agree with previous comments that it can easily be published as multiple articles. It will be great as a chapter in one of the books!

    A lot of great points and discussion has been covered in the above conversations and post but these are the highlights for me :
    • This article encourages cultural changes in our ACLS/BLS training and delivery through customizing the program and training to fit the department and staff needs rather than just ticking a box on a piece of paper.
    This might include the duration of the course, the intervals between 2 courses or the place where the course is taking place (insitu Vs in sim labs or both).
    There is nothing wrong with identifying staff who can’t deliver effective Chest compression in resuscitation due to physical issues but on the other hand, they can be more effective in another task in resuscitation. So know your learners ( staff ) and design the training that meets their need and accommodates their abilities.
    • The assessment section had an interesting discussion. Shifting the measurement from WHAT? to SO WHAT? and measuring what is truly important for the patient outcome.
    Assessment should not only be limited to individual tasks but should also include collective ability and teamwork. I also liked the article suggestion to make the assessment longitudinal.
    • An excellent point was brought up in the contextual learning. Stressing and challenging your learner (to an extent!) will maximize the learners engagement. We had a great journal club article review about psychological safety so I don’t need to say more 😊
    And last your question Ben: What would be barriers towards implementing these strategies?
    It has to be fear of change! this includes learners + trainers and employee + employer.
    I am looking forward to see the changes in our ACLS / PALS training programs that the article has discussed.

  • Ben Symon Post author

    I just want to include the CanadiEM Infographics that have been developed to cover this paper as well, for the ADHD cohort among us who are currently cursing my name for including a 40 page document in Journal Club!
    The infographics are posted here :

    https://canadiem.org/aha-scientific-statement-on-resuscitation-education/

    Created by Simon Huang and Alvin Chin, they provide a great snapshot of the principles outlined in the paper.
    Thanks guys!

    • Victoria Brazil

      Yes thanks Ben
      Truly landmark paper with thorough review of the literature.

      We have been (relatively ) successfully implementing the Laerdal RQI cart (NB Nil disclosures) in our institution which incorporates many of these elements for the pure, individual core skills of BVM and compressions
      – short, low volume, high frequency sessions ( 5 min every 3 months)
      – mastery learning with clear, machine assessed performance criteria, and unlimited attempts to pass
      – real time feedback – visual and auditory – on CPR and BVM performance
      – plus the carts are located in the workplace
      (and it actually costs less than having nurse educators do BLS, allowing them to do more work that actually requires their skills)

      Obviously the teamwork stuff is harder, as it the myriad of knowledge and skill sets that fall into the ‘deteriorating patient’, as opposed to actual cardiac arrest. The paper gives guidance on that too (although i am biased and would suggest in situ/ translational sim could have been more strongly recommended)

      The only ‘omission’ for me was not incorporating pro-active end of life planning in resuscitation education. Our skills in NOT resuscitating patients that won’t benefit from it are arguably as important as resuscitating the ones that will benefit ?

      thanks again

  • Adam Cheng

    Hello Friends,

    Thanks for the excellent discussion and thoughts on this paper. Your comments are bang-on!

    While on one hand, the paper serves as a review of the resuscitation education literature … the more pressing role it serves is as a call to arms for the resuscitation education community. Why are we trapped in our usual ways of doing things, and what can we do to change?

    There are lots of suggestions described in the paper, and some of them may not be feasible for certain organizations to implement. That’s ok….. baby steps … or in Vic’s words … what is your 1%? Let’s make small gains by implementing changes in a stepwise manner, measuring impact, celebrating successes, repeat.

    Locally, we have tried, over the past 3-4 years, to make gains by (1) implementing just in time CPR training; (2) rolling out in situ, inter professional, contextualized resuscitation team training; (3) integrating CPR feedback defibrillators (into clinical and simulation-based environments; (4) clinical (HOT) debriefing a-la INFO style (see Stuart Rose); and (5) data-informed debriefing using outputs from the CPR defibrillator. Next up – CPR Coaches in the ER. While providers are still required to do PALS courses (some evidence suggests this type of training still helps – https://www.cercp.org/images/stories/recursos/articulos_mes/agosto_2018_articulo.pdf ), they are support by other educational strategies in their work environment that can help to enhance performance.

    I believe this Scientific Statement represents the first step in an effort by the AHA to rethink how resuscitation education should be delivered to the masses. While courses such as PALS and ACLS may never completely go away, I anticipate change coming. The AHA will be hosting a series of online “town halls” in the coming months to discuss the principles highlighted in this paper, to answer questions, and to brainstorm with folks on how to implement these strategies locally. I will share the date/time of these on twitter once they are announced. Your ideas, input, and concerns will help to inform future changes to educational offerings … please join in on these town halls if you are able.

    Thanks again to Ben, Vic and Jesse for helping to share this work!

    Cheers
    Adam