Evidenced Based Medicine (EBM): Beyond the dogma

16 Nov

A disclosure on reading EBM based guidelines (and interpreting statistical analysis)evidence-based-medicine-word-collage-concept-vector-illustration-42380553 copy

Before presenting my comments on 2015 ALS Guidelines I wanna share my thoughts on EBM based guidelines and interpretation of statistical analysis as a “disclosure” for all MEDEST followers and to clarify some concepts on this two methodological approach.

Evidence Based Medicine External Validation and applicability.

EBM is based on RCTs (randomized and controlled) studies as maximum expression of quality of evidences.

The original spirit of EBM was to improve the quality of care for real patients in the real world (external validation). RCT studies are mostly based on controlled group of patients and regional organizations, expressions of local contexts and not always applicable to a more wide population of patients.

So in the years the concern about GRADE score of evidence (where RCTs trials are the highest expressions of evidence), made EBM based guidelines more focused on internal validation than external validation and applicability in widest clinical contexts.

Everyone of us when comes to clinical practice have to consider this potential bias.

Local context, individual clinical experience and local experts opinion can be the bridge between internal and external validation of RCT studies and EBM based guidelines.

Statistical Analysis

Similar considerations can be done on statistical analysis and statistical significative results.

To better explain this concept consider the result of this trial, Therapeutic Hypothermia after Out-of-Hospital Cardiac Arrest in Childrenrecently published in NEJM.

Results: The proportion of survivors with VABS-II scores of 70 or more at 12 months was not significantly different between the two groups (20% in the hypothermia group vs. 12% in the normothermia group; relative likelihood, 1.54; 95% confidence interval [CI], 0.86 to 2.76; P=0.14)

Authors conclusions: In conclusion, in comatose children who survive of out-of-hospital cardiac arrest, therapeutic hypothermia, as compared with therapeutic normothermia, did not confer a significant benefit with respect to survival with good functional outcome at 1 year. Survival at 12 months did not differ significantly between the treatment groups.

The authors conclusions are based on a P value of 0,14 that effectively is not relevant froma a statistical point of view. But what about ethic and clinical side of the picture? Can we ignore such a numerical difference on the base of a statistical interpretation?

In an other article (see in the references Difficulty interpreting the results of some trials: the case of therapeutic hypothermia after pediatric cardiac arrest.)  is well illustrated this dilemma, simulating a conversation between a physician and a parent of a post cardiac arrest comatose child.

From the article:

Doctor: I’m really sorry, but your child may have serious brain damage as a result of his cardiac arrest.

Parent: That’s terrible! Isn’t there anything we can do?

Doctor: I’m afraid not. There are some interventions that have been suggested, but they’ve not been shown to be effective.

Parent: What interventions?

Doctor: Well, cooling the body for a couple of days, for example. It’s been tried in neonates with birth asphyxia and adults after cardiac arrest.

Parent: But … if this intervention is used in neonates and adults, how can you say it won’t work in children?

Doctor: Well, in a recent study including almost 300 children, 20 % of those who were cooled survived with good brain function versus just 12 % of those who weren’t cooled. Neurological status improved in 38 % of the cooled children compared with only 29 % of the non-cooled. And, 28 days after the arrest, the mortality rate was 10 % lower in cooled children (57 % versus 67 %). Unfortunately, when the researchers applied the standard statistical rules that we use to interpret all scientific research, there was more than a 10 % possibility that these differences were due to chance, so we can’t recommend it.

Parent: But those results are really encouraging. Even if statistics tell you that this may be due to chance, there’s still the possibility that it wasn’t and I’d like my child to have that opportunity. Maybe the treatment’s expensive?

Doctor: No, that’s not the issue.

Parent: Was it dangerous then?

Doctor: Quite safe actually. Potassium and platelet levels went down a little, but with no harmful consequences. There is a risk that the heart rhythm can be affected; some of these abnormalities can even be quite dangerous. In the same study, serious abnormalities of the heart rhythm occurred in 11 % of the cooled children and 9 % of the others. Reduction in body temperature also increases the risk of infections; the investigators of this study reported that 46 % of cooled children developed an infection, compared with 39 % of the other children.

Parent: So, the treatment is associated with some risk but can still improve the chances of my child surviving… how can you balance the benefits and the risks for my boy?

Doctor: Honestly, I don’t know. If I just have to use numbers… 12 children would need to be cooled instead of kept at normal temperature in order to have one additional child with a good clinical outcome. And, 15 children would need to be cooled for one child to develop an infection.

Parent: Please, try this treatment on my child.

Statistical analysis is not the only determinant in daily clinical practice such as in real life. Reading the results of clinical trials beyond statistical analysis is important when we arrive to apply those results in our clinical practice.

Again, clinical gestalt and local experiences has to be considered when interpreting statistical analysis of clinical trials.

References

Logo MEDEST2

Una Risposta to “Evidenced Based Medicine (EBM): Beyond the dogma”

  1. Alessio Assaghi 17 novembre 2015 a 11:21 AM #

    I think this article merits serious reflection about the daily clinical practice especially when we are in front at so important choices.

Rispondi

Inserisci i tuoi dati qui sotto o clicca su un'icona per effettuare l'accesso:

Logo WordPress.com

Stai commentando usando il tuo account WordPress.com. Chiudi sessione / Modifica )

Foto Twitter

Stai commentando usando il tuo account Twitter. Chiudi sessione / Modifica )

Foto di Facebook

Stai commentando usando il tuo account Facebook. Chiudi sessione / Modifica )

Google+ photo

Stai commentando usando il tuo account Google+. Chiudi sessione / Modifica )

Connessione a %s...

thinking critical care

a blog for thinking docs: blending good evidence, physiology, common sense, and applying it at the bedside!

urgentcareultrasound

More definitive diagnosis, better patient care

My CPD

For WMAS clinicians

Critical Care Northampton

Reviewing Critical Care, Journals and FOAMed

OHCA research

Prehospital critical care for out-of-hospital cardiac arrest

SonoStuff

Education and entertainment for the ultrasound enthusiast

phemcast

A UK PREHOSPITAL PODCAST

First10EM

Emergency medicine resuscitation - When minutes matter...

Songs or Stories

Sharing the Science and Art of Paediatric Anaesthesia

airwayNautics

"Live as if you will die tomorrow; Learn as if you will live forever"

resusNautics

Navigating resuscitation

EMSPOCUS

Taking the hocus out of pocus and bringing hospital care to the streets.

LITFL • Life in the Fast Lane Medical Blog

Emergency medicine and critical care medical education blog

emDOCs.net - Emergency Medicine Education

Our goal is to inform the global EM community with timely and high yield content about what providers like YOU are seeing and doing everyday in your local ED.

The Collective

A Hive Mind for Prehospital and Retrieval Med

Dave on Airways

Thoughts and opinions on airways and resuscitation science

FOAMcast

A Free Open Access Medical Education Emergency Medicine Core Content Mash Up

Broome Docs

Rural Generalist Doctors Education

St.Emlyn's

Emergency Medicine #FOAMed

BoringEM

Bringing the Boring to EM

"CardioOnline"Basic and Advanced Cardiovascular medicine" Cariology" concepts and Review -Dr.Nabil Paktin,MD.FACC.دکتـور نبــــیل "پاکطــــین

این سایت را به آن دکتوران و محصلین طب که شب و روز برای رفاه نوع انسان فداکاری می کنند ، جوانی و لذایذ زندگی را بدون چشمداشت به امتیاز و نفرین و آفرین قربان خدمت به بشر می کنند و بار سنگین خدمت و اصلاح را بدوش می کشند ، اهداء می کنم This site is dedicated to all Doctors and students that aver the great responsibility of People’s well-being upon their shoulders and carry on their onerous task with utmost dedication and Devotionاولین سایت و ژورنال انتــرنتی علـــمی ،تخـصصی ، پــژوهشــی و آمــوزشــی طبـــی در افغــانســـتان

EmergencyPedia

Free Open Access Medical Education

Little Medic

Learning everything I can from everywhere I can. This is my little blog to keep track of new things medical, paramedical and pre-hospital from a student's perspective.

Prehospital Emergency Medicine Blog

All you want to know about prehospital emergency medicine

Italy Customized Travel Blog

Local Travel Agent, sommelier, food & wine expert in Florence, Italy

GoogleFOAM

The FOAM Search Engine

EM Lyceum

where everything is up for debate . . .

Pediatric EM Morsels

Pediatric Emergency Medicine Education

EM Pills

curiosità-novità-aggiornamenti in medicina d'urgenza

AmboFOAM

Free Open Access Medical Education for Paramedics

FOAM4GP

Free Open Access Meducation 4 General Practice

Rural Doctors Net

useful resources for rural clinicians

Auckland HEMS

Unofficial site for prehospital care providers of the Auckland HEMS service

ECHOARTE

L'ECOGRAFIA: ENTROPIA DELL'IMMAGINE

MEDEST

Prehospital Emergency Medicine

ruralflyingdoc

Just another WordPress.com site

EM Basic

Your Boot Camp Guide to Emergency Medicine

KI Doc

WE HAVE MOVED - VISIT WWW.KIDOCS.ORG FOR NEW CONTENT

Emergency Live

Prehospital Emergency Medicine

AMP EM

Academic Medicine Pearls in Emergency Medicine from THE Ohio State University Residency Program

ERCAST Emergency Medicine Podcasts

Emergency medicine, podcasts, reviews, opinion and curbside consults

Prehospital Emergency Medicine

 Academic Life in Emergency Medicine

Prehospital Emergency Medicine

Prehospital Emergency Medicine

Greater Sydney Area HEMS

The Pre-hospital & Retrieval Medicine Team of NSW Ambulance

%d blogger hanno fatto clic su Mi Piace per questo: