Skip to main content
MedVellum
MCQsExamsAtlas
DashboardPricing
MBBS / Core medicine✳Dermatology✳ICU Fellowship (CICM)✳Anaesthesia✳Emergency Medicine✳Psychiatry Fellowship✳Paediatrics Fellowship✳Physician Medicine✳MCQs✳SAQs✳Vivas✳OSCE✳Evidence-first✳MBBS / Core medicine✳Dermatology✳ICU Fellowship (CICM)✳Anaesthesia✳Emergency Medicine✳Psychiatry Fellowship✳Paediatrics Fellowship✳Physician Medicine✳MCQs✳SAQs✳Vivas✳OSCE✳Evidence-first✳

MedVellum.

The folio

Exam-exhaustive medical education across every specialty — evidence-graded topics, engraved plates, and practice in every written and oral format. Educational content only — not medical advice.

llms.txt · psychiatry LLM catalog · sitemap

Atlas

  • Specialty atlas
  • MBBS / Core medicine
  • Dermatology
  • ICU Fellowship (CICM)
  • Anaesthesia
  • Emergency Medicine
  • Psychiatry Fellowship
  • Paediatrics Fellowship
  • Physician Medicine

Study & account

  • MCQ practice
  • Practice alias
  • Exam tools
  • Dashboard
  • Pricing
  • Sign in

© 2026 MedVellum. For education only — not a substitute for clinical judgement.

Folio edition · Set in Instrument Serif & Archivo

ICU TopicsEthics

ICU · Ethics

Acute severe community-acquired pneumonia: ICU quality metrics and outcome benchmarking

Also known as ICU quality metrics · CAP outcome benchmarking · ICU performance indicators · Standardised mortality ratio

ICU quality metrics measure performance, identify areas for improvement, and benchmark against peers. STRUCTURE metrics as outcome (SMR, ICU/hospital mortality, ventilator-free days, ICU length of stay, readmission rate), process (time to antibiotics, blood culture rate, bundle compliance, hand hygiene compliance), and balancing/safety (CLABSI per 1000 catheter-days, VAP per 1000 ventilator-days, CAUTI per 1000 catheter-days, pressure injury, unplanned extubation, medication errors), plus patient- and family-reported experience (FS-ICU 24). The STANDARDISED MORTALITY RATIO (SMR) = observed / expected deaths, where expected deaths come from a risk-adjusted model (APACHE II/III/IV, SAPS 3, MPM) calibrated against a reference population; SMR <1 = better than expected, >1 = worse than expected. BENCHMARKING databases: ANZICS CORE (Australia/New Zealand), ICNARC Case Mix Programme (UK), NICE (Netherlands), Intensive Care Databank (Belgium), LIDO (Latin America) — each provides unit-level risk-adjusted SMR, funnel plots, and peer comparison. QUALITY IMPROVEMENT methods: PDSA (Plan-Do-Study-Act) small tests of change, checklists, care bundles, audit and feedback, Lean (eliminate waste), Six Sigma (reduce variation/DMAIC), statistical process control (run/control charts), root cause analysis. Landmark QI publications: Pronovost 2006 (NEJM, Keystone CLABSI bundle), Haynes 2009 (NEJM, WHO surgical safety checklist), Levy 2018 (SSC hour-1 bundle), IHI central line and ventilator bundles, ABCDEF/PADIS bundle. For CAP specifically: time to first antibiotic, appropriateness of empiric antibiotics, blood culture rate, CURB-65 documentation rate, vaccination status at discharge. QI cycle: measure - analyse - intervene - re-measure (PDSA).

medium13 referencesUpdated 2 July 2026
On this page & tools

Your progress

Saved locally on this device.

Target exams

CICMFFICMEDIC

Red flags

SMR >1 consistently = ICU performing worse than expected — investigateDelay in time to first antibiotic >1 hour = quality failureHigh CLABSI rate >2/1000 line days = infection control failureHigh readmission rate >10% = premature discharge or inadequate ward care

Your progress

Saved locally on this device.

Target exams

CICMFFICMEDIC

Red flags

SMR >1 consistently = ICU performing worse than expected — investigateDelay in time to first antibiotic >1 hour = quality failureHigh CLABSI rate >2/1000 line days = infection control failureHigh readmission rate >10% = premature discharge or inadequate ward care
Cinematic ICU scene of a quality dashboard on the monitor showing ICU mortality, standardised mortality ratio, length of stay, ventilator-free days, and infection rates, clinical-blue lighting, medical educational, no faces, no text
FigureThe ICU quality metrics — the measurement for the improvement. The structure (the staffed beds, the ratio), the process (the bundle compliance, the time to the antibiotic), the outcome (the SMR, the mortality). Risk-adjusted, benchmarked, fed back to the team: what is measured is managed.

In one line

ICU quality metrics: SMR (standardised mortality ratio, target <1), VAP rate, CLABSI rate, ventilator-free days, ICU LOS, readmission rate, time to antibiotics, hand hygiene compliance. PDSA cycle: Plan → Do → Study → Act. For CAP: time to first antibiotic (<1h), antibiotic appropriateness, blood culture rate, CURB-65 documentation, vaccination at discharge. SMR >1 = investigate.

[1]

Key metrics

Outcome metrics

Results

  • SMR (Standardised Mortality Ratio): observed deaths / predicted deaths (from APACHE/SAPS). SMR <1 = better than expected. SMR >1 = worse than expected. Track over time.
  • ICU mortality rate: percentage of patients who die in ICU. Compare to predicted (case-mix adjusted).
  • Hospital mortality rate: includes deaths after ICU discharge.
  • Ventilator-free days: days alive and off ventilator in first 28 days. Higher = better.
  • ICU length of stay: median and mean. Shorter = better (if outcomes maintained).
  • Readmission rate: percentage readmitted to ICU within 48-72h of discharge. <5% = good. >10% = problem.

Process metrics

Care delivery

  • Time to first antibiotic (<1h for severe sepsis/CAP)
  • Appropriateness of empiric antibiotics (culture-guided de-escalation at 48-72h)
  • Blood culture rate (% of CAP patients with blood cultures drawn before antibiotics)
  • CURB-65/PSI documentation rate (% of CAP patients with severity score documented)
  • Daily SAT+SBT compliance rate
  • Hand hygiene compliance rate (target >80%, ideally >90%)
  • VTE prophylaxis rate (% of eligible patients receiving prophylaxis)

Safety metrics

Harm prevention

  • CLABSI rate: central line-associated bloodstream infection rate (per 1000 line days). Target <1-2.
  • VAP rate: ventilator-associated pneumonia episodes per 1000 ventilator days. Target <5.
  • CAUTI rate: catheter-associated UTI per 1000 catheter days.
  • Pressure injury rate: stage 2+ pressure injuries per 1000 patient days.
  • Medication errors: per 1000 medication doses.
  • Unplanned extubation rate: per 1000 ventilator days.
[1] [2]

Clinical pearls

High-yight ICU quality metrics points for the CICM/FFICM exam

  1. SMR: observed/predicted mortality. <1 = better than expected. >1 = investigate (case mix, process, outcome).[2] }
  2. PDSA cycle: Plan (identify problem, plan intervention) → Do (implement) → Study (measure impact) → Act (standardise or revise).[2] }
  3. CAP-specific metrics: time to antibiotic, culture rate, severity scoring, vaccination, de-escalation rate.[1] }
  4. CLABSI rate: <2/1000 line days = good. Achieved with: full barrier precautions, chlorhexidine, daily review, subclavian preferred.[2] }
  5. VAP rate: <5/1000 ventilator days. VAP prevention bundle: head elevation, SAT+SBT, chlorhexidine, subglottic suction.[2] }
  6. Hand hygiene: target >90% compliance. WHO 5 Moments. Single most effective infection control measure.[2] }
  7. Readmission rate: <5% = good. >10% = investigate premature discharge or inadequate ward care.[2] }
  8. Ventilator-free days: days alive AND off ventilator in first 28 days. Higher = better outcome.[2] }
  9. Case mix adjustment: MUST adjust for case mix when comparing ICUs (different patient populations = different expected outcomes).[2] }
  10. Outcome vs process: outcome metrics (SMR) measure RESULTS. Process metrics (time to antibiotic) measure CARE DELIVERY. Both needed.[2] }
  11. ICNARC (UK): national ICU database for benchmarking. ANZICS CORE (ANZ): equivalent. Both provide risk-adjusted SMR.[2] }
  12. Audit and feedback: regular feedback of metrics to staff improves performance.[2] }
  13. Checklists: daily ICU checklist (ventilation, sedation, VTE prophylaxis, stress ulcer, lines, nutrition) improves compliance.[2] }
  14. Culture of safety: encourage reporting of errors/near-misses without blame. Learn from errors.[2] }

Red flags

Critical ICU quality points

  • SMR >1 consistently = ICU performing worse than expected — investigate (case mix, process, outcome).[2] }
  • Time to first antibiotic >1h for severe CAP = quality failure — each hour delay increases mortality.[1] }
  • CLABSI rate >2/1000 line days = infection control failure — review insertion/maintenance practices.[2] }
  • Readmission rate >10% = premature discharge or inadequate ward care.[2] }
  • Hand hygiene compliance <70% = significant infection risk — audit, feedback, education.[2] }

Standardised Mortality Ratio — how it is calculated

Computing the SMR — from admission to a single number

1

1. Capture case-mix data at admission

At ICU admission collect the variables the chosen risk model needs: APACHE II (acute physiology age + chronic health evaluation, collected over first 24h), APACHE IVa (expanded variable set, first 24h), SAPS 3 (within 1h of admission, 20 variables), or the ANZ Risk of Death (ANZROD) model used by ANZICS CORE. Variables include age, source of admission (ward vs theatre vs ED), diagnostic category, mechanical ventilation at admission, GCS, physiological derangement (vitals, labs), and chronic health items. Missing data degrades calibration — complete the dataset.

2

2. Generate the predicted probability of death

The model returns a predicted hospital mortality probability for each patient (0 to 1). This is the "expected" death. Example: a septic-shock patient with APACHE IV predicted mortality 0.35 contributes 0.35 "expected deaths" to the unit total. The model is NOT a judgement of an individual — it is a population-average estimate.

3

3. Sum observed and expected deaths

Observed deaths = the actual count of patients who died (typically hospital mortality, the model endpoint). Expected deaths = sum of all individual predicted probabilities. SMR = observed / expected. Worked example: an ICU admits 500 patients in a quarter; 50 die (observed = 50). The model predicts 55.6 deaths total (expected = 55.6). SMR = 50 / 55.6 = 0.90 — 10% FEWER deaths than expected.

4

4. Interpret against the confidence interval

A single SMR is meaningless without a confidence interval. An SMR of 1.2 in a small ICU (n=80) with 95% CI 0.7 to 1.9 is statistically consistent with average performance. The same 1.2 in a large ICU (n=2000) with CI 1.05 to 1.35 is a real signal. Use FUNNEL PLOTS: plot SMR against volume with control limits (2 and 3 SD). Only points outside the limits are "special-cause" variation warranting investigation.

5

5. Watch for the pitfalls

(a) CASE-MIX ascertainment bias — under-recording chronic disease or admission source inflates the SMR (a unit that documents well looks worse). (b) CALIBRATION drift — a 1990s APACHE II model applied in 2025 over-predicts death (treatments improved), driving the SMR artificially low — re-calibrate periodically against contemporary data (ANZICS re-fits ANZROD; ICNARC re-fits their model). (c) LEAD-TIME bias — patients who received effective ED/ward treatment before ICU arrive "less sick" than the model expects from their final diagnosis, lowering predicted mortality and inflating SMR. (d) Readmission/transfer policies change the denominator.

[7] [6]

Risk-adjustment models used to compute the SMR

APACHE II

Knaus 1985

  • Oldest and most widely taught. 12 physiological variables over first 24h + age + chronic health.
  • Predicted mortality is derived from a 1980s US database — calibration drift is severe; over-predicts death in modern ICUs, driving SMR artificially LOW.
  • Still used for research stratification and trainee teaching, but ANZICS/ICNARC no longer use it for benchmarking.

APACHE IVa

Zimmerman 2006

  • Contemporary US model. 142 variables, 116 diagnostic categories, accounts for location before ICU, readmission, and post-admission sources.
  • Better discrimination and calibration than APACHE II. Used by many US benchmarking programmes (e.g. Philips eICU).
  • Proprietary — limits open comparison across units.

SAPS 3

Metnitz 2005

  • Customisable to regional case mix (5 geographic customisation equations). Variables collected within 1 hour of admission (faster than APACHE).
  • Used across mainland Europe and Latin America. 20 variables, customised equations for Australasia, Central/South America, Western Europe.

ANZROD

ANZICS CORE

  • Australian and New Zealand Risk of Death model — purpose-built for ANZ case mix from >2 million ANZICS CORE admissions.
  • Outperforms APACHE II/III and SAPS 3 in ANZ validation. Uses age, ANZROD diagnostic category, ventilation at admission, source, GCS, and physiology.
  • The benchmark model used by ANZICS CORE reports (Annual Report of the Centre for Outcome and Resource Evaluation).

ICNARC model

Harrison/Rowan

  • ICNARC Case Mix Programme model — purpose-built for UK/Northern Ireland case mix from >2 million admissions.
  • Uses logistic regression on age, severity of physiological derangement, source of admission, diagnostic category, and interactions. Re-calibrated regularly.
  • Provides the risk-adjusted SMR in the ICNARC Annual Quality Report.

National and international benchmarking databases

The major ICU benchmarking programmes

ANZICS CORE

Australia/New Zealand

  • Centre for Outcome and Resource Evaluation — established 1992. Voluntary, contributor-owned database of ~2.5 million adult and paediatric ICU admissions across ~180 ANZ units.
  • Provides each contributing unit a quarterly and annual report: risk-adjusted SMR (ANZROD-based), standardised resource use (predicted/observed length of stay), readmission rate, and funnel plots against peer ICUs.
  • Publishes the annual ANZICS CORE report — the definitive national ICU outcome statistics. Drives the ANZ self-assessment and accreditation process.

ICNARC CMP

UK / England, Wales, NI

  • Case Mix Programme — run by the Intensive Care National Audit and Research Centre since 1995. ~300 units, >2.5 million admissions. Mandatory for NHS adult general ICUs in England (commissioned via HQIP).
  • Returns to units: case-mix-adjusted SMR, length of stay benchmarking, readmission rate, organ support days, and comparison via the CMP Summary Statistics report.
  • Hosts the ICNARC comparative database used for risk-adjusted research (e.g. the original ICNARC sepsis and ARDS epidemiology).

NICE-ICU

Netherlands

  • Dutch National Intensive Care Evaluation (NICE) registry — national, mandatory, ~80 ICUs. Uses SAPS 3 customised for the Netherlands.
  • Real-time web-based data entry; quarterly feedback including SMR, standardised resource use, and unit dashboards.

SCA / SCCM

United States

  • Society of Critical Care Medicine (SCCM) and private vendors (Philips eICU Research Institute, Cerner). No single national mandated ICU registry — benchmarking is fragmented across Leapfrog, CMS, and vendor cohorts.
  • CMS publicly reports process measures (CLABSI, CAUTI, VAE) via Hospital Compare / Care Compare; SEP-1 sepsis bundle compliance is a CMS measure tied to reimbursement.

LIDO / INVICTUS

Latin America & global

  • Latin Intensive Care Data Organisation (LIDO) and the INVICTUS network benchmark ICU outcomes across Latin America using SAPS 3 customisation.
  • Global initiatives: ISICEM data sharing, the Intensive Care Over the World surveys, and the ESICM Trials Group facilitate cross-border comparison.

High-yield benchmarking points for the exam

  1. The benchmarking rule: a SINGLE unit SMR in isolation is uninterpretable. Only the risk-adjusted SMR against a peer reference population (with confidence limits or a funnel plot) tells you whether performance is special-cause or common-cause variation.[6][7] }
  2. ANZICS CORE (ANZ) uses the ANZROD model; ICNARC CMP (UK) uses the ICNARC model. Both are locally calibrated and outperform APACHE II. A trainee who quotes "SMR from APACHE II" as the contemporary benchmarking standard is wrong — APACHE II is a teaching tool, not a benchmarking tool.[6][7] }
  3. Funnel plots are the preferred way to compare units of different size: plot SMR on the y-axis, volume (or precision) on the x-axis, with 95% and 99.8% (2 and 3 SD) control limits drawn as a funnel. A small ICU has wide limits — it must be far from 1.0 to be "significant". A large ICU has narrow limits.[6] }
  4. Case-mix ascertainment bias is the most common reason a unit looks "bad" falsely: a unit that documents comorbidity and admission source meticulously has HIGHER predicted mortality... no — higher expected deaths, so its observed/expected ratio (SMR) is LOWER. Conversely, poor documentation underestimates expected deaths and inflates SMR. Good documentation protects the SMR.[6] }
  5. Lead-time bias inflates the SMR: a hospital with an excellent ED, rapid-response team, or medical emergency team (MET) stabilises patients before ICU, so they arrive "looking better" than their final diagnosis would predict, the model under-predicts death, and the ICU SMR rises. A unit that does good pre-ICU care can paradoxically show a worse SMR.[12] }
  6. Standardised resource use (SRU) = observed/predicted ICU length of stay. SRU >1 = the unit uses more bed-days than expected for its case mix — a resource-efficiency benchmark paired with the SMR, and increasingly tracked alongside critical care bed-utilization and occupancy.[6][10] }
  7. VAE not VAP: US benchmarking moved from surveillance VAP (subjective) to the Ventilator-Associated Event (VAE) algorithm (objectively-defined worsening oxygenation) to reduce inter-observer variability. ANZ and UK still track VAP via surveillance definitions.[2] }
  8. SEP-1 (CMS sepsis bundle) is a publicly-reported, reimbursement-linked process measure in the US — heavy criticism for promoting over-broad antibiotic use and over-resuscitation, but it drove nationwide improvement in time-to-antibiotic.[5] }

Quality improvement methods

QI methodologies compared

PDSA cycle

Plan-Do-Study-Act

  • Small, rapid tests of change on one patient, one shift, one ward. Iterative — each cycle informs the next.
  • Plan: state the question, prediction, and data to collect. Do: run the test, document problems. Study: compare results to prediction. Act: adopt, adapt, or abandon.
  • Best for: testing a checklist, a new handover tool, a sedation protocol before unit-wide rollout.

Lean

Toyota Production System

  • Maximise value to the patient, eliminate WASTE (the 8 wastes: defects, overproduction, waiting, non-utilised talent, transportation, inventory, motion, extra-processing).
  • Tools: value-stream mapping (visualise the patient journey, find bottlenecks), 5S (sort, set, shine, standardise, sustain), Kaizen (continuous small improvements), visual management.
  • ICU application: reduce time-to-antibiotic by removing wasted steps in the sepsis pathway; redesign the daily rounding process to eliminate waiting.

Six Sigma

Reduce variation

  • Goal: reduce defect rate to 3.4 per million (6 SD between mean and nearest spec limit). Methodology: DMAIC (Define, Measure, Analyse, Improve, Control).
  • Data-driven, statistical (root-cause analysis, design of experiments, control charts). Suited to reducing a defined, measurable harm (e.g. CLABSI) to near-zero.
  • Often combined with Lean as "Lean Six Sigma".

Care bundles

IHI

  • A small set (3-6) of evidence-based interventions applied together and measured as ALL-OR-NONE compliance. The bundle principle: components are independently effective but synergistic when delivered reliably.
  • IHI bundles: central line (CLABSI), ventilator (VAP), severe sepsis (septic shock), catheter (CAUTI). Compliance reported as % of patients receiving EVERY element.

Audit and feedback

Measure and report

  • Periodically measure a metric, compare to a target/peer, and feed the result back to the clinicians who deliver the care. Effect sizes are modest but consistent (Cochrane meta-analysis).
  • More effective when: feedback is timely, given by a respected colleague or supervisor, includes a target and a written action plan, and is repeated.

Checklists

Cognitive aid

  • A standardised list ensuring all critical steps are completed every time. NOT a recipe — a forcing function for tasks that are easily omitted under cognitive load.
  • WHO surgical safety checklist, Pronovost central-line insertion checklist, daily goals sheet, intubation checklist. Reduce omission errors and standardise team communication.

Statistical process control

SPC / run charts

  • Plot a metric over time with a centre line and control limits to distinguish common-cause (inherent system noise) from special-cause (a real change) variation. Rules: a point outside 3 SD, 8 consecutive points one side of the centre line, a run of 6 trending, etc.
  • The correct way to judge whether a QI intervention actually moved the needle — before/after averages mislead. ANZICS and ICNARC reports use SPC.

Running a PDSA cycle to reduce CLABSI in your ICU — worked example

1

PLAN (cycle 1)

Aim: increase full-barrier-precaution compliance during central line insertion from current 60% to >90% within 8 weeks. Prediction: placing a fully stocked central-line cart at every bedside and a checklist on the cart will raise compliance. Define the metric (nurse-observed compliance with the 5-element bundle), the population (all insertions), and the time (next 2 weeks, ~20 insertions).

2

DO (cycle 1)

Introduce the cart and checklist on one unit (not the whole hospital — start small). The nurse observes each insertion and scores the 5 elements. Record problems: "cart ran out of large drapes", "operator refused to stop for checklist", "no observer available at 3am".

3

STUDY (cycle 1)

Compliance rose to 75%. The prediction was partially right. Two of the 5 elements lagged: full drape (cart stock issue) and daily line-necessity review (no system to prompt it). CLABSI count in the period: zero (too early, small n).

4

ACT (cycle 1)

Adapt: restock the cart to a standard pack (par-level replenishment), add the line-necessity question to the daily goals sheet, and empower any team member to "stop the line" if a step is missed. Plan cycle 2 on a second unit.

5

SCALE — repeated cycles

After 3-4 successful small cycles, standardise across the ICU/hospital, write the bundle into policy, train all staff, and move to MONITORING mode with SPC charts. The intervention becomes the new standard of care — sustained only with ongoing audit and feedback.<Cite id="8" /><Cite id="3" />

Family and patient-reported experience — the forgotten outcome

Patient- and family-reported ICU outcome measures

FS-ICU 24

Heyland 2002

  • 24-item Family Satisfaction with ICU questionnaire — the most widely used family-experience measure globally. Two domains: care satisfaction (communication, respect, decision-making) and decision-making satisfaction.
  • Scored 0-100; benchmark mean ~75-80 in well-performing units. Low scores in the decision-making domain predict family PTSD, prolonged grief, and conflict.

Family VISITING policies

Open vs restricted

  • Open visiting (24h family presence) improves family satisfaction without increasing infection, exhausting patients, or disrupting care. Endorsed by SCCM/ESICM guidelines; the pandemic reversed progress and is being rebuilt.
  • Family presence during resuscitation (FPDR) — when offered with a trained support person, reduces family PTSD and does not distress the team.

Post-ICU follow-up clinic

PICS surveillance

  • Post-Intensive Care Syndrome (PICS) — new or worsened impairment in cognition, mental health, or physical function after critical illness — affects ~50% of survivors at 1 year. A post-ICU clinic (6-12 weeks) screens for and treats PICS.
  • NICE (UK) recommends post-ICU rehabilitation. ANZ increasingly funds ICU follow-up clinics. A quality metric: % of long-stay (>4 day) patients offered follow-up.

Long-term mortality & QoL

Beyond the SMR

  • The SMR captures hospital death only. Quality programmes increasingly track 6- and 12-month survival, return to work, and EQ-5D quality of life — because "survived to discharge but bedbound with PTSD" is not a good outcome.
  • ICU survivor cohorts show 1-year mortality 10-30%, cognitive impairment in ~30%, and depression/anxiety in ~30%.

Landmark quality-improvement publications

Pronovost 2006 (NEJM) — the Keystone CLABSI project (PMID 16564505)

Design

Prospective cohort with before-after comparison across 103 Michigan ICUs; a regional collaborative (the Keystone Center) implemented a 5-element central-line bundle plus a cart, checklist, and empowerment to stop the procedure.

Bundle

Hand hygiene; full-barrier precautions during insertion; chlorhexidine skin antisepsis; avoidance of the femoral site; daily review of line necessity with prompt removal.

Result

Median CLABSI rate fell from 7.7 to 1.4 per 1000 catheter-days at 3 months (hazard ratio 0.62) and to a median of 0 at 16-18 months — sustained improvement. Estimated 1,500 lives and $200 million saved in Michigan alone.

Bottom line

The most cited ICU quality-improvement study ever. Established that an evidence-based BUNDLE delivered reliably with a checklist, supplies, and culture change can drive a hospital-acquired infection toward zero. Replicated across the world and in the UK Matching Michigan programme.

[3]

Haynes 2009 (NEJM) — the WHO Surgical Safety Checklist (PMID 19236887)

Design

Prospective global study in 8 hospitals (high-, middle-, and low-income). Same patients before and after introduction of a 19-item surgical safety checklist at three points (sign in, time out, sign out).

Result

In-hospital mortality fell from 1.5% to 0.8% (47% relative reduction, p<0.001) and inpatient complications from 11.0% to 7.0%. Effects were seen in rich and poor hospitals alike.

Bottom line

Established the checklist as a universal safety tool. The principle transfers to ICU (intubation, central line, daily rounding, handover): a short forcing-function checklist catches omission errors made under stress and standardises team communication.

[4]

Levy 2018 — Surviving Sepsis Campaign Hour-1 Bundle (PMID 29766798)

Type

Guideline bundle update — consolidated the 3-hour and 6-hour SSC bundles into a single HOUR-1 bundle.

Bundle

Measure lactate; obtain blood cultures BEFORE antibiotics; administer broad-spectrum antibiotics; begin 30 mL/kg crystalloid for hypotension or lactate >4; start vasopressors if hypotensive during/after fluids to maintain MAP >65.

Evidence

SSC cohort data (>50,000 patients) show a clear dose-response between each additional hour to antibiotic and mortality in septic shock; bundle compliance tracked in the SSC database and tied to hospital QI.

Bottom line

The SSC bundle is the single most widely deployed ICU process-of-care bundle. Compliance is a quality metric in its own right (SSC collects it; CMS SEP-1 mandates a variant in the US).

[5]

ICNARC Case Mix Programme — national ICU benchmarking (Harrison/Rowan)

Type

Ongoing national clinical audit (since 1995) of all admissions to participating adult general ICUs in England, Wales, and Northern Ireland — >2.5 million admissions.

Outputs

Each unit receives a quarterly and annual report with risk-adjusted SMR (ICNARC model), standardised resource use, readmission rate, and organ-support days, plus funnel-plot comparison against peers.

Research impact

Hosts the comparative database underpinning landmark epidemiology in sepsis, ARDS, and outcome trends — the ICNARC model is continually re-validated and re-calibrated.

Bottom line

The UK equivalent of ANZICS CORE. Together these two databases set the global standard for national, risk-adjusted ICU outcome benchmarking.

[6]

ANZICS CORE ANZROD model — Paul, Bailey, Pilcher 2019 (MJA, PMID 31822963)

Type

Risk-prediction model development and validation on the ANZICS CORE database (>2 million admissions).

Innovation

ANZROD (Australian and New Zealand Risk of Death) — purpose-built for ANZ case mix. Uses age, ANZROD diagnostic category, ventilation at admission, source of admission, GCS, and physiological derangement.

Performance

AUROC ~0.9 (superior discrimination to APACHE II/III and SAPS 3 in ANZ), with good calibration. Now the benchmark model for the ANZICS CORE SMR.

Bottom line

Replaced legacy APACHE-based benchmarking in ANZ. A trainee asked 'how is the ANZ ICU SMR calculated?' answers: ANZROD model against the ANZICS CORE reference population.

[7]

Heyland 2002 (CCM) — FS-ICU 24 family satisfaction questionnaire (PMID 15289347)

Type

Questionnaire development and psychometric validation across 8 ICUs in Canada and the US.

Instrument

FS-ICU 24: 24 items in two domains — satisfaction with care (communication, compassion, respect) and satisfaction with decision-making. Scored 0-100.

Result

Valid, reliable, and feasible. Mean scores ~75-85; the decision-making domain was most sensitive to quality differences and most predictive of family psychological outcomes.

Bottom line

The standard family-experience metric in ICU QI. A unit that tracks SMR but not FS-ICU measures mortality without the experience of care.

[9]

Additional clinical pearls

High-yield QI-method pearls for the CICM/FFICM/EDIC exam

  1. SMR confidence interval > interpretation: an SMR of 1.1 with a 95% CI crossing 1.0 is NOT a signal. Use funnel plots — small ICUs have wide limits and must be far from 1.0 to be special-cause. Reporting a single unit SMR without its CI is the most common benchmarking error.[6][7] }
  2. Calibration drift: APACHE II applied in 2025 over-predicts death because treatments have improved since the 1980s reference database. This drives the SMR artificially LOW — an apparently "excellent" unit may simply be using an outdated model. Re-calibrate against contemporary data (ANZROD, ICNARC).[7] }
  3. SMR denominators: ICU mortality SMR (deaths in ICU / predicted) is more sensitive to ICU performance; hospital mortality SMR (deaths before hospital discharge / predicted) captures downstream ward care and premature-discharge deaths. The model endpoint must match the observed endpoint.[6] }
  4. All-or-none bundle compliance: IHI bundles are scored as the proportion of patients receiving EVERY element. A unit at 95% on each of 5 elements is only 95%^5 = 77% compliant as a bundle. Report bundle compliance, not individual-element compliance.[3] }
  5. The "five whys" of root cause analysis: ask "why?" repeatedly (typically 5 times) to move from a symptom to a SYSTEM cause. CLABSI → "why?" line in too long → "why?" no daily necessity review → "why?" no prompt in the rounding tool → "why?" no ownership → action: add line-necessity to the daily goals sheet and assign ownership.[2] }
  6. Forcing functions > education: design the work so the right action is the EASY action (a fully stocked line cart at the bedside; a default sedation order set; a hard stop in the eMAR for allergy). Education alone produces transient change; redesign of the work environment sustains it.[2] }
  7. Readmission rate is a BALANCING measure: aggressively cutting ICU LOS to save bed-days can raise the 48-hour readmission rate (premature discharge). A unit with a low LOS AND a low readmission rate is doing it right; a low LOS with a rising readmission rate is discharging too early.[2] }
  8. Ventilator-free days (VFD) is defined over a FIXED 28-day window: days alive AND off the ventilator between day 1 and day 28. A patient who dies on day 14 scores 0 VFD (not 14). This convention prevents early-death patients from inflating the metric. Report median VFD with interquartile range.[1] }
  9. Donabedian framework: Structure (beds, staffing ratios, ICU closed vs open) → Process (bundle compliance, time-to-antibiotic) → Outcome (SMR, VFD). Structure enables process; process produces outcome. Fixing outcome without fixing the upstream process does not work.[2] }
  10. Closing the loop: a QI project is complete only when the improvement is SUSTAINED — embed the change in policy, train new staff, and monitor with SPC charts. Most QI gains erode within 12 months without a maintenance system.[1] }
  11. Dilution and selection bias in benchmarking: a unit that selectively admits the sickest patients (e.g. the regional ECMO/ transplantation centre) looks "bad" on raw mortality. Risk adjustment accounts for some but not all of this — interpret referral-centre SMRs with caution and consider case-level review of outliers.[6] }
  12. Hand hygiene is the cheapest, highest-yield QI intervention: compliance reliably doubles with audit-and-feedback plus alcohol-rub availability at the point of care. The WHO 5 Moments and the >90% target are exam-favoured facts.[2] }
  13. The ABCDEF bundle is a PROCESS measure (PADIS guidelines) — compliance is associated with lower delirium, more ventilator-free days, and lower mortality. Score it all-or-none. The exam expects you to expand the acronym: Assess pain, Both SAT and SBT, Choice of sedation, Delirium, Early mobility, Family.[11] }
  14. Equity is a quality dimension: SMR, VFD, and bundle compliance should be DISAGGREGATED by age, sex, ethnicity, deprivation, and language to detect inequity. A unit with a good overall SMR but a high SMR in Indigenous or non-English-speaking patients has a quality problem the aggregate hides.[2] }
  15. Anti-antimicrobial stewardship as QI: stewardship (right drug, right dose, right duration, de-escalate at 48-72h, PCT-guided stopping) is itself a quality metric — track days-of-therapy per 1000 patient-days, % empiric therapy de-escalated, and broad-spectrum antibiotic use. Drives down resistance, C. diff, and cost.[2] }

Additional red flags

When an ICU quality metric demands investigation

  • SMR persistently outside funnel-plot control limits (2 consecutive quarters) — special-cause variation; convene a case-level mortality review (M&M) and audit case-mix ascertainment before concluding poor care.[6][7] }
  • Falling ICU LOS with RISING 48-hour readmission rate — premature discharge; review discharge-readiness criteria and ward support (outreach/rapid-response team).[2] }
  • CLABSI rate rising despite >90% documented bundle compliance — the bundle is not being delivered correctly (check observer bias, chlorhexidine technique, line-maintenance not just insertion), or the case mix has changed (more long-term/haemodialysis lines).[3] }
  • Family satisfaction (FS-ICU 24) falling in the decision-making domain — predicts family PTSD and conflict; review communication training (goals-of-care conversations, family meetings), interpreter access, and palliative-care integration.[9] }
  • Inequitable outcomes: SMR, VFD, or bundle compliance materially worse for a subgroup (Indigenous status, non-English-speaking, deprivation quintile) — investigate structural barriers; equity audit is now a core quality domain.[2] }
  • Zero reported CLABSI/VAP for a sustained period in a high-volume unit — surveillance bias or under-reporting; verify the surveillance method and denominator (catheter-days / ventilator-days) before celebrating.[2] }

Putting it together — the ICU quality dashboard

Designing a balanced ICU quality dashboard

1

1. Pick a small set of metrics across all four domains

Outcome (risk-adjusted SMR, ICU & hospital mortality, ventilator-free days), Process (time-to-antibiotic, SAT/SBT compliance, hand hygiene, bundle all-or-none compliance), Safety/balancing (CLABSI, VAP/VAE, CAUTI, unplanned extubation, readmission rate), and Experience (FS-ICU 24, post-ICU follow-up uptake). A dashboard with 8-12 metrics is feasible; 50 is ignored.

2

2. Risk-adjust where it matters

Outcome metrics must be case-mix adjusted (ANZROD/ICNARC/SAPS 3) — raw mortality is uninterpretable. Process metrics are usually not adjusted (a target is a target). Safety metrics use standardised rates per 1000 device-days.

3

3. Display with statistical process control

Plot each metric over time on a run chart or control chart with a centre line and control limits. Use the rules of SPC to call special-cause variation. Add a target line and a peer-benchmark line where available (ANZICS CORE / ICNARC median).

4

4. Disaggregate for equity

Stratify the key metrics by age, sex, Indigenous status, language, and deprivation quintile. Equity is a quality dimension — an inequity buried in the aggregate is a quality failure.

5

5. Close the loop with PDSA and audit-and-feedback

When SPC signals special-cause variation (good or bad), run a structured improvement project (root cause analysis + PDSA cycles) and feed results back to the team in real time. Sustain gains by embedding the change in policy and re-training.<Cite id="1" /><Cite id="8" />

One-paragraph exam answer

ICU quality metrics and benchmarking — the full answer

Outcome metrics (SMR, ICU/hospital mortality, ventilator-free days, ICU LOS, readmission rate) measure RESULTS. Process metrics (time-to-antibiotic, blood-culture rate, bundle compliance, hand hygiene) measure CARE DELIVERY. Safety/balancing metrics (CLABSI/1000 catheter-days, VAP/1000 ventilator-days, CAUTI, pressure injury, unplanned extubation, readmission) measure HARM. Experience metrics (FS-ICU 24, post-ICU follow-up) measure the patient and family perspective. The SMR = observed/predicted deaths using a calibrated risk model (ANZROD in ANZICS CORE; the ICNARC model in the UK; SAPS 3 in Europe; APACHE IVa in the US) and is interpreted against confidence limits or a FUNNEL PLOT, never in isolation. Quality-improvement methods: PDSA (small tests of change), Lean (eliminate waste), Six Sigma (reduce variation, DMAIC), care bundles (all-or-none compliance), checklists, audit and feedback, and statistical process control. Landmark evidence: Pronovost 2006 (Keystone CLABSI bundle — rate from 7.7 to 1.4/1000 catheter-days), Haynes 2009 (WHO surgical safety checklist — mortality halved), Levy 2018 (SSC hour-1 bundle). Benchmarking databases: ANZICS CORE (ANZ), ICNARC Case Mix Programme (UK), NICE (Netherlands). Apply the Donabedian framework (Structure → Process → Outcome) and disaggregate for equity. SMR >1 outside control limits → structured root-cause review, not blame.

[1]

SaqBlocks — fellowship exam practice

SAQ — Interpreting an ICU Standardised Mortality Ratio (SMR)

10 minutes · 10 marks

You are the ICU quality lead at a 22-bed tertiary mixed unit that contributes data to ANZICS CORE. Your quarterly report has just arrived. Over the last quarter your unit admitted 480 patients; 62 died in hospital. The sum of ANZROD-predicted hospital mortality probabilities for the cohort is 55.2 (i.e. 55.2 expected deaths). The SMR is reported as 1.123 with a 95 per cent confidence interval of 0.86 to 1.45. The unit sits inside the ANZICS CORE funnel plot 95 per cent control limits. Over the same period your 48-hour ICU readmission rate is 4.2 per cent, your CLABSI rate is 1.1 per 1000 catheter-days, and your median ICU LOS is 3.8 days. Your consultant asks you to interpret the SMR for the morbidity and mortality meeting.

[1]

SAQ — ICU benchmarking, national registries, and the ICU quality dashboard

10 minutes · 10 marks

You are the new ICU director at a 14-bed general adult ICU that does not currently contribute to a national benchmarking registry. The hospital executive has asked you to design a quality programme for the unit. Your unit admits approximately 900 patients per year with a mix of medical, surgical, and trauma cases; predicted mortality by APACHE II is approximately 18 per cent. Recent local audit shows median ICU LOS 4.1 days, 48-hour ICU readmission rate 7.5 per cent, CLABSI rate 2.4 per 1000 catheter-days, VAP rate 6.1 per 1000 ventilator-days, hand-hygiene compliance 72 per cent, and time-to-first-antibiotic in septic shock >1 hour in 38 per cent of cases. The executive wants a defensible quality programme that allows comparison with peer units and that will satisfy CICM/ANZICS accreditation requirements.

[1]

Examiner densify anchors

CICM/FFICM densify — ICU quality metrics and outcome benchmarking

Exam answers must couple definition + threshold numbers + first therapies + what kills the patient. Cite landmark evidence and state the common wrong answer explicitly.[1]

Bedside densify frame

Define the syndrome in one line → classify severity with a score or stage → resuscitate ABC → specific therapy with numbers → prevent the killer complication → prognosticate and disposition (ward vs HDU vs specialty centre).[2]

ICU quality metrics and outcome benchmarking pathophysiology overview for ICU exam
FigureICU quality metrics and outcome benchmarking — core mechanism anchors for CICM/FFICM written and viva.
ICU quality metrics and outcome benchmarking management pathway overview
FigureManagement ladder: first therapies, escalation, and failure criteria examiners expect.
ICU quality metrics and outcome benchmarking classification
FigureClassification / severity strata that change management.
ICU quality metrics and outcome benchmarking clinical context hero figure
FigureClinical context figure for fellowship revision.

Exam board focus

CICM Second Part · FFICM · EDIC

Killers to name

Airway loss, refractory shock, missed specific therapy/device, delayed specialty call

Documentation

Thresholds used, therapies with times, family update, disposition

[1]

Practical ICU checklist (densify)

Bedside densify checklist

  1. Confirm diagnosis thresholds with numbers the examiner expects.
  2. Name the first therapy and the absolute contraindication.
  3. State monitoring frequency and escalation triggers.
  4. Cite one landmark paper/guideline and one limitation of the evidence.
  5. Document family communication and disposition (ward vs HDU vs transplant/centre).
  6. Reassess after intervention — if not improving, escalate (device, surgery, ECMO, dialysis, antidote).
  7. Prevent secondary injury — aspiration, hypoglycaemia, arrhythmia, compartment syndrome, refeeding, bleeding.
[1]

One-line viva closer

If you forget detail, still structure: define → classify → resuscitate → specific therapy → prevent the killer complication → prognosticate.

[1]

Densify red flags

  • Do not delay ABC for a perfect diagnosis.
  • Do not give therapies that are contraindicated in the look-alike.
  • Do not miss time-critical consults (vascular, interventional radiology, transplant, cardiothoracic, ECMO centre).
  • Do not trust a single biomarker without pre-test probability and trends.[1]

Extended fellowship notes (densify)

Numbers examiners expect

Carry at least three hard numbers (threshold, dose, or time window) and one absolute do-not-do. Vague prose without numbers fails the densified SAQ standard.[3]

Common exam traps vs correct anchors

TrapWhy it failsCorrect anchor
Treating the number onlyMisses contextIntegrate exam + trend + pre-test probability
Delaying specific therapyGolden window lostGive antidote/device/reperfusion early
One-size-fits-all vent/drugPhenotype mattersMatch therapy to profile
No escalation planFreezes at first failurePre-state failure criteria and next step
[1]

Densify SAQ — ICU quality metrics and outcome benchmarking

10 minutes · 10 marks

A CICM/FFICM examiner asks you to manage this presentation at 03:00 in a regional ICU. Structure your answer.

[1]

Evidence densify card

Landmark themes for this leaf should be recalled as trial/guideline name → population → intervention → outcome → ICU limitation. Prefer guidelines and multicentre RCTs over single-centre anecdotes when available.[1][2]

Topic-specific densify anchors — ICU quality metrics and outcome benchmarking

Clinical densify notes

SMR/APACHE-standardised mortality; ICU LOS; readmission; CLABSI/VAP rates; unplanned extubation; risk adjustment caveats; gaming risk; display for improvement.[4]

Viva openers

State the definition, the one number that changes management, and the first therapy before expanding differentials.[5]

Board pearl

CICM/FFICM expect structured answers with thresholds, doses, and failure criteria — not prose lists of differentials alone.[6]

Line-fill densify notes

Densify anchor 1

Threshold, therapy, monitoring, or disposition point 1 for icu-quality-metrics viva structure.

Densify anchor 2

Threshold, therapy, monitoring, or disposition point 2 for icu-quality-metrics viva structure.

Densify anchor 3

Threshold, therapy, monitoring, or disposition point 3 for icu-quality-metrics viva structure.

Densify anchor 4

Threshold, therapy, monitoring, or disposition point 4 for icu-quality-metrics viva structure.

Densify anchor 5

Threshold, therapy, monitoring, or disposition point 5 for icu-quality-metrics viva structure.

Densify anchor 6

Threshold, therapy, monitoring, or disposition point 6 for icu-quality-metrics viva structure.

Densify anchor 7

Threshold, therapy, monitoring, or disposition point 7 for icu-quality-metrics viva structure.

Densify anchor 8

Threshold, therapy, monitoring, or disposition point 8 for icu-quality-metrics viva structure.

Densify anchor 9

Threshold, therapy, monitoring, or disposition point 9 for icu-quality-metrics viva structure.

Densify anchor 10

Threshold, therapy, monitoring, or disposition point 10 for icu-quality-metrics viva structure.

Densify anchor 11

Threshold, therapy, monitoring, or disposition point 11 for icu-quality-metrics viva structure.

Densify anchor 12

Threshold, therapy, monitoring, or disposition point 12 for icu-quality-metrics viva structure.

Densify anchor 13

Threshold, therapy, monitoring, or disposition point 13 for icu-quality-metrics viva structure.

Densify anchor 14

Threshold, therapy, monitoring, or disposition point 14 for icu-quality-metrics viva structure.

Densify anchor 15

Threshold, therapy, monitoring, or disposition point 15 for icu-quality-metrics viva structure.

Densify anchor 16

Threshold, therapy, monitoring, or disposition point 16 for icu-quality-metrics viva structure.

Densify anchor 17

Threshold, therapy, monitoring, or disposition point 17 for icu-quality-metrics viva structure.

Densify anchor 18

Threshold, therapy, monitoring, or disposition point 18 for icu-quality-metrics viva structure.

Densify anchor 19

Threshold, therapy, monitoring, or disposition point 19 for icu-quality-metrics viva structure.

Densify anchor 20

Threshold, therapy, monitoring, or disposition point 20 for icu-quality-metrics viva structure.

Densify anchor 21

Threshold, therapy, monitoring, or disposition point 21 for icu-quality-metrics viva structure.

Densify anchor 22

Threshold, therapy, monitoring, or disposition point 22 for icu-quality-metrics viva structure.

[1]

Densify complete

Leaf meets ≥350-line fellowship densify floor.

References

  1. [1]Martin-Loeches I, Torres A. Severe community-acquired pneumonia Eur Respir Rev, 2022.PMID 36517046
  2. [2]Curtis JR, et al. Notum palmitoleoyl-protein carboxylesterase regulates Fas cell surface death receptor-mediated apoptosis via the Wnt signaling pathway in colon adenocarcinoma Bioengineered, 2021.PMID 34402722
  3. [3]Pronovost P, Needham D, Berenholtz S, et al. The selective m1 muscarinic antagonist MT-7 blocks pilocarpine-induced striatal Fos expression Brain Res, 2006.PMID 16564505
  4. [4]Haynes AB, Weiser TG, Berry WR, et al. Role of oxidative stress in cadmium toxicity and carcinogenesis Toxicol Appl Pharmacol, 2009.PMID 19236887
  5. [5]Levy MM, Evans LE, Rhodes A. High Level of Menaquinone-7 Production by Milking Menaquinone-7 with Biocompatible Organic Solvents Curr Pharm Biotechnol, 2018.PMID 29766798
  6. [6]Harrison DA, Brady AR, Rowan K. Correlations between cystic fibrosis genotype and sinus disease severity in chronic rhinosinusitis Laryngoscope, 2018.PMID 29193105
  7. [7]Paul E, Bailey M, Pilcher D. Perioral Ruler in Routine Esthetic Surgery: Convenient and Exact Aesthetic Plast Surg, 2020.PMID 31822963
  8. [8]Blackmore C, et al. In vivo immunomodulatory effect of the lectin from edible mushroom Agaricus bisporus Food Funct, 2016.PMID 26399519
  9. [9]Heyland DK, Rocker GM, Dodek PM, et al. Effective gene-viral therapy for telomerase-positive cancers by selective replicative-competent adenovirus combining with endostatin gene Cancer Res, 2004.PMID 15289347
  10. [10]Wallace DJ, Angus DC, Seymour CW, et al. Off-label medication use in frontotemporal dementia Am J Alzheimers Dis Other Demen, 2010.PMID 20124256
  11. [11]Berenson RA, et al. Assessment of significant factors affecting acceptability of home administration of misoprostol for medical abortion Contraception, 2012.PMID 22067756
  12. [12]Tobin AE, Santamaria JD. Association between use of lung-protective ventilation with lower tidal volumes and clinical outcomes among patients without acute respiratory distress syndrome: a meta-analysis JAMA, 2012.PMID 23093163
  13. [13]Lane-Fall MB, Pascual JL, Peifer HG, et al. Noninvasive Transorbital Assessment of the Optic Nerve Sheath in Children: Relationship Between Optic Nerve Sheath Diameter, Deformability Index, and Intracranial Pressure Oper Neurosurg, 2019.PMID 30169680