Skip to main content
MMedVellum
MCQsExamsAtlas
DashboardPricing
MMedVellum

The exam atlas that feels like a flagship product — evidence-graded topics and exam tools for MBBS and fellowship preparation. Built to scale to fifty specialties. Educational content only — not medical advice.

llms.txt·psychiatry LLM catalog · sitemap

Atlas

  • Specialty atlas
  • MBBS / Core medicine
  • Dermatology
  • ICU Fellowship (CICM)
  • Anaesthesia
  • Emergency Medicine
  • Psychiatry Fellowship

Study & account

  • MCQ practice
  • Practice alias
  • Exam tools
  • Dashboard
  • Pricing
  • Sign in

© 2026 MedVellum. For education only — not a substitute for clinical judgement.

Clinical Atlas Prestige · Evidence-first

Psych MEQs / SAQsfoundations — advanced EBM and evidence synthesis

Psych MEQs / SAQs · foundations — advanced EBM and evidence synthesis

Advanced appraisal of a psychiatry meta-analysis and non-inferiority claim (MEQ)

Advanced MEQ on prediction intervals, heterogeneity, GRADE, publication bias, absolute effects, non-inferiority misuse, and external validity in psychiatry.

25 marks25 min
On this page & tools

Target exams

FRANZCPMRCPsychABPNMD-DNB

Target exams

FRANZCPMRCPsychABPNMD-DNB
Prompt
You are the registrar preparing a FRANZCP/MRCPsych-style advanced critical appraisal station. Materials: (A) Random-effects meta-analysis of SSRI X versus placebo for major depression (12 RCTs, n=3,200). Pooled RR for response 0.80 (95% CI 0.72–0.89), I-squared 68%, tau-squared elevated, 95% prediction interval 0.55–1.16. Funnel plot asymmetric (Egger p=0.04). Several included trials had unclear allocation concealment and unblinded outcome raters. (B) Separate industry press release claims a new LAI antipsychotic is 'non-inferior' to oral risperidone based on a superiority RCT whose 95% CI for relapse difference was −4% to +11% (no pre-specified non-inferiority margin). (i) Interpret the forest-plot diamond versus the prediction interval and the I-squared for panel A. (ii) List GRADE downgrade domains you would apply and propose a certainty rating with justification. (iii) Explain what absolute numbers you need before counselling a patient using NNT language. (iv) Appraise the non-inferiority claim in panel B. (v) Give a one-paragraph applicability conclusion for an older adult with multimorbidity excluded from most of the SSRI trials. (25 marks)

Model answer

Reveal model answer

(i) Diamond vs prediction interval and I-squared. The pooled RR 0.80 with CI 0.72–0.89 indicates a statistically significant average benefit under a random-effects model (CI excludes 1). The prediction interval 0.55–1.16 is wider and crosses 1, meaning that in a new similar setting/study the true effect could include no benefit — the key advanced distinction between average-effect precision and between-study predictive uncertainty.[1] I-squared 68% indicates a substantial proportion of variability is due to heterogeneity rather than chance and should trigger clinical and methodological exploration (dose, severity, blinding, attrition), not automatic rejection of all synthesis nor uncritical class-effect claims.[2]

(ii) GRADE downgrades and certainty. Starting from RCTs (high): downgrade for risk of bias (unclear concealment; unblinded raters on subjective outcomes — RoB 2 measurement and randomisation-process concerns).[7][3] Downgrade for inconsistency (I-squared 68%, PI crossing null).[2][3] Downgrade for publication bias / small-study effects (asymmetric funnel, Egger signal; psychiatry has known selective publication threats).[4][8] Imprecision is less dominant for the average effect (CI excludes 1) but the wide PI supports cautious language about applicability across settings. Overall certainty commonly low (or low–moderate if RoB is only 'some concerns' and search is comprehensive) for the average response effect — state your judgment with domain linkage rather than a bare label.[3]

(iii) Numbers for NNT counselling. Need a dichotomous patient-important outcome (response/remission), event rates or a chosen baseline risk (CER) for the patient before you, the relative effect (RR or OR) with uncertainty, and treatment duration. Absolute risk difference = CER − (CER × RR) for a harmful-event framing of non-response, or use response rates directly if available; NNT = 1/ARR. Relative meta-analytic RR alone is insufficient for honest NNT talk.[1][3]

(iv) Non-inferiority claim. Invalid. Non-inferiority requires a pre-specified clinically justified margin (delta), appropriate analysis sets, and a CI that lies entirely on the non-inferior side of delta; CONSORT non-inferiority extension items should be reported.[5] A superiority trial whose CI extends to +11% cannot be rebranded as NI without that design; residual possible inferiority of 11% may exceed a typical acceptable margin. Press-release language is spin until the protocol and CI-vs-delta are shown.[5]

(v) Applicability (older multimorbid adult). External validity is limited: exclusion of multimorbidity, polypharmacy, frailty, and pharmacokinetic change means baseline risk, harm profile, and absolute benefits may differ — an indirectness concern in GRADE terms and a classic Rothwell external-validity problem.[6][3] Shared decision-making should present low-certainty average efficacy, emphasise monitoring for adverse effects (hyponatraemia, falls, interactions), and avoid protocol-forced switching based on the diamond alone.

Common errors

Reading only the diamond; treating I-squared as a p-value; declaring definitive publication bias from a small funnel; inventing NNT without CER; accepting post-hoc non-inferiority; ignoring RoB 2 measurement bias for rating scales; over-generalising to excluded older adults without naming indirectness.[1][4][5][6]

References

  1. [1]Riley RD, Higgins JPT, Deeks JJ Interpretation of random effects meta-analyses BMJ, 2011.PMID 21310794
  2. [2]Higgins JP, Thompson SG, Deeks JJ, Altman DG Measuring inconsistency in meta-analyses BMJ, 2003.PMID 12958120
  3. [3]Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence J Clin Epidemiol, 2011.PMID 21208779
  4. [4]Sterne JAC, Sutton AJ, Ioannidis JPA, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials BMJ, 2011.PMID 21784880
  5. [5]Piaggio G, Elbourne DR, Pocock SJ, Evans SJW, Altman DG; CONSORT Group Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement JAMA, 2012.PMID 23268518
  6. [6]Rothwell PM External validity of randomised controlled trials: "to whom do the results of this trial apply?" Lancet, 2005.PMID 15639683
  7. [7]Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials BMJ, 2019.PMID 31462531
  8. [8]Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R Selective publication of antidepressant trials and its influence on apparent efficacy N Engl J Med, 2008.PMID 18199864