viva questions with answers for the critical appraisal of a RCT for MD Pharmacology exam

Searching the Web

critical appraisal RCT viva questions MD Pharmacology CASP CONSORT

Searching the Web

critical appraisal randomized controlled trial questions answers pharmacology postgraduate exam

I have enough from both the CASP framework and the RCT methodology literature to compile a thorough, exam-focused viva Q&A. Here is the complete set:

Viva Questions & Answers: Critical Appraisal of an RCT

MD Pharmacology Exam Preparation


SECTION A: Basics & Definitions

Q1. What is a Randomized Controlled Trial (RCT)?
An RCT is a prospective experimental study in which participants are randomly allocated to receive either the intervention under study or a comparator (placebo or active control), with outcomes measured and compared between groups. It is considered the gold standard for evaluating the efficacy of interventions because randomization controls for both known and unknown confounders.

Q2. What is the purpose of critical appraisal of an RCT?
Critical appraisal systematically evaluates whether the design, conduct, analysis, and reporting of an RCT are rigorous enough to make its results trustworthy, interpretable, and applicable to clinical practice. It answers three questions:
  1. Are the results valid? (Internal validity)
  2. What are the results? (Magnitude and precision of effect)
  3. Are the results applicable to my patients? (External validity / generalizability)

Q3. Name the framework/checklist you would use to critically appraise an RCT.
  • CASP (Critical Appraisal Skills Programme) Checklist - 11 questions for RCTs
  • CONSORT (Consolidated Standards of Reporting Trials) 2010 Statement - 25-item checklist + flow diagram for reporting RCTs
  • JBI Critical Appraisal Checklist for RCTs (Joanna Briggs Institute)
  • Cochrane Risk of Bias Tool (RoB 2) - for systematic reviews assessing individual RCT quality
For an MD Pharmacology viva, CASP and CONSORT are the most commonly expected.

SECTION B: Internal Validity - Study Design

Q4. What is randomization? Why is it done?
Randomization is the allocation of participants to intervention or control groups by chance. Its purpose is to:
  • Balance known and unknown confounding factors between groups at baseline
  • Prevent selection bias in group allocation
  • Form the basis for valid statistical inference
Q5. What are the different methods of randomization?
MethodDescription
Simple randomizationCoin toss, random number table - no restriction; can give unequal group sizes
Block randomizationFixed block sizes (e.g., 4 or 6) ensure equal group sizes at any point during recruitment
Stratified randomizationRandomization done separately within strata (e.g., age, sex, disease severity) to ensure balance on important prognostic factors
MinimizationDynamic allocation that minimizes imbalance on multiple factors simultaneously
Cluster randomizationGroups (e.g., villages, hospitals) rather than individuals are randomized

Q6. What is allocation concealment? How is it different from blinding?
Allocation concealment means that the person enrolling participants does not know in advance which treatment the next participant will receive. It prevents selection bias BEFORE randomization (i.e., at the point of allocation).
Blinding means that participants, investigators, and/or outcome assessors do not know which treatment was given AFTER allocation. It prevents performance bias and detection bias.
The key difference: allocation concealment occurs before and during enrollment; blinding occurs after allocation throughout the trial.
Methods of allocation concealment: Sequentially numbered opaque sealed envelopes (SNOSE), centralized telephone/web-based randomization, pharmacy-controlled dispensing.

Q7. What are the types of blinding in an RCT?
LevelWho is blinded
Open-label / unblindedNo one is blinded
Single-blindParticipant is blinded
Double-blindParticipant AND investigator/clinician are blinded
Triple-blindParticipant, investigator, AND outcome assessor/data analyst are blinded
Note: "Double-blind" is ambiguous - always ask who specifically was blinded. CONSORT recommends stating exactly which parties were blinded.

Q8. What biases does blinding prevent?
  • Performance bias: Unequal care given to participants in different arms due to knowledge of allocation
  • Detection bias: Systematic differences in how outcomes are assessed between groups
  • Attrition bias (partial): Differential dropout due to awareness of treatment
  • Reporting bias: Selective reporting of outcomes based on results

Q9. What is the CONSORT flow diagram? Why is it important?
The CONSORT flow diagram tracks participant movement through all stages of an RCT:
  1. Assessed for eligibility
  2. Excluded (with reasons)
  3. Randomized
  4. Allocated to intervention / control
  5. Lost to follow-up / discontinued (with reasons)
  6. Analyzed
It is important because it allows the reader to assess:
  • Whether the randomized sample is representative
  • The extent and reasons for dropouts
  • Whether intention-to-treat analysis is feasible

Q10. What should you look for in the baseline characteristics table (Table 1 of an RCT)?
  • Are the groups comparable at baseline on key demographic and clinical variables?
  • Were any statistically significant differences present (potential confounders)?
  • Was a p-value used to compare baseline characteristics? (Note: this is discouraged by CONSORT; if randomization was done properly, any baseline differences are due to chance and a p-value is not meaningful - use clinical judgment instead)

SECTION C: Internal Validity - Conduct & Analysis

Q11. What is intention-to-treat (ITT) analysis?
ITT analysis means participants are analyzed in the groups to which they were originally randomized, regardless of whether they:
  • Completed the treatment
  • Were non-compliant
  • Withdrew from the study
  • Received the wrong treatment
Why it is preferred: It preserves the benefit of randomization and reflects real-world effectiveness. It gives a conservative estimate of treatment effect.

Q12. What is per-protocol (PP) analysis? When is it used?
PP analysis includes only participants who completed the study as planned (i.e., received the assigned treatment without major protocol deviations).
Advantages: May give a better estimate of efficacy under ideal conditions (explanatory trial).
Disadvantages: Can introduce bias if dropouts are non-random; breaks the protection of randomization.
When used: In non-inferiority/equivalence trials, PP analysis is the primary analysis because ITT may artificially push results toward the null (making two treatments look more similar).

Q13. What is modified ITT (mITT)?
A variant of ITT that excludes participants who were randomized but never received any treatment or had no post-baseline measurements. It is often used in practice but must be clearly defined and justified in the protocol.

Q14. What is attrition bias? How do you assess it?
Attrition bias occurs when there is differential dropout between groups (i.e., the reasons or rates of withdrawal differ between arms). This can distort the apparent treatment effect.
Assessment:
  • Compare dropout rates and reasons between arms
  • Was ITT analysis performed?
  • Was missing data handled appropriately (e.g., last observation carried forward, multiple imputation)?
  • Was a sensitivity analysis done?

Q15. What is contamination bias in an RCT?
Contamination occurs when participants in the control group inadvertently receive the intervention (or vice versa), or when knowledge of the intervention "leaks" to the control arm. This dilutes the apparent treatment effect. More common in cluster RCTs.

Q16. What is a run-in period in an RCT?
A run-in period is a phase before randomization where all participants receive placebo (or sometimes the active drug). It is used to:
  • Identify and exclude non-compliant participants before randomization
  • Wash out prior medications
  • Stabilize baseline measurements
Limitation: Excluding non-compliers at this stage may lead to overestimation of efficacy in the enrolled population.

Q17. What are primary and secondary outcomes? Why does this matter?
  • Primary outcome: The main outcome the trial is designed and powered to detect. Should be pre-specified in the protocol.
  • Secondary outcomes: Additional outcomes of interest, but the trial is not powered specifically for these.
Why it matters: Reporting only statistically significant secondary outcomes while ignoring non-significant ones is outcome reporting bias (cherry-picking). The examiner may ask: "Was the primary outcome pre-specified? Was there evidence of outcome switching?"

SECTION D: Statistical Concepts

Q18. What is a p-value? What are its limitations?
A p-value is the probability of obtaining the observed result (or one more extreme) assuming the null hypothesis is true.
Conventional threshold: p < 0.05 (5% chance of Type I error)
Limitations:
  • Does not measure the size of the effect
  • Does not tell you the clinical importance of a result
  • Sensitive to sample size - a large trial can yield p < 0.05 for a trivially small, clinically meaningless difference
  • A non-significant p-value does NOT prove equivalence (it may just mean the study was underpowered)

Q19. What is a confidence interval (CI)? Why is it preferred over p-value alone?
A 95% CI is the range within which the true population parameter lies with 95% confidence (i.e., if the study were repeated 100 times, 95 of those intervals would contain the true value).
Advantages over p-value:
  • Gives information about both statistical significance AND the size and precision of the effect
  • Narrow CI = precise estimate (large sample); Wide CI = imprecise estimate (small sample)
  • A CI that crosses the line of no effect (RR=1, OR=1, MD=0) corresponds to p > 0.05

Q20. What is statistical power? What is a Type II error?
  • Power = 1 - β = probability of detecting a true effect if it exists. Conventionally set at 80% or 90%.
  • Type II error (β): Failing to reject the null hypothesis when it is actually false (false negative). Conventionally accepted at β = 0.20 (20%).
  • Type I error (α): Rejecting the null hypothesis when it is actually true (false positive). Conventionally α = 0.05.
Examiner tip: "A study with p = 0.08 does NOT mean there is no effect. The study may have been underpowered."

Q21. How is sample size calculated in an RCT?
Sample size depends on:
  1. α (significance level): Usually 0.05
  2. Power (1-β): Usually 0.80 or 0.90
  3. Expected effect size (clinically meaningful difference)
  4. Variability (SD) of the outcome (for continuous outcomes)
  5. Expected event rate (for binary outcomes)
  6. Allowance for attrition (multiply by 1/(1 - expected dropout rate))
A larger effect size and less variability require a smaller sample. Rare outcomes require much larger samples.

Q22. What is the Number Needed to Treat (NNT)?
NNT = 1 / Absolute Risk Reduction (ARR)
Where:
  • ARR = Control Event Rate (CER) - Experimental Event Rate (EER)
  • NNT = number of patients who need to be treated for one additional patient to benefit
Example: If control event rate = 20%, experimental rate = 10%: ARR = 10%, NNT = 1/0.10 = 10
NNH (Number Needed to Harm): = 1 / Absolute Risk Increase - used for adverse effects. Lower NNT = more beneficial drug; lower NNH = more harmful.

Q23. What is Relative Risk (RR) vs. Odds Ratio (OR)?
MeasureFormulaUse
Relative Risk (RR)EER / CERProspective studies (RCTs, cohort)
Odds Ratio (OR)(a/b) / (c/d)Case-control studies; approximates RR when events are rare
Relative Risk Reduction (RRR)(CER - EER) / CERProportional reduction in risk
Absolute Risk Reduction (ARR)CER - EERAbsolute difference in risk
Examiner tip: RRR can be misleading. A drug that reduces risk from 2% to 1% has RRR = 50% but ARR = only 1% and NNT = 100.

Q24. What is a surrogate outcome? What are the concerns?
A surrogate outcome is a laboratory or physiological measure used as a proxy for a clinically meaningful endpoint (e.g., HbA1c as surrogate for diabetic complications, LDL-C as surrogate for cardiovascular events).
Concerns:
  • The surrogate may not accurately predict the clinical outcome
  • Drugs may improve surrogate endpoints without improving clinical outcomes (e.g., some antiarrhythmics reduced PVCs but increased mortality in CAST trial)
  • Regulatory approval based on surrogates may not translate to patient benefit

SECTION E: External Validity & Applicability

Q25. What determines whether an RCT's results are applicable to your patients (external validity/generalizability)?
Ask:
  1. Population: Are my patients similar to trial participants (age, sex, comorbidities, ethnicity)?
  2. Intervention: Is the intervention feasible in my setting (dose, formulation, delivery method)?
  3. Comparator: Was the comparator appropriate? Was placebo used when an effective treatment exists?
  4. Outcome: Are the outcomes clinically relevant to my patients?
  5. Setting: Is the trial setting (tertiary academic center) different from my practice?
  6. Follow-up duration: Was follow-up long enough to capture long-term effects?

Q26. What is an explanatory vs. pragmatic RCT?
Explanatory RCTPragmatic RCT
QuestionEfficacy - does it work under ideal conditions?Effectiveness - does it work in real-world practice?
ParticipantsHighly selected, homogeneousBroad, heterogeneous, real patients
SettingAcademic centers, controlledRoutine clinical settings
AdherenceStrictly monitoredNormal clinical adherence
AnalysisPer-protocol preferredITT preferred
Tool: PRECIS-2 (Pragmatic-Explanatory Continuum Indicator Summary) rates trials on a spectrum.

SECTION F: Special Topics (High-Yield for MD Viva)

Q27. What is a non-inferiority trial? How is it different from a superiority trial?
  • Superiority trial: Tests whether the new treatment is BETTER than the comparator (H0: no difference).
  • Non-inferiority trial: Tests whether the new treatment is NOT WORSE than the comparator by more than a pre-defined margin (the "delta" or non-inferiority margin).
Key issues in non-inferiority trials:
  • The non-inferiority margin must be clinically justified and pre-specified
  • ITT analysis is conservative for superiority but anti-conservative for non-inferiority (PP analysis is preferred)
  • "Biocreep" - successive non-inferiority trials can progressively dilute efficacy

Q28. What is an equivalence trial?
A trial that tests whether two treatments are therapeutically equivalent (neither superior nor inferior) within a pre-defined margin. Both the upper and lower confidence interval bounds must lie within the equivalence margin.

Q29. What is a crossover trial? What are its advantages and limitations?
Each participant receives both treatments sequentially (in random order), serving as their own control.
Advantages: Reduced sample size needed, controls for between-subject variability.
Limitations:
  • Carryover effect: Effect of first treatment persists into second period (washout period required)
  • Period effect: Changes in disease over time confound results
  • Not suitable for acute/fatal conditions or treatments that permanently alter the disease

Q30. What is a factorial design RCT?
A factorial RCT tests two or more interventions simultaneously using the same set of participants. For example, a 2x2 factorial design tests Treatment A vs. no A, AND Treatment B vs. no B, giving 4 groups.
Advantage: Efficient - can answer two questions with one trial.
Issue: If there is an interaction between the two treatments, interpretation becomes complex.

Q31. What is publication bias? How does it affect the literature?
Publication bias is the tendency for studies with positive (statistically significant) results to be published more readily than negative or null results. This distorts the evidence base and can make a drug appear more effective than it truly is.
Detection in meta-analyses: Funnel plot asymmetry (Egger's test, Begg's test).
Solutions: Trial registries (ClinicalTrials.gov, CTRI in India), mandatory prospective registration, CONSORT requirement.

Q32. What is the Hawthorne effect?
The tendency of participants to modify their behavior simply because they know they are being observed or studied. It can artificially improve outcomes in both arms, potentially diluting the apparent treatment effect. Most relevant in behavioral and open-label trials.

Q33. What is a placebo effect and why is a placebo-controlled RCT important?
The placebo effect is the improvement in outcome due to a participant's belief that they are receiving an effective treatment, independent of any pharmacological action. A placebo-controlled RCT separates the true pharmacological effect from:
  • Placebo effect
  • Natural disease course (regression to the mean)
  • Observer bias

Q34. What are stopping rules (interim analysis) in an RCT?
Interim analyses are pre-planned looks at accumulating data during the trial, monitored by an independent Data Safety Monitoring Board (DSMB). A trial may be stopped early if:
  • Overwhelming efficacy (benefit so clear that continuing denies effective treatment to controls)
  • Clear harm (safety concern)
  • Futility (no realistic chance of finding a significant difference even if the trial is completed)
Statistical concern with early stopping for benefit: Inflates the apparent effect size (overestimation of treatment effect).

Q35. What is the CONSORT 2010 statement and what does it require?
CONSORT 2010 is a 25-item reporting checklist plus a flow diagram for RCTs, endorsed by major journals. Key requirements include:
  • Structured title/abstract identifying it as an RCT
  • Pre-specified primary and secondary outcomes
  • Sample size calculation details
  • Description of randomization sequence generation, allocation concealment, blinding
  • CONSORT flow diagram
  • Baseline characteristics table
  • Primary outcome results with effect size and 95% CI
  • Harms reporting
  • Trial registration number and funding sources

SECTION G: Rapid-Fire Questions

Q36. What is selection bias? Systematic difference between groups due to non-random allocation. Prevented by proper randomization and allocation concealment.
Q37. What is confounding? A variable that is associated with both the exposure and the outcome, and can distort the apparent relationship. Controlled by randomization in RCTs.
Q38. What is regression to the mean? The tendency of extreme values at baseline to move closer to the average on repeat measurement, independent of treatment. Controlled by including a placebo group.
Q39. What is a washout period? A period before or between treatment phases where all active drug is cleared, to prevent carryover effects (especially in crossover trials).
Q40. What does a p-value of 0.03 mean? If the null hypothesis were true, there is a 3% probability of obtaining a result as extreme as or more extreme than what was observed. It does NOT mean there is a 97% chance the treatment works.
Q41. What is a composite outcome? Combining multiple endpoints into a single outcome (e.g., MACE = myocardial infarction + stroke + death). Increases event rate and reduces required sample size but can be driven by less important components.
Q42. What is multiplicity/multiple testing problem? When multiple outcomes or subgroups are tested, the chance of finding a false positive by chance increases. Corrected by Bonferroni correction or pre-specifying primary outcomes.
Q43. What is a subgroup analysis? What are the concerns? Analyzing outcomes in subsets of the trial population (e.g., by age, sex, severity). Concerns: low power, data dredging, false positives. Should be pre-specified, and interaction tests (not separate p-values) should be used.
Q44. What is a pragmatic trial vs. an explanatory trial? See Q26 above.
Q45. What is an adaptive trial design? A trial design that allows pre-planned modifications to the trial (e.g., sample size re-estimation, arm dropping, dose changes) based on interim data, while maintaining statistical validity.

QUICK REFERENCE: Key Formulas

MeasureFormula
ARR (Absolute Risk Reduction)CER - EER
RRR (Relative Risk Reduction)(CER - EER) / CER
NNT1 / ARR
NNH1 / ARI (Absolute Risk Increase)
Relative Risk (RR)EER / CER
Odds Ratio (OR)(a/b) / (c/d)
(CER = Control Event Rate; EER = Experimental Event Rate)

EXAMINER'S FAVOURITE TRICK QUESTIONS

  1. "A drug showed p = 0.001. Is it clinically useful?" - Not necessarily. A very large sample can make a tiny, clinically irrelevant difference statistically significant. Always look at the absolute effect size and NNT.
  2. "The trial was randomized, so it must be free of bias." - Wrong. Randomization only controls for allocation bias. Lack of blinding, high attrition, outcome switching, and publication bias can all introduce bias in a properly randomized trial.
  3. "The 95% CI crosses 1.0 for RR, so there is definitely no effect." - Wrong. This means the result is not statistically significant at α=0.05. The study may simply be underpowered. Absence of evidence is not evidence of absence.
  4. "The trial was double-blind." - Always ask: who exactly was blinded? The patient? The clinician? The outcome assessor? The statistician? CONSORT requires this to be explicit.
  5. "The control group received placebo, so the comparison is valid." - Ask: is withholding an effective, available treatment ethical? The Declaration of Helsinki requires placebo-controlled trials to be justified when effective therapy exists.

This set covers all the domains an MD Pharmacology examiner is likely to probe in a critical appraisal viva. The CASP 11-question framework provides the structural backbone, while the statistical and design questions reflect the depth expected at a postgraduate level.

viva questions with answers for the critical appraisal of a OBSERVATIONAL STUDY for MD Pharmacology exam

Searching the Web

critical appraisal observational study cohort case-control cross-sectional viva questions MD pharmacology STROBE Newcastle-Ottawa

Searching the Web

Bradford Hill criteria causation observational study pharmacoepidemiology postgraduate exam questions answers

Excellent material gathered. Here is the complete, exam-focused viva Q&A set:

Viva Questions & Answers: Critical Appraisal of an Observational Study

MD Pharmacology Exam Preparation


SECTION A: Study Design Fundamentals

Q1. What is an observational study? How does it differ from an RCT?
An observational study is one in which the researcher observes participants without intervening - no randomization, no allocation of treatment. The investigator simply records exposures and outcomes as they naturally occur.
FeatureRCTObservational Study
AllocationRandomizedNot randomized
Confounding controlBy design (randomization)Requires statistical adjustment
CausationCan establishCan suggest association only
EthicsMay not be feasible for harmful exposuresSuitable for rare/harmful outcomes
Time & costExpensive, longCheaper, faster (especially retrospective)
Hierarchy of evidenceLevel ILevel II-III

Q2. Name the three main types of observational (analytical) studies and state what each is best suited for.
Study DesignDirectionBest For
Cohort studyExposure → Outcome (forward)Common diseases, multiple outcomes from one exposure, incidence, RR
Case-control studyOutcome → Exposure (backward)Rare diseases, multiple exposures, generating hypotheses
Cross-sectional studyExposure and outcome measured simultaneouslyPrevalence, hypothesis generation, surveys
Also recognize: Ecological study (group-level data), Case series/Case reports (descriptive, no comparison group).

Q3. What is the hierarchy of evidence for observational studies?
From strongest to weakest:
  1. Systematic review/meta-analysis of RCTs
  2. RCT
  3. Systematic review/meta-analysis of observational studies
  4. Prospective cohort study
  5. Retrospective cohort study
  6. Case-control study
  7. Cross-sectional study
  8. Case series
  9. Case report
  10. Expert opinion/editorials

Q4. What reporting guideline is used for observational studies?
STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) - a 22-item checklist covering Title, Abstract, Introduction, Methods, Results, and Discussion. Separate checklists exist for cohort, case-control, and cross-sectional designs.
For quality assessment (not just reporting): Newcastle-Ottawa Scale (NOS) - scores cohort and case-control studies on selection, comparability, and outcome/exposure assessment (max 9 stars).

SECTION B: Cohort Studies

Q5. What is a cohort study? Distinguish prospective from retrospective cohort.
A cohort study selects participants on the basis of exposure status (exposed vs. unexposed/differently exposed) and follows them forward in time to compare the incidence of outcomes.
Prospective CohortRetrospective Cohort
Data collectionForward in real timeFrom past records
Exposure assessmentMeasured at baseline, accurateFrom existing records, may be incomplete
Time & costYears, expensiveFaster, cheaper
BiasLess recall biasMore measurement bias
ExampleFramingham Heart StudyGPRD-based pharmacoepidemiology studies

Q6. What is the key measure of effect in a cohort study?
Relative Risk (RR) = Incidence in exposed / Incidence in unexposed
Since cohort studies measure incidence directly (true denominators are known), RR is the appropriate and direct measure of association.
Also reported:
  • Attributable Risk (AR) / Absolute Risk Difference = Incidence in exposed - Incidence in unexposed
  • Attributable Risk Percent = AR / Incidence in exposed × 100
  • Population Attributable Risk (PAR) - useful for public health decisions

Q7. What biases commonly affect cohort studies?
BiasDescriptionControl
Selection biasExposed and unexposed groups differ at baselineCareful selection criteria; matching
Attrition/loss to follow-up biasDifferential dropout between groupsMinimize dropout; compare dropouts vs. completers; ITT-equivalent analysis
Surveillance bias (detection bias)Exposed group monitored more intensively, so more outcomes detectedBlind outcome assessors
Healthy worker effectOccupational cohorts are healthier than the general population, underestimating riskUse appropriate comparison group
Confounding by indicationPatients receiving a drug are sicker than those not receiving itPropensity score matching; restriction
Temporal biasExposure or outcome timing misclassifiedClear definition of follow-up start (time zero)

Q8. What is the "healthy user bias" / "healthy adherer effect"?
Patients who adhere to medications tend to have better overall health behaviors. In pharmacoepidemiology, this can make a drug appear more effective than it really is. For example, patients who fill prescriptions for statins regularly may also exercise more, smoke less, and follow a healthy diet - so their better outcomes may not be purely due to the statin.

Q9. What is "immortal time bias" in a pharmacoepidemiology cohort study?
Immortal time is a span of time in the follow-up period during which a participant cannot have the outcome by definition (they are "immortal"). If this time is incorrectly attributed to the exposed group (e.g., time between cohort entry and first prescription fill is counted as "drug exposure time"), it artificially inflates the apparent benefit of the drug.
Classic example: Studies showing that statin initiators have lower cancer mortality - if the time before statin initiation is misclassified as exposed time, the exposed group appears to survive longer simply because they had to survive long enough to get the prescription.

Q10. What is loss to follow-up? How much is acceptable?
Loss to follow-up means participants who were enrolled but did not complete follow-up and whose outcome status is unknown.
"5 and 20" rule of thumb:
  • < 5% loss to follow-up: minimal concern
  • 5-20%: moderate concern; assess whether dropout was differential between groups
  • 20%: serious threat to validity
More important than the rate of loss is whether dropout was differential (related to exposure or outcome) - non-differential loss is less biasing.

SECTION C: Case-Control Studies

Q11. What is a case-control study? What is it best suited for?
A case-control study identifies individuals who have the outcome of interest (cases) and compares them to individuals who do not (controls), then looks backward to compare past exposures between the two groups.
Best suited for:
  • Rare diseases (rare outcomes are expensive/impossible to study in cohorts)
  • Diseases with long latency periods
  • Generating hypotheses about multiple exposures for one outcome
  • Outbreaks and pharmacovigilance signal investigation

Q12. What is the measure of effect in a case-control study?
Odds Ratio (OR) = (Odds of exposure in cases) / (Odds of exposure in controls)
= (a/c) / (b/d) = ad/bc (from the 2×2 table)
Since case-control studies do not measure incidence (no true denominators), RR cannot be calculated directly. The OR approximates the RR when:
  • The disease is rare (< 10%) - the rare disease assumption
  • Controls are sampled from the source population independently of exposure

Q13. How are controls selected in a case-control study? Why is this critical?
Controls should represent the same source population that gave rise to the cases - i.e., if they had developed the disease, they would have been eligible as cases. This is called the source population principle.
Types of controls:
  • Hospital controls: convenient but may share exposures with cases (Berkson's bias)
  • Population controls: community-based, more representative but harder to recruit
  • Nested case-control controls: drawn from within a defined cohort (gold standard)
Matching: Controls may be matched to cases on confounders (age, sex, hospital). This controls those confounders but requires conditional logistic regression for analysis. Over-matching can reduce efficiency.

Q14. What is Berkson's bias (hospital admission bias)?
When both cases and controls are drawn from a hospital population, the hospital controls may not represent the true source population. Hospitalized patients have different exposure rates than the general population (e.g., they may smoke more, be sicker). This can distort the OR.

Q15. What is recall bias? In which study design is it most problematic?
Recall bias occurs when cases and controls systematically differ in how accurately they recall past exposures. Cases (particularly those with serious diseases) may recall exposures more intensively or inaccurately compared to controls who have no disease.
Most problematic in retrospective case-control studies, especially for drug exposures, dietary factors, and lifestyle variables.
Mitigation: Use objective records (prescription databases, pharmacy records) rather than self-report; interview controls as soon as possible after diagnosis; blind interviewers to case/control status.

Q16. What is a nested case-control study? What are its advantages?
A nested case-control study is conducted within a defined cohort. Cases are identified within the cohort, and controls are randomly selected from cohort members who were at risk at the time the case was diagnosed (risk-set sampling).
Advantages:
  • Controls are drawn from the same source population (eliminates Berkson's bias)
  • Exposure data was collected prospectively before outcome (eliminates recall bias)
  • Efficient - cheaper than analyzing the full cohort
  • Temporality is assured
  • OR from risk-set sampling directly estimates the RR

Q17. What is a case-cohort study? How is it different from a nested case-control?
In a case-cohort study, the comparison group (sub-cohort) is a random sample of the entire cohort selected at baseline (before any outcomes), regardless of whether they later become cases. The same sub-cohort serves as the comparison group for all outcomes.
Nested Case-ControlCase-Cohort
ControlsRisk-set matched at time of each caseRandom sub-cohort sampled at start
Multiple outcomesSeparate controls for eachSame sub-cohort reused
AnalysisConditional logistic regressionWeighted Cox regression

SECTION D: Cross-Sectional Studies

Q18. What is a cross-sectional study? What are its uses and limitations?
A cross-sectional study measures both exposure and outcome at the same point in time (a "snapshot"). It measures prevalence rather than incidence.
Uses:
  • Estimating disease prevalence
  • Identifying associated factors/hypotheses
  • Health surveys and needs assessment
  • Screening program evaluation
Limitations:
  • Cannot establish temporality - you cannot tell whether the exposure preceded the outcome or vice versa
  • Cannot calculate incidence or RR
  • Prevalent cases only - subjects with a rapidly fatal or rapidly resolving disease are underrepresented (prevalence-incidence bias / Neyman bias)
  • Subject to cross-sectional bias: the association found may reflect factors determining disease duration/survival, not disease causation
Measure of association: Prevalence Ratio (PR) or OR (for logistic regression)

Q19. What is Neyman bias (prevalence-incidence bias)?
In a cross-sectional study, the prevalence of a disease depends on both its incidence and its duration. If an exposure causes a severe or rapidly fatal disease, prevalent cases will be underrepresented (those with the disease died before the study). Conversely, if the exposure is associated with milder disease, these patients survive longer and are overrepresented. This can distort the apparent association between exposure and disease.

SECTION E: Confounding - The Central Issue in Observational Studies

Q20. What is confounding? How is it different from bias?
Confounding is a mixing of the effect of the exposure of interest with the effect of a third variable (the confounder). A confounder must:
  1. Be associated with the exposure
  2. Be associated with the outcome (independently)
  3. NOT be on the causal pathway between exposure and outcome
Bias is a systematic error introduced by the study design, conduct, or analysis (e.g., selection bias, recall bias). Confounding is a real phenomenon in the population, not an artifact of the study; bias is an artifact.
Examiner tip: Confounding can be controlled; bias generally cannot be undone after data collection.

Q21. How can confounding be controlled in an observational study?
At the design stage:
  • Restriction: Include only participants within a narrow range of the confounder (e.g., only non-smokers)
  • Matching: Match cases to controls (or exposed to unexposed) on key confounders
  • Randomization (only in RCTs)
At the analysis stage:
  • Stratification (Mantel-Haenszel): Calculate stratum-specific estimates and pool them
  • Multivariable regression: Include confounders as covariates in logistic/Cox/linear regression
  • Propensity score methods: Matching, stratification, inverse probability weighting (IPW), covariate adjustment using propensity score

Q22. What is a propensity score? Why is it used in observational studies?
A propensity score is the probability of receiving the exposure/treatment given a set of observed baseline covariates. It is estimated using logistic regression (exposure as outcome, covariates as predictors).
Uses: Propensity score matching, stratification, or weighting can reduce confounding in observational data by creating groups that are balanced on observed covariates - mimicking some aspects of randomization.
Limitation: Propensity scores only control for measured confounders. Unmeasured confounders remain a threat (residual confounding).

Q23. What is residual confounding?
Residual confounding is confounding that persists even after adjustment, due to:
  • Unmeasured confounders (variables not collected in the study)
  • Imprecisely measured confounders (measurement error in confounder variables)
  • Unconsidered confounders
This is the fundamental limitation that prevents observational studies from definitively establishing causation. It is why "association does not imply causation."

Q24. What is confounding by indication?
A specific and very common form of confounding in pharmacoepidemiology where the indication (disease severity, specific diagnosis) for prescribing a drug is itself a risk factor for the outcome being studied.
Example: If a study finds that patients taking Drug X have worse outcomes than those not taking it, this may simply reflect that Drug X is given to sicker patients (the indication itself causes worse outcomes), not that Drug X is harmful.
Solutions: Restrict to patients with the same indication; active comparator design (compare Drug X vs. Drug Y for the same indication); propensity score matching.

Q25. What is an "active comparator, new user" design in pharmacoepidemiology?
  • New user design: Restricts the study to patients who are initiating the drug (new starts), rather than including prevalent users who have already been on the drug for varying periods. Eliminates depletion of susceptibles bias and immortal time bias.
  • Active comparator: Uses patients on an alternative drug for the same indication as the comparison group (instead of non-users). Controls for confounding by indication because both groups have the same condition warranting treatment.
This is considered the most rigorous observational design for drug safety studies.

SECTION F: Specific Biases in Observational Studies

Q26. List and explain the major types of bias in observational studies.
Selection Biases:
BiasDescription
Berkson's biasHospital-based controls have different exposure rates than general population
Volunteer biasVolunteers tend to be healthier than non-participants (overestimates benefit)
Attrition biasDifferential dropout distorts results
Healthy worker effectEmployed workers are healthier than general population
Prevalence-incidence bias (Neyman)In cross-sectional studies, missing fatal/rapid cases
Length-biased samplingScreening programs preferentially detect slow-growing disease
Information/Measurement Biases:
BiasDescription
Recall biasCases recall exposures differently than controls
Observer/interviewer biasInterviewer probes cases more thoroughly than controls
Misclassification biasExposure or outcome incorrectly categorized
Non-differential misclassificationSame error in both groups - biases toward null (underestimation)
Differential misclassificationDifferent error rates between groups - can bias in any direction
Confounding:
BiasDescription
Confounding by indicationIndication itself is a risk factor for the outcome
Residual confoundingUnmeasured or imprecisely measured confounders remain
Time-varying confoundingConfounders change over time and are on the causal pathway

Q27. What is effect modification (interaction)? How is it different from confounding?
Effect modification (interaction) occurs when the magnitude of an association between exposure and outcome differs across strata of a third variable (the effect modifier). It is a real biological phenomenon and should be reported, not adjusted away.
Confounding is a nuisance that distorts apparent associations and should be controlled.
How to distinguish:
  • Check stratum-specific estimates: if they differ substantially from each other AND from the crude estimate, effect modification may be present
  • Confounding is identified when the Mantel-Haenszel pooled estimate differs from the crude estimate

SECTION G: Causality - Bradford Hill Criteria

Q28. What are the Bradford Hill criteria? Why are they important for observational studies?
Proposed by Sir Austin Bradford Hill in 1965, these nine criteria help assess whether an observed association in an observational study is likely to be causal. They are guidelines, not a rigid checklist - no single criterion is necessary or sufficient.
#CriterionExplanation
1StrengthLarger associations (higher RR/OR) are more likely to be causal and less likely to be due to unmeasured confounding
2ConsistencyAssociation reproduced in multiple studies by different investigators in different populations
3SpecificityOne exposure → one outcome (less important; many exposures have multiple effects)
4TemporalityExposure must precede outcome - the ONLY essential criterion
5Biological gradientDose-response relationship: greater exposure → greater effect
6PlausibilityBiologically plausible mechanism (limited by current knowledge)
7CoherenceDoes not conflict with known facts about the disease's natural history or biology
8ExperimentExperimental evidence supports the association (e.g., removing the exposure reduces the outcome)
9AnalogySimilar exposure-outcome relationships are already established
Key point for the viva: Temporality is the ONLY essential criterion. All others support causality but none individually proves or disproves it. These criteria were developed to assess whether tobacco smoking causes lung cancer.

Q29. Why can observational studies only establish association and not causation?
Because:
  1. Residual confounding can never be fully eliminated - unmeasured variables may explain the association
  2. Temporality may be unclear (especially in cross-sectional studies)
  3. Multiple biases (recall, selection, observer) can create spurious associations
  4. The association may be due to reverse causation (the outcome causes the exposure rather than vice versa)
Causality requires ruling out chance, bias, confounding, and reverse causation, then applying Bradford Hill criteria.

SECTION H: Statistical Measures & Interpretation

Q30. Summarize the measures of association used in each study design.
Study DesignMeasureInterpretation
CohortRelative Risk (RR)RR > 1: increased risk; RR < 1: reduced risk; RR = 1: no association
Case-controlOdds Ratio (OR)Same interpretation as RR when rare disease assumption holds
Cross-sectionalPrevalence Ratio (PR) / ORAssociation between exposure and prevalent disease
All designs95% CIPrecision of estimate; crosses 1 = non-significant at α=0.05

Q31. When does OR approximate RR? When does OR overestimate RR?
OR approximates RR when the disease is rare (incidence < 10%) - the rare disease assumption.
OR overestimates RR when the disease is common (incidence > 10%) - OR will be further from 1 than the true RR. In studies of common conditions, a large OR may look impressive but the RR may be much smaller.
Formula: OR = RR × [(1 - P0) / (1 - P1)] where P0 = outcome rate in unexposed, P1 = outcome rate in exposed

Q32. What is attributable risk (AR) and population attributable risk (PAR)? Why do they matter?
  • Attributable Risk (AR): The absolute difference in incidence between exposed and unexposed. Tells you how much of the risk in the exposed group is due to the exposure. AR = I_exposed - I_unexposed
  • Population Attributable Risk (PAR): The reduction in disease incidence that would occur if the exposure were eliminated from the entire population. Depends on both AR and the prevalence of the exposure in the population.
Why it matters: For public health and pharmacovigilance decisions. A drug with a high RR but very low AR (because the outcome is rare) may not warrant withdrawal, whereas a drug with a modest RR but very high PAR (because the outcome is common and the drug is widely used) may pose a significant public health burden.

Q33. What is a dose-response relationship? Why is it important in pharmacoepidemiology?
A dose-response relationship means that as the dose or duration of exposure increases, the magnitude of the outcome also increases (or decreases for protective factors). It supports:
  • Biological gradient (Bradford Hill criterion #5)
  • Causality
  • Pharmacological plausibility
In pharmacoepidemiology, demonstrating that higher drug doses or longer duration of use are associated with greater adverse effects strengthens the causal inference (e.g., thalidomide and limb defects with first-trimester exposure, bisphosphonates and atypical femur fractures with long-term use).

SECTION I: Quality Assessment Tools

Q34. Describe the Newcastle-Ottawa Scale (NOS).
The NOS is a validated quality assessment tool for observational studies used in systematic reviews. It has two versions:
For Cohort Studies (max 9 stars):
  1. Selection (4 stars): Representativeness of the exposed cohort; selection of the non-exposed cohort; ascertainment of exposure; demonstration that outcome was not present at start
  2. Comparability (2 stars): Comparability of cohorts on the basis of design or analysis (e.g., age, sex controlled)
  3. Outcome (3 stars): Assessment of outcome; adequacy of follow-up length; adequacy of follow-up completeness
For Case-Control Studies (max 9 stars):
  1. Selection (4 stars): Case definition adequacy; representativeness of cases; selection of controls; definition of controls
  2. Comparability (2 stars): Controls for important confounders
  3. Exposure (3 stars): Ascertainment of exposure; same method for cases and controls; non-response rate
Generally: ≥7 stars = high quality; 4-6 = moderate; <4 = low quality.

Q35. What does STROBE stand for and what does it assess?
STROBE = Strengthening the Reporting of Observational Studies in Epidemiology
A 22-item reporting guideline for cohort, case-control, and cross-sectional studies. It does NOT assess study quality - it assesses completeness of reporting. Key items include:
  • Clear statement of study design in title/abstract
  • Study setting, eligibility criteria
  • Exposure, outcome, and confounder measurement methods
  • Handling of missing data
  • Sensitivity analyses
  • Limitations (particularly sources of bias and confounding)
  • Funding sources

SECTION J: Pharmacoepidemiology-Specific Concepts

Q36. What is pharmacoepidemiology? Why are observational studies important in this field?
Pharmacoepidemiology is the study of the use and effects of drugs in large numbers of people. Observational studies are important because:
  • RCTs are often underpowered for rare adverse events
  • RCT populations are highly selected (exclude elderly, pregnant women, children, comorbidities)
  • Long-term effects cannot be studied in RCTs
  • Post-marketing surveillance (Phase IV) depends on observational methods
  • Ethical constraints prevent randomization to potentially harmful exposures

Q37. What is PASS (Post-Authorization Safety Study)?
A Post-Authorization Safety Study is a non-interventional (observational) study performed after a drug has been authorized to identify, characterize, or quantify a safety hazard, confirm the safety profile, or measure the effectiveness of risk management measures. Required by regulators (EMA, CDSCO) as a condition of drug approval for drugs with identified safety concerns.

Q38. What is pharmacovigilance and what observational methods support it?
Pharmacovigilance is the science and activities related to detecting, assessing, understanding, and preventing adverse effects of medicines. Observational methods used include:
  • Spontaneous reporting systems (Yellow Card, MedWatch, VigiBase) - generate signals
  • Disproportionality analysis - Reporting Odds Ratio (ROR), Proportional Reporting Ratio (PRR)
  • Prescription-event monitoring - cohort-based, follow up all patients on a new drug
  • Electronic health record (EHR) / claims database studies - large-scale pharmacoepidemiology

Q39. What is a "signal" in pharmacovigilance?
A signal is information arising from one or multiple sources (including observations and experiments) suggesting a new potentially causal association between an intervention and an event or set of related events, either adverse or beneficial, that is judged to be of sufficient likelihood to justify verification. Detection does NOT imply causation - signals require evaluation and confirmation.

SECTION K: Rapid-Fire Questions

Q40. What is the difference between prevalence and incidence?
  • Incidence = new cases per population at risk per time period (measures risk)
  • Prevalence = all existing cases per total population at a point in time (measures burden)
  • Prevalence ≈ Incidence × Duration (for stable endemic diseases)
Q41. Can a case-control study measure incidence? No - cases and controls are sampled, so true denominators are not available. It can only estimate relative odds of exposure.
Q42. What is matching in a case-control study? What is overmatching? Matching controls to cases on potential confounders (e.g., age, sex) to make groups comparable. Overmatching is matching on a variable that is associated with exposure but not independently with the outcome, or matching on a variable on the causal pathway - this reduces efficiency and can introduce bias.
Q43. What is information bias? Systematic differences in how data on exposures or outcomes are collected between comparison groups. Includes recall bias, interviewer bias, surveillance bias.
Q44. What is reverse causation? The outcome influences the exposure rather than the other way around. For example, in a cross-sectional study finding that overweight people eat fewer calories - this may reflect that obese patients have already been advised to reduce calorie intake (the disease caused the behavior change).
Q45. What is the "file drawer problem"? Negative studies are often not published and remain in researchers' "file drawers." This is a major source of publication bias. See also: systematic review funnel plots.
Q46. What is an ecological study? What is the ecological fallacy? An ecological study uses aggregate (group-level) data rather than individual-level data to examine associations. The ecological fallacy (aggregation bias) is the erroneous assumption that associations observed at the group level apply to individuals within those groups.
Q47. What is a case series? A case report?
  • Case report: Detailed description of one patient with an unusual condition or drug reaction
  • Case series: Description of a group of patients with similar presentations, without a comparison group
These are descriptive, hypothesis-generating, and represent the lowest level of evidence. Important in pharmacovigilance for detecting novel adverse drug reactions.

EXAMINER'S FAVOURITE TRICK QUESTIONS

1. "An observational study found OR = 4.0. Can you conclude the drug causes the outcome?" No. An OR of 4.0 is a strong association, but it does not establish causation. You must systematically rule out: chance (is the CI narrow? Is p significant?), bias (selection, recall, observer), confounding (measured and unmeasured), and reverse causation. Then apply Bradford Hill criteria to assess plausibility of causation.
2. "Why is OR used in case-control studies instead of RR?" Because in a case-control study, cases and controls are sampled - you don't know the total number of exposed and unexposed people in the source population. Without true denominators, incidence cannot be calculated, so RR cannot be directly estimated. OR can be calculated from the 2×2 table and approximates RR when the rare disease assumption holds.
3. "What happens to bias when you adjust for confounders in a regression model?" Multivariable adjustment controls confounding but does NOT control bias. Selection bias and information bias are methodological errors that cannot be corrected in statistical analysis - they must be prevented at the design stage.
4. "A cohort study shows that patients taking Drug A have a lower risk of stroke. Does this mean Drug A prevents stroke?" Not necessarily. Consider: (a) confounding by indication - healthier patients may be more likely to receive Drug A; (b) healthy user bias - adherent patients have better health behaviors; (c) detection bias - Drug A patients may be monitored more carefully; (d) depletion of susceptibles - patients who would have had early strokes may have been removed before the study.
5. "Why is temporality the only essential Bradford Hill criterion?" Without temporality - the exposure preceding the outcome - there is no possible causal pathway. Every other criterion strengthens the case for causation but is not logically essential. You can imagine causes with small effect sizes (against strength), rare exceptions (against specificity), or novel mechanisms (against plausibility). But if the exposure comes AFTER the outcome, by definition the exposure cannot have caused it.

QUICK REFERENCE SUMMARY TABLE

Study TypeDirectionKey MeasureKey BiasAppraisal Tool
Prospective cohortExposure → OutcomeRR, AR, PARAttrition, surveillance, confounding by indicationNOS, STROBE
Retrospective cohortRecord review → OutcomeRRMisclassification, immortal time biasNOS, STROBE
Case-controlOutcome ← ExposureORRecall bias, Berkson's biasNOS, STROBE
Nested case-controlWithin cohortOR ≈ RRMinimal if well-designedNOS, STROBE
Cross-sectionalSimultaneousPR or ORNeyman bias, reverse causationSTROBE
EcologicalGroup-levelCorrelationEcological fallacySTROBE

This set covers all domains an MD Pharmacology examiner is likely to probe in a critical appraisal viva for observational studies - from basic study design selection through to Bradford Hill causality, pharmacoepidemiology-specific concepts, and the statistical interpretation of association measures.

viva questions with answers for the critical appraisal of a SYSTEMIC REVIEW & META ANALYSIS for MD Pharmacology exam

Searching the Web

critical appraisal systematic review meta-analysis viva questions MD pharmacology PRISMA AMSTAR heterogeneity forest plot

Searching the Web

GRADE evidence certainty heterogeneity I-squared fixed random effects model funnel plot meta-analysis exam questions answers

Excellent. Here is the complete, exam-focused viva Q&A set:

Viva Questions & Answers: Critical Appraisal of a Systematic Review & Meta-Analysis

MD Pharmacology Exam Preparation


SECTION A: Definitions & Fundamentals

Q1. What is a systematic review? How does it differ from a narrative (traditional) review?
A systematic review is a synthesis of all available evidence addressing a pre-specified, focused clinical question using explicit, reproducible, pre-planned methods to identify, select, critically appraise, and summarize relevant studies.
FeatureSystematic ReviewNarrative Review
QuestionFocused, pre-specified (PICO)Broad, general
Search strategyComprehensive, explicit, reproducibleNot standardized, selective
Study selectionPre-defined inclusion/exclusion criteriaAuthor's discretion
Quality appraisalFormal (RoB 2, AMSTAR-2)Informal or absent
Bias riskLow (if well conducted)High (author opinion shapes conclusions)
ReproducibilityYesNo
OutputQuantitative summary possibleQualitative narrative

Q2. What is a meta-analysis? Is every systematic review also a meta-analysis?
A meta-analysis is the statistical pooling of quantitative results from two or more independent studies that are sufficiently similar to produce a single summary (pooled) estimate of effect.
No - not every systematic review includes a meta-analysis:
  • A systematic review may conclude that the included studies are too heterogeneous (in population, intervention, outcome, or study design) to pool statistically
  • A systematic review without meta-analysis presents results narratively, summarizing each study's findings
  • A meta-analysis without a systematic review is possible (e.g., ad hoc pooling) but is methodologically weak because it lacks a rigorous, bias-free search strategy

Q3. Why are systematic reviews and meta-analyses at the top of the evidence hierarchy?
  • They synthesize all available evidence on a question, reducing the impact of any single study's random error or bias
  • They maximize statistical power by pooling data from many studies
  • Their methods are explicit and reproducible, enabling verification
  • They can identify consistency or inconsistency across different populations, settings, and contexts
  • They reduce the impact of publication bias compared to individual studies (when search is comprehensive)
  • They form the basis for clinical practice guidelines and drug regulatory decisions

Q4. What frameworks/checklists are used to appraise a systematic review and meta-analysis?
ToolPurposeFocus
PRISMA 2020 (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)Reporting guideline27-item checklist + flow diagram; ensures complete, transparent reporting
AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews)Quality/conduct assessment16-item tool; evaluates methodological rigor
GRADE (Grading of Recommendations Assessment, Development and Evaluation)Certainty of evidenceRates confidence in effect estimates: High/Moderate/Low/Very Low
Cochrane RoB 2Risk of bias in individual included RCTs5 domains; used within a review to assess included studies
ROBINS-IRisk of bias in included observational studiesUsed within a review of non-randomized studies
MOOSEReporting guideline for meta-analyses of observational studiesEquivalent of PRISMA for observational study meta-analyses

SECTION B: Formulating the Question - PICO

Q5. What is PICO? Why is it essential for a systematic review?
PICO is a framework for structuring a focused, answerable clinical question:
LetterStands forExample
PPopulation/ProblemAdults with type 2 diabetes
IInterventionSGLT-2 inhibitors
CComparisonPlacebo or active comparator
OOutcomeHbA1c reduction at 6 months, cardiovascular events, adverse effects
Why essential: A precise PICO defines which studies are eligible for inclusion. Without it, the review question is vague, inclusion/exclusion criteria cannot be operationalized, and the review cannot be reproduced. Extended versions: PICOS (S = Study design), PICOT (T = Time frame), PICOTS (T + S).

SECTION C: Search Strategy & Study Selection

Q6. What should a comprehensive search strategy for a systematic review include?
A rigorous search must be:
  • Multi-database: MEDLINE (PubMed), EMBASE, Cochrane Central Register of Controlled Trials (CENTRAL), and topic-specific databases (e.g., PsycINFO for mental health)
  • Inclusive of grey literature: Conference abstracts, thesis repositories, ClinicalTrials.gov, WHO ICTRP, regulatory agency reports - to reduce publication bias
  • Hand-searching: Reference lists of included studies and key journals
  • No language or date restrictions (unless scientifically justified)
  • Documented with search strings using MeSH terms, free-text terms, Boolean operators (AND, OR, NOT), and truncation/wildcards
  • Reproducible: Search date recorded; strategy replicable by an independent researcher

Q7. What is the PRISMA flow diagram? Describe its components.
The PRISMA flow diagram tracks the movement of records through the review:
  1. Identification: Total records identified through database searching + additional sources
  2. Screening: Records after duplicate removal → records screened by title/abstract → records excluded (with reasons)
  3. Eligibility: Full-text articles assessed → full-text articles excluded (with specific reasons)
  4. Included: Studies included in systematic review ± included in meta-analysis
Why it matters: It documents transparency of the selection process and allows the reader to assess whether the included studies are a representative, unbiased sample of the available literature. Any deviation from pre-specified inclusion criteria should be apparent.

Q8. What is the "two-reviewer" principle in systematic reviews?
All stages - screening (title/abstract), full-text eligibility assessment, data extraction, and risk of bias assessment - should be performed independently by two reviewers. Disagreements are resolved by discussion or a third reviewer. This reduces subjective bias and errors in each step.
Cohen's Kappa (κ): Measures inter-rater agreement beyond chance. κ > 0.6 is considered acceptable; κ > 0.8 is excellent.

SECTION D: Risk of Bias Assessment

Q9. What is the Cochrane Risk of Bias tool (RoB 2)? What domains does it assess?
RoB 2 is used to assess the risk of bias in individual RCTs included within a systematic review. It assesses 5 domains:
DomainWhat it assesses
D1. Randomization processSequence generation, allocation concealment
D2. Deviations from intended interventionPerformance bias; adherence to intervention
D3. Missing outcome dataAttrition bias; incomplete outcome data
D4. Measurement of the outcomeDetection bias; blinding of outcome assessors
D5. Selection of the reported resultReporting bias; outcome switching vs. protocol
Overall judgment: Low risk / Some concerns / High risk of bias

Q10. What is ROBINS-I?
Risk Of Bias In Non-randomized Studies - of Interventions - a Cochrane tool for assessing bias in non-randomized (observational) studies included in a systematic review. It uses 7 domains including confounding, selection of participants, classification of interventions, deviations from intended interventions, missing data, measurement of outcomes, and selection of the reported result.

SECTION E: Meta-Analysis Statistics - The Core of the Viva

Q11. How is meta-analysis performed? What is the basic concept of weighting?
Meta-analysis pools the effect estimates (e.g., OR, RR, MD, SMD) from individual studies into a single summary estimate. Each study is given a weight proportional to its contribution of information.
Under a fixed-effect model: Weight = 1 / Variance = 1 / (SE²). Larger studies (smaller variance) get more weight.
The pooled estimate = Σ(Wᵢ × θᵢ) / Σ(Wᵢ)
where Wᵢ = weight of study i, θᵢ = effect estimate of study i.
The pooled estimate is shown as a diamond at the bottom of the forest plot.

Q12. What is a forest plot? How do you read it?
A forest plot is the graphical display of individual study results and the pooled estimate in a meta-analysis.
How to read it:
  • Horizontal axis: Effect measure (OR, RR, MD). The vertical line of no effect is at 1.0 (for ratio measures) or 0 (for difference measures)
  • Each row: One study. The black square = point estimate; its size = weight in the meta-analysis (larger square = larger weight)
  • Horizontal line through square: 95% CI. If the line crosses the line of no effect, that study is individually non-significant
  • Diamond at the bottom: Pooled estimate. Width of diamond = 95% CI of the pooled estimate
  • Heterogeneity statistics: I², Cochran's Q, tau² displayed below or above the diamond
Key questions when reading:
  1. Are the individual CIs overlapping? (Visual check for heterogeneity)
  2. Does the diamond cross the line of no effect? (Is the pooled result significant?)
  3. Is the diamond narrow? (Is the pooled estimate precise?)
  4. Are there outlier studies pulling the estimate?

Q13. What is heterogeneity in meta-analysis? Name its types.
Heterogeneity refers to variability among the studies being combined. Three types:
TypeDescription
Clinical heterogeneityDifferences in participants (age, disease severity, comorbidities), interventions (doses, formulations, duration), outcomes (definition, timing of measurement)
Methodological heterogeneityDifferences in study design, risk of bias, blinding, follow-up
Statistical heterogeneityVariability in the observed effect estimates beyond what is expected by chance alone
Statistical heterogeneity is a consequence of clinical and/or methodological heterogeneity. All three types must be considered before pooling.

Q14. How is statistical heterogeneity measured? Interpret Cochran's Q and I².
Cochran's Q test:
  • Tests the null hypothesis that all studies share a common effect size
  • Q = Σ Wᵢ(θᵢ - θ̄)²
  • Degrees of freedom = k - 1 (where k = number of studies)
  • p < 0.10 (not 0.05) conventionally indicates significant heterogeneity (the test has low power with few studies)
  • Limitation: Underpowered when few studies; overpowered when many studies
I² statistic (Higgins I²):
  • I² = [(Q - df) / Q] × 100%
  • Measures the proportion of total variability in effect estimates that is due to true heterogeneity (rather than sampling error/chance)
I² valueInterpretation
0-25%Low heterogeneity
25-50%Moderate heterogeneity
50-75%Substantial heterogeneity
> 75%Considerable heterogeneity
Important caveat: I² is a relative measure. A high I² with wide CIs (few small studies) may be less concerning than a high I² with narrow CIs (many large studies). Always interpret I² together with the 95% CI of the heterogeneity estimate (tau²) and the clinical context.

Q15. What is tau² (tau-squared)?
Tau² (τ²) is the between-study variance - the estimate of the true variance in effect sizes across the underlying population of studies. It is used in random-effects models to account for between-study variability.
  • τ² = 0: all variation between study estimates is due to within-study sampling error (consistent with fixed-effect model)
  • τ² > 0: there is genuine variation in effect sizes across studies
Tau (τ) = √τ² = the standard deviation of true effects across studies. It quantifies the spread of true effects on the same scale as the effect measure.

Q16. What is the difference between a fixed-effect model and a random-effects model? When do you use each?
Fixed-Effect ModelRandom-Effects Model
AssumptionAll studies estimate the SAME true effect; differences are due to sampling error aloneStudies estimate DIFFERENT true effects drawn from a distribution of effects; there is genuine between-study variability
PopulationThese specific studies onlyThe population of all possible similar studies
WeightLarger studies dominate (weight = 1/within-study variance)Weights are more equalized (weight = 1/[within-study variance + τ²])
When to useLow heterogeneity (I² < 25-30%), highly similar studies (same dose, same population, same outcome), explanatory purposeHeterogeneity present, studies differ in population/setting/method, intention to generalize results
CIsNarrowerWider (accounts for extra source of variability)
Common methodsMantel-Haenszel, Inverse-VarianceDerSimonian-Laird (most common), REML, Hartung-Knapp
Examiner tip: Random-effects gives wider CIs and is more conservative; the pooled estimate may be similar to fixed-effect but the CI will be wider. With high heterogeneity, pooling may be inappropriate regardless of model choice.

Q17. If I² is 75%, should I pool the studies?
High I² (>75%) raises serious questions about pooling. Steps to take:
  1. Investigate the source - Is there a clinical or methodological reason? (Different doses, populations, comparators, outcome definitions)
  2. Subgroup analysis - Pool only studies that are clinically similar (e.g., by dose group, study design, population)
  3. Meta-regression - Statistically explore which study-level characteristics explain the heterogeneity
  4. Sensitivity analysis - Remove outlier studies one at a time; does the estimate or heterogeneity change?
  5. Consider not pooling - If heterogeneity is unexplained and substantial, a narrative synthesis is more honest than a misleading pooled number
  6. Use random-effects model if pooling - But acknowledge the limitations in interpreting the pooled estimate

Q18. What is a subgroup analysis in a meta-analysis? What are the concerns?
Subgroup analysis divides included studies into groups based on a specific characteristic (e.g., drug dose, age group, study design quality, follow-up duration) and performs separate meta-analyses in each subgroup.
Purpose: To explore sources of heterogeneity and to check if results are consistent across clinically relevant subgroups.
Concerns:
  • Multiple subgroup analyses inflate the chance of a false positive finding (multiplicity problem)
  • Each subgroup has fewer studies, reducing statistical power
  • Post-hoc subgroup analyses are hypothesis-generating only and prone to data dredging
  • Should be pre-specified in the protocol; post-hoc findings should be clearly labeled as exploratory
  • Should use interaction tests (test whether the subgroup effect modifier is significant), not just compare p-values between subgroups

Q19. What is sensitivity analysis in a meta-analysis?
A sensitivity analysis tests the robustness of the pooled result by repeating the analysis under different assumptions or after removing studies, to see if the conclusion changes:
Examples:
  • Remove high risk-of-bias studies - does the estimate change?
  • Remove the largest or smallest study - does the conclusion hold?
  • Change the statistical model (fixed → random effects)
  • Apply different inclusion criteria
  • Re-run the analysis including or excluding unpublished data
If the pooled estimate is stable across sensitivity analyses, confidence in the result is higher.

SECTION F: Publication Bias

Q20. What is publication bias? Why is it especially important in meta-analysis?
Publication bias is the tendency for studies with statistically significant or positive results to be published more readily than those with null or negative results. In a meta-analysis, if unpublished negative studies are not captured, the pooled estimate will be inflated (overestimating the benefit or harm of an intervention).
Impact is greater in meta-analysis than in individual studies because the pooled result, appearing precise with a narrow CI, may give false confidence in an effect that is actually due to selective publication.

Q21. What is a funnel plot? How do you interpret it?
A funnel plot is a scatter plot of each included study's effect estimate (x-axis) against its precision, usually the standard error (SE) (y-axis, inverted so more precise studies are at the top).
Interpretation:
  • In the absence of publication bias: The plot is symmetrical, shaped like an inverted funnel - large, precise studies cluster near the pooled estimate at the top; smaller, less precise studies scatter more widely at the bottom
  • Asymmetry (gap in one bottom corner): Suggests missing small negative/null studies - consistent with publication bias OR small-study effects, methodological heterogeneity, or true heterogeneity
Important caveats:
  • Funnel plots are only interpretable when there are ≥10 studies (less reliable with fewer)
  • Asymmetry does NOT prove publication bias - other explanations include small-study effects (smaller studies may use selected, higher-risk populations), true heterogeneity, and chance

Q22. What statistical tests detect funnel plot asymmetry / publication bias?
TestMethodNotes
Egger's testLinear regression of standardized effect on precisionContinuous; more powerful but may give false positives with heterogeneity
Begg's testRank correlation (Kendall's tau) between effect size and SELess powerful than Egger's
Trim-and-fill methodImputes "missing" studies to make the funnel symmetric; recalculates adjusted pooled estimateNot a test per se but gives a corrected estimate; useful for sensitivity analysis
Fail-safe N (Rosenthal)Calculates how many unpublished null studies would be needed to make the pooled result non-significantOverused and discouraged by modern methodologists

Q23. What is the "trim-and-fill" method?
A non-parametric method that:
  1. Identifies and removes ("trims") smaller studies causing funnel plot asymmetry
  2. Re-estimates the pooled effect
  3. Adds ("fills") mirror-image studies on the other side of the funnel to restore symmetry
  4. Recalculates the pooled estimate with the added studies
This gives a bias-adjusted estimate. If the adjusted estimate is substantially different from the original, publication bias may be inflating the result. If similar, the result is robust to potential publication bias.

SECTION G: GRADE - Certainty of Evidence

Q24. What is the GRADE framework? What are its four levels of evidence certainty?
GRADE (Grading of Recommendations Assessment, Development and Evaluation) rates the certainty (quality) of evidence - i.e., our confidence that the true effect is close to the estimated effect.
LevelSymbolMeaning
High⊕⊕⊕⊕We are very confident the true effect lies close to the estimate; further research very unlikely to change it
Moderate⊕⊕⊕○We are moderately confident; further research likely to have an important impact
Low⊕⊕○○Our confidence is limited; further research very likely to have an important impact
Very Low⊕○○○We have very little confidence; the true effect may be substantially different
Default starting points:
  • RCTs start at High
  • Observational studies start at Low

Q25. What factors DOWNGRADE evidence in GRADE?
DomainTriggers downgrade
1. Risk of biasIncluded studies have high or unclear risk of bias
2. InconsistencyUnexplained heterogeneity (I² high, wide variation in estimates across studies)
3. IndirectnessPICO of included studies differs from the review question (different population, surrogate outcomes, indirect comparisons)
4. ImprecisionWide confidence intervals; small sample size; few events (optimal information size not met)
5. Publication biasEvidence of funnel plot asymmetry; important industry-funded studies
Each domain can downgrade by -1 (serious) or -2 (very serious) levels.

Q26. What factors UPGRADE evidence in GRADE?
FactorExplanation
Large effect sizeRR > 2 or < 0.5 (upgrade +1); RR > 5 or < 0.2 (upgrade +2) - unlikely to be explained by confounding alone
Dose-response gradientEvidence of a dose-response relationship strengthens causality
Plausible confounding would reduce effectIf all residual confounding would make the result conservative, the true effect may be even larger
Observational studies can be upgraded to Moderate or even High evidence if all three upgrade factors are present.

Q27. How does GRADE differ from AMSTAR-2?
AMSTAR-2GRADE
AssessesThe systematic review's methodology and conductThe certainty of the evidence from the body of studies
FocusWas the review itself done properly?How confident should we be in the pooled result?
LevelsHigh / Moderate / Low / Critically Low confidence in the reviewHigh / Moderate / Low / Very Low certainty of evidence
Tool typeReview-level appraisalEvidence body-level appraisal

SECTION H: AMSTAR-2

Q28. What is AMSTAR-2? What are its critical domains?
AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) is a 16-item checklist for appraising the methodological quality of systematic reviews (including reviews of both RCTs and non-randomized studies).
7 Critical domains (any flaw here → major concern):
  1. Was the review protocol pre-registered (before the review was conducted)?
  2. Was the literature search strategy comprehensive (multiple databases, grey literature)?
  3. Were reasons for study exclusion provided?
  4. Did reviewers assess risk of bias in individual included studies?
  5. Were appropriate meta-analytical methods used?
  6. Was risk of bias considered when interpreting/discussing the results?
  7. Was publication bias assessed (funnel plot and/or statistical test)?
Overall confidence rating: High / Moderate / Low / Critically Low
  • One non-critical flaw: Moderate
  • More than one non-critical flaw: Low
  • One critical flaw (with or without non-critical flaws): Critically Low

SECTION I: Special Meta-Analysis Methods

Q29. What is a network meta-analysis (NMA)?
A network meta-analysis (also called mixed-treatment comparison) simultaneously compares three or more interventions by combining direct evidence (from head-to-head trials) and indirect evidence (e.g., A vs. C and B vs. C to infer A vs. B) within a single statistical model.
Advantages:
  • Enables comparisons between treatments that have never been directly compared in a head-to-head RCT
  • Produces a ranking of all included treatments (P-scores, SUCRA)
  • Maximum use of available evidence
Key assumption - transitivity (consistency): The indirect comparison is valid only if the studies connected through the network are sufficiently similar (same PICO). If there is inconsistency (direct evidence contradicts indirect evidence), the NMA is invalid.
Appraisal tool: CINeMA (Confidence in Network Meta-Analysis) for GRADE in NMA.

Q30. What is an individual patient data (IPD) meta-analysis? Why is it the gold standard?
An IPD meta-analysis obtains the raw, patient-level data from all included trials (rather than aggregate published summary statistics) and re-analyzes them with a consistent statistical approach.
Advantages over aggregate meta-analysis:
  • Can standardize outcome definitions across studies
  • Can perform patient-level subgroup analyses
  • Avoids ecological bias
  • Can handle time-to-event data properly
  • Detects within-study interactions that aggregate data misses
  • More accurate, less subject to misinterpretation of published summaries
Limitation: Requires cooperation of all original investigators; time-intensive; not always feasible.

Q31. What is a cumulative meta-analysis?
A cumulative meta-analysis adds studies one at a time (in chronological order) and recalculates the pooled estimate after each addition. It shows how the evidence has evolved over time and identifies the point at which the pooled estimate became stable and crossed the threshold of significance. Useful for identifying when sufficient evidence existed to change clinical practice.

Q32. What is a prospective meta-analysis (PMA)?
A PMA is planned and the protocol registered before the individual trials complete. Individual trial investigators agree in advance on common outcome definitions, eligibility criteria, and analysis plans. This avoids outcome switching and selective reporting - making it more rigorous than a retrospective meta-analysis.

SECTION J: Reporting Quality vs. Methodological Quality

Q33. What is the difference between reporting quality and methodological quality of a systematic review?
  • Reporting quality (PRISMA): How completely and transparently is the review reported? A well-reported review may have actually been poorly conducted; the good reporting simply means the authors explained their methods clearly
  • Methodological quality (AMSTAR-2): Was the review actually conducted rigorously? Were protocols pre-registered? Were biases minimized?
Key point: A review can score well on PRISMA (good reporting) but poorly on AMSTAR-2 (poor conduct), and vice versa. Both must be assessed independently. PRISMA tells you what was done; AMSTAR-2 tells you how well it was done.

SECTION K: Effect Measures in Meta-Analysis

Q34. What effect measures are used in meta-analysis? When is each appropriate?
Outcome TypeEffect MeasureWhen Used
DichotomousOdds Ratio (OR)Case-control studies; logistic regression
DichotomousRisk Ratio (RR) / Relative RiskCohort studies; RCTs with event data
DichotomousRisk Difference (RD) / Absolute Risk ReductionWhen absolute effect is needed (used to calculate NNT)
ContinuousMean Difference (MD) / Weighted Mean Difference (WMD)Same scale across all studies (e.g., same questionnaire, same unit)
ContinuousStandardized Mean Difference (SMD) / Cohen's dDifferent scales for same construct (e.g., depression measured by Hamilton vs. Beck scores)
Time-to-eventHazard Ratio (HR)Survival data (time to death, relapse, discharge)
Examiner tip on SMD:
  • Cohen's d: < 0.2 = trivial; 0.2-0.5 = small; 0.5-0.8 = medium; > 0.8 = large effect

Q35. What is the Mantel-Haenszel method?
The Mantel-Haenszel method is the standard fixed-effect pooling method for dichotomous outcomes (OR, RR, RD). It weights each study by its contribution of information (function of sample size and event rates), then calculates a weighted average across all strata (studies). It is robust when event rates are low or sample sizes are small.

Q36. What is the DerSimonian-Laird method?
The DerSimonian-Laird (DSL) method is the most widely used random-effects pooling method. It estimates τ² (between-study variance) using the method of moments, then incorporates this into the weighting:
Weight (random-effects) = 1 / (Vᵢ + τ²)
where Vᵢ = within-study variance.
Limitation: DerSimonian-Laird can underestimate τ² when there are few studies, leading to falsely narrow CIs. More modern alternatives: REML (Restricted Maximum Likelihood), Paule-Mandel method, Hartung-Knapp adjustment.

SECTION L: Common Pitfalls & Examiner Trick Questions

Q37. What is the "apples and oranges" problem in meta-analysis?
If included studies are too different in their populations, interventions, comparators, or outcome definitions, pooling them is like combining apples and oranges - the pooled estimate is meaningless or misleading. The solution is not to pool, or to pool only clinically and methodologically homogeneous subgroups.

Q38. What is the "garbage in, garbage out" problem?
A meta-analysis is only as good as its included studies. If all included studies are of poor quality (high risk of bias), a precise pooled estimate simply means you have pooled poor-quality evidence efficiently - the result may be precise but unreliable. This is why risk of bias assessment of each included study (RoB 2, ROBINS-I) is a critical step.

Q39. What is a Cochrane Review? Why is it considered the highest quality systematic review?
A Cochrane Review is produced following the rigorous Cochrane Handbook for Systematic Reviews methodology and is published in the Cochrane Library. Features:
  • Mandatory pre-registration of protocol in Cochrane's system before the review starts
  • Peer-reviewed protocol before data collection
  • Standardized RoB 2 / ROBINS-I assessment
  • Mandatory GRADE assessment
  • Regular updates when new trials emerge
  • Open access and transparent

Q40. What is overlap bias (duplication bias) in systematic reviews?
When the same patients or data appear in multiple publications (e.g., the same dataset published in multiple papers, or preliminary and final reports of the same trial), including all such publications in a meta-analysis effectively double-counts participants. This inflates sample size and makes the pooled estimate artificially precise.
Solution: Identify and handle multiple publications from the same trial by using only one report (the most complete one) per trial.

SECTION M: Rapid-Fire Questions

Q41. What is the line of no effect in a forest plot? The vertical line at OR/RR = 1 (for ratio measures) or MD = 0 (for difference measures). If a study's CI crosses this line, its result is individually non-significant.
Q42. If the pooled diamond does not cross the line of no effect, what does that mean? The pooled result is statistically significant at the chosen α level (usually 0.05). The pooled intervention has a statistically significant effect compared to control.
Q43. What does the SIZE of the square in a forest plot represent? The weight of that study in the meta-analysis. A larger square = a larger weight = that study contributes more to the pooled estimate. Weight is proportional to precision (inverse of variance).
Q44. Can a meta-analysis prove causation? No more than the individual studies it includes. A meta-analysis of observational studies cannot establish causation. A meta-analysis of RCTs provides the strongest evidence for causation, but the Bradford Hill criteria and clinical judgment are still required.
Q45. What is the optimal information size (OIS) in GRADE? The minimum number of participants (events) needed for the meta-analysis to reliably detect the effect. If the total n in the meta-analysis is below OIS, the evidence is downgraded for imprecision - the estimate may change substantially as more data accumulate.
Q46. What is grey literature? Why is it searched? Unpublished reports, conference abstracts, government documents, regulatory submissions, and theses. It is searched to minimize publication bias - negative studies are more likely to remain unpublished and in the "grey" domain.
Q47. What is a scoping review? How is it different from a systematic review? A scoping review maps the extent, range, and nature of evidence on a broad topic without formally appraising quality or quantitatively pooling results. It is used when the question is broad, the literature is heterogeneous, or the goal is to identify research gaps - not to answer a specific focused clinical question.
Q48. What is meta-regression? A statistical technique in meta-analysis that examines whether specific study-level characteristics (e.g., mean age, dose, duration, year of publication, risk of bias score) explain heterogeneity in effect estimates. It is analogous to regression analysis but the unit of analysis is each included study.

QUICK REFERENCE DECISION TREE

SYSTEMATIC REVIEW RECEIVED
         ↓
1. Is the PICO focused and pre-specified? (AMSTAR-2 item 2)
         ↓
2. Was the search comprehensive (multi-database, grey literature)? (AMSTAR-2 item 4)
         ↓
3. Were inclusion/exclusion criteria pre-specified? Were exclusions reasoned? (AMSTAR-2 items 5 & 8)
         ↓
4. Was risk of bias assessed in each included study? (RoB 2 / ROBINS-I) (AMSTAR-2 item 9)
         ↓
5. Was meta-analysis appropriate? (Homogeneity? Correct model?)
         ↓
6. Was heterogeneity assessed and explained? (I², Cochran Q, subgroups)
         ↓
7. Was publication bias assessed? (Funnel plot, Egger's test, trim-and-fill)
         ↓
8. Was GRADE applied to rate certainty of evidence?
         ↓
9. Were conclusions consistent with the evidence (not overclaimed)?
         ↓
10. Are results applicable to my patients (PICO match, setting, values)?

EXAMINER'S FAVOURITE TRICK QUESTIONS

1. "I² = 80%. The authors used a random-effects model and found p < 0.001. Can you trust the result?" Not without further scrutiny. High I² means substantial between-study variability. A random-effects model produces a wider CI, which may still be significant, but the pooled estimate represents an "average effect across a heterogeneous set of studies" - which may not apply to any specific clinical context. You should investigate sources of heterogeneity, check subgroup and sensitivity analyses, and downgrade for inconsistency using GRADE.
2. "The funnel plot is asymmetric. What does that mean?" Asymmetry suggests that smaller studies have systematically larger effect estimates than larger studies. This is consistent with publication bias (small negative studies unpublished) but is NOT diagnostic of it. Other causes: small-study effects (smaller trials enroll higher-risk patients who benefit more), methodological heterogeneity, true heterogeneity, or chance. Statistical tests (Egger's) and trim-and-fill should be applied.
3. "A meta-analysis of 30 RCTs found OR = 1.5 (95% CI 1.4-1.6). Is this clinically important?" Statistical precision (narrow CI) and significance do NOT equal clinical importance. Ask: What is the absolute risk increase? What is the NNH? What is the baseline risk? An OR of 1.5 for a rare event (baseline rate 0.1%) gives a tiny ARR; for a common event (50%), it may be clinically highly significant.
4. "A Cochrane review concluded 'insufficient evidence to recommend the drug.' Does this mean the drug doesn't work?" No. Absence of evidence is NOT evidence of absence. It may mean there are too few trials, trials are too small, or trials have not been conducted - not that the drug is ineffective. The review should state this explicitly.
5. "The authors combined RCTs and observational studies in one meta-analysis. Is this appropriate?" Generally not without subgroup analysis by study design. RCTs and observational studies have different baseline risk of bias. Mixing them without stratification conflates very different sources of evidence and may produce a misleading pooled estimate. GRADE would start at Low certainty for such a mixed pool.

SUMMARY COMPARISON TABLE: Three Review Types

FeatureNarrative ReviewSystematic ReviewMeta-Analysis
QuestionBroadFocused (PICO)Focused (PICO)
SearchSelectiveComprehensive, reproducibleComprehensive, reproducible
SelectionSubjectivePre-specified criteriaPre-specified criteria
Quality appraisalInformalFormal (RoB 2, ROBINS-I)Formal (RoB 2, ROBINS-I)
SynthesisNarrativeNarrative ± quantitativeQuantitative (pooled estimate)
Bias riskHighLow (if rigorous)Low (if rigorous)
Appraisal tool-AMSTAR-2, PRISMAAMSTAR-2, PRISMA, GRADE
OutputOpinionSummary of evidenceSummary effect with CI
Evidence levelLowestHighHighest (Level I)

This set covers all the domains an MD Pharmacology examiner will probe in a critical appraisal viva for systematic reviews and meta-analyses - from PICO formulation and search strategy through heterogeneity statistics, forest and funnel plots, fixed vs. random effects models, AMSTAR-2, GRADE, and network meta-analysis.

viva questions with answers for the critical appraisal of a CASE REPORT for MD Pharmacology exam

Searching the Web

critical appraisal case report viva questions MD pharmacology CARE guidelines Naranjo scale causality assessment

Searching the Web

CARE checklist case report appraisal adverse drug reaction pharmacovigilance causality WHO-UMC Naranjo algorithm exam questions

Excellent data retrieved. Here is the complete, exam-focused viva Q&A set:

Viva Questions & Answers: Critical Appraisal of a Case Report

MD Pharmacology Exam Preparation


SECTION A: Definitions & Fundamentals

Q1. What is a case report? How does it differ from a case series?
A case report is a detailed description of a single patient's clinical presentation, course, diagnosis, and management - highlighting an unusual, novel, or instructive clinical event. It is the oldest and simplest form of medical communication.
A case series is a description of a group of patients (typically 3-10) with similar clinical features, exposures, or outcomes, without a comparison group.
FeatureCase ReportCase Series
Number of patients1≥ 2 (typically 3-10)
Comparison groupNoneNone
Statistical analysisDescriptive onlyDescriptive; some frequency data
Hypothesis generationYesStronger signal than a single report
Evidence levelLowest (Level V)Very low (Level IV-V)
Reporting guidelineCARECARE (extended)

Q2. Where does a case report sit in the hierarchy of evidence? Why?
Case reports sit at the base (bottom) of the evidence pyramid (Level V, below case series at Level IV).
Reasons:
  • No comparison group - there is no control to compare outcomes against
  • No randomization - selection bias cannot be excluded
  • Single patient - results cannot be generalized to a population
  • Susceptible to observer bias, recall bias, and publication bias (positive/dramatic cases get published)
  • Cannot establish causation - only raises a hypothesis
  • Retrospective in nature - data collected after the fact
Despite this, case reports serve a unique and irreplaceable role in pharmacology (see Q3).

Q3. Why are case reports important in pharmacology specifically? Why should an MD Pharmacology student care?
Case reports are the primary mechanism for detecting novel adverse drug reactions (ADRs) and unexpected drug interactions, especially for:
  1. Post-marketing surveillance: Pre-marketing RCTs enroll only ~3,000 patients - insufficient to detect rare ADRs (frequency < 1/3,000). Case reports through spontaneous reporting systems fill this gap
  2. Rare events that cannot be randomized: It would be unethical to randomize patients to a potentially harmful exposure
  3. Novel drug interactions: Two drugs never studied together in an RCT
  4. Unusual patient populations: Elderly, pregnant women, children, and patients with rare comorbidities are excluded from most RCTs
  5. First signal of a class effect: e.g., thalidomide-related phocomelia was first reported as case reports; COX-2 inhibitor cardiovascular risk was first flagged in case reports before the VIGOR trial confirmed it
  6. Unlabeled (off-label) use: Unexpected therapeutic responses or toxicities from off-label prescribing
  7. Drug re-purposing signals: Unexpected beneficial effects (e.g., minoxidil for hypertension → case reports of hair regrowth → repurposed as topical alopecia treatment)

Q4. What reporting guideline is used for case reports?
CARE (CAse REport) Guidelines / Checklist - published in 2013, updated with explanations in 2017.
CARE stands for CAse REport. It is a 13-item checklist covering:
  1. Title
  2. Key words
  3. Abstract (structured)
  4. Introduction (What is unique about this case? Why should clinicians know about it?)
  5. Patient information (demographics, main complaint, history)
  6. Clinical findings (physical examination)
  7. Timeline (key dates and events in chronological order)
  8. Diagnostic assessment (methods, findings, differential diagnoses)
  9. Therapeutic interventions (type, dose, duration, changes)
  10. Follow-up and outcomes
  11. Discussion (strengths, limitations, literature review, rationale for conclusions)
  12. Patient perspective (optional but encouraged)
  13. Informed consent
CARE does NOT assess quality - it is a reporting guideline ensuring completeness and transparency. For quality assessment, examiners may ask about the JBI (Joanna Briggs Institute) Critical Appraisal Checklist for Case Reports (8 items).

SECTION B: Structure of a Case Report

Q5. Describe the ideal structure of a case report.
A well-written case report should contain:
1. Title: Should be informative, include the diagnosis/condition, and indicate it is a case report (e.g., "Stevens-Johnson Syndrome following Lamotrigine use: A Case Report")
2. Abstract: Structured: Introduction (why report this case), Case Presentation (key clinical details), Discussion, Conclusion
3. Introduction:
  • What is the background condition/drug?
  • What is novel about this case? (first report? unusual presentation? rare interaction?)
  • Why is it relevant to clinicians?
4. Case Presentation:
  • Patient demographics (age, sex, ethnicity - no identifying information)
  • Chief complaint and history of present illness
  • Relevant past medical history, medications, allergies, family/social history
  • Physical examination findings
  • Laboratory, imaging, and other investigations
  • Differential diagnosis considered
  • Definitive diagnosis made
  • Timeline of events (CARE requirement - presented as a table or figure)
5. Therapeutic Intervention:
  • Drug name (generic), dose, route, frequency, duration
  • Any dechallenge/rechallenge details
  • Other co-medications and their management
6. Outcome and Follow-up:
  • What happened to the patient? (Recovered/resolved/died/improved)
  • Time course of resolution
  • Any sequelae
7. Discussion:
  • How does this case compare to existing literature?
  • Causality assessment (Naranjo, WHO-UMC)
  • Proposed mechanism of the ADR/interaction
  • Clinical implications and lessons
  • Limitations of the case report
  • What further research is needed?
8. Patient Consent: Mandatory ethical requirement - informed consent from patient (or guardian) for publication

Q6. What is the timeline in a CARE case report? Why is it important?
The timeline is a chronological table or figure mapping key dates and clinical events - when the drug was started, when the adverse reaction appeared, when it peaked, when the drug was stopped (dechallenge), and whether the reaction resolved - to when rechallenge (if any) occurred and its result.
Why important:
  • Temporal relationship is the most critical element in causality assessment. The adverse event MUST appear after drug initiation (temporality = the only essential Bradford Hill criterion)
  • Allows calculation of the latency period (time from drug start to ADR onset)
  • Documents dechallenge and rechallenge events (crucial for Naranjo scoring)
  • Enables peer reviewers and readers to independently assess the plausibility of the drug-event relationship

SECTION C: Causality Assessment - The Core of MD Pharmacology Viva

Q7. What is causality assessment in pharmacovigilance?
Causality assessment is the systematic evaluation of the likelihood that a particular drug is the cause of an observed adverse event in an individual patient. It determines the degree of certainty of the drug-ADR relationship.
Why needed: Most ADRs are not pathognomonic (specific) to a particular drug - they resemble naturally occurring diseases. Spontaneous reports always represent suspected ADRs, not confirmed ones. Causality assessment distinguishes drug-caused events from coincidental ones.

Q8. What are the two most commonly used causality assessment tools in pharmacovigilance? Compare them.
FeatureNaranjo Algorithm (1981)WHO-UMC Criteria
Developed byNaranjo et al., 1981WHO & Uppsala Monitoring Centre, Sweden
TypeQuantitative algorithm (scoring)Qualitative/categorical assessment
Method10 questions; Yes/No/Unknown; scoredCombined assessment considering clinical-pharmacological aspects + documentation quality
OutputNumerical score → categoryDirect categorical assignment
CategoriesDefinite (≥9), Probable (5-8), Possible (1-4), Doubtful (≤0)Certain, Probable/Likely, Possible, Unlikely, Conditional/Unclassified, Unclassifiable
StrengthsStandardized, reproducible, widely used, easy to applyIncorporates documentation quality; broader clinical judgment; officially endorsed
LimitationsDesigned for clinical trial ADRs; some questions not applicable to spontaneous reports; subjectivity in "alternative causes" questionMore subjective; requires rechallenge for "Certain" which is often unethical
Gold standard?No - no single tool is universally acceptedNo

Q9. Explain the Naranjo Algorithm in detail. How is it scored?
The Naranjo ADR Probability Scale is a 10-question questionnaire. Each question is answered as Yes, No, or Do Not Know/Not Done, with assigned scores:
#QuestionYesNoDo Not Know
1Are there previous conclusive reports on this reaction?+100
2Did the AE appear after the suspected drug was administered?+2-10
3Did the AE improve when the drug was discontinued or a specific antagonist was given?+100
4Did the AE reappear when the drug was readministered (rechallenge)?+2-10
5Are there alternative causes (other than the drug) that could solely have caused the AE?-1+20
6Did the AE reappear when a placebo was given?-1+10
7Was the drug detected in blood/other fluids in toxic concentrations?+100
8Was the AE more severe when the dose was increased, or less severe when dose decreased?+100
9Did the patient have a similar AE with the same or similar drug in a previous exposure?+100
10Was the AE confirmed by any objective evidence?+100
Scoring:
  • ≥ 9: Definite ADR
  • 5-8: Probable ADR
  • 1-4: Possible ADR
  • ≤ 0: Doubtful ADR
Maximum possible score: +13 (theoretically); Minimum: -4
Key examiner question: "Why is question 4 (rechallenge) scored +2?" Because rechallenge (re-administering the suspected drug after the ADR resolved) is the strongest evidence of causality - it demonstrates the drug-ADR relationship is reproducible. It carries the most weight.

Q10. Explain the WHO-UMC causality assessment criteria.
The WHO-UMC system uses a combined assessment based on four criteria:
  • (a) Temporal relationship between drug administration and adverse event
  • (b) Alternative causes (other drugs, underlying disease) - are they excluded?
  • (c) Dechallenge response - did the event improve on stopping the drug?
  • (d) Rechallenge - did the event recur on re-administration?
CategoryCriteria
Certain(a) Plausible time relationship AND (b) alternative causes excluded AND (c) reaction confirmed on dechallenge AND (d) rechallenge positive if done
Probable/Likely(a) Reasonable time relationship AND (b) alternative causes unlikely AND (c) reasonable dechallenge response; rechallenge NOT required
Possible(a) Reasonable time relationship BUT (b) alternative causes possible AND (c) dechallenge information incomplete or lacking
Unlikely(a) Time relationship improbable AND (b) other causes plausible
Conditional/UnclassifiedEvent is clinically important but needs more data for proper assessment
UnclassifiableReport cannot be assessed due to insufficient or contradictory data
Key point: "Certain" in WHO-UMC requires rechallenge to be positive. Since rechallenge is often unethical (re-exposing a patient to a potentially harmful drug), most ADRs are classified as Probable or Possible in clinical practice.

Q11. What is dechallenge and rechallenge? Why are they important in causality assessment?
Dechallenge: Stopping (withdrawing) the suspected drug and observing whether the adverse reaction improves or resolves. A positive dechallenge (improvement on stopping) supports the drug as the cause.
Rechallenge: Re-administering the suspected drug after the reaction has resolved and observing whether the reaction recurs. A positive rechallenge is the strongest possible evidence of a drug-ADR causal relationship.
EventImplication
Positive dechallenge + Positive rechallengeStrong evidence of causation (Definite in WHO-UMC; +3 in Naranjo)
Positive dechallenge onlyProbable cause
Negative dechallengeSuggests the drug may not be responsible, OR the reaction has become irreversible
Rechallenge not doneLimits causality category to Probable at most
Why rechallenge is often avoided: Deliberately re-exposing a patient to a drug that caused a serious reaction (e.g., anaphylaxis, Stevens-Johnson Syndrome, agranulocytosis) is ethically unjustifiable. This is the most common reason causality cannot reach "Certain" or "Definite."

Q12. What is the Rawlins-Thompson classification of ADRs? How does it apply to case reports?
Rawlins and Thompson (1977) classified ADRs into two types:
TypeNameDescriptionExamples
Type AAugmented (predictable)Pharmacologically predictable; dose-dependent; common; rarely fatalOpioid-induced constipation, ACE inhibitor cough, hypoglycemia with insulin
Type BBizarre (unpredictable)Pharmacologically unpredictable; dose-independent; rare; potentially severe; idiosyncratic or immunologicalPenicillin anaphylaxis, halothane hepatitis, Stevens-Johnson Syndrome
Type B reactions are more likely to appear in case reports because:
  • They are rare (missed in clinical trials)
  • They are pharmacologically unpredictable (not deducible from the drug's mechanism)
  • They require a specific patient genetic or immunological susceptibility
Extended classification: Type C (chronic effects, e.g., analgesic nephropathy), Type D (delayed, e.g., carcinogenesis, teratogenicity), Type E (end-of-use, e.g., withdrawal reactions), Type F (failure, e.g., treatment failure due to interaction).

Q13. What are the DoTS criteria for classifying ADRs?
The DoTS (Dose-relatedness, Time-course, Susceptibility) classification by Aronson and Ferner (2003) is a more clinically useful alternative to Rawlins-Thompson:
  • Do (Dose-relatedness): Toxic (supertherapeutic dose), Collateral (normal therapeutic dose), Hypersusceptibility (sub-therapeutic dose)
  • T (Time-course): Time-independent, Time-dependent (immediate, first-dose, early, intermediate, late, delayed), Withdrawal
  • S (Susceptibility): Age, sex, genetic factors, comorbidity, polypharmacy
Advantage over A/B classification: More nuanced - recognizes that many "Type B" reactions are actually dose-related in susceptible individuals (not truly pharmacologically unpredictable).

SECTION D: Critical Appraisal of a Case Report

Q14. What are the key questions to ask when critically appraising a case report?
Use the JBI Critical Appraisal Checklist for Case Reports (8 items):
  1. Were the patient's demographic characteristics clearly described? (Age, sex, relevant background)
  2. Was the patient's history clearly described and presented as a timeline? (Temporal relationship assessable)
  3. Was the current clinical condition of the patient on presentation clearly described? (Severity, context)
  4. Were diagnostic tests or assessment methods and their results clearly described? (Objective data)
  5. Was the intervention(s) or treatment procedure(s) clearly described? (Drug name, dose, route, duration)
  6. Was the post-intervention clinical condition clearly described? (Outcome documented)
  7. Were adverse events (harms) or unanticipated events identified and described? (Safety data)
  8. Did the case report provide takeaway lessons? (Educational value)
Overall:
  • Yes/No/Unclear for each item
  • No numerical score; overall qualitative judgment of completeness and credibility

Q15. What are the major limitations of a case report?
LimitationExplanation
No comparison groupCannot determine whether the outcome would have occurred without the drug/exposure
No denominatorsCannot calculate incidence or prevalence; cannot quantify risk
Single observationCannot establish generalizability to other patients
Reverse causation possibleThe underlying disease, not the drug, may have caused the event
Recall biasInformation about past exposures may be inaccurately remembered
Channeling biasSicker patients may receive certain drugs, making the drug appear harmful when the disease is responsible
ConfoundingOther drugs, diseases, or patient factors may be the true cause
Publication biasDramatic, positive-result cases are published; negative cases or uneventful outcomes are not
Temporal biasThe relationship between drug administration and event timing may be coincidental
Cannot establish causationAssociation only; Bradford Hill criteria can be applied but causality remains inferential
Observer/reporter biasThe clinician writing the report may have a preconceived belief about the drug-event relationship

Q16. What is the significance of the Discussion section in a case report?
The Discussion is the most academically important section. It should:
  1. Compare to existing literature: How does this case compare to similar previously reported cases? Is this the first report?
  2. Apply causality assessment: Explicitly apply Naranjo and/or WHO-UMC criteria and state the result
  3. Propose a mechanism: What is the plausible pharmacological/immunological mechanism?
  4. Consider differential diagnosis: Why were other causes excluded?
  5. State clinical implications: What should clinicians do with this information? (monitor, avoid combination, adjust dose, counsel patients)
  6. Acknowledge limitations: Honestly state what is unknown or uncertain
  7. Suggest future research: What studies are needed to confirm this signal? (cohort study, nested case-control, pharmacokinetic study)
  8. State the learning point: What is the key "take-home message" for practicing clinicians?

Q17. What ethical considerations apply to case reports?
  1. Informed consent: Patient (or legal guardian/next of kin) must give explicit written consent for their case to be published. Without consent, the case may only be published in a de-identified manner
  2. Anonymization: All identifying information must be removed or altered (exact dates → approximate, specific institution → tertiary care hospital, uncommon demographics → obscured)
  3. Institutional review: Many institutions require ethics committee notification or formal exemption even for case reports
  4. Patient perspective: CARE 2017 explicitly encourages including the patient's perspective (patient's own words/description of their experience) with their consent
  5. Benefit-harm balance: Publishing details that could identify a patient with a stigmatized condition (e.g., HIV, psychiatric illness) requires extra caution
  6. Conflict of interest: Authors must declare any financial relationships with drug manufacturers

SECTION E: Pharmacovigilance & Case Reports

Q18. What is spontaneous reporting? What are the major spontaneous reporting systems?
Spontaneous reporting is the voluntary (or mandatory) submission of suspected ADR reports by healthcare professionals, patients, or pharmaceutical companies to regulatory authorities or pharmacovigilance centers.
SystemCountry/Organization
Yellow Card SchemeUK (MHRA)
MedWatchUSA (FDA)
VigiBaseGlobal (WHO, managed by Uppsala Monitoring Centre)
EudraVigilanceEuropean Union (EMA)
PvPI (Pharmacovigilance Programme of India)India (CDSCO, coordinated by IPC Ghaziabad)
FAERS (FDA Adverse Event Reporting System)USA (FDA)
Examiner note: India's PvPI was launched in 2010 under the Ministry of Health & Family Welfare. AMC (Adverse Event Monitoring Centres) are established at medical colleges. Reports submitted to the National Coordinating Centre (NCC) at IPC Ghaziabad, which submits to VigiBase.

Q19. What is the difference between an ADR report and a case report published in a journal?
FeatureSpontaneous ADR Report (e.g., Yellow Card)Published Case Report (journal)
PurposeSignal detection, regulatory actionEducation, communication of novel finding
AudienceRegulators, pharmacovigilance centersClinicians, researchers
DetailLimited (standardized form)Extensive clinical narrative
Peer reviewNoYes
CausalitySuspected; not necessarily assessedFormally assessed (Naranjo/WHO-UMC)
Threshold to submitLow (any suspicion)Higher (novelty, educational value)
Denominator dataAggregated across all reportsSingle patient only
SpeedFast (real-time signal detection)Slow (months to years to publish)

Q20. What is disproportionality analysis in pharmacovigilance? How do case reports feed into it?
When large numbers of spontaneous ADR reports accumulate in a database (e.g., VigiBase, FAERS), disproportionality analysis detects whether a specific drug-ADR combination is reported more frequently than expected by chance, relative to all other drugs and all other ADRs.
Key measures:
  • PRR (Proportional Reporting Ratio): Ratio of the proportion of reports for Drug X associated with ADR Y vs. the proportion of all other drug reports associated with ADR Y. PRR > 2 with n ≥ 3 reports = signal
  • ROR (Reporting Odds Ratio): Analogous to OR in epidemiology; from the 2×2 table of drug × ADR in the database
  • IC (Information Component): Bayesian method used by WHO-UMC; IC > 0 = signal
Connection to case reports: Individual case reports (spontaneous reports) are the building blocks of these databases. A single dramatic case report may prompt other clinicians to report similar cases, accumulating enough reports for disproportionality analysis to detect a formal signal, which then prompts a formal pharmacoepidemiology study or regulatory action.

Q21. How does a case report contribute to the signal-to-evidence pipeline in pharmacovigilance?
The progression from a case report to regulatory action follows a defined pipeline:
Case Report (single patient, novel ADR suspected)
        ↓
Case Series (multiple similar reports accumulate)
        ↓
Spontaneous Reporting Database Signal
(Disproportionality analysis: PRR/ROR/IC exceeds threshold)
        ↓
Pharmacoepidemiology Study (nested case-control or cohort)
        ↓
Post-Authorization Safety Study (PASS) mandated by regulator
        ↓
Risk Management Plan: Label update / Contraindication / Market withdrawal
Classic examples:
  • Thalidomide teratogenicity: Case report by McBride (1961) → withdrawal within months
  • Practolol oculomucocutaneous syndrome: Case reports (1974) → withdrawal
  • COX-2 inhibitors and cardiovascular risk: Case reports → VIGOR trial signal → rofecoxib withdrawal (2004)

SECTION F: Specific Pharmacology Concepts in Case Reports

Q22. What types of pharmacology findings are typically reported in case reports?
  1. Novel ADR: A previously unknown or undescribed adverse drug reaction
  2. Known ADR in a new population: e.g., a well-known ADR occurring in a pediatric patient, pregnant woman, or patient with specific organ failure
  3. Drug-drug interaction (DDI): Unexpected pharmacokinetic (altered drug levels) or pharmacodynamic (additive, synergistic, antagonistic) interaction between two co-administered drugs
  4. Drug-disease interaction: e.g., QT prolongation with a drug in a patient with underlying bradycardia
  5. Dose-response relationship for toxicity: Severe toxicity at a dose considered safe in the general population (pharmacogenomic basis)
  6. Therapeutic paradox / Unexpected therapeutic effect: e.g., beta-blocker use in thyrotoxicosis, or a drug worsening the condition it is being used to treat
  7. Withdrawal syndrome: Unexpected discontinuation reaction
  8. Drug overdose / poisoning: Management of an unusual or complex overdose
  9. Drug repurposing signal: Beneficial effect in an unintended condition

Q23. What is a drug-drug interaction (DDI) case report? How is it appraised?
A DDI case report describes an adverse event resulting from the pharmacokinetic or pharmacodynamic interaction between two or more co-administered drugs.
Appraisal questions specific to DDI case reports:
  1. Temporal relationship: Was the adverse event temporally related to co-administration of both drugs (not either drug alone)?
  2. Pharmacokinetic mechanism: Is there a plausible PK mechanism?
    • CYP450 inhibition/induction (e.g., fluconazole inhibits CYP2C9 → increases warfarin levels → bleeding)
    • P-glycoprotein interaction
    • Protein binding displacement
  3. Pharmacodynamic mechanism: Is there a plausible PD mechanism?
    • Additive: two QT-prolonging drugs → torsades de pointes
    • Synergistic: two CNS depressants → respiratory depression
    • Antagonistic: non-selective NSAIDs → reduced antihypertensive effect of ACE inhibitors
  4. Drug levels: Were plasma drug levels measured? Are they consistent with a DDI?
  5. Dechallenge: Did stopping one drug (or both) resolve the adverse event?
  6. Literature: Are there prior pharmacokinetic interaction studies supporting the mechanism?

Q24. What makes a case report "publishable"? What is the threshold for novelty?
A case report is considered worth publishing if it presents:
  1. First-ever report of a drug-ADR combination
  2. Rare presentation of a known ADR (e.g., unusual severity, atypical timing)
  3. Unique patient population (neonates, pregnancy, rare genetic variant)
  4. Teaching point relevant to clinical practice (important diagnostic challenge, management insight)
  5. Mechanism clarification: Adds to understanding of the pharmacology even if the ADR is known
  6. Important public health relevance (widely used drug, potentially underreported ADR)
  7. Outcome data for a rare condition (e.g., successful management of a rare poisoning)
Not publishable: A well-known ADR with standard management and no novel feature. Journals like BMJ Case Reports, Journal of Medical Case Reports, and specialty pharmacology journals have explicit editorial criteria for novelty.

SECTION G: Critical Appraisal - Putting It Together

Q25. If you are given a case report in a viva and asked to critically appraise it, what is your systematic approach?
Step 1 - Reporting completeness (CARE checklist):
  • Is there a clear timeline?
  • Are demographics, history, examination, investigations, intervention, and outcome all described?
  • Is informed consent stated?
Step 2 - Clinical validity:
  • Is the diagnosis well-supported? (objective investigations, differential diagnoses considered)
  • Is the temporal relationship between drug and event clearly established?
  • Is the drug dose, route, and duration clearly stated?
  • What is the dechallenge/rechallenge status?
Step 3 - Causality assessment:
  • Apply Naranjo scale (score and category)
  • Apply WHO-UMC criteria (category)
  • Are alternative causes (other drugs, underlying disease, natural disease course) adequately excluded?
Step 4 - Discussion quality:
  • Is the existing literature appropriately cited and compared?
  • Is the proposed mechanism pharmacologically plausible?
  • Are limitations honestly acknowledged?
  • Is the clinical learning point clearly stated?
Step 5 - Ethics:
  • Is patient consent stated?
  • Is the case adequately anonymized?
Step 6 - Importance:
  • Is this case novel? Is it pharmacologically or clinically important?
  • What is the next step in investigating this signal?

SECTION H: Rapid-Fire Questions

Q26. Name five classic examples where case reports changed pharmacological practice.
  1. Thalidomide teratogenicity (McBride, Lancet, 1961) → worldwide withdrawal
  2. Minoxidil hair growth (case reports of hypertrichosis during oral use) → repurposed as topical alopecia treatment
  3. Sildenafil for pulmonary arterial hypertension (originally developed for angina; penile erection as case report finding) → repurposed as PDE-5 inhibitor
  4. Aspirin for cardiovascular prevention (antiplatelet effect initially noted as an unexpected finding in arthritis patients)
  5. Vigabatrin-associated visual field defects (first detected as case reports before large-scale surveillance)
Q27. What is the Naranjo score for a "definite" ADR? ≥ 9
Q28. What is the most critical question in the Naranjo scale? Question 4 (rechallenge positive = +2), as it provides the strongest reproducible evidence of causality.
Q29. Can a case report prove causation? No. It can establish temporal association, biological plausibility, and raise a hypothesis, but cannot exclude confounding or prove causality. At best, a positive rechallenge under controlled conditions (accidental or intentional) approximates proof for that individual patient.
Q30. What is the "Rule of Three" in pharmacovigilance? If none of n patients experience a particular ADR, the upper 95% CI for the true incidence rate is approximately 3/n. If 3,000 patients are enrolled in an RCT, the upper CI for missing a rate of 1/1,000 is just met. This means clinical trials routinely miss ADRs with frequency < 1/1,000 - which is why post-marketing case reports and spontaneous reporting remain essential.
Q31. What is the "tip of the iceberg" phenomenon in ADR reporting? Spontaneous reporting captures only a fraction of all actual ADRs. Studies estimate that only 1-10% of serious ADRs and < 1% of non-serious ADRs are reported. The visible "tip" of published and reported cases represents only a small fraction of the true incidence - the "iceberg" beneath the surface. This is called under-reporting and is the main limitation of spontaneous pharmacovigilance systems.
Q32. What is the difference between a side effect and an ADR? An ADR (WHO definition): "A response to a drug which is noxious and unintended, and which occurs at doses normally used in man for prophylaxis, diagnosis, or therapy."
A side effect (WHO definition): "Any unintended effect of a pharmaceutical product occurring at doses normally used in man, which is related to the pharmacological properties of the drug." It encompasses both beneficial and harmful unintended effects.
All ADRs are side effects, but not all side effects are ADRs (some are therapeutically exploited - e.g., sedation from antihistamines).
Q33. What is the Edwards-Aronson definition of an ADR? "An appreciably harmful or unpleasant reaction, resulting from an intervention related to the use of a medicinal product, which predicts hazard from future administration and warrants prevention or specific treatment, or alteration of the dosage regimen, or withdrawal of the product." (2000) - This is broader and more practically applicable than the WHO definition.
Q34. What is a SUSAR? Suspected Unexpected Serious Adverse Reaction. In clinical trials, a SUSAR is an adverse reaction that is:
  • Serious (hospitalization, life-threatening, death, disability, congenital anomaly, or medically significant event)
  • Unexpected (not listed in the Investigator's Brochure or product label)
  • Causally related to the study drug (suspected)
SUSARs must be reported to the regulatory authority within 7 days (fatal/life-threatening) or 15 days (non-fatal/non-life-threatening). They are essentially a case report in the context of a clinical trial.

EXAMINER'S FAVOURITE TRICK QUESTIONS

1. "A case report shows that Drug X caused a serious ADR. Should Drug X be withdrawn from the market?" Absolutely not on the basis of a single case report alone. A single case report is a hypothesis-generating signal, not evidence for regulatory action. The signal must be evaluated through: disproportionality analysis of the spontaneous reporting database, cohort or case-control pharmacoepidemiology study, benefit-risk assessment across the full population, and clinical and regulatory expert review. Withdrawal is justified only when the risk is confirmed and outweighs benefit.
2. "The Naranjo score is 6 (Probable). Can you call it a definite ADR?" No. "Probable" means there is a reasonable time relationship, the reaction improved on dechallenge, and alternative causes are unlikely - but the gold standard (positive rechallenge) has not been demonstrated, or some uncertainty remains. A score of 6 cannot be reclassified as "Definite" (≥9) regardless of clinical intuition. "Probable" is a legitimate and meaningful category that is actionable.
3. "Why can't you calculate NNT or NNH from a case report?" NNT and NNH require knowledge of the absolute risk difference (ARR = Control Event Rate - Experimental Event Rate). A case report describes a single patient with no comparison group. Without a denominator (how many patients took the drug and did NOT develop the ADR), it is impossible to calculate event rates, and therefore impossible to calculate any measure of absolute risk.
4. "A patient developed jaundice after starting a new drug. Is this definitely a drug-induced liver injury (DILI)?" Not necessarily. The differential diagnosis of jaundice includes viral hepatitis, alcohol, biliary obstruction, autoimmune hepatitis, ischemic hepatitis, and many other causes. The Naranjo algorithm should be applied. Additionally, for DILI specifically, the RUCAM (Roussel Uclaf Causality Assessment Method) is the gold standard causality assessment tool (more specific for hepatotoxicity, scoring R-value for hepatocellular vs cholestatic pattern).
5. "What is the one thing a case report can do that no RCT can?" It can describe a clinical phenomenon in a single real patient at the bedside - including rare, unexpected, first-ever, or idiosyncratic events that would never be captured in an RCT's pre-specified endpoints, and in populations (pregnant women, neonates, multi-morbid elderly patients on polypharmacy) that are systematically excluded from trials. This is its unique and irreplaceable role in pharmacovigilance and pharmacological knowledge generation.

QUICK REFERENCE SUMMARY

AspectKey Point
Evidence levelLowest (Level V); hypothesis-generating only
Reporting guidelineCARE checklist (13 items, 2013/2017)
Quality appraisalJBI Case Report Checklist (8 items)
Causality toolsNaranjo Algorithm + WHO-UMC Criteria
Naranjo categoriesDefinite ≥9, Probable 5-8, Possible 1-4, Doubtful ≤0
WHO-UMC categoriesCertain, Probable, Possible, Unlikely, Conditional, Unclassifiable
Most critical elementTemporal relationship (exposure must precede event)
Strongest causality evidencePositive rechallenge
Most common causality category in practiceProbable (rechallenge ethically unjustifiable)
Unique pharmacology valueFirst signal of novel ADR, DDI, rare event, new population
India's PV systemPvPI (Pharmacovigilance Programme of India); NCC at IPC Ghaziabad
Key ethical requirementInformed consent for publication

This set covers all domains an MD Pharmacology examiner will probe in a critical appraisal viva for case reports - from CARE guidelines and causality assessment tools through pharmacovigilance systems, ADR classification, DDIs, ethics, and the unique role of case reports in the pharmacological evidence ecosystem.

viva questions with answers for the topic RESEARCH METHODOLOGY for MD Pharmacology exam

Searching the Web

research methodology viva questions MD Pharmacology hypothesis study design ethics ICMR GCP Declaration Helsinki

Searching the Web

research methodology biostatistics scales measurement sample size type I II error MD postgraduate pharmacology exam India

Excellent. Here is the complete, exam-focused viva Q&A set:

Viva Questions & Answers: Research Methodology

MD Pharmacology Exam Preparation


SECTION A: Fundamentals of Research

Q1. What is research? What are the objectives of biomedical research?
Research is a systematic, objective, and organized process of gathering, analyzing, and interpreting information to increase understanding of a topic or problem.
Objectives of biomedical research:
  1. Basic/fundamental research: Understand mechanisms of disease or drug action (e.g., receptor pharmacology, signal transduction)
  2. Applied/translational research: Convert basic science findings into clinical applications ("bench to bedside")
  3. Clinical research: Test interventions in human subjects to assess safety, efficacy, and effectiveness
  4. Epidemiological/public health research: Understand disease distribution, risk factors, and population-level interventions
  5. Health systems research: Evaluate delivery, access, quality, and cost of healthcare
  6. Pharmacovigilance research: Monitor drug safety in real-world populations post-marketing

Q2. What is the difference between basic, clinical, translational, and operational research?
TypeFocusExample in Pharmacology
Basic researchMechanisms, molecular/cellular levelCharacterizing a new drug receptor
Applied/translational researchApplying basic findings to clinical problemsPhase I/II trials of a new molecule
Clinical researchTesting in humans; efficacy and safetyPhase III RCT of a new antihypertensive
Epidemiological researchDistribution and determinants of diseaseCohort study of drug-induced hepatotoxicity
Operational/health systems researchImplementation and delivery of interventionsDrug utilization study in a district hospital

Q3. Define a research question. What makes a good research question?
A research question is a specific, focused, answerable question that a study is designed to address.
A good research question should fulfill the FINER criteria:
LetterCriterionMeaning
FFeasibleAdequate sample, resources, time, expertise available
IInterestingEngages the investigator and scientific community
NNovelConfirms, refutes, or extends prior knowledge; not already answered
EEthicalCan be conducted ethically with acceptable risk-benefit ratio
RRelevantImportant to clinical practice, public health, or scientific knowledge
It should also be structured using PICO/PICOS (Population, Intervention, Comparison, Outcome, Study design).

Q4. What is a hypothesis? Distinguish between the null hypothesis and the alternative hypothesis.
A hypothesis is a testable, specific, predictive statement about the relationship between two or more variables.
Null Hypothesis (H₀)Alternative Hypothesis (H₁ or Hₐ)
DefinitionStates there is NO effect, no difference, or no association between the variablesStates there IS an effect, difference, or association
RoleWhat the statistical test tries to disproveWhat the investigator believes/hopes to demonstrate
Example"Drug A does not reduce blood pressure compared to placebo""Drug A reduces blood pressure compared to placebo"
Statistical testTests the probability of the observed data IF H₀ were trueAccepted when H₀ is rejected
DirectionAlways non-directionalCan be directional (one-tailed) or non-directional (two-tailed)
One-tailed vs two-tailed hypothesis:
  • Two-tailed (non-directional): Drug A differs from placebo (either increases or decreases BP) - used when direction is not predicted; requires smaller observed difference to reject H₀ but is less powerful
  • One-tailed (directional): Drug A reduces BP compared to placebo - used when direction is specified; requires less extreme data to be significant in that direction but cannot detect effects in the other direction

SECTION B: Study Design

Q5. What is the classification of study designs?
STUDY DESIGNS
├── EXPERIMENTAL (Investigator allocates intervention)
│   ├── Randomized Controlled Trial (RCT)
│   │   ├── Parallel group
│   │   ├── Crossover
│   │   ├── Factorial
│   │   └── Cluster randomized
│   └── Non-randomized / Quasi-experimental
│       ├── Before-after study
│       └── Non-randomized controlled trial
│
└── OBSERVATIONAL (No intervention by investigator)
    ├── Analytical (test hypotheses)
    │   ├── Cohort (prospective / retrospective)
    │   ├── Case-control
    │   └── Cross-sectional
    └── Descriptive (generate hypotheses)
        ├── Case report
        ├── Case series
        └── Ecological / correlational study
Also: Systematic Reviews and Meta-analyses (secondary research synthesizing primary studies).

Q6. How do you select the appropriate study design for a research question?
Selection depends on:
FactorConsideration
Research question typeEtiology/causation → cohort or case-control; Efficacy → RCT; Prevalence → cross-sectional
Outcome frequencyRare outcome → case-control; common outcome → cohort or RCT
EthicsCannot randomize to a harmful exposure → observational only
Time and resourcesQuick/cheap → cross-sectional or retrospective cohort; gold standard → RCT
Available evidenceEarly stage/hypothesis generation → case reports, cross-sectional; confirmation → RCT
Temporality neededCausality requires prospective design (cohort/RCT)
Mnemonic for matching design to question:
  • Diagnosis: Cross-sectional / cohort
  • Etiology: Case-control (rare disease) / cohort (rare exposure)
  • Therapy: RCT (gold standard)
  • Prognosis: Cohort (prospective)
  • Prevention: RCT or cohort

Q7. What is a pilot study? When is it done and what are its uses?
A pilot study is a small-scale preliminary study conducted before the main study to test and refine study procedures.
Uses:
  1. Estimate variance/SD of the primary outcome (needed for sample size calculation)
  2. Test feasibility of recruitment and data collection
  3. Identify problems with inclusion/exclusion criteria
  4. Test the questionnaire/data collection tool for clarity and acceptability
  5. Estimate dropout/attrition rate for adjustment in final sample size
  6. Train research staff
  7. Identify unforeseen logistical problems
Typically 10-30 participants or 10% of the planned final sample size.

SECTION C: Ethics in Research

Q8. What are the four basic ethical principles governing biomedical research?
Based on the Belmont Report (1979) and adopted by ICMR:
PrincipleMeaningApplication
Respect for persons (Autonomy)Individuals have the right to make their own decisions; those with diminished autonomy must be protectedInformed consent; special protections for vulnerable populations
BeneficenceDo good; maximize benefits and minimize harmsRisk-benefit analysis before study approval
Non-maleficenceDo no harmStopping a study if harm is detected (DSMB); not exposing participants to unacceptable risk
JusticeFair distribution of benefits and burdens of research; equitable selection of participantsDo not exploit vulnerable populations; include minorities and women

Q9. What is the Declaration of Helsinki? What are its key principles?
The Declaration of Helsinki (DoH) is the cornerstone ethical document for human research, developed by the World Medical Association (WMA) in 1964 in Helsinki, Finland. It has undergone 8 revisions (most recent: 2024, adding digital/AI considerations).
Key principles:
  1. The interests of the individual research subject must take precedence over the interests of science and society
  2. Medical research must conform to generally accepted scientific principles and be based on thorough knowledge of the scientific literature
  3. Research involving human subjects must be conducted only by scientifically qualified persons
  4. The study must be approved by an independent Ethics Committee (EC) / Institutional Review Board (IRB)
  5. Informed consent is mandatory; participants must be voluntary and free to withdraw at any time without penalty
  6. Risks must be assessed and be justified by potential benefits
  7. Vulnerable populations (children, prisoners, pregnant women, mentally incapacitated) require special protection
  8. Placebo-controlled trials are justified only where no proven intervention exists, or where for compelling methodological reasons; but patients must receive best available treatment at study end
  9. Results must be published - including negative and inconclusive findings (combating publication bias)
  10. The physician's duty to the patient takes precedence over the needs of research

Q10. What are the ICMR ethical guidelines for biomedical research in India?
The ICMR (Indian Council of Medical Research) National Ethical Guidelines for Biomedical and Health Research Involving Human Participants (2017) govern all human research in India.
Key requirements:
RequirementDetail
Ethics Committee registrationAll IECs (Institutional Ethics Committees) must be registered with CDSCO under New Drugs and Clinical Trials Rules 2019
Informed consentWritten, in participant's language; capacity assessed; voluntary; right to withdraw
Vulnerable populationsAdditional safeguards for children (<18 years), pregnant women, prisoners, tribal communities, students, employees
Benefit sharingResearch benefits should flow back to communities studied
Post-trial accessParticipants should have access to beneficial interventions identified in the trial
Clinical trial registrationAll trials must be registered on CTRI (Clinical Trials Registry of India) before enrollment
Data sharingPromotes open data sharing while protecting privacy
CompensationFor study-related injury; not coercive incentives

Q11. What is Informed Consent? What are its essential elements?
Informed consent is the process by which a potential research participant voluntarily confirms willingness to participate after being provided with relevant information in a language they understand.
It is a process, not just a signature.
Essential elements (as per ICH-GCP E6 and ICMR):
  1. Disclosure: Nature, purpose, duration, procedures, experimental aspects of the study
  2. Risks and benefits: Foreseeable risks, discomforts, and anticipated benefits
  3. Alternatives: Other available treatments outside the study
  4. Confidentiality: How personal data will be protected
  5. Voluntariness: Participation is voluntary; refusal or withdrawal will not affect care
  6. Contact information: Whom to contact for questions about research or rights
  7. Compensation: For participation and for study-related injury
  8. Right to withdraw: At any time without penalty
  9. Trial registration number
  10. Comprehension: Must be ensured; not just signing a form
Waiver of consent: May be granted by IEC for minimal-risk retrospective record reviews, emergency research (when consent cannot be obtained), or public health surveillance.

Q12. What is Good Clinical Practice (GCP)?
GCP (Good Clinical Practice) is an international ethical and scientific quality standard for designing, conducting, recording, and reporting clinical trials that involve the participation of human subjects (ICH-GCP E6, first harmonized in 1996; updated 2016/2024).
Purpose: To ensure trial data are credible, and the rights, safety, and well-being of participants are protected.
Key principles of ICH-GCP:
  1. Consistent with Declaration of Helsinki
  2. Foreseeable risks justified by anticipated benefits
  3. Participants' rights, safety, and well-being take priority over science/society interests
  4. Non-clinical and clinical information adequate to support the proposed trial
  5. Protocol scientifically sound and clearly described
  6. Medical care and decisions made by qualified physician/dentist
  7. Each individual involved in the trial is qualified for their function
  8. Freely given informed consent prior to participation
  9. All trial information should be recorded, handled, and stored in a way that allows accurate reporting, interpretation, and verification
  10. Confidentiality of records protected per applicable regulations
  11. Investigational products manufactured, handled, and stored per GMP
  12. System with procedures ensuring quality at every step

Q13. What is an Institutional Ethics Committee (IEC) / IRB? What is its composition?
An IEC (Institutional Ethics Committee) or IRB (Institutional Review Board) is an independent body that reviews, approves, and monitors biomedical research involving human participants to ensure ethical conduct and participant protection.
Functions: Protocol review; risk-benefit assessment; informed consent document review; continuing review; safety monitoring oversight.
Composition (as per CDSCO/ICMR guidelines for India):
MemberMinimum requirement
ChairpersonSenior researcher; not from the same institution ideally
Basic medical/non-clinical scientist1
Clinician1
Legal expert / Jurist1
Social scientist / Philosopher / Ethicist1
Lay person / Community representative1
Patient/participant advocate1
Member Secretary1
Minimum size7 members
External/non-institutional membersAt least 50% should have no affiliation with the institution
Quorum requirement: A fixed quorum must be present for valid decisions; any member with a conflict of interest in a specific protocol must recuse themselves.

Q14. What is a Data Safety Monitoring Board (DSMB) / Data Monitoring Committee (DMC)?
A DSMB is an independent group of experts (clinicians, statisticians, ethicists) that periodically reviews accumulating safety and efficacy data from an ongoing trial to protect participant safety and ensure trial integrity.
Functions:
  • Review unblinded interim data at pre-specified intervals
  • Recommend trial continuation, modification, or stopping (for benefit, harm, or futility)
  • Ensure the trial does not expose participants to unacceptable risk
  • May recommend early stopping rules (O'Brien-Fleming boundaries, Haybittle-Peto rule)
Mandatory for: All Phase II-III trials; trials in vulnerable populations; trials with serious adverse event potential.

SECTION D: Sampling

Q15. What is sampling? What is the difference between a population and a sample?
  • Population (universe): The entire group of individuals about whom conclusions are to be drawn (e.g., all patients with hypertension in India)
  • Sample: A subset of the population selected for study to make inferences about the population
  • Sampling: The process of selecting a sample from the population
Why sample rather than study the entire population?
  • Population is too large to study completely (impractical)
  • Saves time and cost
  • Enables more intensive data collection on each subject
  • Destructive tests require sampling (e.g., drug potency testing destroys the tablet)

Q16. What are the types of sampling? Explain each briefly.
PROBABILITY SAMPLING (each unit has a known, non-zero chance of selection - preferred for inferential statistics):
MethodDescriptionWhen Used
Simple Random Sampling (SRS)Each member has an equal chance of selection; random number table or computer-generated numbersSmall, accessible, homogeneous populations
Systematic Random SamplingSelect every kth element (k = N/n) after a random startOrdered lists; efficient for large populations
Stratified Random SamplingPopulation divided into mutually exclusive strata; random sample from each stratumHeterogeneous population; ensures subgroup representation
Cluster SamplingPopulation divided into clusters (e.g., villages, wards); entire clusters randomly selectedLarge geographically dispersed populations; cheaper
Multi-stage SamplingSampling in successive stages (e.g., districts → hospitals → wards → patients)National surveys; complex populations
NON-PROBABILITY SAMPLING (selection not random; cannot generalize statistically; used when probability sampling is not feasible):
MethodDescription
Convenience samplingSelect who is easily available (e.g., walk-in clinic patients) - most common but most biased
Purposive/Judgemental samplingResearcher deliberately selects "information-rich" cases
Snowball samplingParticipants recruit other participants; used for hidden/hard-to-reach populations
Quota samplingNon-random selection until quota in each category filled

Q17. What is sampling error vs. non-sampling error?
Sampling ErrorNon-Sampling Error
DefinitionDifference between sample statistic and true population parameter due to chance variation in sample selectionErrors arising from sources OTHER than the sampling process
Can be reduced byIncreasing sample size; probability samplingProper study design, training, standardization
TypesRandom error; standard errorMeasurement error, observer bias, data entry errors, non-response bias
Quantified byStandard error (SE = SD/√n)Not directly quantifiable

SECTION E: Measurement Scales

Q18. Describe the four scales of measurement. Give pharmacology examples for each.
ScalePropertiesMathematical operationsPharmacology example
NominalCategories only; no order; no arithmetic meaningCount, frequency, modeBlood group (A/B/AB/O); sex; drug class (NSAID/opioid/antibiotic); ADR type (Type A/B)
OrdinalCategories with a meaningful order; intervals NOT equalMedian, mode; rank-order testsPain scale (Mild/Moderate/Severe); WHO performance status; Likert scale; sedation score
IntervalEqual intervals between values; NO true zeroMean, SD; parametric testsTemperature in °C; IQ score; calendar year
RatioEqual intervals; TRUE zero (zero means absence)All arithmetic; geometric meanDrug dose (mg); blood pressure (mmHg); weight (kg); drug concentration (μg/mL)
Memory aid: NOIR (Nominal, Ordinal, Interval, Ratio) - each level has all properties of the previous plus one more.

Q19. What is the difference between continuous and discrete (categorical) variables?
Continuous VariableDiscrete/Categorical Variable
DefinitionCan take any value within a range (infinite possible values)Takes only specific, separate values
Sub-typesRatio scale, interval scaleNominal (no order), ordinal (ordered)
ExamplesBlood glucose (mg/dL), blood pressure, serum creatinine, drug CmaxSex (male/female); drug response (responder/non-responder); NYHA class
Summary statisticsMean ± SD (normally distributed); median, IQR (skewed)Frequency, percentage
Appropriate testst-test, ANOVA (parametric); Mann-Whitney, Kruskal-Wallis (non-parametric)Chi-square, Fisher's exact; McNemar

SECTION F: Biostatistics

Q20. What is the difference between descriptive and inferential statistics?
Descriptive StatisticsInferential Statistics
PurposeSummarize and describe the data from the sampleDraw conclusions about the population from the sample
OutputMean, median, mode, SD, range, IQR, frequency tables, graphsp-values, confidence intervals, regression coefficients
GeneralizationNo; describes only the sampleYes; makes population-level inferences
ExamplesMean age of participants = 45 ± 12 yearsThe drug reduced SBP by 8 mmHg (95% CI: 4-12), p = 0.002

Q21. What are measures of central tendency and dispersion? When is each appropriate?
Measures of Central Tendency:
MeasureDefinitionWhen to use
MeanSum of all values / number of valuesNormally distributed continuous data
MedianMiddle value of ordered dataSkewed data; ordinal data
ModeMost frequently occurring valueCategorical (nominal) data; bimodal distributions
Measures of Dispersion:
MeasureDefinitionWhen to use
Standard Deviation (SD)Average deviation from the meanNormally distributed data; shows spread in original units
VarianceSD²Basis for many statistical tests
RangeMaximum - MinimumQuick summary; sensitive to outliers
Interquartile Range (IQR)75th percentile - 25th percentileSkewed data; resistant to outliers; accompanies median
Standard Error (SE)SD/√nPrecision of the sample mean as an estimate of population mean; used in CIs
Coefficient of Variation (CV)(SD/Mean) × 100%Comparing variability across different units or scales

Q22. What is a normal (Gaussian) distribution? What are its properties?
A normal distribution is a symmetrical, bell-shaped frequency distribution of continuous data where:
  • Mean = Median = Mode (all equal)
  • Symmetrical about the mean
  • Described completely by two parameters: mean (μ) and SD (σ)
Key properties (empirical rule / 68-95-99.7 rule):
  • Mean ± 1 SD contains ~68% of observations
  • Mean ± 2 SD contains ~95% of observations
  • Mean ± 3 SD contains ~99.7% of observations
How to test for normality:
  • Histogram (visual) - should be bell-shaped
  • Q-Q (quantile-quantile) plot - should be linear
  • Shapiro-Wilk test (most powerful; best for small samples, n < 50)
  • Kolmogorov-Smirnov test (large samples)
  • Skewness and kurtosis values (|skewness| < 2, |kurtosis| < 7 = approximately normal)

Q23. What is a p-value? What are Type I and Type II errors?
p-value: The probability of obtaining the observed result (or more extreme) if the null hypothesis were true. Conventional threshold: p < 0.05 (5%).
Reality: H₀ TrueReality: H₀ False
Decision: Reject H₀Type I Error (α) = False PositiveCorrect (Power = 1-β)
Decision: Fail to Reject H₀Correct (Confidence = 1-α)Type II Error (β) = False Negative
ErrorSymbolAlso calledConventional rateConsequence
Type IαFalse positive0.05Adopting an ineffective treatment
Type IIβFalse negative0.20Rejecting an effective treatment
Power1-βSensitivity of the study0.80-0.90Ability to detect true effect
Examiner trick: "Which error is more serious?" - Depends on context. In drug safety (detecting a harmful ADR), Type II error (missing a real harm) is more dangerous. In efficacy trials, Type I error (falsely claiming efficacy) may be more serious. In pharmacology, Type II error in discovering a new active compound means the compound may never be tried again.

Q24. What is statistical power? How does it relate to sample size?
Power = 1 - β = probability of correctly rejecting H₀ when H₁ is true (i.e., detecting a true effect when it exists).
Power depends on:
  1. α (significance level): Lower α → lower power
  2. Effect size (δ): Larger effect → higher power
  3. Sample size (n): Larger n → higher power
  4. Variability (SD): Lower SD → higher power
Relationship: Power and sample size are directly proportional. To increase power, increase sample size, increase effect size (choose a clinically meaningful minimum detectable difference), lower variability, or increase α.

Q25. How is sample size calculated in a clinical study? What inputs are needed?
For a two-sample comparison of means (parallel RCT):
n = 2 × [(Zα/2 + Zβ)² × σ²] / δ²
where:
  • Zα/2 = Z-value for Type I error (1.96 for α = 0.05, two-tailed)
  • Zβ = Z-value for Type II error (0.84 for 80% power; 1.28 for 90% power)
  • σ = expected standard deviation of the outcome
  • δ = minimum clinically important difference (effect size)
Inputs required:
  1. α (significance level): Usually 0.05
  2. Power (1-β): Usually 80% or 90%
  3. Effect size (δ): Minimum clinically meaningful difference - obtained from pilot data or literature
  4. Variability (SD): From prior studies or pilot
  5. Study design: Parallel, crossover (crossover needs smaller n), matching ratio in case-control
  6. Type of outcome: Continuous (t-test formula), binary/dichotomous (proportions formula), time-to-event (log-rank formula)
  7. Anticipated dropout/attrition: Inflate sample size by n/(1 - dropout proportion)
  8. Number of comparison groups
  9. One-tailed vs. two-tailed test
  10. Multiple comparison correction (if applicable)
Formula for binary outcomes:
n = [Zα/2√(2P̄Q̄) + Zβ√(P₁Q₁ + P₂Q₂)]² / (P₁ - P₂)²
where P₁, P₂ = expected event proportions in the two groups; P̄ = (P₁+P₂)/2; Q = 1-P.

Q26. What is the difference between parametric and non-parametric tests? Give examples.
FeatureParametric TestsNon-parametric Tests
AssumptionData normally distributed; homogeneity of varianceNo distributional assumptions
Data typeContinuous (interval/ratio), normally distributedOrdinal; non-normally distributed continuous; small samples
PowerMore powerful when assumptions metLess powerful but valid regardless of distribution
Examplest-test, ANOVA, Pearson correlation, linear regressionMann-Whitney U, Wilcoxon signed-rank, Kruskal-Wallis, Friedman, Spearman correlation, Chi-square
When to use non-parametric tests:
  • Data is ordinal (pain scores, Likert scales)
  • Distribution is heavily skewed
  • Small sample size (n < 30 and non-normal)
  • Presence of outliers that cannot be removed

Q27. Which statistical test do you use for each situation?
SituationTest
Compare means of 2 independent groups, normal distributionIndependent samples t-test
Compare means of 2 paired/matched groups, normalPaired t-test
Compare means of ≥3 independent groups, normalOne-way ANOVA
Post-hoc after ANOVA (which pairs differ?)Tukey's HSD, Bonferroni, Scheffé
Compare 2 independent groups, non-normal or ordinalMann-Whitney U test
Compare 2 paired groups, non-normal or ordinalWilcoxon signed-rank test
Compare ≥3 independent groups, non-normalKruskal-Wallis test
Compare ≥3 paired groups, non-normalFriedman test
Compare proportions between 2 independent groupsChi-square test
Chi-square when expected cell count < 5Fisher's exact test
Compare proportions in matched/paired groupsMcNemar's test
Correlation between 2 continuous normal variablesPearson's r
Correlation between 2 ordinal/non-normal variablesSpearman's rho
Predict continuous outcome from ≥1 variablesMultiple linear regression
Predict binary outcome from ≥1 variablesLogistic regression
Time-to-event (survival) data, compare 2 groupsLog-rank (Mantel-Cox) test
Time-to-event, adjusting for multiple covariatesCox proportional hazards regression
Agreement between two raters (categorical)Cohen's Kappa
Agreement between two methods (continuous)Bland-Altman plot; Intraclass correlation coefficient (ICC)

Q28. What is the difference between correlation and regression?
CorrelationRegression
PurposeMeasures the strength and direction of association between two variablesModels the relationship; predicts outcome from predictor(s)
OutputCorrelation coefficient (r or ρ): -1 to +1Regression equation: Y = a + bX (+ error)
DirectionSymmetric (X correlates with Y = Y correlates with X)Asymmetric (X predicts Y; cannot reverse without re-analysis)
Output interpretationr = 0: no correlation; r = ±1: perfect correlationRegression coefficient (b) = change in Y per unit change in X
TypesPearson (parametric); Spearman (non-parametric)Linear (continuous Y); logistic (binary Y); Cox (survival)
r² (coefficient of determination): The proportion of variance in Y explained by X. e.g., r = 0.7 → r² = 0.49 → 49% of variance in Y is explained by X.

SECTION G: Validity and Reliability

Q29. What is validity? What are the types of validity in research?
Validity is the extent to which a study measures what it is intended to measure and produces results that accurately reflect reality.
TypeDefinition
Internal validityThe degree to which observed results are due to the study intervention and not to other factors (confounding, bias). "Did the study design and conduct support the conclusions?"
External validity (Generalizability)The degree to which study results apply to other populations, settings, and times. "Can results be applied to my patients?"
Content validityThe measurement tool covers all relevant aspects of the construct being measured
Construct validityThe tool actually measures the theoretical construct it is intended to measure
Criterion validity (concurrent + predictive)Concurrent: tool agrees with a gold standard measured simultaneously. Predictive: tool predicts a future criterion.
Face validityThe tool appears to measure what it claims on the surface (expert judgment)

Q30. What is reliability? How is it measured?
Reliability is the consistency or reproducibility of a measurement - the extent to which the same result is obtained when the measurement is repeated under the same conditions.
TypeDefinitionMeasure
Test-retest reliabilitySame results when test repeated at different times on the same subjectsPearson r or ICC
Inter-rater reliabilityAgreement between different raters/observers measuring the same thingCohen's Kappa (κ); ICC
Intra-rater reliabilitySame rater produces same results at different timesKappa; ICC
Internal consistencyItems in a questionnaire all measure the same constructCronbach's alpha (α ≥ 0.70 acceptable; ≥ 0.80 good)
Relationship between validity and reliability:
  • A test can be reliable without being valid (consistently wrong)
  • A test cannot be valid without being reliable (validity requires consistency)
  • Reliability is necessary but not sufficient for validity

Q31. What is the difference between accuracy and precision?
AccuracyPrecision
DefinitionHow close a measurement is to the true value (absence of systematic error)How reproducible a measurement is (absence of random error)
Related toValidity; systematic biasReliability; random error
AnalogyHitting the bullseye (correct target)Hitting the same spot repeatedly (consistent)
Improved byCalibrating instruments; removing biasIncreasing sample size; standardizing technique

SECTION H: Variables and Data

Q32. What is the difference between independent, dependent, and confounding variables?
VariableDefinitionExample in pharmacology
Independent (explanatory, predictor)Variable the researcher manipulates or uses to predict outcomesDrug treatment group (Drug A vs placebo)
Dependent (outcome, response)Variable that is measured; the outcome of interestSystolic blood pressure reduction
ConfoundingAssociated with both independent and dependent; distorts apparent relationshipAge, sex, comorbidities (may differ between treatment groups and independently affect BP)
Effect modifier (moderator)Changes the magnitude of the association between independent and dependentCYP2D6 genotype (modifies drug metabolism and hence response)
MediatingOn the causal pathway between independent and dependentDrug → ↑ NO production → vasodilation → ↓BP (NO is the mediator)

Q33. What is an outcome measure? Differentiate primary, secondary, and surrogate outcomes.
TypeDefinitionExample
Primary outcomeThe main outcome the study is designed and powered to detect; pre-specifiedMACE (major adverse cardiovascular events) at 5 years in a cardiovascular outcomes trial
Secondary outcomeAdditional outcomes of interest; study not specifically powered for theseIndividual components of MACE; quality of life; healthcare costs
Exploratory outcomeHypothesis-generating; not pre-specified; analyzed post-hocSubgroup analyses; biomarker changes
Surrogate outcomeProxy measure used in place of a definitive clinical endpointHbA1c (surrogate for diabetic complications); LDL-C (surrogate for cardiovascular events); BP (surrogate for stroke/MI)
Concerns with surrogates: The surrogate may not accurately predict the clinical outcome. A drug can improve a surrogate without improving clinical outcomes (e.g., CAST trial: class IC antiarrhythmics reduced PVCs but increased mortality; rosiglitazone lowered HbA1c but may increase cardiovascular events).

SECTION I: Research Protocol

Q34. What is a research protocol? What are its essential components?
A research protocol is the detailed, pre-specified plan for conducting a study. It is the contract between the investigator, sponsor, ethics committee, and regulatory authority.
Essential components (as per ICH-GCP E6 and ICMR):
  1. Title and trial identification (protocol number, version, date)
  2. Background and rationale (why this study is needed; gap in evidence)
  3. Research question and objectives (primary and secondary objectives)
  4. Hypotheses (null and alternative)
  5. Study design (type, phase, randomization, blinding)
  6. Study population: Inclusion criteria; exclusion criteria; sample size with justification
  7. Intervention: Drug name, dose, route, frequency, duration, formulation
  8. Comparator: Placebo or active control; justification
  9. Randomization and allocation concealment methods
  10. Blinding procedures
  11. Outcome measures: Primary, secondary; definitions; measurement methods; timing
  12. Data collection tools (CRFs, questionnaires)
  13. Statistical analysis plan (SAP): Tests to be used; handling of missing data; subgroup analyses
  14. Ethical considerations: IEC approval; informed consent procedure; benefits and risks; insurance/indemnity
  15. Timeline and milestones
  16. Budget and funding sources
  17. References

Q35. What is a CRF (Case Record Form / Case Report Form)?
A CRF is a printed, optical, or electronic document designed to record all protocol-required information about each trial participant. It is the primary document for data collection in a clinical trial.
Key principles:
  • All CRF entries must be traceable to source documents (medical records, lab reports)
  • Corrections must be made with a single line through the error (not obliteration), with the corrector's initials and date
  • No blank fields (use "N/A" or "Not done" as appropriate)
  • Electronic CRFs (eCRFs) have built-in validation and audit trails

Q36. What is the difference between a protocol and a standard operating procedure (SOP)?
ProtocolSOP
ScopeStudy-specific; governs one trialGeneral; governs procedures across all studies
ContentRationale, objectives, design, analysis for that specific studyStep-by-step instructions for a specific procedure (e.g., how to obtain informed consent; how to randomize; how to report an SAE)
ChangesProtocol amendments require IEC and regulatory approvalSOP revisions follow version control within the institution
ExampleProtocol for a Phase III trial of Drug XSOP for administering study drug; SOP for blood sample processing

SECTION J: Indian Regulatory Context

Q37. What is the regulatory framework for clinical trials in India?
RegulationDetails
Drugs and Cosmetics Act, 1940Primary legislation governing drugs in India
Drugs and Cosmetics Rules, 1945, Schedule YDefines requirements for clinical trials; phases; data requirements for new drug approval
New Drugs and Clinical Trials Rules, 2019 (replaced Schedule Y)Comprehensive; defines new drugs, clinical trials, academic clinical trials, bioequivalence studies; IEC registration mandatory; audio-visual consent for vulnerable populations
ICMR National Ethical Guidelines 2017Ethical conduct of biomedical research
CDSCO (Central Drugs Standard Control Organisation)National regulatory authority; equivalent to FDA of India
DCGI (Drugs Controller General of India)Head of CDSCO; approves clinical trial applications
CTRI (Clinical Trials Registry of India)Mandatory prospective registration of all clinical trials before enrollment; managed by ICMR (NIIH); publicly accessible at ctri.nic.in

Q38. What are the phases of clinical drug development? Summarize each.
PhasePopulationPurposen (approx.)
PreclinicalAnimal/in vitroSafety, pharmacology, toxicology before human exposure-
Phase IHealthy volunteers (occasionally patients for oncology/toxicology)Safety, tolerability, pharmacokinetics, pharmacodynamics; establish MTD20-80
Phase II (IIa/IIb)Patients (target disease)Preliminary efficacy; dose-finding; further safety100-300
Phase IIIPatients; multi-center; randomizedConfirm efficacy; assess safety; compare to standard treatment; basis for regulatory approval300-3,000+
Phase IVPost-marketing; general populationPost-marketing surveillance; rare ADRs; new populations; long-term safety; drug interactions; health economicsThousands
Phase IIa: Dose exploration; Phase IIb: Dose confirmation.
Accelerated approval pathways: Fast Track (FDA), Breakthrough Therapy, Priority Review; India's New Drug Rules 2019 allow expedited review for unmet medical needs.

Q39. What is a Drug Utilization Study (DUS)? What are its types?
A Drug Utilization Study (DUS) is the study of the marketing, distribution, prescription, and use of drugs in a society, with special emphasis on the resulting medical, social, and economic consequences (WHO, 1977).
Types:
  1. Quantitative DUS: How much of a drug is used? Uses Defined Daily Dose (DDD) per 1000 inhabitants per day as the unit
  2. Qualitative DUS: Is the drug used appropriately? Compare against standard treatment guidelines
  3. Drug Prescribing Indicators (WHO): Average number of drugs per prescription; % prescriptions with antibiotics; % prescriptions with injections; % drugs prescribed by generic name; % drugs from Essential Medicines List
  4. Prescription Event Monitoring (PEM): Cohort-based; follow-up of all patients prescribed a new drug
DDD (Defined Daily Dose): The assumed average maintenance dose per day for a drug used for its main indication in adults. Set by WHO Collaborating Centre for Drug Statistics Methodology, Oslo. DDD is a statistical, not prescribing, unit.

SECTION K: Scales, Tools & Reporting

Q40. What is a Likert scale? What type of data does it produce?
A Likert scale is a psychometric rating scale where respondents indicate their level of agreement/disagreement on a symmetric agree-disagree scale (typically 5 or 7 points):
e.g., 1 = Strongly disagree; 2 = Disagree; 3 = Neutral; 4 = Agree; 5 = Strongly agree
Data type: Ordinal (not interval - the difference between "strongly disagree" and "disagree" may not equal the difference between "agree" and "strongly agree"). Strictly, each individual Likert item produces ordinal data; a summated Likert scale (total of multiple items) is often treated as approximately interval.
Analysis: Median and IQR (individual items); mean ± SD if treating summated scale as interval; Mann-Whitney or Kruskal-Wallis for comparisons.

Q41. What are VAS and NRS for pain assessment? What type of data do they produce?
ScaleDescriptionData type
VAS (Visual Analogue Scale)100 mm horizontal line; patient marks point between "no pain" (0mm) and "worst imaginable pain" (100mm); score = distance in mm from 0Approximately continuous (ratio); can use parametric tests
NRS (Numeric Rating Scale)Patient rates pain from 0 to 10 in whole numbersOrdinal (but commonly treated as interval in practice)
VRS (Verbal Rating Scale)"None / Mild / Moderate / Severe"Ordinal
Minimum clinically important difference (MCID) for pain: 13mm on VAS or 1.5 points on NRS is generally accepted as a clinically meaningful change.

SECTION L: Rapid-Fire Questions

Q42. What is a pilot study vs. a feasibility study? A feasibility study determines whether a full study can and should be conducted (broad "can we do this?"). A pilot study specifically tests and refines the study procedures on a small scale before the main study ("how well do the procedures work?"). All pilot studies are feasibility studies but not vice versa.
Q43. What is the difference between efficacy and effectiveness?
  • Efficacy: Does the intervention work under ideal, controlled conditions? (Explanatory RCT)
  • Effectiveness: Does the intervention work in real-world clinical practice? (Pragmatic RCT, observational study)
Q44. What is a surrogate endpoint? Give an example of a surrogate that failed. A surrogate is a proxy for a clinical endpoint (see Q33). Classic failure: Class I/IC antiarrhythmics (encainide, flecainide) in the CAST trial - they suppressed PVCs (the surrogate) but increased mortality (the true clinical endpoint).
Q45. What is multiplicity in research? Testing multiple outcomes or multiple subgroups in the same dataset inflates the Type I error rate. Correction methods: Bonferroni correction (α/k, where k = number of comparisons); Holm-Bonferroni; pre-specify primary outcome; limit subgroup analyses.
Q46. What is data dredging (p-hacking)? Post-hoc manipulation of data analysis (testing multiple outcomes, subgroups, or statistical methods until p < 0.05 is achieved) to find statistically significant results. Leads to spurious findings. Prevented by pre-registration of protocols, pre-specified analysis plans, and transparent reporting.
Q47. What is a protocol deviation vs. a protocol violation?
  • Protocol deviation: Minor departure from the protocol; does not affect participant safety or data integrity
  • Protocol violation: Major breach that significantly affects participant rights, safety, or data integrity; must be reported to IEC/sponsor
Q48. What is a SAE (Serious Adverse Event)? Any adverse event that:
  • Results in death
  • Is life-threatening
  • Requires inpatient hospitalization or prolongation of hospitalization
  • Results in persistent significant disability/incapacity
  • Is a congenital anomaly/birth defect
  • Is otherwise medically significant
SAEs must be reported to the sponsor and IEC within 24 hours for fatal/life-threatening events, and 15 days for others (Indian NDC Rules 2019).
Q49. What is an audit trail in a clinical trial? A secure, time-stamped record of all changes to electronic study data, showing what was changed, who changed it, when, and why. Required by GCP and FDA 21 CFR Part 11 for electronic records. Allows reconstruction of the complete history of data collection and modification.
Q50. What is the difference between blinded and open-label trials? In a blinded trial, one or more parties (participant, investigator, outcome assessor) are unaware of treatment allocation. In an open-label trial, all parties know the treatment. Open-label is used when blinding is not feasible (e.g., surgical vs. medical treatment, lifestyle interventions).

SECTION M: Examiner's Favourite Trick Questions

1. "What is more important: p-value or confidence interval?" The confidence interval is more informative. A p-value is binary (significant/non-significant) and gives no information about the size of the effect. A CI provides both statistical significance (does it cross the null?) AND the magnitude and precision of the effect. CONSORT, BMJ, and most major journals now require CIs as primary reporting of results.
2. "Can a study with p = 0.049 be trusted more than one with p = 0.051?" No. Treating p = 0.05 as a bright line is a methodological error (the "cliff effect"). Both values represent essentially the same strength of evidence against H₀. Many statisticians and the American Statistical Association (2019 statement) advocate abandoning the single p < 0.05 threshold and focusing on effect size, CI, and clinical judgment.
3. "What does it mean to say a study is 'adequately powered'?" A study is adequately powered if its sample size is large enough to detect the minimum clinically important difference with a specified probability (usually 80% or 90% power) at a given significance level (usually α = 0.05). A study with too small a sample (underpowered) may miss a real effect and produce an inconclusive or false-negative result.
4. "A researcher says their study was approved by the ethics committee. Does that mean it is ethical?" Not necessarily. Ethics committee approval is necessary but not sufficient for ethical conduct. The trial must ALSO be conducted in accordance with the approved protocol, GCP, and applicable regulations throughout. Ethical conduct is an ongoing obligation - not a one-time approval. EC approval can be revoked if unethical conduct is found during monitoring.
5. "What is the difference between randomization and blinding? Can you have one without the other?" Randomization controls for confounding at allocation (before the study). Blinding controls for performance, detection, and reporting bias after allocation (during and after the study). You can have:
  • Randomization without blinding: Open-label RCT (e.g., comparing surgery vs. drug therapy)
  • Blinding without randomization: Observer-blind observational study
  • Both: Double-blind RCT (ideal)
  • Neither: Open-label observational study
6. "What is regression to the mean and why does it make a control group necessary?" Regression to the mean is the statistical tendency for extreme measurements to be closer to the average when measured again, regardless of any intervention. Patients often enroll in a study when their disease is at its worst - subsequent improvement may reflect natural disease fluctuation, not the treatment. A control group (ideally placebo-controlled) accounts for this phenomenon, natural disease history, and the placebo effect simultaneously.

QUICK REFERENCE SUMMARY TABLE

DomainKey ConceptExam Answer
Research questionFINER criteriaFeasible, Interesting, Novel, Ethical, Relevant
HypothesisH₀ vs H₁H₀ = no effect; H₁ = effect exists; p-value tests H₀
Scales of measurementNOIRNominal → Ordinal → Interval → Ratio
SamplingProbability vs. non-probabilityProbability: SRS, systematic, stratified, cluster
ErrorsType I vs Type IIα = false positive; β = false negative; Power = 1-β
Sample size inputs5 factorsα, Power, Effect size (δ), SD (σ), Design
Ethics4 Belmont principlesAutonomy, Beneficence, Non-maleficence, Justice
Declaration of HelsinkiYear, WMA, cornerstone1964; World Medical Association; patient > science
ICH-GCPPurposeQuality, integrity, participant protection in trials
ICMR GuidelinesYear2017; India's national research ethics standard
CTRIMandatory registrationBefore enrollment; ctri.nic.in; managed by ICMR
CDSCO / DCGIRegulatory authorityIndia's equivalent of FDA; approves trial applications
Phase III trialDefinitionLarge, multi-center, randomized; basis for approval
SAE reportingTimelinesFatal/life-threatening: 24 hours; Others: 15 days
Surrogate outcomeRiskMay not predict clinical benefit (e.g., CAST trial)

This set covers all domains an MD Pharmacology examiner will probe in a research methodology viva - from hypothesis formulation and study design selection, through biostatistics, ethics (Declaration of Helsinki, ICMR, GCP), sampling, measurement scales, and the Indian regulatory context (CDSCO, CTRI, New Drugs and Clinical Trials Rules 2019).

viva questions with answers for the topic STATISTICAL ANALYSIS IN RESEARCH METHODOLOGY for MD Pharmacology exam

Searching the Web

statistical analysis research methodology viva questions MD pharmacology sensitivity specificity ROC curve survival analysis Kaplan-Meier

Searching the Web

biostatistics parametric nonparametric tests ANOVA regression logistic cox proportional hazards postgraduate pharmacology exam questions India

Here is the complete, exam-focused viva Q&A set:

Viva Questions & Answers: Statistical Analysis in Research Methodology

MD Pharmacology Exam Preparation


SECTION A: Foundations of Statistical Inference

Q1. What is the difference between a statistic and a parameter?
StatisticParameter
DefinitionA numerical value calculated from sample dataA numerical value describing the entire population
SourceSamplePopulation (usually unknown; estimated from sample)
Notationx̄ (sample mean), s (sample SD), p̂ (sample proportion)μ (population mean), σ (population SD), π (population proportion)
CertaintyKnown (calculated)Unknown (estimated)
Standard error (SE): Measures how much the sample statistic varies from the true population parameter. SE = SD / √n. As n increases, SE decreases (estimates become more precise).

Q2. What is a sampling distribution? Why does it matter?
The sampling distribution is the probability distribution of a statistic (e.g., the sample mean) calculated from all possible samples of the same size drawn from a population.
Central Limit Theorem (CLT): Regardless of the shape of the population distribution, the sampling distribution of the mean approaches a normal distribution as the sample size increases (typically n ≥ 30). This is the mathematical justification for using normal-theory statistical tests even when the original data are not perfectly normally distributed.
Why it matters: All parametric hypothesis tests and confidence intervals are based on the sampling distribution of the test statistic. The CLT makes these tests valid for reasonably large samples even when the raw data deviate from normality.

Q3. What is a confidence interval? How do you construct and interpret a 95% CI?
A 95% CI is a range of values constructed from sample data such that, in 95% of all possible samples, the interval would contain the true population parameter.
Construction: For a mean: CI = x̄ ± (Z or t) × SE
  • For large samples (n > 30): 95% CI = x̄ ± 1.96 × SE
  • For small samples (n ≤ 30, normal data): 95% CI = x̄ ± t(df, 0.025) × SE
Correct interpretation: "We are 95% confident that the true population mean lies within this interval." NOT "There is a 95% probability that the true mean lies in this interval" (the true mean is fixed; it either is or is not in the interval - the probability refers to the method, not the interval).
Width of CI:
  • Wider CI = less precision (small sample, large variance)
  • Narrower CI = more precision (large sample, small variance)
Relationship to p-value: If the 95% CI of an OR/RR excludes 1.0, the result is significant at p < 0.05. If the 95% CI of a mean difference excludes 0, p < 0.05.

Q4. What is the difference between one-tailed and two-tailed tests? When do you use each?
One-tailed (directional) testTwo-tailed (non-directional) test
HypothesisH₁: μ₁ > μ₂ (or < )H₁: μ₁ ≠ μ₂
Critical regionAll in one tail of the distributionSplit equally between both tails
Critical Z value (α = 0.05)1.6451.960
PowerGreater for detecting effects in the predicted directionLess powerful for one direction
When to useOnly when the direction of effect is firmly predicted and specified a priori (very rare in pharmacology)Almost always - standard in pharmacology research
RiskCannot detect unexpected effects in the other directionBalanced; standard
Examiner tip: Using a one-tailed test to achieve significance should be pre-specified, scientifically justified, and not done post-hoc to cross p = 0.05. Most regulatory agencies and journals require two-tailed tests.

SECTION B: Choosing the Right Statistical Test

Q5. What is the algorithm for selecting the appropriate statistical test?
What is the OUTCOME variable?
│
├── CONTINUOUS (normally distributed)
│   ├── Compare 2 groups
│   │   ├── Independent → Independent t-test
│   │   └── Paired/matched → Paired t-test
│   └── Compare ≥3 groups
│       ├── One factor → One-way ANOVA
│       ├── Two factors → Two-way ANOVA
│       └── Repeated measures → Repeated-measures ANOVA
│
├── CONTINUOUS (non-normal or ordinal)
│   ├── Compare 2 independent groups → Mann-Whitney U
│   ├── Compare 2 paired groups → Wilcoxon signed-rank
│   ├── Compare ≥3 independent groups → Kruskal-Wallis
│   └── Compare ≥3 repeated measures → Friedman
│
├── CATEGORICAL (binary/nominal)
│   ├── Two independent groups → Chi-square (or Fisher's exact if expected cell < 5)
│   ├── Two paired groups → McNemar's test
│   └── ≥3 independent groups → Chi-square with multiple categories
│
├── CORRELATION between 2 variables
│   ├── Both continuous + normal → Pearson's r
│   └── One/both ordinal or non-normal → Spearman's ρ
│
├── PREDICTION / REGRESSION
│   ├── Continuous outcome → Linear regression (multiple)
│   ├── Binary outcome → Logistic regression
│   └── Time-to-event → Cox proportional hazards
│
└── TIME-TO-EVENT (survival)
    ├── Describe survival curve → Kaplan-Meier
    └── Compare two survival curves → Log-rank test

SECTION C: t-Tests in Detail

Q6. Explain the independent samples t-test. What are its assumptions?
The independent samples (unpaired) t-test compares the means of two unrelated groups.
Formula: t = (x̄₁ - x̄₂) / √(Sp² × (1/n₁ + 1/n₂))
where Sp² = pooled variance
Degrees of freedom: df = n₁ + n₂ - 2
Assumptions:
  1. Continuous data (interval or ratio)
  2. Both groups approximately normally distributed (or n > 30 by CLT)
  3. Independence of observations (no pairing)
  4. Homogeneity of variance (Levene's test; if violated, use Welch's t-test which uses separate variances and adjusted df)
When NOT to use: Non-normal data with small samples (use Mann-Whitney U); paired data (use paired t-test); more than 2 groups (use ANOVA).

Q7. Explain the paired t-test. When is it appropriate?
The paired t-test compares means in two related (matched or repeated) measurements from the same subjects.
Formula: t = d̄ / (SD_d / √n)
where d̄ = mean of differences (post - pre), SD_d = SD of differences, n = number of pairs
df: n - 1 (number of pairs minus 1)
When to use:
  • Before-after measurements on the same subjects (pre-treatment vs. post-treatment BP)
  • Matched case-control studies
  • Crossover RCTs
Advantage over independent t-test: Removes between-subject variability - more powerful for detecting within-subject changes.
Non-parametric equivalent: Wilcoxon signed-rank test.

Q8. What is the one-sample t-test?
Tests whether the sample mean is significantly different from a known or hypothesized population value (μ₀).
Formula: t = (x̄ - μ₀) / (s/√n); df = n - 1
Example: Testing whether the mean Cmax of a new formulation (sample mean) is significantly different from the reference product (known μ₀ = 500 ng/mL).

SECTION D: ANOVA

Q9. What is ANOVA? When is it used instead of multiple t-tests?
ANOVA (Analysis of Variance) tests whether there are statistically significant differences among the means of three or more groups by partitioning total variance into between-group variance and within-group variance.
F ratio = Mean Square Between / Mean Square Within
If F is large (between-group variance >> within-group variance), the null hypothesis (all means equal) is rejected.
Why not multiple t-tests? With k groups, you would need k(k-1)/2 pairwise t-tests. Each test has α = 0.05, so with 3 groups (3 tests), the familywise error rate = 1 - (1-0.05)³ = 14.3%. ANOVA controls the overall Type I error at α = 0.05 for the omnibus test.
ANOVA tells you that at least one mean differs - it does NOT tell you which pairs differ. Post-hoc tests are required.

Q10. What are post-hoc tests? Name and compare them.
Post-hoc tests are pairwise comparison tests performed AFTER a significant ANOVA to identify which specific groups differ. They control for multiple comparisons.
TestWhen UsedCharacter
Tukey's HSD (Honest Significant Difference)Equal group sizes; all pairwise comparisonsBalanced; most commonly used
Bonferroni correctionSmall number of pre-specified comparisonsSimple: divide α by number of comparisons; conservative
Scheffé's testComplex comparisons (not just pairwise); unequal nMost conservative; for exploratory comparisons
LSD (Least Significant Difference)Only valid after significant F; liberalLeast conservative; increased Type I error
Dunnett's testCompare each group only to a control groupTargeted; more powerful than Tukey for this purpose
Games-HowellUnequal variances between groupsWelch-based; recommended when Levene's test significant

Q11. What are the types of ANOVA?
TypeUse
One-way ANOVAOne independent variable with ≥3 levels; one continuous outcome
Two-way ANOVATwo independent variables; tests main effects and interaction
Repeated-measures ANOVASame subjects measured ≥3 times (within-subjects design)
Mixed ANOVABoth within-subjects and between-subjects factors
ANCOVA (Analysis of Covariance)One-way ANOVA with a continuous covariate (confounder) controlled
MANOVA (Multivariate ANOVA)Multiple dependent variables simultaneously
Assumptions of ANOVA:
  1. Normal distribution within each group (or n sufficiently large)
  2. Homogeneity of variance (Levene's test; if violated, use Welch's ANOVA)
  3. Independence of observations
  4. If repeated-measures: Sphericity (equal variances of differences between all pairs of time points; tested by Mauchly's test; if violated, apply Greenhouse-Geisser or Huynh-Feldt correction)

SECTION E: Chi-Square and Fisher's Tests

Q12. Explain the chi-square (χ²) test. What are its assumptions?
The chi-square test of independence tests whether there is a statistically significant association between two categorical variables.
Formula: χ² = Σ [(Observed - Expected)² / Expected]
where Expected = (Row total × Column total) / Grand total for each cell
Degrees of freedom: (r-1)(c-1) where r = rows, c = columns. For a 2×2 table: df = 1.
Interpretation: If χ² is large (p < 0.05), reject H₀ of independence - the variables are associated.
Assumptions:
  1. Categorical data
  2. Observations are independent
  3. Expected frequency in each cell ≥ 5 (if any expected cell < 5, use Fisher's exact test)
  4. No more than 20% of cells have expected frequency < 5
Chi-square does NOT measure the strength of association - it only tests statistical significance. Use Cramér's V or Phi coefficient for strength.

Q13. What is Fisher's Exact Test? When is it preferred over chi-square?
Fisher's Exact Test calculates the exact probability of observing the given 2×2 table (and all more extreme tables) under the null hypothesis of no association, without relying on chi-square approximation.
Preferred when:
  • Any expected cell frequency < 5
  • Small total sample size (n < 20-40)
  • 2×2 tables specifically (for larger tables, use Monte Carlo chi-square)
Fisher's exact test is always valid (no minimum cell size assumption); chi-square is an approximation that works well only when expected frequencies are adequate.

Q14. What is McNemar's test?
McNemar's test is the paired/matched equivalent of chi-square. It is used for paired categorical (binary) data - i.e., when the same subjects are measured twice (before-after, matched pairs).
Formula: χ² = (b - c)² / (b + c), df = 1
where b = number of pairs where first measurement positive, second negative; c = number where first negative, second positive.
Only the discordant pairs (b and c) contribute to the test - concordant pairs (both positive or both negative) are irrelevant.
Example: Testing whether the proportion of patients responding to treatment changed after a dose increase in the same patients.

SECTION F: Correlation

Q15. What is Pearson's correlation coefficient (r)? How is it interpreted?
Pearson's r measures the strength and direction of the linear association between two continuous, normally distributed variables.
Range: -1 to +1
r valueInterpretation
+1.0Perfect positive linear relationship
0.7 to 0.9Strong positive
0.5 to 0.7Moderate positive
0.3 to 0.5Weak positive
0No linear relationship
Negative valuesInverse (negative) direction
Coefficient of determination (r²): The proportion of variance in Y explained by X. e.g., r = 0.8 → r² = 0.64 → 64% of variance in Y is explained by X.
Critical distinction:
  • r measures the linear relationship only; it will be 0 for a perfect non-linear (e.g., U-shaped) relationship
  • Statistical significance of r depends on both the magnitude AND sample size - a small r can be highly significant in a very large study but clinically meaningless
  • Correlation ≠ causation

Q16. What is Spearman's rank correlation? When is it used instead of Pearson's?
Spearman's ρ (rho) is the non-parametric equivalent of Pearson's r. It calculates Pearson's r on the ranks of the data rather than the raw values.
Use instead of Pearson's when:
  • One or both variables are ordinal (pain score, Likert scale)
  • Data are non-normally distributed
  • There are outliers that disproportionately influence Pearson's r
  • The relationship may be monotonic but not strictly linear
Interpretation: Same range (-1 to +1) and direction interpretation as Pearson's. ρ = 1 means perfect monotonic (rank-order) relationship.

SECTION G: Regression Analysis

Q17. What is simple linear regression? What does the regression equation mean?
Simple linear regression models the relationship between one continuous predictor variable (X) and one continuous outcome variable (Y):
Y = a + bX + ε
where:
  • a (intercept): The predicted value of Y when X = 0
  • b (regression coefficient / slope): The change in Y for each one-unit increase in X
  • ε (error term): Residual unexplained variation
Example: Y = serum creatinine (mg/dL); X = age (years); b = 0.01 → for every 1 year increase in age, creatinine increases by 0.01 mg/dL on average.
Assumptions (LINE):
  • Linearity: Relationship is linear (check scatter plot)
  • Independence: Observations independent
  • Normality: Residuals (errors) normally distributed
  • Equal variance (Homoscedasticity): Constant variance of residuals across values of X

Q18. What is multiple linear regression? What is multicollinearity?
Multiple linear regression models the relationship between multiple predictor variables (X₁, X₂, ... Xₖ) and one continuous outcome:
Y = a + b₁X₁ + b₂X₂ + ... + bₖXₖ + ε
Each bᵢ = change in Y per unit increase in Xᵢ, holding all other predictors constant (adjusted coefficient).
Uses in pharmacology:
  • Predicting drug response from multiple patient characteristics
  • Adjusting for confounders
  • Dose-response modeling
Multicollinearity: When two or more predictor variables are highly correlated with each other, making it impossible to distinguish their independent effects. Detected by Variance Inflation Factor (VIF) - VIF > 10 indicates serious multicollinearity. Addressed by removing one of the correlated predictors or combining them.

Q19. What is logistic regression? How is it different from linear regression?
Logistic regression models the relationship between one or more predictors and a binary (dichotomous) outcome (e.g., responder vs. non-responder; ADR present vs. absent).
Key differences from linear regression:
FeatureLinear RegressionLogistic Regression
OutcomeContinuousBinary (0 or 1)
Model outputPredicted value of YLog-odds (logit) of P(Y=1)
Coefficient interpretationChange in Y per unit XChange in log-odds per unit X; exponentiated = Odds Ratio (OR)
AssumptionsNormal residuals; homoscedasticityNo normality required; uses maximum likelihood estimation
Predicted range-∞ to +∞0 to 1 (probability)
Logit function: logit(p) = ln[p/(1-p)] = a + b₁X₁ + b₂X₂ + ...
Output: Each regression coefficient, when exponentiated (eᵇ), gives the adjusted OR for that predictor, controlling for all other variables. 95% CI for OR that excludes 1.0 = significant.

SECTION H: Survival Analysis

Q20. What is survival analysis? When is it used?
Survival analysis (time-to-event analysis) is a branch of statistics for analyzing the time until an event of interest occurs. Despite the name "survival," the event can be:
  • Death
  • Disease relapse
  • First hospitalization
  • Drug failure
  • Adverse drug reaction
Used when:
  • The outcome is the time to an event, not just whether it occurred
  • Follow-up periods differ between participants (administrative censoring)
  • Some participants have not experienced the event by study end (censored)
Key concepts:
  • Event: Occurrence of the outcome of interest
  • Censoring: Participant has not experienced the event by the time of analysis (either lost to follow-up or study ended; their exact event time is unknown but known to be > last observation time)
  • Survival function S(t): Probability that the event has NOT occurred by time t
  • Hazard function h(t): Instantaneous rate of event occurrence at time t given survival up to t

Q21. What is the Kaplan-Meier (KM) method? How do you read a KM curve?
The Kaplan-Meier estimator is a non-parametric method to estimate the survival function S(t) from censored time-to-event data. It recalculates the survival probability each time an event occurs.
Formula: S(tᵢ) = S(tᵢ₋₁) × [(nᵢ - dᵢ) / nᵢ]
where nᵢ = number at risk just before time tᵢ; dᵢ = number of events at time tᵢ
How to read a KM curve:
  • Y-axis: Survival probability (0 to 1); starts at 1.0
  • X-axis: Time (days/months/years)
  • Steps (drops): Each step down = one or more events occurring
  • Vertical tick marks (|): Censored observations (participants who left the study without experiencing the event)
  • Median survival: Time at which survival probability = 0.5 (where the curve crosses the horizontal dashed line at 0.5)
  • Two groups: When comparing Drug A vs. Drug B, two KM curves are plotted; wider separation = greater survival difference
Key examiner question: "What do the tick marks on a KM curve represent?" They indicate censored observations - patients who were lost to follow-up or reached study end without the event.

Q22. What is the log-rank test?
The log-rank test (Mantel-Cox test) is the standard non-parametric test for comparing the survival distributions (KM curves) of two or more groups.
Null hypothesis: The survival curves of the groups are identical (the groups have the same event rate over time).
Calculates: A weighted sum of observed vs. expected events at each event time point across all groups.
Output: Chi-square statistic with df = k-1 (k = number of groups); associated p-value.
Limitations:
  • Only tests whether curves differ overall; does not quantify the magnitude of difference
  • Most powerful when the proportional hazards assumption holds (i.e., hazard ratio is constant over time; curves don't cross)
  • If curves cross (hazard ratio reverses), log-rank test loses power (consider Wilcoxon-Breslow or stratified analyses)

Q23. What is the Cox Proportional Hazards Regression Model?
The Cox model is a semi-parametric regression model for time-to-event data that estimates the effect of predictor variables (covariates) on the hazard (event rate), while adjusting for other variables.
Model: h(t) = h₀(t) × exp(b₁X₁ + b₂X₂ + ... + bₖXₖ)
where h₀(t) = baseline hazard (unspecified; this is the "semi-parametric" part)
Output:
  • Hazard Ratio (HR): eᵇᵢ = ratio of hazard for a one-unit increase in Xᵢ, adjusting for all other variables
  • HR > 1: Higher hazard (worse survival) with increasing X
  • HR < 1: Lower hazard (better survival; protective) with increasing X
  • HR = 1: No effect
  • 95% CI for HR: If it excludes 1.0, statistically significant at p < 0.05
Key assumption - Proportional Hazards (PH): The HR between groups is constant over time (i.e., the two groups' hazards are proportional at every time point). If a drug halves the hazard initially but has no effect later, the PH assumption is violated.
Testing PH assumption:
  • Log-log (ln[-ln(S(t))]) plot: Should be parallel lines if PH holds
  • Schoenfeld residuals test (formal statistical test)

Q24. What is the difference between the log-rank test and Cox regression?
FeatureLog-rank testCox regression
PurposeCompares survival curves of 2+ groupsQuantifies effect of predictor(s) on hazard; adjusts for confounders
CovariatesCannot adjust for covariatesAdjusts for multiple covariates simultaneously
Outputp-value onlyHazard Ratio + 95% CI + p-value
TypeNon-parametricSemi-parametric
When to useSimple group comparison (e.g., treatment A vs B)Multivariable analysis; confounding adjustment; continuous predictors
Analogous tot-test / ANOVALinear / logistic regression

SECTION I: Diagnostic Test Statistics

Q25. Describe the 2×2 contingency table for a diagnostic test.
The gold standard defines true disease status; the test result defines positive or negative.
                    DISEASE (Gold Standard)
                    Present (+)    Absent (-)    Total
TEST   Positive (+)   TP (a)        FP (c)       a+c
       Negative (-)   FN (b)        TN (d)       b+d
       Total          a+b           c+d          N
  • TP (True Positive): Test positive, disease present
  • TN (True Negative): Test negative, disease absent
  • FP (False Positive): Test positive, disease absent (Type I error in testing)
  • FN (False Negative): Test negative, disease present (Type II error in testing)

Q26. Define and calculate sensitivity, specificity, PPV, NPV, and likelihood ratios.
MeasureFormulaMeaningMemory aid
Sensitivity (Sn)TP / (TP + FN) = a/(a+b)Probability of testing positive given disease IS present"Sensitivity rules OUT disease when NEGATIVE" (SnNout)
Specificity (Sp)TN / (TN + FP) = d/(c+d)Probability of testing negative given disease is ABSENT"Specificity rules IN disease when POSITIVE" (SpPin)
Positive Predictive Value (PPV)TP / (TP + FP) = a/(a+c)Probability of disease given a POSITIVE test resultDepends on prevalence
Negative Predictive Value (NPV)TN / (TN + FN) = d/(b+d)Probability of NO disease given a NEGATIVE test resultDepends on prevalence
Positive Likelihood Ratio (+LR)Sensitivity / (1 - Specificity)How much the post-test odds increase after a POSITIVE result+LR > 10: strong evidence to rule in
Negative Likelihood Ratio (-LR)(1 - Sensitivity) / SpecificityHow much the post-test odds decrease after a NEGATIVE result-LR < 0.1: strong evidence to rule out
Accuracy(TP + TN) / N = (a+d)/NOverall proportion of correct classificationsMisleading if disease prevalence is extreme
Critical examiner point: PPV and NPV depend on disease prevalence (pre-test probability). The same test has higher PPV in a high-prevalence population (e.g., specialist clinic) than a low-prevalence population (general screening). Sensitivity and specificity are intrinsic properties of the test (do NOT depend on prevalence).

Q27. What is the ROC (Receiver Operating Characteristic) curve? How do you interpret AUC?
An ROC curve is a graphical plot of sensitivity (y-axis) against 1 - specificity (x-axis = false positive rate) across all possible cut-off values of a continuous diagnostic test.
How it is generated: For each possible threshold/cut-off, calculate sensitivity and (1 - specificity). Plot each pair as a point; connect them.
AUC (Area Under the ROC Curve):
AUC valueDiscrimination
1.0Perfect test
0.90 - 1.00Excellent
0.80 - 0.90Good
0.70 - 0.80Fair
0.60 - 0.70Poor
0.50No better than chance (diagonal line)
< 0.50Worse than chance (inverted test)
Uses:
  1. Compare discriminative ability of two different tests (compare AUCs)
  2. Select the optimal cut-off (point closest to the top-left corner = maximizes sensitivity + specificity)
  3. Evaluate biomarkers for disease diagnosis or drug response prediction
Youden's Index: Sensitivity + Specificity - 1; maximized at the optimal cut-off.

Q28. What is the difference between pre-test and post-test probability? How do likelihood ratios change them?
  • Pre-test probability (prevalence): The probability of disease in the patient BEFORE the test result is known
  • Post-test probability: The probability of disease AFTER accounting for the test result
Conversion using Bayes' theorem and likelihood ratios:
  1. Convert pre-test probability to pre-test odds: Odds = P / (1 - P)
  2. Multiply by Likelihood Ratio: Post-test odds = Pre-test odds × LR
  3. Convert back: Post-test probability = Post-test odds / (Post-test odds + 1)
Practical shortcut (Fagan's nomogram): Draw a line from pre-test probability through the LR to read off post-test probability directly.
Example: Pre-test probability 30%. +LR = 10. Pre-test odds = 0.3/0.7 = 0.43. Post-test odds = 0.43 × 10 = 4.3. Post-test probability = 4.3/5.3 = 81%.

SECTION J: Agreement and Reliability Statistics

Q29. What is Cohen's Kappa? How is it interpreted?
Cohen's Kappa (κ) measures inter-rater agreement for categorical data, correcting for the level of agreement expected by chance alone.
Formula: κ = (Po - Pe) / (1 - Pe)
where Po = observed proportion of agreement; Pe = expected proportion of agreement by chance
κ valueStrength of Agreement
< 0Less than chance (poor)
0 - 0.20Slight
0.21 - 0.40Fair
0.41 - 0.60Moderate
0.61 - 0.80Substantial
0.81 - 1.00Almost perfect
Examiner note: Simple percentage agreement is misleading - two raters who independently respond "yes" 90% of the time to any question will agree 81% of the time by chance alone. Kappa corrects for this.

Q30. What is the Bland-Altman plot? When is it used?
The Bland-Altman (limits of agreement) plot assesses agreement between two quantitative measurement methods (or two raters measuring a continuous variable).
Construction:
  • X-axis: Mean of the two measurements (for each subject)
  • Y-axis: Difference between the two measurements (Method 1 - Method 2)
  • Draw horizontal lines at: Mean difference (bias), Mean difference ± 1.96 × SD of differences (= 95% Limits of Agreement)
Interpretation:
  • If the mean difference is near zero: Little systematic bias between methods
  • If most differences lie within the limits of agreement (±1.96 SD): Methods agree clinically
  • Limits of agreement should be clinically acceptable for the methods to be interchangeable
  • Fan-shaped pattern: Proportional bias (differences increase as the mean increases)
Why not just use correlation? A high correlation does NOT imply good agreement. Two methods can be highly correlated (r = 0.99) but consistently differ by 20% - which would be unacceptable clinically but invisible to a correlation coefficient.

Q31. What is the Intraclass Correlation Coefficient (ICC)?
ICC measures the reliability of continuous measurements from two or more raters or repeated measures. It simultaneously measures both consistency and agreement.
Range: 0 to 1 (higher = better agreement)
ICCReliability
< 0.50Poor
0.50 - 0.75Moderate
0.75 - 0.90Good
> 0.90Excellent
When to use: Preferred over Pearson's r for assessing reliability because it accounts for both correlation and systematic differences (bias) between measurements.

SECTION K: Data Transformation & Distribution Concepts

Q32. What is a skewed distribution? When do you transform data?
A skewed distribution is asymmetrical. The mean is pulled toward the tail.
DistributionMean vs. MedianExample
Positively skewed (right)Mean > Median > ModeIncome, drug serum concentrations, hospital length of stay
Negatively skewed (left)Mean < Median < ModeAge at death in a developed country
NormalMean = Median = ModeHeight, blood pressure in large populations
Log transformation: Applied to right-skewed data (e.g., serum drug concentrations, pharmacokinetic parameters like AUC, Cmax). After log transformation, data approximate normality, and parametric tests become valid. Results expressed as geometric means and geometric mean ratios (relevant for bioequivalence studies).
Other transformations: Square root (count data), reciprocal, arcsine (proportions).

Q33. What is the geometric mean? When is it used in pharmacology?
The geometric mean is the nth root of the product of n values, or equivalently, the antilogarithm of the mean of log-transformed values.
Geometric mean = exp(mean of log-values) = antilog(mean of log-values)
Used in pharmacology:
  • Pharmacokinetic parameters (AUC, Cmax, t½) which are log-normally distributed
  • Bioequivalence studies: the 90% CI of the geometric mean ratio (Test/Reference) must be 80%-125% for equivalence
  • Antibody titers, dilutions, microbiological counts
Why not arithmetic mean? For log-normally distributed data, the arithmetic mean is heavily influenced by high outliers. The geometric mean is more representative of the central tendency.

SECTION L: Multiple Testing and Corrections

Q34. What is the multiple testing problem? How is it addressed?
When k statistical tests are performed on the same dataset, the familywise Type I error rate increases:
Familywise error rate = 1 - (1-α)ᵏ
For k = 3 tests at α = 0.05: error rate = 1 - (0.95)³ = 14.3% (not 5%) For k = 10 tests: error rate = 40% For k = 20 tests: error rate = 64%
Correction methods:
MethodFormulaCharacter
Bonferroni correctionαᵢ = α / k (use threshold of 0.05/k for each test)Simple; very conservative; reduces power
Holm-Bonferroni (sequential Bonferroni)Tests ranked; threshold adjusted sequentiallyLess conservative than Bonferroni; more powerful
Benjamini-Hochberg (FDR)Controls False Discovery Rate rather than familywise errorLess conservative; appropriate for exploratory studies
Pre-specificationDeclare primary outcome in protocol before data collectionMethodological (not statistical) solution; most important
Best solution: Pre-specify a single primary outcome in the protocol before data collection - this is why the statistical analysis plan (SAP) must be finalized before unblinding.

Q35. What is the Bonferroni correction? What is its limitation?
Bonferroni correction: For k simultaneous tests, use α/k as the significance threshold for each test.
Example: 3 outcomes tested → significance threshold = 0.05/3 = 0.0167 for each.
Limitation: Overly conservative (increases Type II error / reduces power), especially when:
  • Tests are not independent (correlated outcomes)
  • Number of comparisons is large
  • It may cause clinically important effects to be dismissed as non-significant
For correlated or many comparisons, the Holm-Bonferroni or FDR methods are preferred.

SECTION M: Effect Size Measures

Q36. What is effect size? Why is it important beyond p-value?
Effect size quantifies the magnitude of a difference or association, independent of sample size. Unlike p-values, which depend on both effect size and sample size, effect size measures the clinical or practical importance of a finding.
Common effect size measures:
MeasureUsed ForInterpretation
Cohen's dTwo means (t-test)d = (x̄₁ - x̄₂) / Sp; d < 0.2 trivial, 0.2-0.5 small, 0.5-0.8 medium, > 0.8 large
Eta-squared (η²)ANOVAProportion of variance in Y explained by group membership; η² = SS_between / SS_total
r (Pearson/Spearman)Correlationr < 0.1 trivial, 0.1-0.3 small, 0.3-0.5 medium, > 0.5 large
Odds Ratio (OR)Binary outcome, case-controlOR = 1 no effect; OR = 2 moderate; OR > 3 large
Risk Ratio (RR)Binary outcome, cohort/RCTSimilar interpretation to OR
NNT / NNHClinical importanceSee Section N
Hazard Ratio (HR)Time-to-eventHR = 1 no effect; HR < 1 protective

SECTION N: Clinical Significance vs. Statistical Significance

Q37. What is the difference between statistical significance and clinical significance?
Statistical SignificanceClinical Significance
MeaningThe observed effect is unlikely to be due to chance (p < 0.05)The magnitude of the effect is large enough to matter to patients and clinicians
Determined bySample size, effect size, variabilityClinical judgment, effect size, NNT, patient values, costs
Can have large n with tiny effectYes - a 0.5 mmHg drop in SBP can be statistically significant with n = 100,000No - 0.5 mmHg is not clinically meaningful
Can have small n with large effectMay miss real clinical effects (underpowered)Large effects in small trials may be clinically impressive but not statistically significant
The solution: Always report both - p-value AND effect size AND 95% CI AND NNT/NNH where applicable.

Q38. What is the MCID (Minimum Clinically Important Difference)?
The MCID is the smallest difference in an outcome that patients and/or clinicians would consider meaningful and worth the cost, risk, and inconvenience of a treatment.
Examples:
  • Pain VAS: 13 mm (out of 100mm) = MCID
  • NRS pain: 1.5 points (out of 10)
  • HRQOL (SF-36): 5-10 points depending on domain
  • Forced Expiratory Volume (FEV₁): 200 mL or 12% change
  • HbA1c: 0.5% absolute change
Importance: A study powered to detect the MCID ensures that a statistically significant result is also clinically significant. Conversely, a statistically significant result that does not reach the MCID may not justify prescribing the drug.

SECTION O: Rapid-Fire Questions

Q39. What is the Z-test vs. the t-test?
  • Z-test: Used when population SD is known OR sample is large (n > 30); uses Z distribution (standard normal)
  • t-test: Used when population SD is unknown (estimated from sample) and/or n ≤ 30; uses t-distribution (heavier tails for small df; approaches Z as n → ∞)
Q40. What is degrees of freedom (df)? The number of independent values free to vary in a statistical calculation after constraints have been applied. Conceptually: df = n - number of parameters estimated from the data. For a one-sample t-test: df = n-1 (one mean estimated); for independent t-test: df = n₁ + n₂ - 2.
Q41. What is homoscedasticity? Constant variance of the residuals (errors) across all levels of the predictor variable. A key assumption of linear regression and ANOVA. Tested visually with a residuals-vs-fitted plot, or by Levene's test (for ANOVA). Violation = heteroscedasticity.
Q42. What is the difference between one-way and two-way ANOVA?
  • One-way: Tests effect of ONE categorical independent variable (factor) with ≥3 levels on a continuous outcome
  • Two-way: Tests effects of TWO categorical factors simultaneously, including their interaction (whether the effect of Factor A depends on the level of Factor B)
Q43. What are residuals in regression? Residuals are the differences between the observed values of Y and the values predicted by the regression model (Y - Ŷ). Analysis of residuals (residual plots, QQ plots) is used to check regression assumptions.
Q44. What is R² in multiple regression? The coefficient of determination - the proportion of total variance in Y that is explained by the model (all predictor variables combined). Adjusted R² penalizes for adding unnecessary predictors and is preferred for comparing models.
Q45. What is censoring in survival analysis? An observation is censored when the event of interest has not occurred by the time of analysis. Right-censoring is most common: the participant was event-free at last observation (they may or may not eventually experience the event). The key assumption: censoring is non-informative (independent of the event probability).
Q46. What is the median survival time? The time at which the estimated survival probability S(t) = 0.5 - i.e., the time by which 50% of the study population has experienced the event. Read off the KM curve where the curve crosses the 0.5 line on the y-axis. If the curve never drops below 0.5, the median survival time is undefined.
Q47. What does "number needed to treat" (NNT) mean? NNT = 1/ARR = 1/(Control Event Rate - Experimental Event Rate). The number of patients who need to be treated for one additional patient to benefit. Lower NNT = more effective treatment. NNT should always be reported with its 95% CI.
Q48. What statistical software packages are used in biomedical research?
  • SPSS (IBM): Most used in Indian medical research; menu-driven; good for basic to moderate analyses
  • R (free, open-source): Most flexible; can perform virtually any analysis; used in academic/research settings
  • SAS: Standard in pharmaceutical industry and regulatory submissions
  • STATA: Epidemiology-focused; excellent for survival analysis
  • GraphPad Prism: Easy for basic statistics and graph generation; popular in pharmacology labs
  • Epi Info (CDC): Free; good for epidemiological surveys; used in India

SECTION P: Examiner's Favourite Trick Questions

1. "p = 0.04, n = 500,000. Is this finding clinically important?" Almost certainly not. With n = 500,000, even a trivially small effect (e.g., 0.1 mmHg BP reduction) will generate p < 0.05. Statistical significance reflects only the probability that the result is due to chance - not whether it matters clinically. Always examine the absolute effect size, CI, and MCID.
2. "The t-test showed p = 0.07. Can you conclude the drugs are equivalent?" No. p = 0.07 means the evidence is insufficient to reject H₀ (no difference), but this does NOT prove the drugs are equivalent. The study may be underpowered. To demonstrate equivalence or non-inferiority, you need an equivalence/non-inferiority trial with pre-specified margins and appropriate analysis (TOST - two one-sided tests).
3. "You have 4 groups to compare. Can you do 6 pairwise t-tests?" No. Running 6 pairwise t-tests at α = 0.05 gives familywise error rate = 1-(0.95)⁶ = 26.5%. The correct approach is one-way ANOVA (omnibus test) followed by post-hoc tests (Tukey, Bonferroni) if the ANOVA is significant.
4. "What is the non-parametric equivalent of ANOVA?" The Kruskal-Wallis test (for 3+ independent groups). Its post-hoc equivalent is Dunn's test with Bonferroni correction. For repeated measures, use the Friedman test (non-parametric equivalent of repeated-measures ANOVA).
5. "Pearson r = 0.92 between two measurement methods. Can they be used interchangeably?" Not without further analysis. A high correlation means the methods move together proportionally but does NOT mean they give the same values. One could consistently read 10 units higher than the other (fixed bias) and still have r = 0.92. The correct tool is the Bland-Altman plot and limits of agreement.
6. "Sensitivity = 95%, Specificity = 60%. Is this a good test?" It depends on the clinical context. Very high sensitivity with moderate specificity makes it a good screening test (rule OUT disease - SnNout): few true cases are missed (low FN rate). However, the low specificity means many non-diseased patients test positive (high FP rate), leading to unnecessary follow-up. This profile is acceptable for initial screening but not for confirmatory diagnosis.
7. "AUC = 0.70 for Drug A vs. 0.85 for Drug B as biomarkers. What does this mean?" Drug B is a better discriminator between disease states than Drug A. AUC = 0.85 means that in 85% of randomly chosen patient-control pairs, Drug B correctly identifies the patient (higher level) as more likely to have the disease. The difference in AUCs can be formally tested using the DeLong method.

MASTER REFERENCE TABLE: Statistical Tests

ComparisonParametricNon-parametricNotes
1 group vs. known valueOne-sample t-testWilcoxon signed-rank
2 independent groups (continuous)Independent t-testMann-Whitney U
2 paired groups (continuous)Paired t-testWilcoxon signed-rank
≥3 independent groups (continuous)One-way ANOVAKruskal-Wallis+ post-hoc
≥3 repeated measures (continuous)Repeated-measures ANOVAFriedmanSphericity check
2 categorical proportions (independent)Chi-squareFisher's exactFisher if expected < 5
2 categorical proportions (paired)McNemar-Discordant pairs only
Correlation (2 continuous, normal)Pearson rSpearman ρ
Predict continuous outcomeLinear regression-Multiple covariates
Predict binary outcomeLogistic regression-Output = OR
Compare survival curvesLog-rank test-Non-parametric
Adjust survival for covariatesCox proportional hazards-Output = HR
Agreement between 2 raters (categorical)Cohen's Kappa-
Agreement between 2 methods (continuous)Bland-AltmanICC
Test for normalityShapiro-Wilk (n<50)K-S test (n>50)
Test for equal variancesLevene's test-For ANOVA

This set covers every statistical domain an MD Pharmacology examiner will probe in a viva - from t-tests and ANOVA through logistic regression, survival analysis, diagnostic test statistics (sensitivity/specificity/ROC/LR), agreement statistics, multiple testing correction, and the critical distinction between statistical and clinical significance.
This is a shared conversation. Sign in to Orris to start your own chat.