Systematic Review

• Follows a strict, reproducible protocol (PRISMA guidelines)
• Includes a comprehensive literature search across multiple databases
• Uses pre-defined inclusion and exclusion criteria
• Assesses the quality and risk of bias of each included study
• May or may not include a quantitative synthesis (meta-analysis)

Interpretation of the Forest Plot

Structure of the Forest Plot

Study-by-Study Data

Overall (Pooled) Result

• Overall HR = 1.50 (95% CI: 1.14 - 1.98) - shown by the diamond
• Since the entire diamond lies to the right of 1.0, this is statistically significant
• Interpretation: Pioglitazone is associated with a 50% increased risk of bladder cancer compared to non-pioglitazone users

Heterogeneity

• I-squared (I²) = 78.8% - this is high (>75%), indicating substantial heterogeneity between studies (the studies do not all agree with each other)
• p-value = 0.000 - the heterogeneity is statistically significant
• Because of high heterogeneity, a random effects model was used (noted at the bottom of the plot), which is appropriate as it accounts for between-study variability

X-axis Direction

• Left of 1 (toward 0.1) = Favours Pioglitazone (pioglitazone is protective/reduces risk)
• Right of 1 (toward 10) = Favours non-pioglitazone (pioglitazone increases risk)
• The overall result falls to the right of 1, confirming increased bladder cancer risk with pioglitazone

Conclusion from the Forest Plot

How to Interpret a Forest Plot

1. The Basic Anatomy

Study Name    |----■----|        HR (95% CI)     Weight
Study Name      |--■--|          HR (95% CI)     Weight
Study Name    |--------■-----|   HR (95% CI)     Weight
              ◆                  Pooled estimate
         _____|_____
        0.1   1    10
     Favours A   Favours B

2. Reading Statistical Significance

For individual studies:

• If the horizontal CI line crosses the vertical null line (value 1) → NOT statistically significant
• If the entire CI line is on one side of the null line → Statistically significant

For the overall pooled result:

• If the diamond touches or crosses the null line → pooled result is NOT significant
• If the diamond lies completely on one side → pooled result IS significant

3. Direction of Effect

Always check the axis labels - they are not always the same in every forest plot.

4. Effect Size Measures Used

5. Study Weight

• Each study is assigned a weight (shown as % or by box size)
• Weight is determined by sample size and precision (narrower CI = higher weight)
• Studies with larger sample sizes and smaller variance contribute more to the pooled estimate
• In fixed-effects models: weight = inverse of within-study variance
• In random-effects models: weight = inverse of total variance (within + between study)

6. Heterogeneity - The Most Important Concept

I² Statistic (most commonly used):

Cochran's Q test (p-value for heterogeneity):

• p < 0.10 is usually taken as significant heterogeneity (note: threshold is 0.10, not 0.05)

What to do when heterogeneity is high:

• Use a random-effects model instead of fixed-effects
• Perform subgroup analyses to find the source
• Consider whether pooling is appropriate at all

7. Fixed-Effects vs Random-Effects Model

8. Step-by-Step Approach in an Exam

1. Read the title - what is the exposure/intervention and outcome?
2. Check the x-axis - what effect measure is used? What do the two sides mean?
3. Look at each study - does the CI cross 1? Which way does the point estimate lean?
4. Check box sizes/weights - which studies are driving the result?
5. Look at the diamond - does it cross the null line? What is the pooled estimate and its CI?
6. Check I² and p-value - is there heterogeneity? Was random or fixed effects used?
7. State the conclusion - is the overall result significant? In which direction? With what caveats?

9. Applied to the Pioglitazone Forest Plot (from Question 3)

1. Topic: Pioglitazone vs no pioglitazone; outcome = bladder cancer (HR used)
2. X-axis: Left = favours pioglitazone; Right = favours non-pioglitazone (more cancer risk)
3. Individual studies: Most CIs cross 1 (not individually significant) except Piccinni 2011 (HR 4.30) and Neumann 2012 (HR 1.22)
4. Weights: Neumann 2012 (16.96%) and Chang 2012 (15.48%) carry the most weight; Song 2012 (1.61%) has the least
5. Diamond: Sits entirely to the right of 1 - HR 1.50 (1.14-1.98) - statistically significant
6. Heterogeneity: I² = 78.8%, p = 0.000 - high heterogeneity - random-effects model was correctly used
7. Conclusion: Pioglitazone is associated with a 50% increased risk of bladder cancer, though high heterogeneity means this pooled estimate should be interpreted cautiously