By Stef De Reys, PhD, expert trainer of Practical Statistics Course for Medical Affairs: Interpretation & Application
Besides dealing with efficacy data, Medical Affairs professionals are also concerned with safety data. Every clinical trial produces adverse events data. In treating patients, the benefit–risk discussion is never far away. If you have asthma, cold air puts you at risk of exacerbation. In heart failure, fluid overload may raise the risk of hospitalisation.
That sounds straightforward. In practice, however, risk data are one of the most consistently misread categories of statistics in medicine. A single number, taken out of context, can make a manageable safety signal sound catastrophic, or disguise a serious one behind a reassuring percentage.
This insight gives you a start in understanding: what risk actually is, how to measure it, how to test whether a difference is statistically real, and how to communicate it in a way that supports honest benefit–risk thinking.
In everyday language, risk is synonymous with danger. In statistics, it means something more precise: the probability that a specific event occurs in a defined group of people over a defined period of time.
Risk is always a proportion. It is a number between 0 and 1 — or expressed as a percentage between 0% and 100%. It answers one question:
Out of all the patients in this group, how many experienced this event?
We call this risk the absolute risk. A risk of 0.05 means 5 patients out of 100 experience the event. When, in a vaccine group, 144 patients suffer from headache out of 400 total patients, the absolute risk is 36% (i.e. 144/400=0.36). So absolute risk assessment – as from an AE table from a randomised trial - is straightforward and simple.
In addition, that simple calculation has important statistical consequences.
A proportion has a known mathematical structure: it has a numerator (the number of events) and a denominator (the total number of patients)1. Because of that structure, you do not need complex software to quantify the uncertainty around it. The 95% confidence interval follows directly from the binomial distribution, and can be approximated using a straightforward formula.
In the headache example above: 144 patients suffer from headache out of 400 patients.
This tells you that the true headache rate in the vaccinated population plausibly lies between 31.3% and 40.7% — a reassuringly narrow interval, because the sample size of 400 is reasonably large.
In another trial, 9 patients out of 25 suffer from headache. The absolute risk is the same.
The sample size for risk calculation (denominator) is and remains important. A larger sample size increases our confidence.
1 Importantly, both numerator and denominator are needed. Most often, numerators are cited in medical literature and communication and the denominator is sometimes overlooked.
When you compare two risks, you can express the comparison in two fundamentally different ways:
Returning to the above example - headache in the vaccine trial with large sample size:
| Adverse Event | Vaccine group (n=400) | Placebo group (n=400) |
|---|---|---|
| Headache | 144 | 60 |
| Absolute Risk | 144/400=0.36 36 % | 60/400=0.15 15 % |
The Absolute Risk Difference is 36-15 = 21%.
Knowing ARD is knowing reality. There is a real difference of 21% between the vaccine group and the placebo group.
The Relative Risk (RR) means something different. It tells you how many times higher (or lower) the risk is in one group versus another.
The risk of headache is 2.4 ( (36%)/(15%) ) times higher in the vaccine group than in the placebo group.
The gap between ARD and RR is where most risk communication mistakes are made. Which one sounds the most daunting? That the absolute risk of headache is 21 % higher in the vaccine group or that the risk of headache is 2.4 times higher?
In fact, you cannot compare these numbers and they each serve a different purpose.
This is especially useful in risk-benefit discussions, safety communication, questions from health-care providers about clinical relevance, explaining results to non-statistical audiences or in situations where baseline risk matters. It gives clinical meaning.
In the above example there is a real risk difference of headache of 21%. That is meaningful as you weigh this number vs the potential benefit of the vaccine (vs placebo).
In many instances, this number is also used to calculate how many more patients you can treat (with the vaccine) before the next headache emerges. This is given by the formula:
(NNT) = 1/ARD
The number needed to treat/harm (NNT or NNH)2 before the next headache in the vaccine group arises is 1/0.21 = 4.8 ≈ 5.
This means that for every 5 patients treated with vaccine rather than placebo, 1 additional headache is expected on average over the same timeframe.
2 Often also called NNH: number needed to “harm” as in a risk context, risks are associated with unwanted effects i.e. “harm”. So NNT becomes NNH. It is often a matter of semantics.
This is especially useful when you want to compare groups quickly, summarise strength of association.
In many tables, abstracts, and literature, relative risks are standard as strength of evidence gained importance. It gives comparative magnitude.
The communication about these stats is less straightforward. Correct statements can be found in the table below:
| Relative Risk value | Say |
|---|---|
| RR = 2.0 | “The risk is twice as high” |
| RR = 1.0 | “There is no risk difference” |
| RR= 0.5 | “The risk is half as high” or “The risk is 50 % lower” or “there is a 50 % risk reduction” |
| RR=1.25 | “The risk is 25 % higher” |
| RR=0.80 | “The risk is 20 % lower” |
Consider this scenario. A trial reports two adverse events:
7× Fever risk increase | 2× Headache risk increase |
At first glance, fever looks far more alarming. A sevenfold increase sounds like a crisis. A twofold increase sounds manageable.
This is one of the pitfalls when only one risk statistic (i.e. RR) is reported.
Let’s complete the picture by adding the correct baseline:
| Adverse Event | Vaccine group | Placebo group | Relative Risk |
|---|---|---|---|
| Fever | 3.5% | 0.5% | 7.00 |
| Headache | 37.0% | 15.5% | 2.39 |
You can see that baseline values for headache are much higher. This has consequences:
| Adverse Event | Absolute Risk Diff. | Extra patients/100 | NNT |
|---|---|---|---|
| Fever (RR 7.00) | +3.0% | 3 per 100 | ≈ 33 |
| Headache (RR 2.39) | +21.5% | 22 per 100 | ≈ 5 |
What is our clinical reality?
Although headache has a lower relative risk (2.39 vs 7.00), it is clinically more burdensome. The absolute impact is 22 extra patients with headache per hundred. For fever, this is only 3 patients per 100. When you vaccinate 5 more patients, you already will see headache. For fever, you need to vaccinate 33 patients before one additional fever occurs.
In conclusion, although relative risk can show dramatic increases, the real clinical impact can be different. In this example, the 7-fold increase for fever, because of its low baseline, is clinically less severe than for headache.
Never report one risk measure alone.
Always communicate risk using these three together:
Use AR + ARD + RR in that order every time.
When you see a safety claim, run this checklist before drawing any conclusion or communicating any finding:
| Ask yourself… | Why it matters |
|---|---|
| What is the absolute risk (AR) in each group? | Always your baseline number. |
| What is the absolute risk difference (ARD)? | The real-world impact on patients. |
| What is the 95% confidence interval? | Precision — is the estimate reliable – the calculation is easy? |
| What is the relative risk (RR)? | Comparator strength – but only when your baseline is clear. |
| Is the difference statistically significant (p-value)? | We want to know if the ARD is real or due to chance only – easy statistical tools for this exist. |
Risk is everywhere and being able to communicate it well matters from a medical affairs perspective. It is in every safety table, every benefit–risk discussion, every medical education session, and every stakeholder conversation. This does not have to be daunting.
The tools to calculate, understand and communicate about risk are not complex.
Use them together, report them in order, and risk data stop being intimidating — and start being one of the most powerful tools in your Medical Affairs toolkit.
Continue your learning from Stef
If you’d like to learn more from Stef, CELforPharma also offers a 1-day, hands-on course where you'll learn how to:
Don’t miss the latest insights from our expert faculty
Subscribe to our newsletter to: