What Is Bland-Altman Analysis?
Bland-Altman analysis — also called the method of differences or the difference plot — is a graphical and statistical technique for evaluating the agreement between two quantitative measurement methods applied to the same subjects. It was introduced by Martin Bland and Douglas Altman in their landmark 1986 paper in The Lancet, which has since become one of the most cited papers in medical literature, appearing in tens of thousands of subsequent studies.
The method directly addresses a specific clinical question: "Can these two measurement methods be used interchangeably for the same clinical purpose?" A new automated blood pressure device needs to agree with an auscultatory reference; a point-of-care HbA1c test needs to agree with a laboratory analyser; an ultrasound tumour volume estimate needs to agree with CT volumetry. In all these cases, the clinical audience needs to know not whether the two methods correlate, but whether their differences are clinically tolerable.
Bland-Altman analysis achieves this by plotting, for each subject, the difference between the two methods on the y-axis against the mean of the two methods on the x-axis — then calculating the mean bias (systematic offset between methods) and the 95% Limits of Agreement (the range within which 95% of future individual differences are expected to fall).
Why Correlation Cannot Answer the Method Comparison Question
The core methodological argument made by Bland and Altman in 1986 was that correlation is the wrong tool for method comparison — and this argument remains just as relevant forty years later, as papers using Pearson's r or Spearman's ρ to validate measurement methods continue to be published and criticised in peer review.
Correlation measures the strength of a linear relationship — whether two variables move together in the same direction. It does not measure agreement. Three specific limitations make correlation fundamentally unsuitable for method comparison:
- Insensitive to systematic bias: If Device A reads 10 mmHg higher than Device B for every patient, the correlation is still perfect (r = 1.00) because the rank ordering is preserved. Yet the devices are clearly not interchangeable for clinical use.
- Inflated by sample heterogeneity: Pearson's r increases automatically when the range of values in the sample is wide. A method comparison study with patients ranging from hypertensive to hypotensive will produce a higher r than the same study in a homogeneous sample — even if the measurement errors are identical in both. The r is measuring the sample range as much as the method agreement.
- No clinical units: A correlation of r = 0.92 gives no information about how many mmHg, mg/dL, or degrees the two methods differ in practice. It is dimensionless and cannot support clinical decisions about interchangeability.
Constructing the Bland-Altman Plot
For n subjects, each measured once by Method A and once by Method B, the Bland-Altman procedure involves four steps:
- Compute the difference for each subject: dᵢ = Aᵢ − Bᵢ
- Compute the mean for each subject: mᵢ = (Aᵢ + Bᵢ) / 2
- Plot dᵢ on the y-axis against mᵢ on the x-axis
- Draw three horizontal reference lines: the mean difference (bias), and the upper and lower 95% Limits of Agreement
Bland-Altman Plot Structure
The Core Calculations
The three key statistics from Bland-Altman analysis are the mean bias, the SD of differences, and the 95% Limits of Agreement:
Confidence Intervals for the Limits of Agreement
The LoA are estimates from a sample and have their own uncertainty. Bland and Altman (1986) provided formulas for the 95% confidence intervals around each limit:
- 95% CI for the mean bias: d̄ ± t₉₅ × (SDd / √n)
- 95% CI for each LoA: LoA ± t₉₅ × SDd × √(3/n)
These CIs should be plotted as horizontal error bars on the LoA lines in the Bland-Altman figure and reported numerically in the results section. Wide CIs around the LoA — which occur in small samples — indicate substantial uncertainty about the true limits and should be interpreted cautiously.
Interpreting the Bland-Altman Plot
What to Look for — Four Key Questions
- Is the mean bias clinically acceptable? A non-zero mean bias indicates Method A consistently reads higher or lower than Method B. Whether this is clinically acceptable depends on the context — a +2 mmHg bias in blood pressure is generally tolerable; a +0.5% bias in HbA1c straddles a diabetes management decision threshold.
- Are the Limits of Agreement within the pre-specified maximum acceptable difference? Both the upper and lower LoA must fall within the pre-specified clinically acceptable range for the methods to be considered interchangeable. If either LoA falls outside the acceptable range, the methods are not interchangeable — even if the mean bias is small.
- Is there proportional bias? Scan the scatter of points across the x-axis. If the points fan out or converge (differences grow larger or smaller as the mean increases), there is proportional bias — the two methods agree better in one part of the range than another. Formally test this with linear regression of dᵢ on mᵢ.
- Are approximately 5% of points outside the LoA? By definition, ~5% of differences should fall outside the 95% LoA. If substantially more than 5% fall outside, the LoA may be too narrow (violating the normality assumption) and the differences should be checked for outliers or the normality of the differences should be formally tested.
Proportional Bias in Detail
Proportional bias occurs when the discrepancy between two methods is not constant but scales with the magnitude of the measurement. This is common in analytes spanning a wide range (e.g., troponin from near-zero to very high, tumour diameter from 5 mm to 80 mm) where one method's measurement error grows proportionally with the true value.
Detection: compute Pearson's correlation between the differences (dᵢ) and the means (mᵢ). A statistically significant correlation (p < 0.05) confirms proportional bias. When present, the fixed LoA from standard analysis are invalid — the LoA are too wide at one end and too narrow at the other. Solutions include:
- Log transformation: Log-transform both measurements before Bland-Altman analysis; differences on the log scale become ratio differences on the original scale
- Regression-based LoA: Express the LoA as linear functions of the mean rather than constant values
- Report the regression equation: State "the difference between methods increases by X units for every Y-unit increase in the mean measurement"
Clinical Examples
✓ When Two Methods CAN Be Used Interchangeably
Both the upper AND lower Limits of Agreement fall within the pre-specified maximum acceptable difference. The mean bias is clinically negligible or within an accepted standard. No systematic proportional bias is detected across the measurement range.
✗ When Two Methods CANNOT Be Used Interchangeably
Either or both LoA exceed the pre-specified acceptable range. Significant proportional bias is present — methods agree at some values but diverge dangerously at others. Mean bias is acceptable but individual variation (SD of differences) is too large.
Extensions of the Bland-Altman Method
Repeated Measurements Per Subject
Standard Bland-Altman assumes one measurement per subject per method. When multiple measurements per subject are available (e.g., three readings by each method), the simple approach of randomly selecting one pair per subject wastes data. Bland and Altman (1999) described an extension for repeated measurements that uses within-subject means and variance components. The R package MethComp implements this directly with the BA.est() function. SPSS does not natively support this extension; a mixed-model approach is required.
Comparing Three or More Methods
When three methods are compared (e.g., CT, MRI, and ultrasound for the same measurement), separate pairwise Bland-Altman analyses are conducted for each pair of methods. There is no direct three-method extension of the Bland-Altman plot — each comparison remains pairwise. Adjust for multiple comparisons if the primary endpoint is whether any pair meets the acceptability criterion.
Log Transformation for Ratio Data
For measurements that span orders of magnitude (e.g., serum troponin, viral load, tumour marker levels), the proportional nature of measurement error is expected. Log-transform both measurements before Bland-Altman analysis. The differences on the log scale represent log-ratios, and the LoA on the log scale, when back-transformed, give the ratio Limits of Agreement: the new method is expected to read between X times lower and Y times higher than the reference.
Thesis and Research Reporting Recommendations
Bland-Altman analysis is a complete statistical method that requires specific elements in every section of a manuscript or thesis chapter:
Methods Section
State: (1) the study design (cross-sectional simultaneous comparison, paired test-retest, or crossover); (2) whether each method was applied by blinded assessors; (3) the order of method application and whether order was randomised; (4) the pre-specified maximum acceptable difference (MAD) with justification; and (5) whether proportional bias will be assessed and how. The MAD must be stated in the Methods section — defining it after seeing the results is an unacceptable form of outcome reporting bias.
Results Section
Always include the Bland-Altman plot as a figure with: individual data points, horizontal reference line at zero, horizontal line at the mean bias, dashed lines at both LoA, and optional 95% CI shaded bands around the LoA. If proportional bias was detected, add the regression line through the scatter.
Discussion Section
Interpret the clinical meaning of the LoA in terms that matter to clinicians. State clearly whether the two methods are interchangeable for their intended purpose, and if not, describe what modifications to the measurement protocol or instrument calibration would be required to achieve interchangeability.
Common Mistakes Researchers Make
Mistake 1: Using Pearson's r as a Method Comparison Statistic
Despite four decades of guidance from Bland and Altman, studies continue to report Pearson's r (or Spearman's ρ) as the primary evidence of method agreement. Correlation cannot detect systematic bias, is inflated by sample heterogeneity, and provides no clinically interpretable information about the magnitude of disagreement.
Mistake 2: Defining the Maximum Acceptable Difference After Seeing Results
Post-hoc MAD selection — choosing a threshold that the observed LoA happens to meet — is one of the most common and consequential forms of publication bias in method comparison research. It produces false validation of inadequate measurement tools.
Mistake 3: Ignoring Proportional Bias
Many Bland-Altman studies report the LoA without checking for proportional bias. When proportional bias is present (error increases or decreases across the measurement range), the constant LoA from standard analysis are misleading — they are too wide at one end of the range and too narrow at the other.
Mistake 4: Using the Paired t-Test Alone to Confirm Agreement
A non-significant paired t-test on the differences (p > 0.05) is sometimes cited as evidence that two methods agree. This only confirms that the mean bias is not distinguishable from zero — it gives no information about the spread of individual differences, which is what actually determines interchangeability in practice.
Mistake 5: Reporting the Plot Without Confidence Intervals on the LoA
Many published Bland-Altman plots show only the mean bias and LoA lines without confidence intervals. In studies with fewer than 100 subjects, the uncertainty around the LoA can be substantial — a lower LoA of −9.2 mmHg might have a 95% CI of −13.5 to −4.9, spanning both "within criterion" and "outside criterion."
Mistake 6: Using Multiple Measurements Per Subject Without Adjustment
When subjects contribute more than one measurement pair to the analysis (e.g., three readings per device), treating all pairs as independent violates the independence assumption, artificially narrows the SD of differences, and produces LoA that are too narrow — falsely suggesting better agreement than actually exists.
MethComp handles the extended method automatically.Mistake 7: Plotting Method A vs Method B Instead of Differences vs Means
Some researchers plot Method A on the x-axis and Method B on the y-axis (a standard scatterplot) and call it a Bland-Altman analysis. This is not Bland-Altman — it is a scatterplot. The power of Bland-Altman lies specifically in plotting differences against means, which makes systematic patterns, proportional bias, and outliers visually apparent in a way that a scatterplot cannot.
blandr or MethComp packages), or GraphPad Prism can produce the correct plot automatically.Scientific Reporting Standards
The following guidelines govern Bland-Altman reporting in high-quality clinical journals and thesis submissions:
- GRAPPA / STARD (Bossuyt 2015): For diagnostic test validation studies, report the Bland-Altman parameters alongside sensitivity and specificity — they address different aspects of test performance
- IEEE/AAMI SP10 standard: For blood pressure device validation, mandates Bland-Altman analysis with specific sample size (≥ 85 subjects), LoA criteria (±15 mmHg), and bias criteria (±5 mmHg)
- CLSI EP09 guideline: For laboratory method comparison, specifies Bland-Altman analysis as one of the required evaluation procedures alongside regression analysis
- EQUATOR network: The TRIPOD reporting guideline for clinical prediction models requires method comparison data to use Bland-Altman for continuous outcomes
Practical Recommendations for Medical Researchers
Define Your MAD From Literature, Not Your Data
Search for published clinical guidelines, validation standards, or biological variation data for your specific analyte or measurement. For HbA1c, consult the IFCC biological variation database. For blood pressure, consult IEEE/AAMI SP10. For imaging measurements, check the applicable RECIST or organ-specific guidelines. Your MAD should be evidence-based and documented before any data are collected.
Test Normality of Differences Before Applying Standard LoA
The 1.96 SD Limits of Agreement assume the differences are normally distributed. Test this with a Shapiro-Wilk test or a QQ plot of the differences. If the differences are right-skewed or bimodal, the LoA will not correctly capture the 95th percentile. In this case, use log transformation or bootstrapped LoA from the empirical distribution.
Randomise the Order of Method Application
If the order of measurement matters (patient fatigue, learning effects, environmental changes), randomise whether Method A or B is applied first in each subject. This prevents order effects from masquerading as systematic bias between methods. Document the randomisation procedure in your methods section.
Aim for at Least 50 Subjects (Ideally 100)
With n < 30, the 95% CIs around the LoA are very wide and the analysis is too imprecise for clinical validation decisions. Bland and Altman originally recommended approximately 100 subjects. For regulatory submissions (device CE marking, FDA clearance), standards typically require 85–100 subjects minimum.
Include a Clinical Context Statement
Always interpret the LoA in clinical terms — not just in statistical terms. "The 95% Limits of Agreement were −15.2 to +20.4 mmHg" should be followed by "This means the wearable device could read up to 20 mmHg higher than the reference in any given patient, which could lead to unnecessary antihypertensive treatment in borderline hypertensive individuals."
Report Both ICC and Bland-Altman for Complete Characterisation
ICC tells you the proportion of variance explained by true subject differences (a dimensionless reliability coefficient). Bland-Altman tells you the actual magnitude of measurement errors in clinical units. They answer different questions and together give a complete picture of measurement performance. Report both for any continuous reliability or agreement study.
Frequently Asked Questions
MethComp. Alternatively, use the mean of multiple measurements per subject as a single data point — though this reduces the apparent SD of differences and may not reflect single-measurement clinical use.Run Bland-Altman Analysis Online
Use StatClinic's Bland-Altman calculator to compute mean bias, Limits of Agreement, and 95% confidence intervals from your paired measurements. Get a publication-ready plot and complete numerical output formatted for thesis and journal submission.
Open Bland-Altman Calculator →