A pragmatic trial (also called an effectiveness trial or health services research study) is a clinical trial designed to measure the effectiveness of an intervention under real-world care conditions—in contrast to an explanatory trial (efficacy trial), which examines efficacy under idealized, strictly controlled experimental conditions. Pragmatic trials have gained considerable importance in evidence-based medicine and health technology assessment, as their results are directly transferable to actual care practice and can better inform decisions by reimbursement authorities and guideline developers.
Distinction: Explanatory Trial vs. Pragmatic Trial
The PRECIS-2 framework (Pragmatic-Explanatory Continuum Indicator Summary) describes clinical trials as a continuum between two poles:
- Explanatory Trials (Efficacy Trials): Highly selective patient populations, standardized intervention, intensive monitoring, strict exclusion criteria. Objective: Demonstration of maximum therapeutic potential under ideal conditions. Commonly used in Phase II/III registration trials.
- Pragmatic Trials (Effectiveness Trials): Broad, heterogeneous patient population, flexible intervention (as in practice), routine data collection, few exclusion criteria. Objective: Measurement of actual benefit in clinical practice. Commonly used in Phase IV trials and health services research.
In reality, most trials are hybrids. The PRECIS-2 framework evaluates nine dimensions (eligibility criteria, recruitment, setting, organization, flexibility of intervention, adherence, endpoints, follow-up, analysis) on a scale from 1 (explanatory) to 5 (pragmatic). Study teams use PRECIS-2 to assess early whether the study design matches the research question and to identify and communicate discrepancies between the intended and actually realized degree of pragmatism.
Study Design and Methodological Characteristics
Pragmatic trials frequently employ innovative design elements tailored to real-world care settings:
- Cluster Randomization: Randomization at the level of practices, hospitals, or regions rather than at the patient level to avoid contamination effects.
- Stepped-Wedge Design: All clusters begin in the control condition and switch to the intervention condition at different time points. Ethically advantageous, as all patients receive the intervention.
- Routine Data and Real-World Data: Use of medical records, billing data, or registry data for data collection, which reduces administrative burden and enables large sample sizes. In Germany, billing data from statutory health insurance or electronic patient records can serve as data sources, provided GDPR data protection requirements are met.
- Adaptive Randomization: Adjustment of allocation probabilities based on accumulating data to enable more efficient comparisons.
Regulatory and HTA Relevance
Reimbursement authorities such as G-BA, NICE, and HAS increasingly require effectiveness data from real-world care practice that go beyond the demonstration of efficacy in registration trials. Pragmatic trials can close this gap. The EMA supports the use of pragmatic trials within real-world evidence (RWE) programs and has published guidance on adaptive, pragmatic, and real-world evidence designs. At the same time, the lower internal control in pragmatic trials presents regulatory challenges: confounding, adherence issues, and lack of blinding can limit the interpretability of results. Regulators therefore require robust sensitivity analyses to demonstrate the robustness of results under different assumptions.
Relevance for clinical trials
Pragmatic trials close the evidence gap between what a therapy can achieve under ideal conditions (efficacy) and what it actually achieves in real-world care (effectiveness). This gap is highly relevant clinically and health-economically. Full-service CROs such as mediconomics support sponsors in planning pragmatic study designs, utilizing real-world data sources, conducting trials in real-world care settings, providing regulatory-compliant documentation for HTA submissions to G-BA or NICE, and PRECIS-2-based characterization of study design for regulators and reviewers.
Frequently Asked Questions (FAQ)
Does the EMA accept pragmatic trials as a basis for marketing authorization?
Yes, under certain conditions. The EMA has published guidance on real-world evidence and adaptive designs that explicitly include pragmatic elements. However, for initial marketing authorization, randomized controlled trials are generally preferred. Pragmatic trials primarily play a role in post-approval studies, license extensions, and evidence generation for HTA procedures.
What is the difference between a pragmatic trial and an observational study?
A pragmatic trial always includes randomization—it is a randomized controlled trial with pragmatic design elements. An observational study, on the other hand, does not randomize; patients receive interventions according to clinical decision-making. The pragmatic trial thus retains the essential advantage of randomization (confounder control) while simultaneously pursuing external validity through a realistic setting. This makes it a methodologically stronger instrument than the observational study when both real-world relevance and causal inference are required.
What is the PRECIS-2 framework and what is it used for?
PRECIS-2 (Pragmatic-Explanatory Continuum Indicator Summary 2) is an instrument for characterizing the design of a clinical trial on the continuum between explanatory and pragmatic. It comprises nine domains, each rated on a scale from 1–5. Study teams use PRECIS-2 during the planning phase to ensure that the study design matches the research question, and regulators and reviewers use it for transparent classification of the trial. PRECIS-2 ratings should be documented in study protocols and clinical study reports to create transparency about the intended degree of pragmatism and facilitate discussions about the external validity of results.
Regulatory References
- EMA Reflection Paper on the Use of Real World Data in Non-interventional Studies (EMA/CHMP/REG/613576/2020)
- ICH E8(R1) – General Considerations for Clinical Studies (2021): Pragmatic and explanatory study designs
- PRECIS-2 Framework: Loudon K et al., BMJ 2015;350:h2147
- FDA Guidance: Real World Evidence Program (2018): Pragmatic trials as RWE source
- G-BA Rules of Procedure § 35a SGB V: Requirements for study design and transferability to care practice