Tag Archives: Pragmatic clinical trial

The Department of Health and Human Services and 15 other agencies announce changes to Common Rule

The Department of Health and Human Services and 15 other agencies have announced revisions to the Federal Policy for the Protection of Human Subjects, otherwise known as the Common Rule. The final rule can be found here and will be officially published in the Federal Register on January 19, 2017.

The changes to the rule that will have a significant impact on the conduct of pragmatic clinical trials and embedded research include:

  • New requirements regarding the information that must be given to patients as part of the informed consent process, including
    • Key information that is most important to the subject and likely to help a patient (or legal representative) make a decision about participation
    • An opportunity to discuss the information
    • An approach that emphasizes the fostering of overall understanding (as opposed to specific length requirements)
  • Allowing the use of broad consent for the use of identifiable information or identifiable biospecimens for other research studies (other than the proposed one) for
    • Storage and maintenance for secondary research use
    • Secondary research (including future uses)
  • New exempt categories of research based on risk profile
  • A requirement for U.S.-based institutions engaged in cooperative research to use a single Institution Review Board (IRB)
  • A removal of the requirement for continuing review of ongoing research for studies that undergo expedited review.

New NIH Funding Opportunity to Support Collaboratory Demonstration Projects


A new funding opportunity announcement from the NIH solicits applications to support Demonstration Projects that include an efficient, large-scale pragmatic clinical trial. Trials must be conducted across two or more health care systems (HCS) and must be conducted as part of the NIH HCS Research Collaboratory supported through the NIH Common Fund. Awards made through this FOA will initially support a one-year milestone-driven planning phase (UG3), with possible rapid transition to the second implementation phase (UH3) for a pragmatic trial Demonstration Project.

Access the full funding announcement: RFA-RM-16-019

Important Due Dates
   Earliest submission date: May 2, 2017
   Letter of intent date: 30 days prior to application due date
   Application due date: June 2, 2017

NIH Collaboratory ABATE Infection Trial Highlighted in Wall Street Journal


Susan Huang, MD, MPH
Dr. Susan Huang

The ABATE Infection trial, an NIH Collaboratory project led by Dr. Susan Huang, is featured in the September 12 Health section of the Wall Street Journal. The article describes several studies aimed at preventing the hospital-associated infection MRSA (methicillin-resistant Staphylococcus aureus).

In the Reduce MRSA trial, published in 2013, Dr. Huang’s team demonstrated that treating ICU patients with a germ-fighting soap plus a nasal antibiotic ointment, an approach called “universal decolonization,” was superior to standard approaches in preventing MRSA infections. The ABATE Infection trial examines similar approaches to decolonization for all patients in non–critical care medical and surgical units, comparing the use of an antiseptic bath and nasal ointment to standard bathing and showering. More than 1 million showers and baths were taken over the course of the study, which has now completed enrollment. Data from ABATE are currently being analyzed, with the results expected to inform whether this strategy is effective in reducing hospital-associated infections.

“These are preventable infections and we should be able to drive them down to zero.” Susan Huang, MD

Read The Ultimate Battle Against MRSA in the WSJ.

Read more about the ABATE Infection trial.

Watch the ABATE Infection training video.

New NIH Collaboratory resource for the transparent reporting of PCTs


The NIH Collaboratory has developed a tool to assist authors in the complete and transparent reporting of their pragmatic clinical trials (PCTs). In the PCT Reporting Template, users will find descriptions of reporting elements based on CONSORT guidance as well as on expertise from the NIH Collaboratory Demonstration Projects and Core working groups.

Particularly relevant to PCTs are recommendations on how to report the use of data from electronic health records. Other elements of importance to PCTs include reporting wider stakeholder engagement, monitoring for unanticipated changes in study arms, and specific approaches to human subjects protection. The template contains numerous links to online material in the Living Textbook, CONSORT, and the Pragmatic–Explanatory Continuum Indicator Summary tool known as PRECIS-2.

This resource is intended to assist authors in developing primary journal publications. It will be updated over time as new best practices emerge for the transparent reporting of PCTs.

Download the PCT Reporting Template.

Please note: this document opens as an Adobe PDF. If you do not have software that can open a PDF, click here to download a free version of Adobe Acrobat Reader.


This work was supported by a cooperative agreement (U54 AT007748) from the NIH Common Fund for the NIH Health Care Systems Research Collaboratory. The views presented in this document are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.


Originally published on September 1, 2016.


  • Questions or comments can be submitted via email. Please add “Living Textbook” to the Subject line of the email.

Trauma Survivors Outcomes and Support (TSOS) trial publishes design paper


The study team for the Trauma Survivors Outcomes and Support (TSOS) trial recently published their study protocol in Implementation Science. TSOS, an NIH Health Care Systems Research Collaboratory Demonstration Project, is an effectiveness-implementation hybrid trial designed to test the delivery of screening and intervention for PTSD and comorbidities across 24 U.S. level I trauma center sites. The study employs a stepped-wedge, cluster-randomized design in which sites are randomized sequentially to initiate the intervention. The study aims to determine if injured patients receiving a collaborative care intervention demonstrate significant reductions in PTSD symptoms when compared with control patients receiving usual care. The study will also evaluate whether intervention patients demonstrate significant reductions in depressive symptoms and associated suicidal ideation, alcohol use problems, and improvements in physical function.

The open access article is available here: An effectiveness-implementation hybrid trial study protocol targeting posttraumatic stress disorder and comorbidity


FDA Cites Collaboratory as Part of a National System for Generating Clinical Evidence

In a recent post on the FDA’s “FDA Voice” blog, Associate Deputy Commissioner Rachel Sherman and Commissioner Robert Califf describe how to overcome barriers to data sharing and create a successful national system for medical evidence generation (or “EvGen”). To foster new approaches for creating clinical evidence the authors suggest 3 principles:

“1. There must be a common approach to how data is presented, reported and analyzed and strict methods for ensuring patient privacy and data security.

2. Rules of engagement must be transparent and developed through a process that builds consensus across the relevant ecosystem and its stakeholders.

3. To ensure support across a diverse ecosystem that often includes competing priorities and incentives, the system’s output must be intended for the public good and be readily accessible to all stakeholders.”

Drs. Sherman and Califf point to substantial pioneering work being done in secondary use of data, in which data collected for clinical care are “secondarily” used for research, including projects currently underway through the NIH Collaboratory, PCORnet, and other initiatives and networks. The experience gained from these groundbreaking efforts should provide a foundation for a national system for evidence generation.

Read the full post here.

Recent Collaboratory Publications on Research Ethics


The American Journal of Bioethics has recently published three articles authored by members of the Regulatory/Ethics core group describing various questions related to research on medical practices:

  • Is shared decision making an appropriate analytic frame for research on medical practices (Sugarman 2015) discusses the role of shared decision making (SDM) in research on medical practices. The author cautions that “while SDM is in many ways similar to informed consent, there are some important differences, especially in the research setting.” This publication is freely accessible through PubMed Central.
  • Patients’ views concerning research on medical practices: implications for consent (Weinfurt et al. 2015) describes the results of focus group sessions that elicited a range of patients’ views and opinions about different types of research on usual medical practices. The authors state that “our data suggest that effective policy and guidance will involve balancing different patients’ interests and potentially different sets of interests for different types of research studies on usual medical practices.”
  • Ethics of research in usual care settings: data on point (Sugarman 2016) introduces a special five-article supplement in the American Journal of Bioethics, stating that the “growing empirical ethics literature regarding research in usual care settings provides data to inform conceptual and policy debates regarding this research and suggests areas that require further study.”

These publications were supported by a bioethics supplement awarded to the Regulatory/Ethics Core group by the NIH’s Office of the Director.


STOP CRC Trial: Analytic Challenges and Pragmatic Solutions


Investigators from the STOP CRC pragmatic trial, an NIH Collaboratory Demonstration Project, have recently published an article in the journal eGEMs describing solutions to issues that arose in the trial’s implementation phase. STOP CRC tests a program to improve colorectal cancer screening rates in a collaborative network of Federally Qualified Health Centers by mailing fecal immunochemical testing (FIT) kits to screen-eligible patients at clinics in the intervention arm. Clinics in the control arm provided opportunistic colorectal-cancer screening to patients at clinic visits in Year 1 and implemented the intervention in Year 2. In this cluster-randomized trial, clinics are the unit of analysis, rather than individual patients, with the primary outcome being the proportion of screen-eligible patients at each clinic who complete a FIT.

The team dealt with various challenges that threatened the validity of their primary analysis, one of which related to potential contamination of the primary outcome due to the timing of the intervention rollout: for control participants, the Year 2 intervention actively overlapped with the Year 1 control measurements. The other challenge was due to a lack of synchronization between the measurement and accrual windows. To deal with these issues, the team had to slightly modify the study design in addition to developing a few sensitivity analyses to better estimate the true impact of the intervention.

“While the nature of the challenges we encountered are not unique to pragmatic trials, we believe they are likely to be more common in such trials due to both the types of designs commonly used in such studies and the challenges of implementing system-based interventions within freestanding health clinics.” (Vollmer et al. eGEMs 2015)

The Publish EDM Forum Community publishes eGEMs (generating evidence & methods to improve patient outcomes) and provides free and open access to this methods case study. Readers can access the article here.

Applying PRECIS Ratings to Collaboratory Pragmatic Trials

A new article published in the journal Trials provides a look at how the  Pragmatic–Explanatory Continuum Indicator Summary, or PRECIS, rating system can be applied to clinical trials designs in order to examine where a given study sits on the spectrum of explanatory versus pragmatic clinical trials.

The PRECIS-2 criteria are used to rate study designs as more or less “pragmatic” according to multiple domains that include participant eligibility, recruitment methods, setting, organization, analysis methods, primary outcomes, and more. In this context, “pragmatic” refers to trials that are designed to study a therapy or intervention in a “real world” setting similar or identical to the one in which the therapy will actually be used. Pragmatic trials stand in contrast to explanatory trials, which are typically designed to demonstrate the safety and efficacy of an intervention under highly controlled conditions and in carefully selected groups of participants, but which may also be difficult to generalize to larger or more varied populations.

Schematic of PRECIS-2 Wheel used to evaluate where a given trial design resides upon the explanatory-pragmatic spectrum.
PRECIS-2 Wheel.  Kirsty Loudon et al. BMJ 2015;350:bmj.h2147. Copyright 2015 by British Medical Journal Publishing Group. Used by permission.

Clinical trials are almost never wholly “explanatory” or wholly “pragmatic.” Instead, many studies exist somewhere on a spectrum between these two categories. However, understanding how these different attributes apply to trials can help researchers design studies that are optimally fit for purpose, whether that purpose is to describe a biological mechanism (as in an explanatory trial) or to show how effective an intervention is when used across a broad population of patients (as in a pragmatic trial).

In their article in Trials, authors Karin Johnson, Gila Neta, and colleagues  applied PRECIS-2 criteria to 5 pragmatic clinical trials (PCTs) being conducted through the NIH Collaboratory. Each trial was found to rate as “highly pragmatic” across the multiple PRECIS-2 domains, highlighting the tool’s potential usefulness in guiding decisions about study design, but also revealing a number of challenges in applying it and interpreting the results.

Study authors Johnson and Neta will be discussing their findings during the NIH Collaboratory’s Grand Rounds on Friday, January 22, 2016 (an archived version of the presentation will be available the following week).


Johnson KE, Neta G, Dember LM, Coronado GD, Suls J, Chambers DA, Rundell S, Smith DH, Liu B, Taplin S, Stoney CM, Farrell MM, Glasgow RE. Use of PRECIS ratings in the National Institutes of Health (NIH) Health Care Systems Research Collaboratory. Trials. 2016;17(1):32. doi: 10.1186/s13063-016-1158-y. PMID: 26772801. PMCID: PMC4715340.
You can read more about the NIH Collaboratory PCTs featured as part of this project at the following links:

ABATE (Active Bathing to Eliminate Infection)

LIRE (A pragmatic trial of Lumbar Image Reporting with Epidemiology)

PPACT (Collaborative Care for Chronic Pain in Primary Care)

STOP-CRC (Strategies & Opportunities to Stop Colon Cancer in Priority Populations)

TIME (Time to Reduce Mortality in End-Stage Renal Disease)
Additional Resources

An introductory slide set on PCTs (by study author Karin Johnson) is available from the Living Textbook:

Introduction to Pragmatic Clinical Trials

The University of Colorado Denver - Anschutz Medical Campus publishes an electronic textbook on pragmatic trials:

Pragmatic Trials: A workshop Handbook

 

 

 

New Lessons Learned Document Draws on Experiences of Demonstration Projects

The NIH Collaboratory’s Health Care Systems Interactions Core has published a document entitled Lessons Learned from the NIH Health Care Systems Research Collaboratory Demonstration Projects. The Principal Investigators of each of the Demonstration Projects shared their trial-specific experience with the Core to develop the document, which presents problems and solutions for initiation and implementation of pragmatic clinical trials (PCTs). Lessons learned are divided into the following categories: build partnerships, define clinically important questions, assess feasibility, involve stakeholders in study design, consider institutional review board and regulatory issues, and assess potential issues with biostatistics and the analytic plan.

Other tools available from the Health Care Systems Interactions Core include a guidance document entitled Considerations for Training Front-Line Staff and Clinicians on Pragmatic Clinical Trial Procedures and an introduction to PCTs slide set.