Skip to main content

Effect of hospital-at-home vs. traditional brick-and-mortar hospital care in acutely ill adults: study protocol for a pragmatic randomized controlled trial

Abstract

Background

Delivering acute hospital care to patients at home might reduce costs and improve patient experience. Mayo Clinic’s Advanced Care at Home (ACH) program is a novel virtual hybrid model of “Hospital at Home.” This pragmatic randomized controlled non-inferiority trial aims to compare two acute care delivery models: ACH vs. traditional brick-and-mortar hospital care in acutely ill patients.

Methods

We aim to enroll 360 acutely ill adult patients (≥18 years) who are admitted to three hospitals in Arizona, Florida, and Wisconsin, two of which are academic medical centers and one is a community-based practice. The eligibility criteria will follow what is used in routine practice determined by local clinical teams, including clinical stability, social stability, health insurance plans, and zip codes. Patients will be randomized 1:1 to ACH or traditional inpatient care, stratified by site. The primary outcome is a composite outcome of all-cause mortality and 30-day readmission. Secondary outcomes include individual outcomes in the composite endpoint, fall with injury, medication errors, emergency room visit, transfer to intensive care unit (ICU), cost, the number of days alive out of hospital, and patient-reported quality of life. A mixed-methods study will be conducted with patients, clinicians, and other staff to investigate their experience.

Discussion

The pragmatic trial will examine a novel virtual hybrid model for delivering high-acuity medical care at home. The findings will inform patient selection and future large-scale implementation.

Trial registration

ClinicalTrials.gov NCT05212077. Registered on 27 January 2022

Peer Review reports

Background

Hospital care accounts for one-third of the US medical expenditures yet can be unsafe for some patients, with adverse events being common [1]. Furthermore, many patients prefer to be at home and days spent at home has been increasingly considered a patient-centered goal and outcome [2]. The “Hospital at Home” (HaH) model has been developed to deliver the necessary services, technology, and capabilities to safely shift hospital-level care to a patient’s home. Previous studies suggested that this approach might reduce cost and healthcare use while improving patient outcomes and experience when compared with usual hospital care for acutely ill adults [3,4,5,6,7,8,9]. However, these studies are either non-randomized studies or small randomized controlled trials (RCTs), mostly from other countries [10,11,12].

More importantly, previous HaH programs often are confined to a small number of local patients since most programs rely on clinicians to frequently travel to patients’ homes to deliver care. This model faces scalability barriers as it would be resource-intensive to scale to large, broad populations. Mayo Clinic recently established a novel HaH program, i.e., Advanced Care at Home (ACH), which combines a virtual physician-staffed command center with a vendor-mediated supply chain that can deliver high-acuity care across rural, suburban, and urban settings. In this new model, all physician visits are virtual; the nursing care, including care coordination and planning, is also virtual and synchronized with other care team members who visit patients’ homes. As such, we aim to conduct a pragmatic randomized controlled trial (RCT) to compare two acute care delivery models: ACH vs. traditional brick-and-mortar hospital care in acutely ill patients.

Methods/design

This is a pragmatic non-inferiority RCT with two parallel groups and 1:1 allocation ratio. A total of 360 acutely ill patients will be enrolled and randomized to either ACH or traditional brick-and-mortar hospital care. The study was approved by the Mayo Clinic Institutional Review Board (IRB) and was registered on ClinicalTrials.gov (NCT05212077). The SPIRIT checklist is attached as Additional file 1 and the World Health Organization Trial Registration Dataset is attached as Additional file 2.

Setting

The trial will be conducted at Mayo Clinic sites where ACH is currently being delivered, including three hospitals in Phoenix, Arizona, Jacksonville, Florida, and Eau Claire, Wisconsin, respectively. The hospitals in Arizona and Florida are academic medical centers, and the hospital in Wisconsin is a community-based practice.

Study population

Adult patients (≥18 years) who are acutely ill will be screened for eligibility. Acutely ill patients are those deemed by the emergency department (ED) or inpatient attending physicians as requiring acute inpatient care based on InterQual ® criteria, a well-established set of criteria adopted by most hospitals. Because we aim to compare two care models currently used in routine practice, the local clinical teams (not the research team) will make the final decision regarding eligibility and will refer eligible patients to the research team. The enrollment workflow will follow these steps: if the ED or inpatient attending physician decides to admit or transfer a patient, the physician will contact the ACH team to screen the patient based on clinical criteria, zip code, and health insurance plan. Eligible patients must have a chief complaint currently targeted by the ACH program (Table 1). The patients will be further screened based on the zip codes of their home address since they must reside in areas where ACH can be delivered (Table 2). Patients will also need to have health insurance plans that cover the ACH services (Table 3). In preliminary analyses, most patients were eligible for ACH services based on health insurance plans, as the study population consists of mostly older adults insured by Medicare. Patients randomized to receive either ACH or traditional inpatient hospital care will be reimbursed by their health insurance plans. Although patients might be responsible for certain out-of-pocket costs, such as deductible, copay, and coinsurance, the out-of-pocket costs have been comparable for patients receiving ACH or traditional brick-and-mortar hospital care based on our experience over the past several years. As the study aims to compare two care models already used in routine practice, the research team will not cover the costs of routine care.

Table 1 Inclusion criteria—examples of qualifying diagnoses
Table 2 Inclusion criteria—zip codes
Table 3 Inclusion criteria—health insurance plans

If the local clinical team concludes a patient would benefit more from one treatment, then the patient would not be eligible for randomization. Examples of exclusion criteria include residing in a nursing home, on or requiring dialysis, positive for COVID-19, having a discharge order, requiring intensive care unit (ICU) level of care, or a history of drug abuse (Table 4). Patients will also need to meet the clinical stability criteria (Additional file 3: Clinical Stability Screen). Additionally, eligible patients must have the capacity to consent or could assent with the consent of a health care proxy who is physically present.

Table 4 Exclusion criteria

If a patient is eligible, an ACH case manager or nurse will give a brief introduction of the ACH model to the patient. If the patient is interested, the case manager/nurse will complete the social stability screening (Additional file 4: Social Stability Screening) with them to make a final determination as to whether or not the patient is eligible for ACH. If the patient passes the social stability screening and is still interested in exploring the ACH option, the local clinical team will connect with a study coordinator who will inform patients in more detail of the opportunity to participate in the study, including the study purpose, procedures, risks, and benefits. Potential participants will be informed that participation in the research study is voluntary and that they are free to decline to be in the study or to withdraw from it at any point without any negative consequence. Additionally, they will be informed that the option to receive ACH or traditional brick-and-mortar hospital care will still be available to them outside of participation in the study. The study coordinators will consent and enroll patients using the attached consent form (Additional file 5).

Randomization

Patients will be randomized in a 1:1 ratio to either ACH or traditional brick-and-mortar hospital care. The randomization algorithm will be generated within the Remote Data Capture (REDCap) software system, using stratified block randomization with blocks of random size. As the clinical trial will be stratified by site, randomization is then performed separately within each stratum level, utilizing blocks of random size. The study coordinators will implement the randomization in REDCap and assign participants. Due to the nature of the intervention, blinding is not feasible for trial participants and care providers. Of the study team members, the study coordinators, analysts, and the data manager will know the randomization due to their roles and responsibilities, including implementing randomization, ensuring data quality, and providing reports to the Data and Safety Monitoring Board (DSMB). The rest of the study team, e.g., the principal investigators and co-investigators, will be blinded to the allocation.

Intervention

The Mayo Clinic ACH model was previously described (Paulson et al., in press) and the procedures used in the trial will be the same as those established in current routine practice. In short, the ACH program consists of three key components, linked by Medically Home’s Cesia ContinuumTM software platform: (1) Command Center, staffed with physicians, registered nurses (RNs), and advanced practice providers (APPs, i.e., physician assistants and advanced nurse practitioners); (2) technology in the home with custom technology kits, including biometric devices for monitoring vital signs, a custom-configured tablet with video visit capability, a telephone to facilitate 2-way communication, a backup power supply, a backup cellular communication device, and an emergency response system bracelet to keep patients and their families connected to the care team; and (3) care delivery services that include a full suite of escalation of care services, such as nurse practitioners, community paramedics, skilled nursing services, infusion therapy, phlebotomists, basic radiography technicians, and oxygen, dispatched to patients in their homes to allow for the provision of urgent and routine patient care needs.

Once a patient is randomized to the ACH arm, an admission huddle will be coordinated by the ACH physician, ACH RN, and service coordinator to plan patient-specific care and address care coordination needs. The patient will be physically transported home by community paramedics who set up the necessary technology and orient the patient and caregivers to that technology.

During the acute phase, daily rounds will be conducted by video with the ACH physician or in the patient’s home by APP with or without the presence of ACH physician by video. The physician and APPs huddle each day prior to rounds to determine if a patient is best served by an in-person visit, video visit, or both types of provider visits on the same day. Basic radiographic exams, such as x-rays and ultrasound, will be performed at home. Labs will be obtained and intravenous medications will be administered by a visiting nurse or community paramedic. Any advanced imaging or procedures will be accommodated by bringing the patient to the brick-and-mortar hospital and returning home upon completion. Any escalation of care to the hospital will be arranged as a transfer through the hospital admissions and transfer center. The endpoints for the acute phase are similar to the traditional hospital endpoints for discharge.

The next phase of care will be the restorative phase, which involves patient and family education, medication adherence, advanced care planning, and physical and occupational therapy to address patient-specific goals of care, such as optimizing medical and non-medical issues that result in hospitalization and monitoring for early signs of clinical decompensation. APPs will perform as-needed video and in-home visits and coordinate care during this phase of care. During the restorative phase, medications will be prescribed and sent to the patient’s preferred pharmacy. Any recommended outpatient clinical appointments will be coordinated to optimize their medical conditions. Near the end of the restorative phase, the discharge will be coordinated by the APPs and a handoff will be provided to the patient’s primary care physician. Home technology and equipment will be then removed, and the patient will be given discharge instructions prepared by the clinicians.

Of note, minor modifications to the care process or procedures are common in routine practice and could happen during the trial in both the ACH arm and the inpatient hospital care arm, due to quality improvement efforts or other operational needs. The project aims to compare two care models already in practice, and the research team does not interfere with or control clinical teams’ day-to-day operation. Local clinical and operational teams are responsible for communicating such modifications with patients and providers, but such changes in routine practice do not need to be reported to IRB. The principal investigators will work with the project manager and study coordinators to report to IRB regarding protocol deviation and other unexpected protocol amendments beyond routine practice changes and communicate with other relevant parties.

Due to the nature of the intervention (i.e., the delivery of acute care at home versus in the brick-and-mortar hospital), criteria for discontinuing or modifying allocated intervention are not needed. If patients in the ACH arm are transferred back to the hospital during the acute phase, such events will be recorded and reported as adverse events, and if patients are re-admitted during the restorative phase, such events will be counted in the outcome, i.e., 30-day readmission. A highly pragmatic trial would allow full flexibility in how the end-users engage with the intervention in order to estimate real-world effectiveness. Therefore, this trial will not utilize additional strategies to improve adherence above what are used in routine practice to engage patients. According to previous experience in practice, the cross-over between the two care delivery models has been rare. Any cross-over events will be recorded.

Baseline measurements

Patient-level baseline data will be collected from the Mayo Clinic electronic health record (EHR), including age, sex, race, ethnicity, address, and the primary diagnosis for admission. These data will be ascertained at the time of randomization.

Outcomes and follow-up

Follow-up will start from the day of randomization. It will contain two phases: the acute care phase (for the traditional inpatient care, this will last until the discharge from the hospital) and 30 days after the acute care phase. The primary outcome is a composite of all-cause mortality and 30-day readmission. The 30-day readmission will be assessed during the 30 days after the end of the acute phase. Transfers of ACH patients back to the hospital during the acute care phase will be recorded.

Secondary outcomes include individual outcomes in the composite endpoint, fall with injury, medication error, emergency room visit, transfer to ICU, cost, the number of days alive out of the hospital, and quality of life. Fall with injury will be defined based on National Database for Nursing Quality Indicators criteria (Table 5). Medication error is defined in Table 6. Quality of life will be measured by the EQ-5D during the follow-up phone call (Fig. 1).

Table 5 Definition of fall with injury
Table 6 Definition of medication error
Fig. 1
figure 1

Schedule of enrollment, interventions, and assessments

The outcomes will be collected from the EHR, supplemented by a follow-up call from a study coordinator at the end of the study, i.e., after the 30th post-acute day. During this call, the study coordinator will ask the patient or the caregiver to ascertain outcomes, including mortality, readmission, fall with injury within 30 days, and medication errors. This follow-up call is necessary as some patients might receive care outside of Mayo Clinic not reflected in our EHR. If a participant has received care outside of Mayo Clinic, the study coordinator will send the participant an authorization for the release of records to sign and return by mail. The research team will contact relevant clinicians for additional outcome adjudication if needed. The study coordinator will also administer a 5-question measure of the quality of care (EQ-5D; Appendix EQ-5D) via phone [13], and a short survey to examine their care experience (Appendix Patient Care experience Survey) [14]. Patients and caregivers will receive up to three phone calls if they cannot be reached.

Exploratory studies will be conducted using EHR data to examine the same outcomes over longer periods of time, such as 91 days, 183 days, and one year.

Patient experience and implementation

Semi-structured interviews will be conducted with a sample of patients/caregivers and clinicians/staff. We will use a purposeful sampling strategy to identify interviewees that represent each of the 3 sites and differing diagnosis groups. The number of patients and hospital staff is not pre-determined since qualitative research is concerned with the richness of the information rather than hypothesis testing. The data will be iteratively collected and analyzed; additional participants will be recruited as needed to understand emerging topics and explore variation. We expect to interview about 25–30 patients and 15–20 clinicians/staff. Patients will be recruited by phone after they have completed the study. Care team members will be invited via email to participate in an individual or group interview.

We will use the Systems Engineering Initiative for Patient Safety model [15] and the Consolidated Framework for Implementation Research [16, 17] to inform the qualitative data collection and analysis. A patient interview guide that was developed based on a previous study [18], focused on understanding patients’ experience with home hospital care (Additional file 6: Patient Interview Guide). A clinician and staff interview guide was developed to assess care team perceptions of ACH and to identify factors influencing implementation (Additional file 7: Clinician and Staff Interview Guide).

Interviews will last 45–60 min and be conducted by an experienced qualitative interviewer via telephone or video (depending on participant preference) and will be recorded. The recordings will be transcribed verbatim and analyzed using a content analysis approach [19, 20]. Two study members will review each interview transcript and make notes of their initial impressions (analytic memos). Those notes will be used to generate labels or codes, which will be arranged into higher-order categories related to the study aims. Preliminary analysis of the data will be concurrent with data collection to refine interview procedures to respond to emerging topics, and as part of our strategy to rapidly analyze data for timely dissemination and to inform intervention adaptations. Rapid analysis will leverage structured templates—organized around higher-order categories—to facilitate rapid synthesis of findings [21, 22]. Interviews will be examined within each subgroup as well as compared across groups (e.g., ACH vs. inpatient care), and the findings will be qualitatively described.

Sample size

This randomized non-inferiority trial is designed to assess the non-inferiority of the defined ACH model compared to traditional inpatient hospital care. Based on preliminary analyses, we expect that the event proportion of the composite endpoint in the traditional brick-and-mortar hospital care arm will be approximately 30%. Additionally, we expect that the event rate in the ACH arm under the alternative hypothesis will be 30%. Sample size is based on the one-sided score test statistic for the non-inferiority test for an odds ratio of proportions. Given a non-inferiority odds ratio of 1.909, one-sided alpha of 0.025, and an interim analysis (defined under Interim Analysis), a sample size of 360 (180 per arm) is required to achieve 80% power. A non-inferiority margin expressed as an odds ratio of 1.909 with a 30% event rate in the traditional inpatient care arm is equivalent to a relative risk ratio of 1.5, a 45% event rate in the ACH arm, as the non-inferiority margin. EAST (Cytel) software was used for all sample size calculations.

Statistical analysis

Logistic regression will be performed to assess the primary outcome. Analysis will be performed on all eligible patients who provide consent, are randomized, and start the intervention, following the intention-to-treat (ITT) principle. Cox proportional hazards regression analysis will also be performed to assess time-to-event; cumulative incidence curves will be plotted. If there is cross-over between treatment arms, a “per-protocol” analysis will be performed. In this per-protocol analysis, the ACH group would consider all patients who are randomized to ACH, with the follow-up censored at the time of crossing over to the control group; similarly, the control group would consider all patients who are randomized to control, with the follow-up censored at the time of crossing over to ACH. When analyzing continuous outcomes (i.e., cost and days alive out of hospital), a generalized linear model will be used, assuming a γ distribution with a log link, given the skewed nature of the data. When examining the long-term time-to-event outcomes beyond 30 days, a Cox proportional hazards model will be used when it may be necessary to account for censored data.

Because the baseline and outcome data will be obtained from the EHR, no significant missing data is expected. The study coordinators will check with patients during the end-of-study phone call regarding outcome events in case patients receive care outside of the study sites (Additional file 8). However, such events are anticipated to be rare in this patient population. In a previous trial of a HaH program, only 2 out of 91 patients received care outside the study sites [3].

Exploratory analyses such as machine learning approaches using causal tree will be performed to examine the heterogeneous treatment effect (HTE), i.e., which patients might benefit most from the intervention. Exploratory analyses will be performed stratified by acute and restorative phases.

Interim analysis

An interim analysis will be performed when at least 50% of patients complete follow-up. We plan for this interim analysis to consider cost, resources, and meaningfulness of the trial and the interim analysis could call for potential termination or early declaration of success. Using the same composite endpoint and analysis plan as the primary endpoint, if the odds ratio of event proportions between the two arms is > 1.984, then the study will be stopped because one arm seems to be more beneficial than the other. Otherwise, the study will continue to full accrual and the final analyses will be conducted as described. The rho family spending function with rho=3.5 was used.

Statistical analysis plan

The statistical analysis plan will be finalized before the close of the database. This plan will include all the analyses described above and other sensitivity and exploratory analyses. If there is any major deviation regarding the main analysis, an addendum to the protocol will be made. No changes will be made once the database is closed.

Oversight and monitoring

The trial management group (TMG) includes XY, MSH, and EMB, which oversees the day-to-day operation of the trial and meets daily. The trial steering committee (TSC) includes XY, SMD, SCD, EBH, MP, MJM, AND, CRN, and LRS and is responsible for making executive decisions, providing advice, and endorsing the TMG actions. An independent DSMB has been assembled to act in an advisory capacity to monitor participant safety, data quality, and progress. The DSMB charter is provided in Additional file 9.

Safety reporting

Due to the nature of the interventions, i.e., comparing two models of delivering acute care in routine practice, the anticipated adverse events are included as the primary and secondary outcomes and will be managed as part of the routine care. Any unanticipated adverse events should be reported to TMG as soon as possible within 24 h. All the adverse events, regardless of whether anticipated or not, will be reported to DSMB.

Data management

Throughout the trial, the PI (XY), project manager (MSH), and protocol specialist/data manager (EMB) will monitor the quality of the trial with special attention to protocol deviations and the quality of data entered in the REDCap database. MSH will send the study sites and TSC an update of the trial progress every 2 weeks. Protocol deviations will be communicated with TSC, IRB, and study sites as needed. Certain functions have been built in REDCap to automatically prevent logical inconsistencies. EMB will perform manual data auditing within 45 days of the enrollment of the first patient and repeat the auditing at least quarterly and at the end of the study. During each audit, five patients will be randomly selected and checked for any previously unrecognized missingness, errors, or logical inconsistencies. An auditing log will be maintained to document dates of auditing, patient identifier, and any problems uncovered from the auditing. At the end of the trial after the final auditing is completed, a data management meeting will be held to assess the suitability of the database for analysis, and the database will be then closed.

Discussion

The ACH virtual hybrid HaH model has great potential to improve patient outcomes and reduce costs, but few rigorous evaluations of this new care delivery model exist. The only recent RCT in the USA enrolled 91 patients in one urban setting, thereby lacking the ability to definitely ascertain the effectiveness and safety [3]. The lack of evidence may prohibit or delay providers and payers to adopt this new model of high-acuity home care, especially in suburban and rural areas. We will conduct a pragmatic trial to inform real-world decisions regarding alternative treatment options in the delivery of advanced health care to acutely ill adults.

Pragmatism is a continuum that can be assessed by the PRECIS-2 tool from nine domains, each of which is rated from 1 (very explanatory) to 5 (very pragmatic) [23]. The PRECIS-2 tool is encouraged to be used at the design stage to ensure that the design choices are concordant with the intended purpose. Therefore, we report the evaluation of pragmatism below (Fig. 2).

Fig. 2
figure 2

Evaluation of pragmatism—PRECIS-2 Wheel

The first domain of pragmatism is “eligibility”—“To what extent are trial participants similar to those who would receive this intervention if it was part of usual care?” The ACH trial aims to enroll all patients who are at the equipoise of receiving ACH or traditional brick-and-mortar hospital care. The trial eligibility criteria aim to exclude patients who would likely only qualify for one arm, not both, and were determined by the clinical team, not the research team. Therefore, the trial is very pragmatic, with a score of 5, aiming to represent the population to which the results will apply.

The second domain is “recruitment”: “How much extra effort is made to recruit participants over and above what would be used in the usual care setting to engage patients?” A highly pragmatic approach would be to recruit through usual appointments at diverse clinics and hospitals—exactly what the ACH trial will do. Local clinical teams will screen all patients as they do in routine practice. Once an eligible patient is identified, the local clinical team will contact the central research team at Mayo Clinic, Rochester, Minnesota. If patients refuse to participate in the research study, then they will continue with their routine care of choice, either ACH or traditional brick-and-mortar hospital care. In other words, we will embed the recruitment into the routine clinical workflow, and the research activities (e.g., introducing the study, research consent, and randomization) will be conducted virtually by the central research team, thereby minimizing the burden on local clinical staff. As such, the trial is very pragmatic in terms of recruitment, with a score of 5.

The third domain is “setting”—“How different are the settings of the trial from the usual care setting?” We will perform the trial at three hospitals in Arizona, Florida, and Wisconsin, including two academic medical center hospitals and one community-based hospital. The trial setting mimics routine practice and is geographically diverse. However, all three hospitals belong to Mayo Clinic’s multistate health system. Therefore, the trial is rather pragmatic in terms of setting, with a score of 4.

The fourth domain is “organization”—“What expertise and resources are needed to deliver the intervention?” The ACH trial will make use of no more than the existing staff and resources in routine practice and, thus, is very pragmatic with a score of 5.

The fifth domain is “flexibility in terms of the delivery of the intervention.” The ACH trial will leave the details of how to deliver the intervention to frontline clinicians and staff, rather than being rigidly prescriptive in the protocol. Therefore, the trial is very pragmatic, with a score of 5.

The sixth dimension is “flexibility in terms of adherence.” ACH will allow full flexibility in how the end-users engage with the intervention. Therefore, it is very pragmatic with a score of 5.

The seventh dimension is follow-up. In the ACH trial, baseline characteristics will be captured from the EHR, and outcome data will be collected via a combination of EHR and a study coordinator call enabling patient reporting. We will conduct a one-time interview at the end of the study. This hybrid approach using both EHR and patient reporting is to improve the completeness of the data, e.g., mortality, readmission, and other events outside the study sites, as well as to collect patient-reported outcomes. Therefore, we consider the trial very pragmatic with a score of 5.

The eighth dimension is “primary outcome”—measures “How relevant is the outcome to participants?” The primary outcome is the composite of all-cause mortality and readmission. The outcome is clearly important for patients, clinicians, and our health system, but since it is a composite outcome, we will give a score of 4 as “rather pragmatic” for this domain.

The ninth dimension is primary analysis. The ACH trial will use the intention-to-treat analysis with all the available data as the primary analysis and, thus, is very pragmatic with a score of 5.

The current study is also an example of building a learning health system, which is characterized by continual improvement and innovation with new knowledge captured as an integral by-product of the delivery experience [24, 25]. A variety of HaH programs have been developed in other health systems over the past several decades. Mayo Clinic leveraged innovative technologies and care delivery methods to further improve this model. Traditionally, such new care delivery innovations and quality improvement programs would be implemented as is because they seem like good ideas, but few were rigorously evaluated. Recently, a few pragmatic trials demonstrated that the programs with face validity might not improve care delivery and patient outcomes when evaluated rigorously [26, 27]. Therefore, multiple institutions have transitioned towards a learning health system through rapid-cycle evaluation embedded into routine clinical care.

Such pragmatic approaches could generate evidence to inform real-world decision-making at a low cost and fast pace. However, unlike conventional clinical trials, these projects are mainly conducted by internal teams, due to the short turnaround time, cost, and resource constraint. Furthermore, most of the innovations might lead to business development opportunities. For example, a health system might hold patents for the artificial intelligence algorithms they developed, or in this trial, Mayo Clinic has financial investment in a company that supports the new care delivery model. As a result, how to avoid bias in evaluation needs to be considered. A common approach is for a health system to have a dedicated independent team serving as the “unbiased evaluator.” This evaluation team does not work exclusively in any particular disease area and has no financial interest or other relationships with the departments that developed the innovations. For example, NYU Langone Health’s team was able to complete ten randomized rapid cycle testing within a year [24]; similarly, the current trial is led by Mayo Clinic Kern Center for the Science of Health Care Delivery, which has evaluated a broad range of interventions using prospective and retrospective data, as well as quantitative and qualitative methodologies [28,29,30].

In conclusion, the current study will be the first large pragmatic RCT that examines the HaH model in diverse routine clinical practice settings. The pragmatism is high with all the domains having a score of at least 4. The results will inform whether the ACH model maintains or improves the quality and safety of patient care traditionally delivered at inpatient settings. The findings will also identify barriers and needs from patients, clinicians, and other staff, thereby paving the way for future large-scale implementation.

Trial status

The trial is currently under way, with recruitment having commenced in February 15, 2022. Protocol version: 3 (December 5, 2021). Recruitment is likely to be completed in 2023.

Availability of data and materials

The trial findings will be presented in conferences and published in peer-reviewed journals. The statistical codes will be published with the main trial results paper. SAI and EMB will have access to the final trial dataset. Request of individual-level dataset can be made directly to the contact author and reviewed on a case-by-case basis.

Abbreviations

ACH:

Advanced care at home

APP:

Advanced practice provider

DSMB:

Data and Safety Monitoring Board

ED:

Emergency department

EHR:

Electronic health record

HTE:

Heterogeneous treatment effect

ICU:

Intensive care unit

ITT:

Intention to treat

IRB:

Institutional Review Board

REDCap:

Remote Data Capture

RCT:

Randomized controlled trial

RN:

Registered nurses

TMG:

Trial management group

TSC:

Trial steering committee

References

  1. Centers for Disease Control and Prevention. Health expenditures 2021; https://www.cdc.gov/nchs/fastats/health-expenditures.htm. Accessed 13 May 2021.

  2. Groff AC, Colla CH, Lee TH. Days spent at home - a patient-centered goal and outcome. N Engl J Med. 2016;375(17):1610–2.

    Article  Google Scholar 

  3. Levine DM, Ouchi K, Blanchfield B, et al. Hospital-level care at home for acutely ill adults: a randomized controlled trial. Ann Intern Med. 2020;172(2):77–85.

    Article  Google Scholar 

  4. Summerfelt WT, Sulo S, Robinson A, Chess D, Catanzano K. Scalable hospital at home with virtual physician visits: pilot study. Am J Manag Care. 2015;21(10):675–84.

    PubMed  Google Scholar 

  5. Leff B, Burton L, Mader SL, et al. Hospital at home: feasibility and outcomes of a program to provide hospital-level care at home for acutely ill older patients. Ann Intern Med. 2005;143(11):798–808.

    Article  Google Scholar 

  6. Cryer L, Shannon SB, Van Amsterdam M, Leff B. Costs for ‘hospital at home’ patients were 19 percent lower, with equal or better outcomes compared to similar inpatients. Health Aff (Millwood). 2012;31(6):1237–43.

    Article  Google Scholar 

  7. Caplan GA, Sulaiman NS, Mangin DA, Aimonino Ricauda N, Wilson AD, Barclay L. A meta-analysis of “hospital in the home”. Med J Aust. 2012;197(9):512–9.

    Article  Google Scholar 

  8. Shepperd S, Doll H, Angus RM, et al. Avoiding hospital admission through provision of hospital care at home: a systematic review and meta-analysis of individual patient data. Cmaj. 2009;180(2):175–82.

    Article  Google Scholar 

  9. Shepperd S, Iliffe S, Doll HA, et al. Admission avoidance hospital at home. Cochrane Database Syst Rev 2016;9(9):Cd007491.

  10. Tibaldi V, Isaia G, Scarafiotti C, et al. Hospital at home for elderly patients with acute decompensation of chronic heart failure: a prospective randomized controlled trial. Arch Intern Med. 2009;169(17):1569–75.

    Article  Google Scholar 

  11. Board N, Brennan N, Caplan GA. A randomised controlled trial of the costs of hospital as compared with hospital in the home for acute medical patients. Aust N Z J Public Health. 2000;24(3):305–11.

    Article  CAS  Google Scholar 

  12. Federman AD, Soones T, DeCherrie LV, Leff B, Siu AL. Association of a bundled hospital-at-home and 30-day postacute transitional care program with clinical outcomes and patient experiences. JAMA Intern Med. 2018;178(8):1033–40.

    Article  Google Scholar 

  13. Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.

    Article  CAS  Google Scholar 

  14. Jenkinson C, Coulter A, Bruster S. The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14(5):353–8.

    Article  Google Scholar 

  15. Carayon P, Hundt AS, Karsh B, et al. Work system design for patient safety: the SEIPS model. BMJ Quality Safety. 2006;15(suppl 1):i50–8.

    Article  Google Scholar 

  16. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):1–15.

    Article  Google Scholar 

  17. Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: Pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Syst. 2020;4(1):e10201.

    PubMed  Google Scholar 

  18. Levine DM, Pian J, Mahendrakumar K, Patel A, Saenz A, Schnipper JL. Hospital-level care at home for acutely ill adults: a qualitative evaluation of a randomized controlled trial. J Gen Intern Med. 2021.

  19. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qualitat Health Res. 2005;15(9):1277–88.

    Article  Google Scholar 

  20. Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15(3):398–405.

    Article  Google Scholar 

  21. Hamilton A. Qualitative methods in rapid turn-around health services research. Health Serv Res Develop Cyberseminar. 2013.

  22. Hamilton AB, Finley EP. Qualitative methods in implementation research: an introduction. Psychiat Res. 2019;280:112516.

    Article  Google Scholar 

  23. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ (Clinical research ed). 2015;350:h2147.

    Google Scholar 

  24. Horwitz LI, Kuznetsova M, Jones SA. Creating a learning health system through rapid-cycle, randomized testing. N Engl J Med. 2019;381(12):1175–9.

    Article  Google Scholar 

  25. Simon GE, Platt R, Hernandez AF. Evidence from pragmatic trials during routine care - slouching toward a learning health system. N Engl J Med. 2020;382(16):1488–91.

    Article  Google Scholar 

  26. DeVore AD, Granger BB, Fonarow GC, et al. Effect of a hospital and postdischarge quality improvement intervention on clinical outcomes and quality of care for patients with heart failure with reduced ejection fraction: the CONNECT-HF randomized clinical trial. Jama. 2021;326(4):314–23.

    Article  Google Scholar 

  27. Asch DA, Troxel AB, Goldberg LR, et al. Remote monitoring and behavioral economics in managing heart failure in patients discharged from the hospital: a randomized clinical trial. JAMA. Int Med. 2022.

  28. Yao X, Rushlow DR, Inselman JW, et al. Artificial intelligence-enabled electrocardiograms for identification of patients with low ejection fraction: a pragmatic, randomized clinical trial. Nat Med. 2021;27(5):815–9.

    Article  CAS  Google Scholar 

  29. Noseworthy PA, Gersh BJ, Kent DM, et al. Atrial fibrillation ablation in practice: assessing CABANA generalizability. Eur Heart J. 2019;40(16):1257–64.

    Article  CAS  Google Scholar 

  30. Yao X, Noseworthy PA. Left atrial appendage occlusion and surgical ablation for atrial fibrillation during cardiac surgery-reply. Jama. 2018;320(15):1602–3.

    Article  Google Scholar 

Download references

Acknowledgements

Ellen Love, Jacey Fazio, Venessa Boyle, Maura Nazario, Nicole McClure, Jessica Entzminger, Erika Cavallaro, Holly Greenwell, Karly Mucks, Kasey Peissig, and Nathan A. Smith for their help in developing the protocol and trial procedures.

Funding

This study is funded by Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery. No extramural funding was used to support this work. The authors are solely responsible for the design and conduct of this study, all study analyses, the drafting and editing of the paper, and its final contents. Please contact Dr. Xiaoxi Yao yao.xiaoxi@mayo.edu for any questions related to trial sponsor.

Author information

Authors and Affiliations

Authors

Contributions

The manuscript was drafted by XY. All the authors contributed to the development of the protocol, made critical revision to the manuscript, read and approved the final manuscript.

Corresponding author

Correspondence to Xiaoxi Yao.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Mayo Clinic Institutional Review Board and was registered on ClinicalTrials.gov (NCT05212077).

Consent for publication

Not applicable

Competing interests

Mayo Clinic has a financial investment in Medically Home, the company that supports the ACH program. MJM serves on the Board of Directors for Medically Home, representing Mayo Clinic. At no point will any of the authors benefit financially from ACH. The other authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

SPIRIT checklist

Additional file 2.

WHO Trial Registration Dataset

Additional file 3.

Clinical Stability Screen

Additional file 4.

Social Stability Screening

Additional file 5.

Informed consent

Additional file 6.

Patient Interview Guide

Additional file 7.

Clinician and Staff Interview Guide

Additional file 8.

Patient 30-Day Follow-Up

Additional file 9.

ACH DSMB Charter

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yao, X., Paulson, M., Maniaci, M.J. et al. Effect of hospital-at-home vs. traditional brick-and-mortar hospital care in acutely ill adults: study protocol for a pragmatic randomized controlled trial. Trials 23, 503 (2022). https://doi.org/10.1186/s13063-022-06430-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-06430-6

Keywords