- Study protocol
- Open Access
Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) through non-specialist providers and telemedicine: a study protocol for a non-inferiority randomized controlled trial
Trials volume 22, Article number: 186 (2021)
Depression and anxiety impact up to 1 in 5 pregnant and postpartum women worldwide. Yet, as few as 20% of these women are treated with frontline interventions such as evidence-based psychological treatments. Major barriers to uptake are the limited number of specialized mental health treatment providers in most settings, and problems with accessing in-person care, such as childcare or transportation. Task sharing of treatment to non-specialist providers with delivery on telemedicine platforms could address such barriers. However, the equivalence of these strategies to specialist and in-person models remains unproven.
This study protocol outlines the Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) randomized trial. SUMMIT is a pragmatic, non-inferiority test of the comparable effectiveness of two types of providers (specialist vs. non-specialist) and delivery modes (telemedicine vs. in-person) of a brief, behavioral activation (BA) treatment for perinatal depressive and anxiety symptoms. Specialists (psychologists, psychiatrists, and social workers with ≥ 5 years of therapy experience) and non-specialists (nurses and midwives with no formal training in mental health care) were trained in the BA protocol, with the latter supervised by a BA expert during treatment delivery. Consenting pregnant and postpartum women with Edinburgh Postnatal Depression Scale (EPDS) score of ≥ 10 (N = 1368) will be randomized to one of four arms (telemedicine specialist, telemedicine non-specialist, in-person specialist, in-person non-specialist), stratified by pregnancy status (antenatal/postnatal) and study site. The primary outcome is participant-reported depressive symptoms (EPDS) at 3 months post-randomization. Secondary outcomes are maternal symptoms of anxiety and trauma symptoms, perceived social support, activation levels and quality of life at 3-, 6-, and 12-month post-randomization, and depressive symptoms at 6- and 12-month post-randomization. Primary analyses are per-protocol and intent-to-treat. The study has successfully continued despite the COVID-19 pandemic, with needed adaptations, including temporary suspension of the in-person arms and ongoing randomization to telemedicine arms.
The SUMMIT trial is expected to generate evidence on the non-inferiority of BA delivered by a non-specialist provider compared to specialist and telemedicine compared to in-person. If confirmed, results could pave the way to a dramatic increase in access to treatment for perinatal depression and anxiety.
ClinicalTrials.gov NCT 04153864. Registered on November 6, 2019.
Depression is a leading cause of disability worldwide  with an estimated 10 to 15% of women worldwide experiencing depression during pregnancy or the year following childbirth [2, 3]. Symptoms often begin in the antenatal period , and estimates of the annualized lifetime costs of perinatal depression amount to over $45.9 billion USD dollars in the USA alone . Although given less attention than depression, up to 20% of mothers also experience anxiety symptoms  and approximately 10% are co-morbid for both . The negative impact of these disorders on mother and child [8,9,10] underscores the importance of addressing perinatal mental health.
Psychological treatments, such as cognitive, behavioral, and interpersonal therapies, are first-line, effective interventions for perinatal depression and anxiety [11, 12] and are preferred by many women over pharmacotherapy [13, 14]. Despite the recent US Preventive Task Force Recommendations for evidence-based psychological treatments for perinatal populations , as few as 20% of affected women are treated with adequate treatments in North America . Barriers include childcare needs, costs, transportation, and stigma [13, 17], in addition to the paucity and inequitable distribution of mental health professionals across settings. Given their prevalence and detrimental impact, developing low-cost, innovative solutions to improve access to psychological treatments for perinatal depression and anxiety is a public health priority. This is particularly true in the context of the COVID-19 pandemic and its impact on mental health symptoms.
Task-sharing is used worldwide to improve access to care, with non-specialist providers (NSPs)—individuals with no formal training in delivering mental health care such as nurses, peers, lay counselors, midwives, teachers, and primary care doctors—trained to effectively treat perinatal depressive and anxiety symptoms [18, 19]. NSPs are widely available, affordable, and often have regular contact with women in the course of their healthcare during pregnancy and the postpartum period [18, 20, 21]. NSPs have effectively delivered behavioral activation (BA) to reduce maternal depressive symptoms [22, 23], anxiety symptoms , and intimate partner violence among women of childbearing age . In high-income countries, nurses and midwives are among the most likely to deliver effective psychological interventions  and appear to be a preferred type of NSP by perinatal women . Whether specialists and NSPs are equally effective in targeting perinatal depressive and anxiety symptoms when delivering the same treatment remains unknown.
Telemedicine-based psychological treatments offer an alternative approach for perinatal women in terms of flexibility , efficiency , and cost . This delivery method also increases accessibility and scalability. Recent reviews suggest that telemedicine is as efficacious as in-person psychotherapy on depression and anxiety are similar [29, 30]. However, most of these studies have not compared in-person visits to telemedicine platforms and are underpowered to establish equivalence of the two treatment formats .
BA proposes that the key to reducing depression and anxiety is to increase enjoyable or fulfilling activities that align with one’s values [31, 32], targeting key mechanisms of patient activation and avoidant coping. BA has strong evidence for its effectiveness in treating depression in the general population [33, 34]. A randomized placebo controlled study in the USA found that BA was as efficacious as, and more enduring than, antidepressant medication, with fewer patients dropping out of treatment [35, 36]; in the USA and UK, BA was as effective as longer courses of cognitive behavioral therapy [36, 37]. BA was also as effective in treating perinatal depression in randomized trials in the USA, where BA was associated with high satisfaction and treatment engagement [21, 38] and offered significant benefit compared with treatment as usual [23, 39]. Further, BA is easy to understand and implement , which is critical when training NSPs. Trials in the USA , Uganda , India and Nepal [22, 41, 42], and the UK  have demonstrated that lay counselors, psychology undergraduates, maternal peers and midwives can all be trained to deliver BA to reduce depressive symptoms.
The primary objectives of this study are twofold:
To examine if BA can be delivered as effectively by NSPs as specialists in treating perinatal depressive symptoms, as measured by the Edinburgh Postnatal Depression Scale (EPDS) ; and
To examine if BA delivered through telemedicine is as effective as BA delivered through in-person format, in treating perinatal depressive symptoms as measured by the EPDS .
To examine the aforementioned questions on anxiety symptoms, as measured by the Generalized Anxiety Disorder-7 (GAD-7) .
To assess moderating effects of clinical severity and treatment timing (antenatal vs. postnatal) on the comparative effectiveness of the two delivery formats on depressive and anxiety symptoms;
To determine whether timing of the treatment influences child mental development at 9 to 15 months post childbirth; and
To describe the underlying processes, barriers, and facilitators to the delivery of BA for perinatal depressive and anxiety symptoms from a multi-stakeholder perspective.
The COVID-19 pandemic has amplified the need for effective mental healthcare and led to a dramatic increase in the use and role of telemedicine platforms . While following key guidelines for preserving clinical trial integrity, the study has continued during the pandemic . A list of adaptations made to study implementation is presented in Table 5.
Methods—design, setting, participants, interventions, and outcomes
This is a multi-center, four-arm, randomized, non-inferiority trial to test the comparable effectiveness of delivery mode (telemedicine vs. in-person) and provider (NSP vs. SP), implementing a brief, evidence-based BA treatment for perinatal depressive and anxiety symptoms. In this trial, we will also determine the underlying processes related to delivery of this brief psychological intervention from a multi-stakeholder perspective. The protocol conforms to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines (see Additional file 1: Figure S1 and Additional file 2: SPIRIT checklist).
The study takes place in three hubs—Toronto, Chapel Hill, and Chicago. In Toronto, recruitment is at Sinai Health (SH), Women’s College Hospital (WCH), and St. Michael’s Hospital (SMH)—three academic hospitals affiliated with the University of Toronto. In North Carolina, we are recruiting from three clinical sites affiliated with the University of North Carolina (UNC) Women’s and Neuroscience Hospitals. In Chicago, we are recruiting from fourteen affiliated obstetric and family medicine clinics affiliated with NorthShore University HealthSystem and the University of Chicago.
Participants and procedures
We plan to recruit 1368 pregnant and postpartum women aged ≥ 18 (Fig. 1). Inclusion and exclusion criteria are detailed in Table 1. The study is introduced to eligible women by a trained research assistant or one of the women’s clinical providers at their respective study site. Recruitment and informed consent are acquired in-person or via telephone, using Research Electronic Data Capture system (REDCap™). After consenting to participate, women are screened on the Edinburgh Postnatal Depression Scale (EPDS ≥ 10 ) for eligibility. A systematic effort is made to recruit ethnically diverse populations, including women from Latinax communities. For example, bilingual research assistants at the US sites introduce the study in Spanish with a translated consent form. In-person study activities have been paused since the onset of the COVID-19 pandemic (see Table 5).
Treatment and intervention arms
The SUMMIT treatment consists of six to eight individual weekly BA sessions. The manual was adapted from two well-established source manuals—the Alma Program for perinatal populations in Colorado and the Healthy Activity Program (HAP [22, 48];) from Goa, India. Key strategies include: psychoeducation, behavioral assessment, values-based activity monitoring and structuring, interpersonal effectiveness, and problem solving. Unlike cognitive behavioral interventions for depression, BA explicitly targets avoidant coping  and has been effective in reducing anxiety symptoms .
Participants are randomized to one of four arms (Fig. 2):
Non-specialists vs. specialists
SUMMIT treatment providers include both NSPs and specialist providers (SPs). NSPs are registered nurses (RNs) or midwives with general health care professional skills but without formal training in mental health care or experience delivering psychotherapies. SPs include individuals with formal training in mental health care delivery (e.g., psychiatrists, psychologists, and social workers) and with experience in treating mental illness and a minimum of 5 years of experience delivering psychological treatments.
Telemedicine vs. in-person
Telemedicine is implemented via the Ontario Telemedicine Network and Zoom™ in Toronto, the UNC TelePsychiatry Program in Chapel Hill, and Zoom™ in Chicago. All platforms (1) permit video-visits and scheduling; (2) are accessible on PC, Mac, Android and iOS systems; and (3) are PHIPA/HIPAA compliant. For participants lacking access to a technology, study tablets are provided for use on a temporary basis. Participants assigned to telemedicine can conduct BA sessions in a preferred private location (e.g., home). In-person sessions are held at participating clinical care sites (paused during COVID-19).
Recruitment, training, supervision of treatment providers
The same procedures were implemented in each hub.
All NSPs were recruited through advertisements in relevant listservs and word of mouth and selected based on their performance in a structured interview and role-play during an intake interview. A mock patient was incorporated and the Therapy Quality Scale was used to rate the potential provider . SPs were recruited through advertisements and word of mouth. They were selected based on location, interest and availability, and good standing with their respective colleges.
Training and competency tests
Separate workshops were held to train NSPs and SPs. A minimum of two clinical leads conducted each training workshop to ensure consistency across hubs. Clinical leads are expert clinicians and co-Is (PR in Toronto, CS in Chapel Hill, and JJK and LML in Chicago) who are designated to oversee the training and clinical implementation of the BA treatment along with supervision. The workshops utilized observation and didactics with interactive educational strategies including role play, games, and homework. The primary objectives of the training workshops (see Table 2) were to prepare the providers to implement the BA manual and SUMMIT protocol with its safety procedures, including when to refer a participant for post-trial care. Trainees meeting competency standards (based on a multiple-choice questionnaire  and in an interaction with a standardized patient (actor) rated by experts using an adapted version of the Quality of HAP (Q-HAP scale)  were selected for the 8-week internship phase of the trial. During this phase, trainees saw up to two participants (one via telemedicine and one in-person) to implement the BA treatment. Only trainees who achieved competence, as assessed by standardized role-plays and therapy quality assessments, were selected to deliver BA during the trial.
During the training phase, clinical leads provided weekly supervision with NSPs and SPs (separately to avoid contamination) to review and discuss cases and reinforce BA training. All treatment providers recorded all BA sessions for training and supervision purposes and for fidelity measures. Treatment providers who required additional assistance to gain competence completed an additional training case with additional supervision.
During the trial, NSPs have continued weekly supervision meetings with their designated clinical lead. In addition, NSPs engage in monthly measurement-based supervision where clinical leads and NSPs rate individual audio-recorded sessions for therapy quality—the extent to which a psychological treatment was implemented well enough to achieve its expected effects . Audio recordings are rated using the 20-item Q-HAP  for BA treatment-specific and common therapeutic (e.g., collaboration, empathy) skills. The individual NSP who conducted the session (self-rating), 2–4 peers (peer ratings), and a clinical lead (expert rating) evaluate a selected session. The summed score by peers for each subscale is used to estimate therapy quality for the session and is compared to the expert ratings. As the trainee NSPs gain experience in delivering BA and rating audio-recorded sessions, the supervision format will evolve from expert led (that is, the clinical lead and specialist who is skilled in the delivery of the psychological treatment to peer-led group supervision) . SPs do not attend regular supervision, but the clinical lead is available on an ad hoc basis to reflect real-world conditions.
Independent consultants evaluate up to 5% of all audio sessions by both NSPs and SPs to assess treatment adherence and fidelity during the trial phase. Treatment providers not reaching the cut-off for specific items will receive refresher training by the hub clinical leads.
Outcomes and timing of assessments
Table 3 lists all measures and the timing of assessments. In general, there are measures related to the participant (measured at baseline, 3-, 6-, and 12-month post-randomization), the therapy (session-wise scores and end of treatment), and the participant’s child (assessed at 9–15 months post-childbirth). All measures (Table 3) have been validated and previously used in one or more of the investigators’ trials targeting perinatal mental health (e.g., [22, 23, 40, 41, 54, 55, 61, 68, 69]. The assessment period is extended if there is a treatment hiatus due to perinatal life events (e.g., giving birth, obstetrical complications, or contracting COVID-19).
The primary outcome measure is an EPDS mean score at 3 months post-randomization. The sample size calculation is based on an EPDS mean estimate of 7.93 (SD = 4.68 ). Using a non-inferiority margin of 10% (i.e., EPDS score of 0.79 in relation to the mean), and an alpha = 0.025 (i.e., 0.05/2 for our two key comparisons of interest: telemedicine vs. in-person and SP vs. NSP), we require 274 participants in each of the four arms to provide greater than 80% power. To account for 20% drop out, and provide additional power (up to 76%) for pairwise comparisons between the four arms (i.e., telemedicine SP, telemedicine NSP, in-person SP, in-person NSP) and 80% power for our secondary hypothesis of reduced anxiety (mean GAD-7 = 8.07, SD = 5.50 ), the required final sample is N = 1368 (342 per arm).
Across the three hubs, we anticipate assessing 18,280 participants for potential eligibility and obtaining informed consent to screen 9140 from which we will recruit and retain a sample size of N = 1368 women (see Fig. 2). We anticipate that 50% of participants will be recruited in Toronto, and 25% each in Chapel Hill and Chicago.
Nested qualitative study
Interviews are being conducted with various subsets of participants (n = 60) including representation from each of the four arms, treatment completers vs. non-completers, and antenatal vs. postnatal enrollment. A maximum variance sample will be used to capture participants across severity levels, perinatal periods, site key sociodemographic factors, and stakeholder groups. An unblinded data coordinator identifies potential participants. In addition, we are interviewing up to 20 significant others (including spouses or partners of participating mothers), all SPs and NSPs, 10 healthcare providers (obstetricians, family physicians, nurses, midwives, psychiatrists and psychologists not participating in the study), and relevant stakeholders such as patient advocates. Each treatment provider will be interviewed three times, once during each phase of their participation in the trial (beginning, middle, and end) to capture relevant aspects of the intervention during implementation. Finally, we will examine the data to determine the presence of specific barriers, facilitators, and modifications made to the content and delivery of the BA treatment in response to COVID-19 (Figs. 3 and 4).
Methods—allocation, data collection, management, and analysis
After informed consent, verification of inclusion/exclusion criteria, and completion of baseline measures, participants are stratified by whether they enrolled antenatally or postnatally then randomized within site to one of the four arms (1:1:1:1) via computer-generated randomization through REDCap™. Since the start of COVID-19 containment efforts in all study jurisdictions, in-person arms have been temporarily suspended (see Fig. 2) to decrease the number of non-urgent visits to hospitals and clinics and to decrease the risk of exposure to COVID-19 for both study participants and treatment providers, in line with institutional guidelines. Pending the duration of the COVID-19 outbreak and its impact on the safety of in-person care, the return to a four-arm trial will include weighting of randomization toward in-person sessions to “balance” the number of individuals who are currently being randomized to telemedicine.
Blinding and masking
Baseline assessments are completed as per participant preference either remotely or on site (paused during COVID-19) at time of recruitment via a secure REDCap™ link prior to randomization. Outcome assessments at 3-, 6-, and 12-month post-randomization are also completed via REDCap™. While participants and providers are aware of treatment allocation, research assistants conducting the recruitment, participant qualitative interviews, and child in-home 9–15 months post-birth assessments will remain unblinded (Fig. 1; Table 3).
All data are collected via REDCap™.
De-identified data are collected in identical REDCap™ databases kept on secure institutional servers within each of the three participating cities. De-identified data from the USA hubs are extracted from the hubs’ REDCap™ database, encrypted, and transferred to Toronto, where they are uploaded, entered, and stored in REDCap™.
All study interviews and focus groups are audio-recorded using a digital voice recorder. Audio files are transcribed and identifiers removed during transcription.
The primary analyses will be run as per-protocol and intent-to-treat, with two-sided significance levels of p < 0.05. Demographic (ethnicity, age, marital status) and other baseline variables (e.g., severity and chronicity) will be checked for differences between study groups using descriptive statistics (means, standard deviations, proportions) and the associated statistical tests (t tests, chi-square tests). The primary outcome (EPDS scores at 3 months post-randomization for telemedicine vs. in-person, and SP vs. NSP) will be analyzed using non-inferiority t tests. One t test will be run to compare treatment modality (is telemedicine non-inferior to in-person). Another t test will be run to compare providers (is NSP non-inferior to SP). Non-inferiority will be assessed by seeing whether the 10% non-inferiority margin is contained in the upper bound of the confidence interval around the difference in EPDS scores (e.g., between telemedicine and in-person). A sensitivity analysis will examine potential differences in baseline and outcome depressive and anxiety symptom scores to determine whether participants recruited and received treatment during the COVID-19 outbreak differed significantly from the larger sample. Multiple imputation methods will be used for data missing at random, with the number of imputations reflecting the percentage of missing data (e.g., if 10% of data is missing, then 10 imputations will be conducted)  and using SAS’s Proc MI and Proc MIANALYZE. Reasons for dropout will be ascertained from clinician records or by interviewing a subset of the participants who dropped out and coded. Drop-out characteristics will be compared to those completing the study. Sensitivity analyses will be carried out should missing data lead to the use of multiple imputation methods. These analyses will compare the results of the models on the imputed data to the ones with the actual missing data included. All analyses will be carried out using SAS Version 9.4 or later (SAS Institute, Cary, NC, USA).
In our secondary analysis, we are interested in (i) assessing the trend in EPDS and GAD-7 scores over time (baseline, 3-, 6-, and 12-month post-randomization) between groups (telemedicine vs. in-person, and SP vs. NSP). These analyses will use linear mixed models and include a group by time interaction term as well as adjust for potential covariates of interest. All child outcomes, including child mental development and the provision of psychosocial stimulation by the mother, will be compared between two groups (antenatal vs. postnatal) at 9–15 months post-childbirth using a two-sample two-sided t test. Sensitivity analyses will be carried out excluding those who dropped out after session one to see if the results are comparable to the entire study group.
Tests of moderation will be conducted to determine whether delivery mode (telemedicine vs. in-person) or agent (SP vs. NSP) is moderated by baseline clinical severity. We expect up to 15% of our sample to be severely depressed (EPDS > 20 ). A 2-group comparison with 75 per group and an assumed mean EPDS score of 20.0 (SD = 7.0)86, will provide 80% power, with an alpha of 0.05, to detect a mean change of 2.3 or greater. Our current sample size including those within severity subgroups described above will be adequately powered to detect medium effect size differences of heterogeneity of treatment effects of symptom severity between groups. This indicates that we have adequate power for clinically meaningful tests. The two groups’ (SP vs. NSP) EPDS scores at 3 months will be compared using a two-sided two-sample t test. Change in EPDS score over time (baseline and every 3 months post-randomization) will also be compared using linear mixed models. We will also examine this for anxiety symptoms at 3 months post randomization.
This model will also test whether expectant mothers who receive antenatal treatment benefit more in terms of reduced depressive symptoms than mothers who receive postnatal treatment at 12 months post-randomization. A 2-group comparison with 200 per group and an assumed EPDS mean of 7.93 (SD = 4.68) will provide 90% power, with an alpha of 0.05, to detect a mean change of 1.5 points. This allows us to detect a drop corresponding to a small effect size of 0.3 (i.e., a drop to mean 6.43 on the EPDS). The two groups’ (antenatal vs. postnatal) EPDS scores at 3 months will be compared using a two-sided two-sample t test. Change in EPDS scores over time (baseline and every 3 months post-randomization) also will be compared using linear mixed models including the interaction between group and time. We will examine anxiety symptoms at 12 months post randomization in a linear mixed model controlling for relevant covariates including child age.
We will examine whether the subset of mothers (up to 75% of the sample) who receive antenatal treatment benefit more in terms of improved child outcomes at 9–15 months than mothers who receive postnatal treatment. A 2-group comparison of 238 per group (antenatal vs. postnatal) and an assumed mean on any Bayley IV raw subscale score of 100, SD = 15 to assess child mental development will provide 80% power, with an alpha of 0.05 to detect a mean clinically-significant change of 3.0 units. Raw and standardized Bayley IV scores of the two groups’ children (antenatal vs. postnatal) at 12 months will be compared using a two-sided, two-sample t test.
All qualitative data will be analyzed using NVivo™. We use content analysis with data analysis (coding) conducted by multiple independent raters, for whom inter-rater reliability is calculated using Kappa (κ) scores. Coding is conducted in a step-wise fashion to facilitate iterative revision and finalization of a coding scheme. Specifically, we first independently code and then discuss a minimum of 3 cases per stakeholder group to achieve a kappa (κ) score of κ = 0.75 or higher (defined as substantial to almost perfect agreement). Qualitative data is then quantified and triangulated across stakeholder groups using our previously established methods [20, 72].
Drop out and follow-up strategies
Participants can withdraw consent and end their participation in the study at any time. We expect 20% of participants to be lost to follow-up. This dropout rate is conservative and has been found in many similar trials using NSP and SP delivered psychological treatments for perinatal depression in the USA and Canada [23, 39, 54, 55]. Based on a Cochrane review , prior research on study retention (e.g., [74,75,76]), and our previous experiences [40, 41, 54, 55], it is realistic to expect a 12-month post-randomization follow-up rate of at least 80% when we incorporate numerous retention strategies, such as questionnaire reminders and remunerations for their completion, obtained secondary contact information from participants, and being flexible with participants’ schedules.
Oversight and monitoring
Several committees monitor the progress of the trial (Table 4). Trial monitoring comprises collation and reporting of routine trial process indicators and adverse events. The Data and Safety Monitoring Board (DSMB) consists of a psychiatrist with expertise in perinatal depressive or anxiety symptoms, a medical provider with expertise in providing obstetric care for pregnant women, a psychologist with expertise in the design and implementation of pragmatic clinical trials, and a PhD-level statistician. None of these persons are directly involved in the trial. The Trial Management Committee (TMC) presents regular reports to the Advisory Committee and the DSMB.
Stakeholder engagement and dissemination strategies
The SUMMIT research team works closely with a range of stakeholder partners across North America to inform the development, implementation, and dissemination of the SUMMIT trial. Two key goals include ensuring ample and appropriate stakeholder engagement as well as the delivery of diverse and audience-centered dissemination strategies.
To achieve the first goal of stakeholder engagement, three key steps are being implemented: (i) the creation of a diverse and informative Stakeholder Advisory Committee; (ii) identify and address potential barriers to engagement and implementation; and (iii) conduct an ongoing process evaluation to ensure that the treatment content, training materials and study questionnaires are acceptable and feasible from a multi-stakeholder perspective. Our stakeholder partners are listed on our study website (www.thesummittrial.com) and include individuals with lived experience, patient advocates and community partners, telemedicine partners, clinicians from various professions (nurses, midwives, family practitioners, obstetricians, social workers, psychologists, and psychiatrists), representatives from US-based insurance companies, and policy makers.
To achieve the second goal of audience-centered dissemination strategies, we work with our stakeholders to ensure that our dissemination strategies are inclusive and accessible to a wide range of networks. They include local, provincial/state-, national, and international methods of dissemination, involving press releases, presentations to local organizations and digital brochures, policy briefs, list-serves, and attending scientific meetings and publication of academic and non-academic publications.
Serious adverse events (SAEs)
SAEs in this trial include disability or permanent harm, hospitalization for psychiatric reasons, life threatening events in the mother, fetus, neonate or infant, fetal or infant death, major congenital anomaly or birth defects, maternal death, or other serious important medical events such as active suicidal or homicidal ideation. Within 72 h of an SAE, the TMC reports the event to the DSMB, including details of the event, severity of any reactions, phase of the study, and procedures for its resolution, and reports to the Institutional Review Board of record.
The DSMB may also recommend termination or modification of the study in the following conditions: if SAEs are significantly clustered in one or more conditions as determined by the DSMB, followed by an unblinded analysis of all sites where we see patients worsening on depressive and anxiety symptoms by two or more standard deviations from the mean or based on the clinical judgment.
Potential risk and benefits
Participants may or may not benefit from the study. The United States Preventive Task Force suggested that there is no-to-minimal harm of evidence-based psychological therapies . If discussion of symptoms causes psychological discomfort or participants experience an exacerbation of depressive or anxiety symptoms, study safety protocols offset these risks. A treatment provider may experience distress if they are excluded from study participation for not meeting competency standards. In addition, NSPs may experience stress while participating as providers owing to their limited experience in this new role. These issues can be discussed at supervision. In addition, NSPs receive education about techniques in self-care as part of the BA training curriculum.
Access to data
A data coordinator oversees the intra-study data sharing process, with input from the Trial Management Committee and trial Biostatistician. The trial Biostatistician has access to cleaned data. Hub PIs have direct access to their own, blinded site’s data and may have access to other sites’ data by request. The datasets analyzed during the current study will be available within 1 year of completing the trial from the corresponding author and upon reasonable request.
Data dispersed to relevant team members are always blinded to participant identity and treatment allocation, except for recruitment RAs, RAs who schedule appointments, the data coordinator, and treatment providers who can access relevant identifying information (e.g., session-wise EPDS and GAD-7 scores). All information is kept in password-protected, encrypted files on encrypted computers and secure servers. Unique study IDs are used to identify the participants with key files encrypted and stored on an encrypted computer or a secure server at each site.
This trial is designed to compare the clinical benefits of who (NSP vs. SP) and how (telemedicine vs. in-person) effective psychological treatment for perinatal depression and anxiety can be delivered. Our non-inferiority design and analytical strategy will determine if NSPs and telemedicine are comparable to the current standard of usual care (SPs and in-person). Our process evaluation will illuminate relevant barriers and facilitators related to training, supervision, intervention content and delivery across a wide range of stakeholders across several time-points of this trial.
As the largest psychological treatment trial for perinatal populations to date, SUMMIT’s findings have great potential to improve access to mental healthcare to address the growing burden of perinatal depression and anxiety. Examining these comparisons has the capacity to support a stepped care model in which we optimize the use of available resources. Continuing and adapting our study during COVID-19 (see Table 5) will allow us to produce results that are relevant to the current and future context of delivering psychological treatments with a patient-centered focus and the highest ethical standards. By reconceptualizing the delivery of psychological treatments in clinical practice, we can rethink the delivery of mental healthcare to implement sustainable, equitable, and patient-centered solutions. In sum, this research holds promise to improve the accessibility and scalability of brief, evidence-based, psychological treatments for perinatal women worldwide.
Recruitment commenced in January 2020 and is estimated to be completed by April 2023. Recruitment numbers are updated regularly on the study website (www.thesummittrial.com). Modifications to the protocol that impact study conduct, potentially benefit patients or affect their safety require a formal amendment to the protocol. Amendments are agreed upon by the TMC and approved by relevant IRBs prior to implementation. Amendments for safety concerns are also reviewed by the DSMB prior to implementation. The current protocol version (1.0) was approved on December 18, 2020.
Availability of data and materials
Individuals interested in SUMMIT study materials may contact the Study PI.
Data and Safety Monitoring Board
- EPDS :
Edinburgh Postnatal Depression Scale
Generalized Anxiety Disorder-7 Scale
Health Activity Program
Institutional Review Board (US)
St. Michael’s Hospital
Standard Protocol Items: Recommendations for Interventional Trials
Trial Management Committee
University of North Carolina
Women’s College Hospital
Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJ, et al. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11):e1001547.
O’hara MW, Swain AM. Rates and risk of postpartum depression—a meta-analysis. Int Rev Psychiatry. 1996;8(1):37–54.
Wisner KL, Sit DKY, McShea MC, Rizzo DM, Zoretich RA, Hughes CL, et al. Onset timing, thoughts of self-harm, and diagnoses in postpartum women with screen-positive depression findings. JAMA Psychiatry. 2013;70(5):490–8.
Robertson E, Grace S, Wallington T, Stewart DE. Antenatal risk factors for postpartum depression: a synthesis of recent literature. Gen Hosp Psychiatry. 2004;26(4):289–95.
Bauer A, Knapp M, Parsonage M. Lifetime costs of perinatal anxiety and depression. J Affect Disord. 2016;192:83–90.
Dennis C-L, Falah-Hassani K, Shiri R. Prevalence of antenatal and postnatal anxiety: systematic review and meta-analysis. Br J Psychiatry. 2017;210(5):315–23.
Falah-Hassani K, Shiri R, Dennis C-L. Prevalence and risk factors for comorbid postpartum depressive symptomatology and anxiety. J Affect Disord. 2016;198:142–7.
Stein A, Pearson RM, Goodman SH, Rapa E, Rahman A, McCallum M, et al. Effects of perinatal mental disorders on the fetus and child. Lancet. 2014;384(9956):1800–19.
Field T. Prenatal depression effects on early development: a review. Infant Behav Dev. 2011;34(1):1–14.
Meltzer-Brody S, Howard LM, Bergink V, Vigod S, Jones I, Munk-Olsen T, et al. Postpartum psychiatric disorders. Nat Rev Dis Primers. 2018;4:18022.
Sockol LE, Epperson CN, Barber JP. A meta-analysis of treatments for perinatal depression. Clin Psychol Rev. 2011;31(5):839–49.
O’hara MW, McCabe JE. Postpartum depression: current status and future directions. Annu Rev Clin Psychol. 2013;9:379–407.
Goodman JH. Women’s attitudes, preferences, and perceived barriers to treatment for perinatal depression. Birth. 2009;36(1):60–9.
O’Mahen HA, Flynn HA. Preferences and perceived barriers to treatment for depression during the perinatal period. J Women’s Health. 2008;17(8):1301–9.
Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, Davidson KW, et al. Interventions to prevent perinatal depression: US preventive services task force recommendation statement. Jama. 2019;321(6):580–7.
Byatt N, Xiao RS, Dinh KH, Waring ME. Mental health care use in relation to depressive symptoms among pregnant women in the USA. Arch Womens Mental Health. 2016;19(1):187–91.
Dennis CL, Chung-Lee L. Postpartum depression help-seeking barriers and maternal treatment preferences: a qualitative systematic review. Birth. 2006;33(4):323–31.
Singla DR, Kohrt BA, Murray LK, Anand A, Chorpita BF, Patel V. Psychological treatments for the world: lessons from low-and middle-income countries. Annu Rev Clin Psychol. 2017;13:149–81. https://doi.org/10.1146/annurev-clinpsy-032816-045217. PMID: 28482687; PMCID: PMC5506549.
Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review. J Rural Health. 2018;34(1):48–62.
Singla D, Lazarus A, Atif N, Sikander S, Bhatia U, Ahmad I, et al. “Someone like us”: delivering maternal mental health through peers in two South Asian contexts. J Affect Disord. 2014;168:452–8.
O’Mahen HA, Grieve H, Jones J, McGinley J, Woodford J, Wilkinson EL. Women’s experiences of factors affecting treatment engagement and adherence in internet delivered Behavioural Activation for Postnatal Depression. Internet Interv. 2015;2(1):84–90.
Patel V, Weobong B, Weiss HA, Anand A, Bhat B, Katti B, et al. The Healthy Activity Program (HAP), a lay counsellor-delivered brief psychological treatment for severe depression, in primary care in India: a randomised controlled trial. Lancet. 2017;389(10065):176–85.
Dimidjian S, Goodman SH, Sherwood NE, Simon GE, Ludman E, Gallop R, et al. A pragmatic randomized clinical trial of behavioral activation for depressed pregnant women. J Consult Clin Psychol. 2017;85(1):26.
Singla DR, Lawson A, Kohrt BA, Jung JW, Meng Z, Ratjen C, Zahedi N, Dennis CL, Patel V. Implementation and effectiveness of non-specialist delivered interventions for perinatal mental health in high-income countries: a systematic review and meta-analysis. JAMA Psychiatry. 2021. https://doi.org/10.1001/jamapsychiatry.2020.4556. Epub ahead of print. PMID: 33533904.
Singla DR, Lemberg-Pelly S, Lawson A, Zahedi N, Thomas-Jacques T, Dennis C-L. Implementing psychological interventions through nonspecialist providers and telemedicine in high-income countries: qualitative study from a multistakeholder perspective. JMIR Mental Health. 2020;7(8):e19271.
Lee EW, Denison FC, Hor K, Reynolds RM. Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review. BMC Pregnancy Childbirth. 2016;16(1):38.
Andrews G. Utility of computerised cognitive–behavioural therapy for depression. Br J Psychiatry. 2010;196(4):257–8.
Lokkerbol J, Adema D, Cuijpers P, Reynolds CF, Schulz R, Weehuizen R, et al. Improving the cost-effectiveness of a healthcare system for depressive disorders by implementing telemedicine: a health economic modeling study. Am J Geriatr Psychiatry. 2014;22(3):253–62.
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196.
Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018;47(1):1–18.
Dimidjian S, Barrera M Jr, Martell C, Muñoz RF, Lewinsohn PM. The origins and current status of behavioral activation treatments for depression. Annu Rev Clin Psychol. 2011;7:1–38.
Jacobson NS, Martell CR, Dimidjian S. Behavioral activation treatment for depression: returning to contextual roots. Clin Psychol Sci Pract. 2001;8(3):255–70.
Cuijpers P, Van Straten A, Warmerdam L. Behavioral activation treatments of depression: a meta-analysis. Clin Psychol Rev. 2007;27(3):318–26.
Mazzucchelli T, Kane R, Rees C. Behavioral activation treatments for depression in adults: a meta-analysis and review. Clin Psychol Sci Pract. 2009;16(4):383–411.
Dimidjian S, Hollon SD, Dobson KS, Schmaling KB, Kohlenberg RJ, Addis ME, et al. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J Consult Clin Psychol. 2006;74(4):658.
Dobson KS, Hollon SD, Dimidjian S, Schmaling KB, Kohlenberg RJ, Gallop RJ, et al. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the prevention of relapse and recurrence in major depression. J Consult Clin Psychol. 2008;76(3):468.
Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren FC, et al. Cost and Outcome of Behavioural Activation versus Cognitive Behavioural Therapy for Depression (COBRA): a randomised, controlled, non-inferiority trial. Lancet. 2016;388(10047):871–80.
Dimidjian S, Goodman SH. Preferences and attitudes toward approaches to depression relapse/recurrence prevention among pregnant women. Behav Res Ther. 2014;54:7–11.
O’mahen H, Richards D, Woodford J, Wilkinson E, McGinley J, Taylor RS, et al. Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression. Psychol Med. 2014;44(08):1675–89.
Singla DR, Kumbakumba E, Aboud FE. Effects of a parenting intervention to address maternal psychological wellbeing and child development and growth in rural Uganda: a community-based, cluster-randomised trial. Lancet Glob Health. 2015;3(8):e458–e69.
Weobong B, Weiss HA, McDaid D, Singla DR, Hollon SD, Nadkarni A, Park AL, Bhat B, Katti B, Anand A, Dimidjian S, Araya R, King M, Vijayakumar L, Wilson GT, Velleman R, Kirkwood BR, Fairburn CG, Patel V. Sustained effectiveness and cost-effectiveness of the Healthy Activity Programme, a brief psychological treatment for depression delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial. PLoS Med. 2017;14(9):e1002385. https://doi.org/10.1371/journal.pmed.1002385. PMID: 28898283; PMCID: PMC5595303.
Jordans MJ, Luitel NP, Garman E, Kohrt BA, Rathod SD, Shrestha P, et al. Effectiveness of psychological treatments for depression and alcohol use disorder delivered by community-based counsellors: two pragmatic randomised controlled trials within primary healthcare in Nepal. Br J Psychiatry. 2019;215(2):485–93.
Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren F, et al. Behavioural Therapy for Depression (COBRA): a randomised, controlled, non-inferiority trial. 2016.
Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150(6):782–6.
Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.
Hollander JE, Carr BG. Virtually perfect? Telemedicine for COVID-19. N Engl J Med. 2020;382(18):1679–81.
McDermott MM, Newman AB. Preserving clinical trial integrity during the coronavirus pandemic. Jama. 2020;323(21):2135–6.
Chowdhary N, Anand A, Dimidjian S, Shinde S, Weobong B, Balaji M, et al. The Healthy Activity Program lay counsellor delivered treatment for severe depression in India: systematic development and randomised evaluation. Br J Psychiatry. 2016;208(4):381–8.
Boswell JF, Iles BR, Gallagher MW, Farchione TJ. Behavioral activation strategies in cognitive-behavioral therapy for anxiety disorders. Psychotherapy (Chic). 2017;54(3):231–6.
Stein AT, Carl E, Cuijpers P, Karyotaki E, Smits JAJ. Looking beyond depression: a meta-analysis of the effect of behavioral activation on depression, anxiety, and activation. Psychol Med. 2020. p. 1–14. https://doi.org/10.1017/S0033291720000239. Epub ahead of print. PMID: 32138802.
Singla DR, Weobong B, Nadkarni A, Chowdhary N, Shinde S, Anand A, et al. Improving the scalability of psychological treatments in developing countries: an evaluation of peer-led therapy quality assessment in Goa, India. Behav Res Ther. 2014;60:53–9.
Restivo JL, Mitchell L, Joshi U, Anand A, Gugiu PC, Singla DR, et al. Assessing health worker competence to deliver a brief psychological treatment for depression: development and validation of a scalable measure. J Behav Cognitive Ther. 2020;30(4):253–66.
Fairburn CG, Cooper Z. Therapist competence, therapy quality, and therapist training. Behav Res Ther. 2011;49(6):373–8.
Dennis C-L, Hodnett E, Kenton L, Weston J, Zupancic J, Stewart DE, et al. Effect of peer support on prevention of postnatal depression among high risk women: multisite randomised controlled trial. Bmj. 2009;338:a3064.
Dennis C-L, Ravitz P, Grigoriadis S, Jovellanos M, Hodnett E, Ross L, et al. The effect of telephone-based interpersonal psychotherapy for the treatment of postpartum depression: study protocol for a randomized controlled trial. Trials. 2012;13(1):38.
Spitzer RL, Kroenke K, Williams JB, Group PHQPCS. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Jama. 1999;282(18):1737–44.
Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. 1988;52(1):30–41.
Üstün TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J, et al. Developing the World Health Organization disability assessment schedule 2.0. Bull World Health Organ. 2010;88:815–23.
Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.
Lang AJ, Stein MB. An abbreviated PTSD checklist for use as a screening instrument in primary care. Behav Res Ther. 2005;43(5):585–94.
Singla DR, MacKinnon DP, Fuhr DC, Sikander S, Rahman A, Patel V. Multiple mediation analysis of the peer-delivered Thinking Healthy Programme for perinatal depression: findings from two parallel, randomised controlled trials. Br J Psychiatry. 2019. p. 1–8. https://doi.org/10.1192/bjp.2019.184. Epub ahead of print. PMID: 31362799.
Attkisson CC, Zwick R. The Client Satisfaction Questionnaire: psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7.
Munder T, Wilmers F, Leonhart R, Linster HW, Barth J. Working Alliance Inventory-Short Revised (WAI-SR): psychometric properties in outpatients and inpatients. Clin Psychol Psychother. 2010;17(3):231–9.
Fuhr DC, Calvert C, Ronsmans C, Chandra PS, Sikander S, De Silva MJ, et al. Contribution of suicide and injuries to pregnancy-related mortality in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Psychiatry. 2014;1(3):213–25.
Brown G. Health service utilization and cost of care questionnaire. Health and Social Service Utilization Research Unit. Hamilton, ON: McMaster University; 2001.
Bradley RH, Caldwell BM. The HOME Inventory and family demographics. Dev Psychol. 1984;20(2):315.
Bayley N. Bayley scales of infant development and toddler development: technical manual: the PsychCorp; 2006.
Aboud FE, Singla DR. Challenges to changing health behaviours in developing countries: a critical overview. Soc Sci Med. 2012;75(4):589–94.
Singla DR, Hollon SD, Velleman R, Weobong B, Nadkarni A, Fairburn CG, Bhat B, Gurav M, Anand A, McCambridge J, Dimidjian S, Patel V. Temporal pathways of change in two randomized controlled trials for depression and harmful drinking in Goa, India. Psychol Med. 2020;50(1):68–76. https://doi.org/10.1017/S0033291718003963. Epub 2019 Jan 8. PMID: 30616698; PMCID: PMC6945322.
Bodner TE. What improves with increased missing data imputations? Struct Equ Model Multidiscip J. 2008;15(4):651–75.
McCabe-Beane JE, Segre LS, Perkhounkova Y, Stuart S, O’Hara MW. The identification of severity ranges for the Edinburgh Postnatal Depression Scale. J Reprod Infant Psychol. 2016;34(3):293–303.
Singla DR, Kumbakumba E. The development and implementation of a theory-informed, integrated mother-child intervention in rural Uganda. Soc Sci Med. 2015;147:242–51.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. Bmj. 2002;324(7347):1183.
Seed M, Juarez M, Alnatour R. Improving recruitment and retention rates in preventive longitudinal research with adolescent mothers. J Child Adolescent Psychiatric Nurs. 2009;22(3):150–3.
Katz KS, El-Mohandes A, Johnson DM, Jarrett M, Rose A, Cober M. Retention of low income mothers in a parenting intervention study. J Community Health. 2001;26(3):203–18.
Hough RL, Tarke H, Renker V, Shields P, Glatstein J. Recruitment and retention of homeless mentally ill participants in research. J Consult Clin Psychol. 1996;64(5):881–91.
We would like to thank the women who have participated in the study and who we have the privilege to serve in the current study context. The authors would also like to thank the SUMMIT treatment providers, additional clinical staff (Drs. Matt Cohen and Beverly Young), and a range of stakeholders who have informed the development and implementation of the SUMMIT trial. Third, we would like to thank Professor Helena Kraemer for her insights on our plan of analysis. Finally, we are grateful for the many research staff (Amanda Abrams, Nicole Andrejek, Amy Angarita-Rodriguez, Norma Elizabeth Ardon Hernandez, Aysha Butt, Erika Campos, Nicole Carmona, Simi Darubra, Karen Dorman, Sonia Ghir, Christina Goode, Anastasia Harris, Sabrina Hossain, James Jung, Melody Kang, Holly Krohn, Laarni Lapat, Sandra Lee, Maria Michalowska, Angie Puerto Niño, Shira Segal, Maral Zibaman), students, and volunteers who contribute to the everyday implementation of the SUMMIT trial.
This study is funded as a Pragmatic Clinical Study (PCS) by the Patient-Centered Outcomes Research Institute (PCORI), PCS-2018C1-10621. The funder was not involved in the design of the study and is not involved in the collection, analysis, and interpretation of data, nor in writing the current manuscript.
Ethics approval and consent to participate
Ethical approval has been received from institutional review boards (IRBs) for all Toronto sites through Clinical Trials Ontario (1895), in Chapel Hill through UNC Biomedical IRB (19-1786), and in Chicago through NorthShore University HealthSystem IRB (EH18-129). Informed consent to participate is being obtained from all participants.
Consent for publication
The study team and all authors report no conflicts of interest. However, SNV reports royalties from UpToDate Inc. for authorship of materials related to depression and pregnancy. JJK is partly supported by a Small Business Innovation Research award from the National Institute of Mental Health (RS, PI). PR receives support from the Sinai Health System, Morgan Firestone Psychotherapy Chair. SD reports being a co-founder of Mindful Noggin, Inc. and receiving revenue from MindfulNoggin.com, receiving royalties from Guilford Press for books on Behavioral Activation and mindfulness. BHM receives financial support from the Labatt Family Chair in Biology of Depression in Late-Life Adults at the University of Toronto. He directly owns stocks of General Electric (less than $5000). Within the past 3 years, he has also received research support from Eli Lilly (medications for a NIH-funded clinical trial) and Pfizer (medications for a NIH-funded clinical trial). He has been an unpaid consultant to Myriad Neuroscience. AMS is a co-investigator for a Janssen Research and Development study, Optimizing Clinical Screening and Management of Maternal Mental Health: Predicting Women at Risk for Perinatal Depression.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Singla, D.R., Meltzer-Brody, S.E., Silver, R.K. et al. Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) through non-specialist providers and telemedicine: a study protocol for a non-inferiority randomized controlled trial. Trials 22, 186 (2021). https://doi.org/10.1186/s13063-021-05075-1
- Psychological treatments
- Behavioral activation
- Randomized controlled trial