Effect evaluation of two types of dementia-specific case conferences in German nursing homes (FallDem) using a stepped-wedge design: study protocol for a randomized controlled trial
Trials volume 15, Article number: 319 (2014)
Case conferences for people with dementia and challenging behaviors (e.g., apathy) are recommended as useful tools that enable staff in nursing homes to understand the behavior of people with this type of disease. Understanding peoples’ behaviors is the basis for the initiation of targeted interventions to improve the quality of care for people with dementia. Furthermore, case conferences demonstrate positive effects on burnout, dementia-specific burden, and vocational action competence of the staff. The two likely approaches for conducting case conferences include the following: A) using a structured assessment instrument, which guides the staff in understanding the residents’ behaviors and B) using a narrative approach in which the staff must identify the reasons for the residents’ behaviors in an unstructured manner. Case conferences are a complex intervention, and evaluating their multiple effects is challenging. The aim of this study protocol was to describe a likely solution for evaluating this type of complex intervention using a special cluster randomized trial.
In this stepped-wedged cluster randomized trial, the two interventions will be sequentially implemented every three months in a group of 12 nursing homes (clusters) with a minimum of 360 residents over 19 months (7 months of intervention for each cluster and follow-up). The primary outcome is the reduction of challenging behavior (measured with the neuropsychiatric inventory-nursing home version [NPI-NH]). Secondary outcomes are residents’ quality of life, prescription of psychotropic medications, staff burnout, dementia-related stress, and vocational action competence. The effectiveness of the study will be accompanied by a process evaluation. The primary data will be analyzed using a Bayesian mixed effect model; the secondary data will be analyzed using descriptive statistics and mixed effects models.
The implementation and effect measurement of complex interventions such as case conferences within a cluster randomized trial are challenging (e.g., complex and intensive training, delayed treatment effect). In this study protocol, the methodological advantages and disadvantages of using the stepped wedge design to answer the research questions are discussed.
http://www.controlled-trials.com/ISRCTN20203855; registered 10 July 2013.
People with dementia usually develop at least one challenging behavior in the course of the disease . Challenging behavior influences both the quality of life of individuals with dementia and the caring situation of the caregivers . The staff in nursing homes are confronted with demanding and complex care situations daily, which is associated with staff distress and burden . Because pharmacological treatments yield only moderate benefits and adverse effects , safe and effective psychosocial interventions are needed to manage the challenging behavior of people with dementia . Challenging behavior can be understood as a response to unmet needs. Therefore, the key prerequisite for person-centered management of challenging behavior  and initiation of individualized interventions [7, 8] is the search for causes of challenging behavior. However, understanding the underlying causes and triggers of challenging behavior is both demanding and complex and requires unique skills. Case conferences (CCs) provide opportunities for care teams to practice reflective communication, to engage in problem-solving with residents, to grow professionally, and to provide and receive emotional support for difficult work situations. The aim is to create a common understanding of a case. Although CCs are recommended for use in dementia care , there is still a lack of evidence to support their effectiveness . The few studies that have been performed in the field of dementia have demonstrated that CCs reduce challenging behavior in people with dementia, positively influence vocational action competence, and reduce the staff’s work-related burden in nursing homes [11, 12]. However, due to the poor methodological quality of these studies, the results must be carefully interpreted. The studies highlight the need for methodologically well-designed intervention studies to provide more conclusive evidence of the effects of CCs on the care of people with dementia [10, 13].
Two different approaches to CCs are most commonly described in the literature, which differ primarily in the standardization of approaches for identifying the causes of challenging behavior in people with dementia . One approach follows a standardized method of using assessment instruments and guidance in the diagnostic process [14, 15]. The other approach supports an open-thinking method for determining the potential causes of challenging behavior rather than relying on assessment instruments . The effect of using a standardized assessment instrument to understand the process of challenging behavior is not clear, and the advantages of an open approach (without a standardized assessment) have not been explored in detail [10, 13]. Therefore, the aim of this cluster-randomized trial is to assess the effect of two different types of dementia-specific CCs, focusing on challenging behavior.
The primary research question of the effectiveness study
The primary research question is: do the two different types of CCs have an effect on the prevalence of challenging behavior in people with dementia in nursing homes?
The secondary questions
Secondary research questions include the following: do the two different types of CCs have an effect on 1) quality of life of people with dementia in nursing homes; 2) use of psychotropic medications for people with dementia in nursing homes; 3) burnout and work-related stress of the staff who care for people with dementia in nursing homes; and 5) vocational action competence of staff who care for people with dementia in nursing homes?
The cluster, randomized, controlled trial will be conducted using a stepped-wedge design (SWD) . In this study, twelve different nursing homes (clusters) will participate in the study. Both interventions, (A) the Wittener model of CCs for people with dementia - the innovative dementia-oriented assessment tool (WELCOME-IdA) and (B) the Wittener model of CCs for people with dementia - the narrative approach (WELCOME-NEO), will be rolled out sequentially and in parallel every 3 months to two nursing homes (groups 1 to 4) over a period of 19 months, and the type of intervention will be randomly allocated (WELCOME-IdA will be allocated to six clusters and WELCOME-NEO will be allocated to six clusters). The last group (group 5) will contain four, instead of two, clusters because two clusters serve as reserves in case a cluster drops out during the intervention study (Figure 1). The primary intervention (training and performing CCs) takes 7 months, followed by a follow-up period that lasts until the end of the data collection in all of the clusters. Thus, each cluster will have the same length of intervention but different lengths of pre-intervention time and follow-up time.
Sample size calculation based on the primary outcome
According to Hussey et al. (2007), the power calculation for a SWD depends on the number of clusters, number of steps, number of participants per cluster, strengths of the desired treatment effect, variability (expressed with the between-cluster variance τ 2 and within-cluster variance σ 2 components), and significance level α . Due to the logistical, timing, and financial aspects of the study, we plan to recruit five nursing homes per intervention arm; we feel optimistic in obtaining informed consent to participate in our study from at least 30 residents per home (n = 150). Six time points in addition to baseline will be needed to ensure that every nursing home will receive the intervention. Based on the experience reported in an earlier study , a reduction in the prevalence of challenging behavior from 0.89 to 0.77 after the intervention WELCOME-IdA is assumed. Here, the prevalence rates will be calculated in the study based on the neuropsychiatric inventory-nursing home version (NPI-NH) (presence or absence (0/1) of at least one of the 12 challenging behaviors).
The between-cluster variance (τ 2) and within-cluster variance (σ 2) are estimated, according to Hussey et al. (2007) , as σ 2 = 0.00326 and τ 2 = 0.198. The significance level α is set at 0.05. The increase in the outcome variance due to the between-cluster heterogeneity is quantified by the inter-cluster coefficient of variation (k). Even if we assume k to be 0.5, rather than the maximum of usually observable inter-cluster coefficients of variation, under all assumptions mentioned above, the trial would achieve more than 80% power. The primary outcome is associated with the resident-level data. At this level, the study population consists of old and often multi-morbid individuals. Therefore, we should account for a minimum dropout rate of 20% during the study. Because of the flexible design, we will be able to adjust the sample size by substituting the dropouts with new residents with dementia. In case an entire cluster prematurely withdraws from the study, one additional home will be used as a reserve. Consequently, 180 residents from 6 nursing homes will be included in the study to test the effectiveness of WELCOME-IdA. The same dropout effects are expected for WELCOME-NEO. Therefore, we calculated using the same number of clusters and residents. In total, 360 residents from 12 nursing homes will participate in the study.
Recruitment and randomization
Nursing homes are invited (by advertisement in a nursing journal) to apply for participation in the study. From this pool of interested nursing homes in North Rhine-Westphalia (NRW), 12 nursing homes will be randomly (simple randomization procedure) selected. Additionally, the type of intervention and when the cluster (nursing homes) switches from the control to the intervention protocol will be randomized. This process will guarantee that all 12 nursing homes have a similar likelihood of utilizing a particular type of intervention at the same time . Then, the leaders of the nursing homes are responsible for the recruitment of the units and the residents according to the inclusion and exclusion criteria of the study. Here, all eligible participants of the participating units are invited to participate. Before the recruitment procedure will commence, each leader of the nursing homes will attend a kick-off meeting held by a senior investigator about the inclusion and exclusion criteria and the planned recruitment strategy. For the participants who drop out of the trial, we are planning to monitor the reasons (for example, death or moving) and perform a sensitive analysis at the end of the trial to determine whether they differ according to certain characteristics (for example, the prevalence of the challenging behavior or gender). Residents who are newly admitted to clusters during follow up will also be included in the study because we are interested (in a secondary analysis) in measuring the effect of the intervention on residents who move into the cluster.
Methods to prevent contamination and selection bias
In the SWD, every nursing home acts as its own control group for the horizontal comparison of data. To avoid contamination of data in the vertical comparisons (between the clusters), the nursing homes will not be informed about the other participating nursing homes to prevent any type of communication and information exchange. Additionally, the data collectors and statistician will be blinded to the type of intervention (CC model) and the study phase (pre-intervention time).
Interventions and control phases of the study
Both interventions (WELCOME-IdA and WELCOME-NEO) are defined as the reference interventions for each arm and therefore act as their own control groups (WELCOME-IdA versus control and WELCOME-NEO versus control) with respect to the stepped wedge design. In the control phase, in addition to primary and secondary data, the normal care practices (for example, existing care concepts, organizational aspects, and meeting forms similar to the CCs) will be assessed following the better reporting of interventions: template for intervention description and replication (TIDieR) guidelines  for each nursing home.
Both CC interventions (WELCOME-IdA and WELCOME-NEO), together with the key characteristics and the different process structures, were tested regarding their feasibility in two previous pilot studies [21, 22]. According to the results, both models were modified and adapted according to the current nursing home situation, were validated on behalf of the literature and expert interviews, and were pretested in one nursing home (manuscript in preparation). Both models have the same theoretical basis, key characteristics (group size, location, duration, sequences, number of participants and their functionality) (Table 1); however, the models differ in operationalization of the sequences with and without an assessment instrument (Table 2) .
Theoretical basis of both interventions
Hermeneutics, which refers to the philosophy of understanding and the science of textual interpretation, has a two-fold objective: (a) orientation and the nature of understanding and (b) the interpretation of texts [19, 24] (Gadamer 1999; Ricoeur 1991). Defining hermeneutic principles as a core element of CCs is related to the ability to translate a particular situation to a universal context and to an overall interpretational framework . The concept of attachment and the translation process are important, which Gadamer (2004) defines as authentic participation. Naden (2007) notes that this concept also refers to the aspect of consciousness-raising . Understanding and interpretation are realized when reflection and contemplation occur, thus representing core principles of CC [26, 27], and are useful for understanding challenging behavior. All of the CC models used or known by the experts are also based on hermeneutic principles. Therefore, hermeneutics was chosen as a general theoretical framework for CCs [26, 27]. However, hermeneutics appears to be insufficient as the only theoretical background for CCs for residents with dementia because it disregards specific concepts associated with behavior in individuals with dementia. It may be assumed that care teams require a more specific theory for understanding the specific meaning of challenging behavior of residents with dementia [10, 23]. Thus, a dementia-specific theory (need-driven dementia-compromised behavior (NDB) model) for understanding challenging behavior and forming the content of our intervention was also selected . In the NDB model, behavior is treated as a meaningful indicator of an unmet need. Therefore, dementia-related behavior can be explained as the staff’s inability to understand the needs of individuals with dementia and as the incapacity of people with dementia to express their own needs. Antecedents of NDBs include background factors and proximal factors. These factors can structure the search for causes and triggers of challenging behavior. In general, the understanding of these behaviors is the basis of initiation of individually tailored interventions, which could lead to a reduction in the prevalence of challenging behavior among residents, to an increased quality of life and to a reduction in the prescription of psychotropic drugs. Furthermore, it is expected that CCs result in an increase in the staff’s vocational action competence, reduced burnout, and decreased work-related stress (Figure 2).
In the intervention WELCOME-IdA, staff are guided systematically through the process of searching for causes and triggers of behaviors using the innovative dementia-oriented assessment tool (IdA). The practicability and validity of the instrument was tested in a previous study . The IdA is a comprehensive assessment instrument based on the NDB model mentioned above and is utilized in a two-step process: the first step is a detailed description and quantification of the challenging behavior and the second step is the search for potential causes of the behavior. The second step of IdA is divided into five dimensions (state of health and independence in everyday life, communication, personality and life style before the onset of dementia, mood and emotions, and environmental influences) with specific guiding questions. The second intervention, WELCOME-NEO, uses no structured assessment. Understanding the situation of people with dementia requires the description and analysis of the behavior in an unstructured, free, narrative manner .
The intervention (components of the intervention) in both CC models will start with training in the respective CC model (WELCOME-IdA; WELCOME-NEO) and will be followed by four supported CCs (training on the job). Subsequently, a minimum of four CCs will be performed without any assistance (CCs without support).
Educational strategy for the intervention groups
From previous studies , important components of specific CC implementation strategies were identified (Table 3) as follows: kick-off meetings with the staff, training in dementia and challenging behavior, training in moderation, CC reminders, a telephone hotline for queries, and the building of a steering group that is responsible for the development of a unit-specific implementation strategy. Three experts from an educational institution (Kaiserswerther-Diakonie) will conduct the training. The three experts are well-trained teachers with several years of experience in the field of CCs and in providing nursing care to people with dementia.
Measurements in residents with dementia
The neuropsychiatric inventory-nursing home version (NPI-NH) , which is a common and validated instrument for detecting challenging behavior in elderly people with dementia , includes 12 subscales (delusions, hallucinations, agitation, depression, anxiety, euphoria, apathy, disinhibiting, irritability, aberrant motor behavior, night-time disturbances, and change in appetite) . The staff members assess the frequency and severity for each domain. The severity index (frequency × severity) is calculated for each domain and for the overall scale. The scores range from 0 to 12 (for each domain) and from 0 to 144 for the total scores. The higher scores indicate the presence of more severe and challenging behaviors. The primary outcome will be coded as the presence or absence (0/1) of at least one challenging behavior measured using the NPI-NH.
The quality of life instrument for dementia (QUALIDEM) , which was developed and validated in the Netherlands and was translated into and tested in German , consists of two consecutive versions for people with mild-to-severe dementia and those with very severe dementia. The version for mild-to-severe dementia assesses the following factors: care relationship, positive affect, negative affect, restless tense behavior, positive self-image, social relation, social isolation, feeling at home, and ability to stay occupied (37 items). The list contains 16 indicative items and 21 contra-indicative items that constitute nine homogeneous subscales. The second version for very severe dementia is based on the following factors: care relationship, positive affect, negative affect, restless tense behavior, social relation, and social isolation (18 items). For both versions, four response options are used: never, seldom, sometimes, and often. A higher score on a subscale indicates a higher quality of life.
The defined daily dose (DDD) of psychotropic drugs, which is a reliable instrument for measuring the volume of medications , is defined as the average maintenance dose of a medication when used according to its major indications in adults. The prescribed psychotropic agents will be obtained from the nursing records
Measurements in nursing staff
The Copenhagen burnout inventory (CBI), which is a widely used and validated instrument , focuses on exhaustion and measures burnout using three sub-dimensions: personal burnout (six items), work-related burnout (seven items), and client-related burnout (six-items). All of the items have five response categories (always, often, sometimes, seldom, never). The responses are rescaled to a 0 to 100 metric (with values of 0 to 25 to 50 to 75 to 100), and the total score of the scale is the average of the scores of the items. Individuals are defined as exposed to burnout with a score of >50 points .
Work-related stress (Bela-Dem)
The dementia-specific stress on the staff will be assessed using the German BelaDem Questionnaire, which consists of 16 items that rate dementia-specific burden in relation to the challenging behavior of the residents. Each item will be rated by severity (0 = not at all, 1 = low, 2 = slightly, 3 = moderate, 4 = strong, 5 = very strong) and frequency (1 = never, 2 = rarely, 3 = sometimes, 4 = often) during the last four weeks. The scores will be calculated for each item as follows:
Each item ranges from 0 to 10, and a higher score indicates a greater stress level. The internal consistency and construct validity of the instrument has already been tested .
Competence - reflection inventory (KRI)
The German questionnaire, the competence - reflection inventory (KRI), which will be used to assess the vocational action competence of the nursing staff, measures the dimensions vocational and methodological expertise, social competence, and self-competence (36 items). Each item is rated in steps of 10 from 0% (strongly disagree) to 100% (strongly agree) . The scores are calculated by taking the mean of the items in each subscale; 50% indicates a normal level of vocational action competence, more than 50% indicates an above-average level of vocational action competence, and less than 50% indicates a low level of vocational action competence.
Several variables will be assessed at each time point, T (T0 to T5) as possible predictors of primary and secondary study outcomes measured at the resident, staff, and institutional levels. The functional assessment staging (FAST) score  will be used to classify the stage of dementia severity in this study. The activities of daily living will be measured using the Physical Self-Maintenance Scale (PSMS) . Age, gender, and pain severity and frequency according to the study by Achterberg et al. and the level of care are further covariates at the resident level. The demographic data, occupational skills, and work experience will be collected at the staff level.
To evaluate several important structural and financial aspects of nursing homes and the potential institutional influences in relation to the characteristics of the respective unit, a self-developed questionnaire will be used. The questionnaire is divided into two domains. The first domain consists of four items and evaluates the entire institutional structure and financial aspects. The second domain focuses on the nursing unit and is divided into resident-specific factors (three items), structure (one item), and staffing, including staff turnover (five items). The single items of the questionnaire were previously tested with regard to practicability and feasibility in two studies [41, 42]. The questionnaire will be completed every 3 months by the study coordinator of the corresponding institution.
The dementia milieu assessment (DMA)
The DMA assesses dementia-friendliness environments and consists of 29 items. The DMA is a standardized observation instrument that was used in a previous study . The factors are divided into an environmental domain (21 items) and a psychosocial domain (8 items). Each item is measured using yes or no dichotomous-response options. The scores range from 0 to 21 for the environmental domain and from 0 to 8 for the psychosocial domain. A higher score indicates a more dementia-friendly environment. The DMA is used during a 2-hour period of observation from 3 to 5 pm in each facility. Observations will only be conducted in public spaces. A trained rater will complete the DMA before starting the intervention and after finishing the intervention.
The process evaluation aims to explore the delivery of the intervention and the implementation strategy to the clusters, the response of clusters and individuals to the intervention and the implementation strategy, the recruitment of clusters and individuals, as well as the context and contextual factors that promote or inhibit the implementation of the intervention (Figure 2). For the process evaluation, the framework for cluster randomized controlled trials (RCTs)  will be used. The details of the comprehensive process evaluation will be published separately.
At least two units of one nursing home must participate in the study, from which at least 30 residents with dementia can be recruited. The care of the residents must predominantly take place in the respective unit.
Criteria for inclusion are informed consent obtained from people with dementia or their legal representative; diagnosis of dementia based on the medical diagnosis in the charts and a FAST score > 1); residence for at least 14 days in the unit.
All of the nursing staff working in one of the two participating wards of the nursing home must provide their informed consent.
Excluded will be nursing homes with <30 residents with dementia; homes with reconstruction work ongoing in the participating unit; homes participating in any other research project at the same time, which requires personal resources.
Exclusions will be patients with schizophrenia or any other type of diagnosed psychiatric disease (found in the nursing documentation); residents with dementia in day or night care who are outside the unit for most of the time.
Nurses who are not working permanently in one of the two participating units of the nursing home or are employed temporarily will be excluded.
Data collection and measurements
The data collection to assess the primary and secondary outcomes will be conducted every 3 months over a period of 17 months (Figure 1). The maximum intervention period for each cluster varies according to when the nursing home switches from the control phase to the intervention phase, which occurs between 7 and 17 months. The measurement instruments were chosen based on their appropriateness for the target setting and population, psychometric properties (validity and reliability), and their feasibility. The data at the resident level (for example, health indicators, behavior) will be obtained from interviews using the caregivers as proxies. The trained study assistants will simultaneously interview two caregivers who know the resident very well. If there is no agreement between the caregivers, the response of the caregiver with the longest relationship with the resident will be chosen. Every study assistant rater (primarily students) will undergo a two-day training session on the use of the questionnaires and instruments and will receive a detailed manual for the data collection, questionnaires, and instruments. For the first data collection session, the raters will be assisted by a senior researcher and a junior researcher to ensure that the data are collected as planned. The staff will complete questionnaires at the institutional and staff levels. The questionnaires will be tested to assess their feasibility in a pretest in one nursing home before commencing the intervention study.
Ethics and dissemination
The Institutional Review Board for Ethics in Research, German Society for Science in Nursing (E-DG-P) has discussed and considered the proposal Fallbesprechungen bei Menschen mit Demenz (FallDem), Teil II: Interventionsdurchführung (delivered in August 2011) and imparts an ethical clearing. Informed consent from each participant (residents and staff) will be obtained before the start of the trial. We will publish the main outcomes of the study in peer-reviewed scientific journals and journals for nursing practice and present the results at national and international conferences. Furthermore, based on the key results, we plan to write a handbook for nursing homes on how to use and implement CCs into their daily work routines.
Analysis of data for effectiveness
In general, the analysis will follow the principles of an intention-to-treat analysis at the cluster level. The missing data will be appropriately imputed after assessing the missing data mechanism. For the analysis of the secondary staff’s outcomes, the missing data will be censored regardless of the reason for missing data.
Primary data analysis
The statistical analysis will be conducted after the end of the follow-up phase (T6). For the main analysis of the primary outcome, differences in the NPI scores of the clusters within the two intervention groups (WELCOME-IdA and WELCOME-NEO) for the different time points will be analyzed. Here, the NPI-NH scores of the control condition will be compared with the data from the intervention phase within each intervention arm . With respect to the nature of the SWD, the clustering, repeated measurements, and confounding effect of time must also be considered in the data analysis. With respect to our binary outcome, the use of a generalized linear mixed-effects model is highly recommended for data obtained from such types of studies. These models allow the inclusion of both fixed (for example, intervention, time) and random (for example, nursing home, resident-observed several times) factors . Furthermore, a delayed intervention effect of the CCs is assumed because the nurses need time to implement the procedure. Thus, the duration of the intervention in months must be considered. For the estimation of model parameters, the Bayesian approach will be used. In contrast to the likelihood-based inference, the Bayesian approach is more flexible and powerful because it allows, for example, the inclusion of prior information from previous studies. For the model selection process, an approach will be used that was previously described by Cheng et al.. If necessary, the influence of missing data will also be analyzed by sensitivity analyses.
Secondary data analysis
The secondary outcome parameters will be analyzed using descriptive statistics and mixed effects models to generate hypotheses for additional research (for example, reduction of staff burden, differences between the two concepts of CCs).
The effectiveness of CCs on challenging behavior, quality of life of people with dementia, prescription of psychotropic drugs, nursing staff’s burnout, dementia-specific burden, and vocational action competences will be evaluated. The use of the SWD offers several methodological and logistical advantages over the traditional randomized cluster design. RCTs are the gold standard for measuring clinical effects. In some situations, it is not possible or it is unethical or unfeasible to deny an intervention to an organization, a team, or residents. CCs are widely used in nursing homes and are recommended in guidelines . The traditional waiting-list designs seem to overestimate the effect of interventions . Therefore, alternative approaches for evaluating clinical and community interventions have received increased attention, particularly those that can retain several elements of randomization and that can be considered as controlled trials . The SWD is described in the literature as an alternative approach because it avoids several methodological pitfalls associated with before and after designs and it retains controlled data elements and randomization . Cluster-randomized trials are used to test whether an intervention is replicable and recognizable. However, CCs represent an example of a complex intervention in which the framework may be standardized but not each individual component. The way in which staff conduct CCs cannot be completely controlled because there is also a type of ongoing group dynamic process, which could change from case to case; often, the process must change because of the specifics of the case. For complex interventions, it is more important to standardize the process and the function of the intervention  rather than all of the individual components of the intervention. In this study, we describe key obligatory elements of the intervention. With the long follow-up period of the trial, we will be able to detect intervention changes over a long time period.
Several logistical advantages of the study design exist. The staggered introduction of the intervention allows time to provide training on CCs and supports the stepwise study design. If we chose to implement a traditional cluster randomized trial, we would need to start with the intervention at the beginning of the trial, which would not be feasible with respect to the resources of our research team. However, from the statistical point of view, the data analysis is complex (for example, control for temporal trends in outcome variables or accounting for repeated measurements) . Only a few papers discuss the analysis methods in an SWD [17, 49, 50]. Additionally, some nursing homes will wait a long time to begin the intervention, which poses a potential risk that several nursing homes may drop out of the trial due to loss of motivation or organizational developments. This situation also affects the resident and staff samples, and the problem of missing data intensifies.
Measuring the effect of psychosocial interventions in health care research is, for the most part, a challenge because of their complexity . Complex interventions often consist of different components that may contribute to the success or failure of the effect of an intervention. Often, the environment in which the intervention will be implemented is also complex . RCTs are stated to be the most powerful design for proving the effect of an intervention; however, these trials are limited in their ability to explain the reasons why an intervention is effective [53, 54]. Therefore, it is important that an effectiveness study is accompanied by a process evaluation that provides additional information regarding the change processes and the contribution of each component of the intervention to the overall effect of the intervention. Otherwise, it will not be possible to gain insight into the so-called black box of this intervention .
Limitations of the study
First, because of limited resources, the study will be conducted in only one state, North Rhine - Westphalia (NRW) in Germany, which must be considered in the generalization of the results (external validity). The funding of long-term care by the local governments could differ between states in Germany. However, NRW is one of the largest and most densely populated states in Germany. Nonetheless, the participating nursing homes can be compared with all of the nursing homes in NRW and in Germany with respect to how representative they are.
The second limitation is the small number of nursing homes (six for each intervention arm) and the simple randomization procedure, which could lead to an imbalance between the different nursing homes in relation to several important covariates. Several studies solve this problem by using a SWD with the constrained randomization procedure after obtaining baseline data [56, 57]. They balanced the allocation with respect to important covariates at the clinic level (for example, geographic region or prevalence rates of important covariates) . However, this type of restricted randomization procedure is criticized even with the use of a small number of clusters because of their influence on the data analysis . Additionally, in our case, we would need baseline data to restrain the allocation sequence to important factors, which seems unrealistic because of logistical reasons. Because we are unable to conduct the randomization procedure after baseline data collection, possible covariates were mentioned in the data analysis section. The third limitation is a possible selection bias at the unit and resident level. In our stepped-wedge cluster randomized trial, we randomize the nursing homes according to the type of intervention and the time at which the cluster switched from control to intervention phase. However, the selection of the unit and the residents based on the inclusion and exclusion criteria must be performed by the nursing home leaders because of logistical reasons. This selection strategy may increase the possibility of post-randomization selection bias at unit and/or resident level (for example, only very motivated units take part in the study or residents with high-intensity or low-intensity behavioral and psychological symptoms of dementia (BPSD) are chosen). To identify a possible selection bias due to the recruitment process, we will collect organizational and structural baseline data at the nursing home, unit and resident level. Additionally, the risk at the resident level is negligible because all eligible participants of the two units are invited . However, at the end of the trial, we will compare the demographic data (for example, care dependency, age, sex) at the resident and unit level with data from the German Office of Statistics.
The fourth limitation concerns the data quality. We will use proxy instruments for the primary and secondary outcomes. We must consider that the challenging behavior assessed using the NPI-NH may be biased. As a proxy-rating instrument, the NPI-NH assesses the experience and subjective perspective of a professional caregiver of an individual with a particular behavior . Another bias may occur if the staff believes they need to rate their own quality of care instead of the residents’ quality of life. To resolve this problem and to increase the objectivity, two staff members will generally be interviewed about people with dementia.
This trial was initiated in 2011 (development of the intervention) and will be completed by the end of 2015. The recruitment of the nursing homes was completed in fall 2013. The recruitment of the participating staff and residents (who will provide intervention training) will be completed by the end of 2014. Participating staff (who will provide intervention training) will be completed by the end of 2014.
behavioral and psychological symptoms of dementia
work-related stress (Belastungen bei Demenz)
Copenhagen burnout inventory
defined daily dose (of psychotropic drugs)
dementia milieu assessment
Institutional Review Board for Ethics in Research German Society for Science in Nursing
dementia-specific case conferences in German nursing homes
Functional Assessment Staging Tool
German questionnaire ‘competence - reflection inventoryʼ
need-driven dementia-compromised behavior
Neuropsychiatric inventory-nursing home version
North Rhine - Westphalia
physical self-maintenance scale
quality of life instrument for dementia
randomized controlled trial
Wittener model of case conferences for people with dementia - innovative dementia-oriented assessment tool
Wittener model of case conferences for people with dementia - narrative approach.
Edberg A, Bird M, Richards DA, Woods R, Keeley P, Davis-Quarrell V: Strain in nursing care of people with dementia: nurses' experience in Australia, Sweden and United Kingdom. Aging Ment Health. 2008, 12: 236-243.
Beerens HC, Zwakhalen SM, Verbeek H, Ruwaard D, Hamers JP: Factors associated with quality of life of people with dementia in long-term care facilities: a systematic review. Int J Nurs Stud. 2013, 50: 1259-1270.
van Beek AP, Gerritsen DL: The relationship between organizational culture of nursing staff and quality of care for residents with dementia: questionnaire surveys and systematic observations in nursing homes. Int J Nurs Stud. 2010, 47: 1274-1282.
Schneider LS, Dagerman K, Insel PS: Efficacy and adverse effects of atypical antipsychotics for dementia: meta-analysis of randomized, placebo-controlled trials. Am J Geriatr Psychiatry. 2006, 14: 191-210.
Ballard C, Corbett A: Management of neuropsychiatric symptoms in people with dementia. CNS Drugs. 2010, 24: 729-739.
Whall AL, Kolanowski AM: The need-driven dementia-compromised behavior model– a framework for understanding the behavioral symptoms of dementia. Aging Ment Health. 2004, 8: 106-108.
Murman DL, Chen Q, Powell MC, Kuo SB, Bradley CJ, Colenda CC: The incremental direct costs associated with behavioral symptoms in AD. Neurology. 2002, 59: 1721-1729.
Vernooij-Dassen M, Vasse E, Zuidema S, Cohen-Mansfield J, Moyle W: Psychosocial interventions for dementia patients in long-term care. Int Psychogeriatr. 2010, 22: 1121-1128.
Bartholomeyczik S, Halek M, Sowinski C, Besselmann K, Dürrmann P, Haupt M, Kuhn C, Müller-Hergl C, Perrar K, Riesner C, Rüsing D, Schwerdt R, van der Kooij C, Zegelin A: Rahmenempfehlungen zum Umgang mit herausforderndem Verhalten bei Menschen mit Demenz in der stationären Altenhilfe. 2007, Berlin: Bundesministerium für Gesundheit (BMG)
Reuther S, Dichter NM, Buscher I, Vollmar HC, Holle D, Bartholomeyczik S, Halek M: Case conferences as interventions dealing with the challenging behavior of people with dementia in nursing homes: a systematic review. Int Psychogeriatr. 2012, 24: 1891-1903.
Crotty M, Halbert J, Rowett D, Giles L, Birks R, Williams H, Whitehead C: An outreach geriatric medication advisory service in residential aged care: a randomised controlled trial of case conferencing. Age Ageing. 2004, 33: 612-617.
Davison TE, McCabe MP, Visser S, Hudgson C, Buchanan G, George K: Controlled trial of dementia training with a peer support group for aged care staff. Int J Geriatr Psychiatry. 2007, 22: 868-873.
Phillips JL, Penny A, West P, Davidson M, Agar M: Does case conferencing for people with advanced dementia living in nursing homes improve care outcomes: Evidence from an integrative review?. Int J Nurs Stud. 2012, 50: 1122-1135.
Bird M, Llewellyn-Jones RH, Korten A: An evaluation of the effectiveness of a case-specific approach to challenging behaviour associated with dementia. Aging Ment Health. 2009, 13: 73-83.
Bartholomeyczik S, Wilm S, Bureick G, Halek M, Hardenacke D, Krüger C, Knee R, Mayer H: Abschlussbericht zum Projekt: „Interdisziplinäre Implementierung von Qualitätsinstrumenten zur Versorgung von Menschen mit Demenz in Altenheimen“(InDemA). 2010, Berlin: Universität Witten/Herdecke Department Pflegewissenschaft und Institut für Allgemeinmedizin und Familienmedizin
Brown CA, Lilford RJ: The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006, 6: 54-
Hussey MA, Hughes JP: Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007, 28: 182-191.
Holle D, Halek M, Mayer H, Bartholomeyczik S: The influence of understanding diagnostics on perceived stress of nurses caring for nursing home residents with dementia. Pflege. 2011, 24: 303-316.
Ricoeur P: From Text to Action — Essays in Hermeneutics II. Edited by: Blamey K, Thompson JB. 1991, London: The Athlone Press
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, Lamb S, Dixon-Woods M, McCulloch P, Wyatt J, Phelan A, Michie S: Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014, 348: g1687-
Buscher I, Kühnert S, Panke Kochinke B: Abschlussbericht zum Leuchtturmprojekt Demenz. Qualitative Evaluation von Inhouse-Weiterbildungen zur Konzept- und Kompetenzentwicklung multiprofessioneller Teams und ehrenamtlicher Mitarbeiter/innen in stationären, teilstationären und ambulanten Einrichtungen der Altenhilfe mit dem Schwerpunkt demenzieller Erkrankungen (QUIKK). 2010, Friederike-Fliedner Institut der Evangelischen Fachhochschule Rheinland-Westfalen-Lippe: Düsseldorf
Bartholomeyczik S, Halek M, Holle D: Herausforderndes Verhalten bei Menschen mit Demenz verstehen: Die Verbesserung der Versorgung Demenzkranker durch Qualitätsinstrumente. 2013, Beltz Juventa Verlag: Weinheim Basel
Buscher I, Reuther S, Holle D, Bartholomeyczik S, Vollmar HC, Halek M: Das kollektive Lernen in Fallbesprechungen. Theoretische Ansätze zur Reduktion herausfordernden Verhaltens bei Menschen mit Demenz im Rahmen des Projektes FallDem [article in German]. Pflegewissenschaft. 2012, 03: 168-178.
Gadamer H-G: Truth and Method, (trans.) Weinsheimer, J., Marshall DG. 2004, New York: Continuum
Nåden D: Hermeneutics and observation–a discussion. Nurs Inq. 2010, 17: 75-81.
Nolan L: Caring connections with older persons with dementia in an acute hospital setting - a hermeneutic interpretation of the staff nurse's experience. Int J Older People Nurs. 2006, 1: 208-215.
Schrems B: Verstehende Pflegediagnostik. Grundlagen zum angemessenen Pflegehandeln. 2008, Wien: Facultasverlag
Kovach CR, Noonan PE, Schlidt AM, Wells T: A model of consequences of need-driven, dementia-compromised behavior. J Nurs Scholarsh. 2005, 37: 134-140.
Halek M, Bartholomeyczik S: Assessmentinstrument für die verstehende Diagnostik bei Demenz: Innovatives demenzorientiertes Assessmentsystem (IdA). Assessmentinstrumente in der Pflege. Edited by: Bartholomeyczik S, Halek M. 2009, Hannover: Schlütersche Verlagsgesellschaft mbH & Co. KG, 94-104.
Cummings JL, McPherson S: Neuropsychiatric assessment of Alzheimer's disease and related dementias. Aging (Milano). 2001, 13: 240-246.
Moniz-Cook E, Vernooij-Dassen M, Woods R, Verhey F, Chattat R, De Vugt M, Mountain G, O'Connell M, Harrison J, Vasse E, Droes RM, Orrel M: A European consensus on outcome measures for psychosocial intervention research in dementia care. Aging Ment Health. 2008, 12: 14-29.
Ettema TP, Droes RM, de Lange J, Mellenbergh GJ, Ribbe MW: QUALIDEM: development and evaluation of a dementia specific quality of life instrument–validation. Int J Geriatr Psychiatry. 2007, 22: 424-430.
Dichter MN, Schwab CG, Meyer G, Bartholomeyczik S, Dortmann O, Halek M: Measuring the quality of life in mild to very severe dementia: Testing the inter-rater and intra-rater reliability of the German version of the QUALIDEM. Int Psychogeriatr. 2014, 26: 1-12.
WHO: Introduction to Drug Utilization Research. 2003, 49-http://apps.who.int/medicinedocs/pdf/s4876e/s4876e.pdf,
Hasselhorn HM, Tackenberg P, Peter R: Effort-reward imbalance among nurses in stable countries and in countries in transition. Int J Occup Environ Health. 2004, 10: 401-408.
Borritz M, Rugulies R, Bjorner JB, Villadsen E, Mikkelsen OA, Kristensen TS: Burnout among employees in human service work: design and baseline findings of the PUMA study. Scand J Publ Health. 2006, 34: 49-58.
Schlee J: Kollegiale Beratung und Supervision für pädagogische Berufe Hilfe zur Selbsthilfe; ein Arbeitsbuch. 2008, Stuttgart: Kohlhammer
Auer S, Reisberg B: The GDS/FAST staging system. Int Psychogeriatr. 1997, 9 (Suppl 1): 167-171.
Lawton MP, Brody EM: Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969, 9: 179-186.
Achterberg WP, Gambassi G, Finne-Soveri H, Liperoti R, Noro A, Frijters DH, Cherubini A, Dell'aquila G, Ribbe MW: Pain in European long-term care facilities: cross-national study in Finland, Italy and The Netherlands. Pain. 2010, 148: 70-74.
Halek M, Dichter MN, Quasdorf T, Riesner C, Bartholomeyczik S: The effects of dementia care mapping on nursing home residents' quality of life and staff attitudes: design of the quasi-experimental study Leben-QD II. BMC Geriatr. 2013, 13: 53-
Palm R, Kohler K, Schwab CG, Bartholomeyczik S, Bernhard H: Longitudinal evaluation of dementia care in German nursing homes: the "DemenzMonitor" study protocol. BMC Geriatr. 2013, 13: 123-
Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B: Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013, 14: 15-
Zwijsen SA, Smalbrugge M, Eefsting JA, Twisk JW, Gerritsen DL, Pot AM, Hertogh CM: Coming to grips with challenging behavior: a cluster randomized controlled trial on the effects of a multidisciplinary care program for challenging behavior in dementia. J Am Med Dir Assoc. 2014, 15: 531-e531-510
Cheng J, Edwards LJ, Maldonado-Molina MM, Komro KA, Muller KE: Real longitudinal data analysis for real people: building a good enough mixed model. Stat Med. 2010, 29: 504-520.
Cunningham JA, Kypri K, McCambridge J: Exploratory randomized controlled trial evaluating the impact of a waiting list control design. BMC Med Res Methodol. 2013, 13: 150-
Mdege ND, Man MS: Taylor Nee Brown CA, Torgerson DJ: Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011, 64: 936-948.
Hawe P, Shiell A, Riley T: Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ. 2004, 328: 1561-1563.
Hayes RJ, Moulton LH: Cluster randomised trials. 2009, CRC Press London: Taylor & Francis
Moulton LH, Golub JE, Durovni B, Cavalcante SC, Pacheco AG, Saraceni V, King B, Chaisson RE: Statistical design of THRio: a phased implementation clinic-randomized study of a tuberculosis preventive therapy intervention. Clin Trials. 2007, 4: 190-199.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-a1655.
Shiell A, Hawe P, Gold L: Complex interventions or complex systems? Implications for health economic evaluation. BMJ. 2008, 336: 1281-1283.
van Meijel B, Gamel C, van Swieten-Duijfjes B, Grypdonck MH: The development of evidence-based nursing interventions: methodological considerations. J Adv Nurs. 2004, 48: 84-92.
Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328: 702-708.
Hulscher ME, Laurant MG, Grol RP: Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003, 12: 40-46.
Sismanidis C, Moulton LH, Ayles H, Fielding K, Schaap A, Beyers N, Bond G, Godfrey-Faussett P, Hayes R: Restricted randomization of ZAMSTAR: a 2 x 2 factorial cluster randomized trial. Clin Trials. 2008, 5: 316-327.
Moulton LH: Covariate-based constrained randomization of group-randomized trials. Clin Trials. 2004, 1: 297-305.
Hewitt CE, Torgerson DJ: Is restricted randomisation necessary?. BMJ. 2006, 332: 1506-1508.
Giraudeau B, Ravaud P: Preventing bias in cluster randomised trials. PLoS Med. 2009, 6: e1000065-
Hardy SE, Allore H, Studenski SA: Missing data: a special challenge in aging research. J Am Geriatr Soc. 2009, 57: 722-729.
We received funding for this study from the Public Welfare Foundation North Rhine-Westphalia (Stiftung-Wohlfahrtspflege-Nordrhein-Westfalen) (Germany). The funders have no role in the study design; data collection, management, analysis, or interpretation; manuscript writing; or the decision to submit the report for publication.
MH was the developer of the IdA assessment instrument. SB, MH, IB and DH participated in the earlier studies on IdA and CCs.
SR, DH, and MH designed and wrote the first draft of the manuscript. SR, DH, IB, SB, RM, OD and MH developed the study design. OD conducted the power calculation and provided advanced statistical consulting. IB, SB and OD assisted in the preparation of the manuscript. DH coordinated and MH supervised the project. All authors read and approved the manuscript.
About this article
Cite this article
Reuther, S., Holle, D., Buscher, I. et al. Effect evaluation of two types of dementia-specific case conferences in German nursing homes (FallDem) using a stepped-wedge design: study protocol for a randomized controlled trial. Trials 15, 319 (2014). https://doi.org/10.1186/1745-6215-15-319