Using discrete choice experiments to inform the design of complex interventions
Trials volume 20, Article number: 157 (2019)
Complex health interventions must incorporate user preferences to maximize their potential effectiveness. Discrete choice experiments (DCEs) quantify the strength of user preferences and identify preference heterogeneity across users. We present the process of using a DCE to supplement conventional qualitative formative research in the design of a demand creation intervention for voluntary medical male circumcision (VMMC) to prevent HIV in Tanzania.
The VMMC intervention was designed within a 3-month formative phase. In-depth interviews (n = 30) and participatory group discussions (n = 20) sought to identify broad setting-specific barriers to and facilitators of VMMC among adult men. Qualitative results informed the DCE development, identifying the role of female partners, service providers’ attitudes and social stigma. A DCE among 325 men in Njombe and Tabora, Tanzania, subsequently measured preferences for modifiable VMMC service characteristics. The final VMMC demand creation intervention design drew jointly on the qualitative and DCE findings.
While the qualitative research informed the community mobilization intervention, the DCE guided the specific VMMC service configuration. The significant positive utilities (u) for availability of partner counselling (u = 0.43, p < 0.01) and age-separated waiting areas (u = 0.21, p < 0.05) led to the provision of community information booths for partners and provision of age-separated waiting areas. The strong disutility of female healthcare providers (u = − 0.24, p < 0.01) led to re-training all providers on client-friendliness.
This is, to our knowledge, the first study documenting how user preferences from DCEs can directly inform the design of a complex intervention. The use of DCEs as formative research may help increase user uptake and adherence to complex interventions.
User social and behavioural characteristics can attenuate the effectiveness of complex interventions, which exacerbates the challenge of testing their effectiveness in trials. For example, use of antiretroviral (ART)-based vaginal and oral pre-exposure prophylaxis (PrEP) was effective in five of eight randomized controlled trials (RCTs) [1,2,3,4,5,6,7,8], with the differing results largely attributed to sub-optimal adherence rather than a lack of product efficacy [9, 10]. Incorporating user preferences at the intervention design phase may be useful for enhancing the uptake of and adherence to complex health interventions.
Although there is a growing literature reporting on the formative research processes applied in intervention development [11,12,13,14,15], to date only few studies or theoretical frameworks provide methodological guidance on conducting such formative research [16,17,18]. Qualitative research can identify a range of barriers and facilitators of accessing services, and participatory rating or ranking exercises can retrieve ordinal measures of importance. However, when faced with numerous service characteristics and a need to prioritize between them, neither of these approaches provides concrete guidance for implementers on which combination of characteristics will achieve the greatest uptake. Some studies have used discrete choice experiments (DCEs) to inform programme design and identify potential barriers and facilitators of uptake [19,20,21]. DCEs are a survey-based approach to eliciting user preferences. They allow the estimation of user values in the absence of observable markets, where services are provided for free or have not yet been introduced. They can measure the strength of preferences between service attributes, for example, valuing waiting times, prices and provider gender, independently. Lastly, they can identify where preferences differ between individuals, which is particularly useful when complex interventions include targeting specific user groups.
The purpose of this study is to describe how the DCE methodology can be used to inform the development of complex interventions. To demonstrate the approach, we use the case of an intervention to increase uptake of voluntary medical male circumcision (VMMC) among adult men in Tanzania (Table 1), for which the DCE was integral in prioritizing the intervention components. We argue that this may be a useful addition to the current MRC guidelines for developing and evaluating complex interventions , as proposed in Fig. 1.
We present the mixed-methods formative research in chronological order. First, the conventional formative qualitative research is described. We then present the design of the DCE and how it built on this qualitative work, followed by the methods for DCE data collection and analysis. Finally, we discuss the intervention design features resulting from information generated within the conventional formative research and the contribution of a DCE in this complex intervention.
Designing an evidence-based demand creation intervention: integrated formative data collection
The DCE was integrated into the qualitative data collection activities.
Table 2 presents an overview of the fieldwork process and how the qualitative research and DCEs were conducted in tandem. While the qualitative research team undertook in-depth interviews (IDIs) and participatory group discussions (PGDs), real-time debriefing of qualitative field teams provided qualitative insights for the DCEs. The qualitative team conducted additional iterative cognitive interviews while the DCE tools were developed and subsequently administered the DCE questionnaires. Recruitment for this phase is described in detail in Additional file 1.
Conventional formative research
Following a scoping literature review around behaviour change and VMMC, the information–motivation–behavioural (IMB) theory was chosen as the most suitable behaviour change framework . Gaps were identified and formative research underpinning the IMB theory was conducted to identify individual and community-level factors that facilitate or limit the uptake of VMMC in each of the three constructs. Findings from this formative research were used to develop the intervention that was evaluated in phase 2 of the study and have been published elsewhere . In brief, the qualitative research team conducted 30 in-depth interviews and 20 participatory group discussions across the two regions, Njombe and Tabora, in rural and urban areas, with women and with younger men (age < 20 years) and older men (age 20 years and older). These interviews aimed to comprehensively understand barriers and facilitators to access VMMC services. When the DCE was added, the scope was expanded to determine which service delivery components to assess within the DCE and thus informed the early stages of the DCE, following the DCE guidelines .
The discrete choice experiment
DCEs present respondents with a series of choice scenarios where they are asked to choose between two or more alternative goods or services with simultaneously varying attribute levels (Fig. 2). In making these choices, respondents are forced to trade-off between preferred and less preferred attribute levels presented in each alternative service. Econometric analysis of respondent choices allows one to retrieve the value (utility) derived from each attribute level relative to the others. It can also test whether people with different characteristics, such as age and gender, have significantly different preferences.
Using the estimated utilities of goods (i.e. the sum of the utility of each characteristic), one can estimate relative market shares. If an opt-out alternative is included (i.e. one can choose ‘Neither of the alternatives’), levels of uptake can be predicted. As such, DCEs allow one to explore the impact of varying service characteristics on potential uptake of an intervention in the context of both research and programme implementation .
The development of the DCE followed steps as laid out in the standard guidelines . The literature on the uptake of VMMC among adult men (age 20 years and older), including the grey literature of qualitative work from within Tanzania, was reviewed [26, 27]. Following this, the DCE was developed and implemented over a 6-week period of fieldwork (February–March 2014). Potential feasible demand creation strategies were explored using sequential rounds of cognitive interviews and debriefings from two group discussions considering both the key drivers of demand and their pictorial representations.
The final attributes (including pictorial representations) included in the DCE are shown in Fig. 2. The full set of attribute levels are presented in Table 3. The DCE provided participants with a sequence of nine repeated choices between two generic circumcision services and ‘Neither’. For uncircumcised men, ‘Neither’ represented remaining uncircumcised; for circumcised men, ‘Neither’ represented having the same services they had when previously circumcised. Analysis of a pilot DCE survey (n = 54) provided the priors to generated a d-efficient design using NGENE 1.1 . The DCE design allowed for an analysis capturing the preference heterogeneity for service characteristics by region (Tabora and Njombe), age and circumcision status. Although preferences for financial incentives were also collected, they were not considered an option within this intervention package and were therefore not part of the intervention development process.
The utility of a given service (VMMCA or VMMCB) is estimated as a function of the utilities of the separate service characteristics:
These service characteristics varied in each choice scenario, as determined in the experimental design. Respondents could also choose to not be circumcised in either VMMCA or VMMCB and then choose ‘Neither’, which in the first instance is given an alternative specific constant (ASC). To obtain total utility for a given service, one can sum the utility values of the specified attribute levels.
Service attributes and respondent covariates allow for exploration of observed preference heterogeneity and will be indicated as the multinomial logit model with interactions (MNLX). In this case we allowed for variation by respondents’ region (Tabora/Njombe, with _NJO indicating variation in preferences of those living in Njombe relative to Tabora) and age (< 21 years, ≥ 21 years).Footnote 1 Categorical variables were coded using effects coding (e.g. 1 and − 1 for a dichotomous variable), which imposes a central utility of 0; thus, the utilities represent relative preferences . The magnitude of the utilities themselves has no meaning if not interpreted relative to the magnitude of utilities of other attributes. The significance levels of the utilities test whether the utilities are significantly different from the utility of the reference (i.e. the omitted) category.
Using the multinomial logit model (MNL) and to allow for unobserved preference heterogeneity and explore scale heterogeneity, we applied the generalized multinomial logit model (GMXL) estimator . The gamma coefficient tests for unobserved preference heterogeneity and the tau coefficient tests for scale heterogeneity. If there is no scale heterogeneity, then the model can be collapsed to a random parameters logit model. Where there is neither scale nor unobserved heterogeneity, the model can be collapsed to the multinomial logit model. Estimation was undertaken using NLOGIT 5.0 . The GMXL model parameters were obtained by simulation; 500 iterations using Halton draws were applied. Service configuration attribute parameters were specified as random with normal distributions. The incentives (lottery and transport reimbursement) were specified with a triangular distribution, as is common around price attributes to impose a minimum of 0 .
Following the qualitative and DCE analyses, a teleconference was held with the full project team to review the findings and revise the initial intervention design for implementation and to evaluate the tailored intervention with routine demand creation for VMMC within a cluster randomized controlled trial (CRT). This CRT is described in detail by Wambura et al. .
DCE sample description and analysis
The fieldwork team administered 325 DCE surveys, 159 in Njombe and 166 in Tabora, with approximately equal numbers in urban and rural areas. Participants’ background characteristics are presented in Additional file 2. To sum, Christianity is the main religion among participants from Njombe (96%), with participants from Tabora having more diverse religious backgrounds: 51% Christian, 24% Muslim and 25% other religions. Ethnic composition was different between the regions: Bena participants were the majority in Njombe (83%), while in Tabora participants were primarily Sukuma (55%) and Nyamwezi (36%). Education and wealth (based on mobile phone and land ownership) appear similar across regions. Sexual behaviour appears more risky among participants from Tabora than from Njombe, with 51.3% and 38.6% (p ≤ 0.01), respectively, reporting more than one partner in the past year and 38.6% versus 50.4% (p < 0.01), respectively, reported condom use at last sex act. Only a third of participants self-reported not being circumcised, with similar rates across the regions. Knowledge and attitudes around VMMC also appear relatively similar across regions.
Full estimation results are presented in Additional file 3; it can be seen that relative utilities were largely robust across estimators. From here onwards we focus on the estimated utilities generated from the MNLX estimator, which estimates the main effects (i.e. those of the service attributes) and tests for preference heterogeneity by region and age, our key interest. Figure 3 shows the relative strength of preferences and the significant differences in preferences across regions and circumcision status. Where preferences did not significantly differ between region or circumcision status, they are not shown, but full utility estimates are presented in Additional file 3.
On average, availability of VMMC services outside standard working hours was not a significant driver of choice. All men preferred to have waiting areas that were separated by age (u = 0.21, p < 0.05). There was a relatively strong dislike for removing HIV testing from the VMMC process (u = − 0.40, p < 0.01). The service characteristic with the greatest utility was partner counselling (u = 0.43, p < 0.01), informing female partners of the need for post-operative abstinence and wound care, and was strongest among men in Tabora (u = 0.47, p < 0.05). Male-only service providers were preferred (u = 0.15, p < 0.1), with men in Njombe having four times stronger preferences for all-male service providers than men in Tabora (uNjombe = 0.15 + 0.09 = 0.24; uTabora = 0.151–0.09 = 0.06).
The final intervention design
Following analysis of the formative research, results from both the DCE and the qualitative study were presented to the full project team for translation into a research design. The qualitative research largely informed community mobilization messaging, and the DCE largely informed the VMMC service delivery model in the intervention arm.
DCE influence on intervention design
Time of service
Previously, it was known that mature men had challenges with fitting in VMMC alongside their livelihoods. It was thought that providing weekend or evening services may alleviate the latter. The DCE shows that this was unlikely to be a driving factor. During the campaign, communities were informed that evening VMMC services were available upon request, but evening services were otherwise not routinely provided.
The strong and positive preference for a VMMC service providing separated waiting areas prompted setting up separate waiting areas for adolescents and adult men, particularly ensuring that the waiting areas were out of view of each other. It has not been previously recognized how strongly men of all ages felt about their privacy relative to other VMMC clients.
Some men had expressed reluctance to present for VMMC due to the HIV testing requirement. The positive value men place on the availability of HIV testing suggested that HIV testing was valued, and led the programme to maintain HIV testing as part of routine client flow and include it in the provider training to re-emphasize its voluntary nature to clients. If strong preferences had been identified against testing, alternative client flows would have been explored, where testing would not be the default.
Gender of service provider
The DCE highlighted how strongly uncomfortable men felt with female staff. It was not feasible to increase male providers. The mobile VMMC service relied on the public health system’s supply of healthcare workers and was unable to influence the gender of providers supplied. However, re-training of providers emphasized the importance of professionalism in VMMC provision, and this was relayed in the community campaign.
The qualitative research identified women as important influences on men’s circumcision decisions . The DCE pre-evaluated one option of addressing this: providing counselling and information to partners about the importance of post-natal abstinence and post-operative care. This was highly valued in the DCE and then implemented by setting up information booths in the community for women.
Intervention and evaluation
Wambura et al.  summarize the new intervention and the status quo/control arm against which it was evaluated, highlighting how the findings from the DCE fed into the intervention arm services (Table 4). The new complex intervention focused on targeted demand creation among adult men (age 20–34 years) with a mass-media campaign and reconfigured services. Using trucks with mega-phones in the communities, radio spots, flyers and posters, and local community peer educators, communities received the key intervention messages. The community was informed about the highly trained staff, addressing issues related to perceptions around female staff and professional staff, and the availability of community-based information booths for female partners. Local peer educators also encouraged men to present for VMMC. Partner counselling booths were set up in the community where women could get information on post-operative abstinence and care. While not operationally feasible to engage all male service providers, re-training was undertaken to ensure providers behaved sensitively towards clients and to emphasize the optional nature of HIV testing prior to VMMC. Separate waiting areas were provided.
This paper presents how DCEs can complement conventional qualitative research to prioritize service components most critical to the target population of adult men in Tanzania. The DCE results led to the inclusion of two key service components. Firstly, the strong preferences among both the younger men and the older men revealed the importance of age-separated waiting areas at the VMMC facilities. Waiting areas for VMMC were rearranged to allow for younger and older men to wait separately and out of view of each other. Secondly, the strong preference for partner counselling led to the introduction of partner counselling booths, staffed by both female health workers and female community peers who provided one-on-one and small group information for female partners about circumcision care and post-circumcision abstinence. Out-of-hours service provision was preferred in Njombe, but the utility was relatively small compared with the value placed on separated waiting areas and partner counselling service. This allowed the intervention to focus less effort on promoting out-of-hours VMMC services, although they remained available upon request. The suggested preference for opt-out testing led to an intensification of the information campaign, ensuring clients were comfortable requesting not to be tested for HIV and staff were re-trained to emphasize the right to opt-out of HIV testing to clients. Officially, however, both the intervention and the control arms maintained a policy of opt-out HIV testing.
DCEs have great potential to inform the design of complex interventions. DCEs can indicate the relative strength of preferences and identify differences in preferences between population groups, which suggest relative differences in uptake by composition of the intervention package. This paper adds to the literature on methods for the formative phase of complex interventions. The DCE’s contribution is in estimating the relative strength of preferences for intervention components, where DCEs can help distinguish the relative importance to users of various intervention elements that had previously been combined as a package. In doing so, it can inform the optimal composition of interventions to maximize uptake.
The development of this VMMC intervention was informed both by traditional qualitative research and complemented by a DCE. Qualitative research led to the development of targeted messages and appropriate community engagement approaches, while the DCE identified priority service attributes for inclusion and highlighted, in particular, the importance adult men placed on separate waiting areas for adolescent and adult males.
The integrated approach to DCE implementation had a few limitations. As the DCE had to fit into the pre-established formative phase timelines, it did not allow for theory-based qualitative analysis to be finalized to inform the DCE design. In this case, there was a reasonably large qualitative literature on men’s preferences for VMMC in Tanzania; thus, this is unlikely to have undermined the identification of appropriate attributes and levels. In future applications, it is recommended to allow for additional time between the qualitative formative work and the DCE implementation to ensure the DCE is fully informed by robust qualitative analysis. In retrospect, sampling of younger men would have augmented the understanding of how preferences may be different between adolescent men and adult men. This was recognized, but including men younger than 18 years old would have required parental consent, and was considered not feasible within the formative research timeline. Although our main objective was to increase uptake among mature men, it appears that the service configuration changes, like separate waiting areas, were preferred both by younger and older men, as suggested by the large increases in uptake among all age groups. Lastly, the decision to be circumcised is only relevant to uncircumcised men, but to recruit only uncircumcised men would have added costs and time, potentially introducing response bias. Nevertheless, our results appear to have informed the development of a highly effective intervention. However, uptake is only one part of intervention effectiveness, and the ultimate intervention impact is an interaction between efficacy and use. To model intervention impact using DCE uptake predictions, as proposed by Terris-Prestholt et al. , HIV risk profiles should be collected and sub-analysis by risk profile undertaken; this could only be done with more robust sample sizes.
There are a number of feasibility issues related to incorporating DCEs into the design phase of pragmatic trials and complex interventions. Firstly, the time required to collect and analyse DCE data can be long, limiting the extent to which this method can rapidly inform interventions. Secondly, DCEs require funding in addition to the primary research study, which may be difficult to justify without providing evidence of its usefulness in modifying the design of the intervention to maximize uptake. Although in this case study the programmers found that the DCE provided concrete design recommendations, how strongly different the intervention would otherwise have been with solely qualitative formative research, or the impact of it on the uptake, would need to be tested. This could follow a research design similar to that by Tang et al. which tested the best crowd-sourced HIV testing promotional videos against the conventionally used promotional video . They found crowd-sourcing a cheaper and no less effective approach to designing these demand creation videos. Similarly, one might test the impact of a DCE-informed demand creation intervention against one developed solely based on qualitative formative research, and compare the costs as well as the uptake across the intervention and control arms.
Although all relevant drivers of demand must be included in DCE scenarios, some of these may not be modifiable for pragmatic reasons. Measuring preferences for non-modifiable attributes may still be critical for identifying key bottlenecks to use and for longer-term health system planning, although they may not be useful for designing shorter-term interventions within health system constraints. For example, ‘All male service providers’ was identified as very important but was not feasible in the short term due to structural shortages of male service providers. However, identification of important but unchangeable service characteristics can help interpret results in cases where a trial shows no impact, and are recommended to still be included in the DCE.
This study suggests two key areas for future research. Firstly, although this study did not include a process evaluation to better understand how the intervention components affected uptake during the trial, we do recommend this for future studies to further develop the use of DCEs for intervention design and to test the validity of the DCE predictions. Secondly, we need to estimate the cost-effectiveness of DCEs in complex intervention design. If trials fail to show the effectiveness of efficacious new technologies due to intervention delivery approaches, up-front investment in the delivery intervention could be a highly efficient use of resources. One approach to investigating whether uptake could significantly change an intervention’s impact would be to apply a value-of-information analysis in the early intervention development stage. This models how important the uptake parameter is in an intervention’s cost-effectiveness and how likely it would be in changing resource allocation decisions. If uptake is found critical, then a DCE may be more worth undertaking prior to complex intervention trials. An additional logical extension would be to use the DCE estimates to model the changes in uptake caused by modifying services. Task-shifting activities to lower healthcare worker grades who may technically perform the procedure equally well, for example, may appear as an appropriate cost saver, but the impact on the uptake is often unknown. DCEs can provide insights into the implications of changes, and when coupled with service component costs can look at the incremental cost-effectiveness of varying service components .
This paper has shown how DCEs may have ultimately contributed to a more effective intervention design. DCEs provide an important complement to the methodologies for developing complex interventions. For this application, the relative strength of preferences contributed to prioritization of the components of the complex intervention. DCEs can provide quantitative guidance on how to maximize uptake of interventions, in both simple and complex interventions, and may improve the quality of intervention research and implementation.
Although the target population is men 20–24 years of age, our sample of 18 and 19 year olds was too small to analyse independently. To allow analysis of younger versus older men, we categorized men aged 18–21 years as the younger age group, and age 21 years and above as older men, despite this not strictly conforming to the CRT age categories.
Cluster randomized trial
Discrete choice experiment
Generalized mixed logit model
Randomized control trial
Voluntary medical male circumcision
Rees H, Delany-Moretlwe S, Baron D, Lombard C, Gray G, Myer L, Panchia R, Schwartz J, Doncel G. FACTS 001 Phase III Trial of Pericoital Tenofovir 1% Gel for HIV Prevention in Women. Seattle: CROI; 2015.
Choopanya K, Martin M, Suntharasamai P, Sangkum U, Mock PA, Leethochawalit M, Chiamwongpaet S, Kitisin P, Natrujirote P, Kittimunkong S, et al. Antiretroviral prophylaxis for HIV infection in injecting drug users in Bangkok, Thailand (the Bangkok Tenofovir Study): a randomised, double-blind, placebo-controlled phase 3 trial. Lancet. 381(9883):2083–90.
Baeten JM, Donnell D, Ndase P, Mugo NR, Campbell JD, Wangisi J, Tappero JW, Bukusi EA, Cohen CR, Katabira E, et al. Antiretroviral prophylaxis for HIV prevention in heterosexual men and women. N Engl J Med. 2012;367(5):399–410.
Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, Vargas L, Goicochea P, Casapía M, Guanira-Carranza JV, Ramirez-Cardich ME, et al. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med. 2010;363(27):2587–99.
Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, Palanee T, Nakabiito C, van der Straten A, Noguchi L, et al. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2015;372(6):509–18.
Thigpen MC, Kebaabetswe PM, Paxton LA, Smith DK, Rose CE, Segolodi TM, Henderson FL, Pathak SR, Soud FA, Chillag KL, et al. Antiretroviral preexposure prophylaxis for heterosexual HIV transmission in Botswana. N Engl J Med. 2012;367(5):423–34.
Van Damme L, Corneli A, Ahmed K, Agot K, Lombaard J, Kapiga S, Malahleha M, Owino F, Manongi R, Onyango J, et al. Preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2012;367(5):411–22.
Abdool Karim Q, Abdool Karim SS, Frohlich JA, Grobler AC, Baxter C, Mansoor LE, Kharsany AB, Sibeko S, Mlisana KP, Omar Z, et al. Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science. 2010;329(5996):1168–74.
van der Straten A, Van Damme L, Haberer JE, Bangsberg DR. Unraveling the divergent results of pre-exposure prophylaxis trials for HIV prevention. AIDS. 2012;26(7):F13–9.
Saag MS. Preventing HIV in women—still trying to find their VOICE. N Engl J Med. 2015;372(6):564–6.
Vastine A, Gittelsohn J, Ethelbah B, Anliker J, Caballero B. Formative research and stakeholder participation in intervention development. Am J Health Behav. 2005;29(1):57–69.
Silk KJ, Bigbsy E, Volkman J, Kingsley C, Atkin C, Ferrara M, Goins LA. Formative research on adolescent and adult perceptions of risk factors for breast cancer. Soc Sci Med. 2006;63(12):3124–36.
Mbonye AK, Magnussen P, Chandler CI, Hansen KS, Lal S, Cundill B, Lynch CA, Clarke SE. Introducing rapid diagnostic tests for malaria into drug shops in Uganda: design and implementation of a cluster randomized trial. Trials. 2014;15:303.
Sureshkumar K, Murthy GV, Kinra S, Goenka S, Kuper H. Development and evaluation of a smartphone-enabled, caregiver-supported educational intervention for management of physical disabilities following stroke in India: protocol for a formative research study. BMJ Innov. 2015;1(3):117–26.
Greenland K, Chipungu J, Chilengi R, Curtis V. Theory-based formative research on oral rehydration salts and zinc use in Lusaka, Zambia. BMC Public Health. 2016;16(1):312.
Chandler CI, Burchett H, Boyle L, Achonduh O, Mbonye AK, Diliberto D, Reyburn H, Onwujekwe O. Examining intervention design: lessons from the development of eight related malaria health care intervention studies. Health Syst Reform. 2016;2(4):373-88.
De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, Patel V. Theory of Change: a theory-driven approach to enhance the Medical Research Council's framework for complex interventions. Trials. 2014;15:267.
Power R, Langhaug LF, Nyamurera T, Wilson D, Bassett MT, Cowan FM. Developing complex interventions for rigorous evaluation—a case study from rural Zimbabwe. Health Educ Res. 2004;19(5):570–5.
Kruk ME, Paczkowski M, Mbaruku G, de Pinho H, Galea S. Women's preferences for place of delivery in rural Tanzania: a population-based discrete choice experiment. Am J Public Health. 2009;99(9):1666–72.
Struik MH, Koster F, Schuit AJ, Nugteren R, Veldwijk J, Lambooij MS. The preferences of users of electronic medical records in hospitals: quantifying the relative importance of barriers and facilitators of an innovation. Implement Sci. 2014;9:69.
van Helvoort-Postulart D, van der Weijden T, Dellaert BG, de Kok M, von Meyenfeldt MF, Dirksen CD. Investigating the complementary value of discrete choice experiments for the evaluation of barriers and facilitators in implementation research: a questionnaire survey. Implement Sci. 2009;4:10.
Cornman DH, Schmiege SJ, Bryan A, Benziger TJ, Fisher JD. An information-motivation-behavioral skills (IMB) model-based HIV prevention intervention for truck drivers in India. Soc Sci Med. 2007;64(8):1572–84.
Osaki H, Mshana G, Wambura M, Grund J, Neke N, Kuringe E, Plotkin M, Mahler H, Terris-Prestholt F, Weiss H, et al. "If you are not circumcised, I cannot say yes": the role of women in promoting the uptake of voluntary medical male circumcision in Tanzania. PLoS One. 2015;10(9):e0139009.
Mangham LJ, Hanson K, McPake B. How to do (or not to do) … Designing a discrete choice experiment for application in a low-income country. Health Policy Plan. 2009;24(2):151–8.
de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21(2):145–72.
Plotkin M, Mziray H, Kuver J, Prince J, Curran K, Mahler H. A qualitative assessment of views and preferences concerning voluntary medical male circumcision in Iringa Region, Tanzania: USAID, MCHIP; 2011. https://www.malecircumcision.org/resource/qualitative-assessment-views-and-preferences-concerning-voluntary-medical-male-circumcision. Accessed 28 Jan 2019.
Wambura M, Mwanga J, Mosha J, Mshana G, Mosha F, Changalucha J. Situation analysis for male circumcision in Tanzania. Dar es Salaam: National Institute for Medical Research Mwanza, Tanzania and Ministry of Health and Social Welfare; 2009.
Ngene 1.1.1 User Manual & Reference Guide, Version 16 February 2012, Sydney.
Bech M, Gyrd-Hansen D. Effects coding in discrete choice experiments. Health Econ. 2005;14(10):1079–83.
Fiebig D, Keane MP, Louvier J, Wasi N. The generalized multinomial logit model: accounting for scale and coefficient heterogeneity. Mark Sci. 2010;29(3):393–421.
Greene B. NLOGIT 5.0. Plainview, NY: Econometric Software, Inc.; 2012.
Michaels-Igbokwe C, Terris-Prestholt F, Lagarde M, Chipeta E, Cairns J. Young people’s preferences for family planning service providers in rural Malawi: a discrete choice experiment. PLoS One. 2015;10(12):e0143287.
Wambura M, Mahler H, Grund JM, Larke N, Mshana G, Kuringe E, Plotkin M, Lija G, Makokha M, Terris-Prestholt F, et al. Increasing voluntary medical male circumcision uptake among adult men in Tanzania. AIDS. 2017;31(7):1025–34.
Terris-Prestholt F, Quaife M, Vickerman P. Parameterising user uptake in economic evaluations: the role of discrete choice experiments. Health Econ. 2016;25(Suppl 1):116–23.
Tang W, Han L, Best J, Zhang Y, Mollan K, Kim J, Liu F, Hudgens M, Bayus B, Terris-Prestholt F, et al. Crowdsourcing HIV test promotion videos: a noninferiority randomized controlled trial in China. Clin Infect Dis. 2016;62(11):1436–42.
Medical Research Council. Developing and evaluating complex interventions: new guidance. London: Medical Research Council (UK); 2008.
Njeuhmeli E, Forsythe S, Reed J, Opuni M, Bollinger L, Heard N, Castor D, Stover J, Farley T, Menon V, et al. Voluntary medical male circumcision: modeling the impact and cost of expanding male circumcision for HIV prevention in eastern and southern Africa. PLoS Med. 2011;8(11):e1001132.
Tanzania country profile. http://www.unaids.org/en/regionscountries/countries/unitedrepublicoftanzania. Accessed 11 July 2015.
Tanzania Commission for AIDS (TACAIDS) ZACZ, National Bureau of Statistics (NBS), Office of the Chief Government Statistician (OCGS), and ICF International. Tanzania HIV/AIDS and Malaria Indicator Survey 2011/12: key findings. Dar es Salaam: TACAIDS, ZAC, NBS, OCGS, and ICF International; 2013.
Ministry of Health and Social Welfare URoT. National strategy for scaling-up male circumcision for HIV prevention: enhancing men’s role in HIV prevention. Dar es Salaam: National AIDS Control Programme; 2010.
Program NAC. In: Ministry of Health and Social Welfare URoT, editor. Third Health Sector HIV and AIDS Strategic Plan (HSHSP III) 2013–2017; 2013.
WHO Progress Brief: voluntary medical male circumcision for HIV prevention in 14 priority countries in East and Southern Africa. http://apps.who.int/iris/bitstream/10665/179933/1/WHO_HIV_2015.21_eng.pdf?ua=1. Accessed 9 Sept 2015.
Ashengo TA, Hatzold K, Mahler H, et al. Voluntary medical male circumcision (VMMC) in Tanzania and Zimbabwe: service delivery intensity and modality and their influence on the age of clients. PLoS One. 2014;9(5):e83642.
Plotkin M, Castor D, Mziray H, Kuver J, Mpuya E, Luvanda PJ, Hellar A, Curran K, Lukobo-Durell M, Ashengo TA, et al. "Man, what took you so long?" Social and individual factors affecting adult attendance at voluntary medical male circumcision services in Tanzania. Glob Health Sci Pract. 2013;1(1):108–16.
Herman-Roloff A, Llewellyn E, Obiero W, Agot K, Ndinya-Achola J, Muraguri N, Bailey RC. Implementing voluntary medical male circumcision for HIV prevention in Nyanza Province, Kenya: lessons learned during the first year. PLoS One. 2011;6(4):e18299.
Results from the 2011 12 Tanzania HIV/AIDS and Malaria Indicator Survey. https://nbs.go.tz/nbs/takwimu/this2012/HIVFactsheetbyRegion.pdf. Accessed 11 July 2015.
Ministry of Health and Social Welfare/National AIDS Control Program: Voluntary Medical Male Circumcision Country Operational Plan. 2014–2017; 2014.
We are grateful to our participants and the data collection team for contributing to this study. We thank Claire Chandler for her comments on a paper draft.
This research has been supported by the President’s Emergency Plan for AIDS Relief (PEPFAR) through the Centers for Disease Control and Prevention under the terms of the Cooperative Agreement Number GH000513. The findings and conclusions in this manuscript are those of the authors and do not necessarily represent the official position of the funding agencies. H.A.W. was funded by the UK Medical Research Council and the UK Department for International Development (DFID) under the MRC/DFID Concordat agreement and is also part of the EDCTP2 programme supported by the European Union. FTP received support for this work from an International Academic Fellowship from the Leverhulme Trust (grant number IAF-2015-015). The latter funded FTP's visit at the Dalla Lana School of Public Health at the University of Toronto, where this work was in part written up.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was granted ethical approval by the National Research Ethics committee in Tanzania (reference number NIMR/HQ/R.8a/Vol.IX/1661) and the Ethics Committees of the London School of Hygiene and Tropical Medicine (reference number 6238–02) and the US Centers for Disease Control and Prevention (reference number 6474). All study participants provided either signed or thumbprint (for those could not read or write) consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Detailed sampling procedures for the integrated formative research (DOCX 14 kb)
Sample overview. Table S1. Sample descriptive statistics, by region (DOCX 27 kb)
Comparison of estimators. Table S2. Full model estimates. Figure S1 Comparison of main effects by estimator (DOCX 164 kb)
About this article
Cite this article
Terris-Prestholt, F., Neke, N., Grund, J.M. et al. Using discrete choice experiments to inform the design of complex interventions. Trials 20, 157 (2019). https://doi.org/10.1186/s13063-019-3186-x