Physical activity screening to recruit inactive randomized controlled trial participants: how much is too much?
Trials volume 16, Article number: 446 (2015)
Screening physical activity levels is common in trials to increase physical activity in inactive populations. Commonly applied single-item screening tools might not always be effective in identifying those who are inactive. We applied the more extensive Active Australia Survey to identify inactive people among those who had initially been misclassified as too active using a single-item measure. Those enrolled after the Active Australia Survey screening had significantly higher physical activity levels at subsequent baseline assessment. Thus, more extensive screening measures might result in the inclusion of participants who would otherwise be excluded, possibly introducing unwanted bias.
Australian New Zealand Clinical Trials Registry, ACTRN12611000157976.
Long-term physical inactivity is associated with increased levels of chronic disease and reduced quality of life . The majority of the population, however, does not engage in enough physical activity to gain optimum health benefits . Randomized controlled trials are being conducted, to examine the effectiveness of interventions to increase physical activity. Many of these trials screen physical activity levels of potential study participants with the aim of only recruiting participants who are low-active .
Pre-randomization screening to enroll low-active participants might increase intervention effect sizes; which might necessitate a smaller study sample to demonstrate between-group differences . People already meeting physical activity recommendations are often attracted to physical activity interventions, though they are typically not the target audience for these kinds of intervention, as there are fewer public health benefits in increasing activity in active people, especially when resources are limited . Participants with low activity levels also have a greater capacity to increase activity levels and ceiling effects are less likely to occur; thus, the likelihood that the intervention will be successful in demonstrating its effectiveness is greater . Finally, active people are known to be responsive to physical activity messages, even in the absence of an intervention to help them become more active. Therefore, to decrease the probability of the control group becoming more active (which would undermine study outcomes) recruiting a sample that is resistant to change in the absence of an intervention (i.e., inactive people) is beneficial .
Waters et al.  indicated that 18 out of 23 trials that they evaluated implemented some sort of physical activity screening, but that the methods applied and the physical activity cut-off points used to determine eligibility varied greatly. The majority of studies have used single-item physical activity screening tools, mainly to ensure that participant recruitment is efficient and of little burden to those wanting to participate . Although some studies have demonstrated acceptable validity for single-item measures , it has also been commonly reported that large proportions of participants still meet physical activity guidelines at the trial baseline assessment when more rigorous physical activity measures are applied, such as full-length questionnaires or objective accelerometer-based measures .
In this study, we examined the effectiveness of a two-stage physical activity screening process as part of a three-arm randomized controlled trial (‘Walk 2.0’) . The Walk 2.0 trial investigated the effectiveness of two web-based physical activity interventions (a traditional web 1.0 intervention and an intervention including online social networking and other web 2.0 components) compared with a print-based intervention . A total of 1244 people completed the initial screening questionnaire and 504 people were randomized into one of three groups. People were excluded based on a number of screening criteria (e.g., under 18 years of age, no internet access, medical condition that prevents increased activity), although the numbers presented here only relate to the outcomes of the physical activity screening. A full overview of why and at what stage participants were excluded from the trial will be presented elsewhere.
Physical activity screening was applied in two steps. The first step included application of a commonly used single-item physical activity measure: ‘As a rule, do you engage in at least half an hour of moderate or vigorous exercise (such as walking or a sport) on five or more days of the week (yes/no)?’ . This measure has demonstrated good concurrent validity, identifying 77 % of those who were physically inactive according to a more extensive assessment of physical activity . Those who answered ‘no’ to this single-item measure were deemed eligible to participate; however, those who answered ‘yes’ underwent a second step of telephone-administered screening, using the Active Australia Survey . This survey includes items to assess the duration and frequency of walking, and of moderate and vigorous physical activity in the previous week and has demonstrated acceptable reliability and validity . Participants were only eligible to participate when reporting less than 150 min/week of physical activity using this survey. This two-step protocol was applied to minimize participant burden (for those who were eligible after the first step), and maximize the use of resources allocated to recruitment (to ensure that eligible participants were not excluded if the initial assessment was inaccurate).
A total of 418 people answered ‘no’ to the single-item measure and were accepted into the trial, whereas the 370 people who answered ‘yes’ underwent further screening using the Active Australia Survey. Of these, 284 (76.8 %) reported more than 150 min/week of physical activity and were excluded as too active to participate in the trial. The average level of physical activity of those excluded was 306 ± 217 min/week. The 86 (23.2 %) people who were included reported an average of 80 ± 48 min/week of physical activity at the time of screening.
When examining baseline physical activity levels (see Table 1), we observed not only that a large number of participants were exceeding 150 min/week of physical activity regardless of screening protocol, but also that those who had participated in the two-step screening process were significantly more physically active at baseline assessment (measured both subjectively and objectively (Actigraph accelerometry)), compared with those who had only undergone the single-item screening. While some test values only trended toward significance (P = 0.05–0.10), the differences between groups seem to be mainly driven by differences in walking levels.
An important point to note is that neither screening approach (single-step or dual-step) was particularly effective in preventing people who were too active from being enrolled in the study; and that screening using objective measures (accelerometry)—despite being burdensome, time intensively, and costly—may thus be preferable, as fewer active participants would subsequently be enrolled. Further, it is challenging to explain the counterintuitive differences with regards of single- and dual-step screening outcomes. One plausible explanation may be related to social desirability bias . That is, some participants may have sensed their likelihood of inclusion in the randomized controlled trial would be higher if reporting a lower level of physical activity on the subsequent screening measure. Another explanation may be that the more extensive screening increased physical activity awareness , resulting in more efforts to be active prior to the baseline assessment. These findings highlight that recruitment procedures need to be designed carefully, as they might introduce potentially unwanted and unexpected biases.
Warburton DER, Nical CW, Bredin SSD. Health benefits of physical activity: the evidence. Can Med Assoc J. 2006;174:801–9.
Sisson SB, Katzmarzyk PT. International prevalence of physical activity in youth and adults. Obesity Rev. 2008;9:606–14.
Waters LA, Winkler EA, Reeves MM, Fjeldsoe BS, Eakin EG. The impact of behavioural screening on intervention outcomes in a randomised controlled multiple behaviour intervention trial. IJBNPA. 2011;8:24.
Prochaska JJ, Sallis JF, Long B. A physical activity screening measure for use with adolescents in primary care. Arch Ped Adolesc Med. 2001;155:554–9.
Snyder CD, Sloane R, Haines PS, Mille P, Clipp EC, Morey MC, et al. The Diet Quality Index-revised: a tool to promote and evaluate dietary change among older cancer survivors enrolled in a home-based intervention trial. J Am Diet Assoc. 2007;107:1519–29.
van Stralen MM, Lecher L, Mudde AN, de Vries H, Bolman C. Determinants of awareness, initiation and maintenance of physical activity among the over fifties: a Delphi study. Health Edu Res. 2010;25:233–47.
Milton K, Bull FC, Bauman A. Reliability and validity testing of a single-item physical activity measure. Brit J Sport Med. 2011;45:203–8.
Jennings CA, Vandelanotte C, Caperchione CM, Mummer WK. Effectiveness of a web-based physical activity intervention for adults with Type 2 diabetes—a randomised controlled trial. Prev Med. 2014;60:33–40.
Kolt GS, Rosenkranz RR, Savages TN, Maeder AJ, Vandelanotte C, Duncan MJ, et al. Walk 2.0—using Web 2.0 applications to promote health-related physical activity: a randomised controlled trial protocol. BMC Pub Health. 2013;13:436.
Elley C, Kerse N, Arroll B, Robinson E. Effectiveness of counselling patients on physical activity in general practice: cluster randomised controlled trial. Brit Med J. 2003;362:793–8.
Rose SB, Elley CR, Lawton BA, Dowell AC. A single question reliably identifies physical inactive women in primary care. NZ Med J. 2008;121:40–6.
Australian Institute of Health and Welfare. The Active Australia Survey; a guide and manual for implementation analysis and reporting. Canberra: Australian Institute of Health and Welfare; 2003.
Brown W, Bauman A, Chey T, Trost S, Mummery K. Comparison of surveys used to measure physical activity. Aust NZ J Public Health. 2004;28:128–34.
Brenner PS, DeLamater JD. Social desirability bias in self-reports of physical activity: is an exercise identity the culprit? Soc Indic Res. 2014;117(2):489–504.
This trial was funded by the National Health and Medical Research Council (Project Grant number 589903). The funder did not have any role in the study other than to provide funding. MJD (ID 100029) and CV (ID 100427) are supported by a Future Leader Fellowship from the National Heart Foundation of Australia.
The authors declare that they have no competing interests.
CV, MJD, CMC, and GSK, conceived the project and procured the project funding. GSK led the coordination of the trial. GSK, RRR, CV, MJD, and CMC assisted with the protocol design. TNS is managing the trial, including data collection with the contributions from the data manager AKVI. CV, RS, TNS, and ALR interpreted the data and drafted the manuscript. All authors read, edited, and approved the final manuscript.
About this article
Cite this article
Vandelanotte, C., Stanton, R., Rebar, A.L. et al. Physical activity screening to recruit inactive randomized controlled trial participants: how much is too much?. Trials 16, 446 (2015). https://doi.org/10.1186/s13063-015-0976-7