Open Peer Review
Jigsaw Puzzles As Cognitive Enrichment (PACE) - the effect of solving jigsaw puzzles on global visuospatial cognition in adults 50 years of age and older: study protocol for a randomized controlled trial
Trialsvolume 18, Article number: 415 (2017)
Neurocognitive disorders are an important societal challenge and the need for early prevention is increasingly recognized. Meta-analyses show beneficial effects of cognitive activities on cognition. However, high financial costs, low intrinsic motivation, logistic challenges of group-based activities, or the need to operate digital devices prevent their widespread application in clinical practice. Solving jigsaw puzzles is a cognitive activity without these hindering characteristics, but cognitive effects have not been investigated yet. With this study, we aim to evaluate the effect of solving jigsaw puzzles on visuospatial cognition, daily functioning, and psychological outcomes.
The pre-posttest, assessor-blinded study will include 100 cognitively healthy adults 50 years of age or older, who will be randomly assigned to a jigsaw puzzle group or a cognitive health counseling group. Within the 5-week intervention period, participants in the jigsaw puzzle group will engage in 30 days of solving jigsaw puzzles for at least 1 h per day and additionally receive cognitive health counseling. The cognitive health counseling group will receive the same counseling intervention but no jigsaw puzzles. The primary outcome, global visuospatial cognition, will depict the average of the z-standardized performance scores in visuospatial tests of perception, constructional praxis, mental rotation, processing speed, flexibility, working memory, reasoning, and episodic memory. As secondary outcomes, we will assess the eight cognitive abilities, objective and subjective visuospatial daily functioning, psychological well-being, general self-efficacy, and perceived stress. The primary data analysis will be based on mixed-effects models in an intention-to-treat approach.
Solving jigsaw puzzles is a low-cost, intrinsically motivating, cognitive leisure activity, which can be executed alone or with others and without the need to operate a digital device. In the case of positive results, these characteristics allow an easy implementation of solving jigsaw puzzles in clinical practice as a way to improve visuospatial functioning. Whether cognitive impairment and loss of independence in everyday functioning might be prevented or delayed in the long run has to be examined in future studies.
ClinicalTrials.gov, NCT02667314. Registered on 27 January 2016.
Neurocognitive disorders such as mild cognitive impairment and dementia become increasingly important healthcare issues . Engagement in cognitively challenging activities is associated with a reduced risk for future cognitive impairment  and dementia . It is among the factors with the highest projected impact on the prevalence of Alzheimer’s dementia . Randomized controlled trials show beneficial cognitive effects of diverse cognitive activities such as cognitive training [5,6,7,8,9], video games [10,11,12,13], card and board games [14, 15], and educational programs such as computer, digital photography, or theater courses [16,17,18]. However, these evidence-based cognitive activities are characterized by obstacles such as high financial costs, low intrinsic motivation, logistic challenges of group-based activities, or the need to use digital devices. We believe that these characteristics of currently investigated cognitive activities reduce their feasibility and implementation in clinical practice.
Solving jigsaw puzzles is a cognitively challenging activity, especially within the visuospatial cognitive domain. We assume that visuospatial cognitive demands comprise perception, constructional praxis, mental rotation, processing speed, flexibility, working memory, reasoning, and episodic memory. In contrast to other cognitive activities, mentioned above, it depicts a low-cost, intrinsically motivating leisure activity which can be executed alone or with others and without the need to operate digital devices. However, to our knowledge, the effect of solving jigsaw puzzles on cognition has not been investigated yet. Next to the positive impact of a wide range of cognitively challenging activities on cognition, several other findings indicate the potential of jigsaw puzzles to promote visuospatial cognitive health. Performance in solving jigsaw puzzles is highly correlated with performance in visuospatial reasoning tasks ; jigsaw puzzle play in preschoolers is associated with future visuospatial transformation skills ; and engagement in intellectual activities including jigsaw puzzles predicts a reduced risk of Alzheimer’s dementia [21,22,23]. Thus, the primary aim of this study is to evaluate the effect of solving jigsaw puzzles on visuospatial cognition.
Furthermore, the effects of cognitive interventions on daily functioning and psychological outcomes are scarcely investigated [24,25,26]. As secondary aims, this study thus examines the effects of solving jigsaw puzzles on visuospatial everyday functioning such as instrumental activities of daily living and self-reported cognitive failures, and on psychological outcomes such as well-being, general self-efficacy, and perceived stress.
The Jigsaw Puzzles As Cognitive Enrichment (PACE) study will take place at Ulm University, Germany, as a randomized, active-controlled, assessor-blinded superiority trial with two parallel groups. Between March and approximately October 2016, we will include and randomly assign 100 cognitively healthy, middle-aged and older adults (age 50 years and above) to a jigsaw puzzle group or a cognitive health counseling group with a 1:1 allocation ratio in blocks of four, stratified by cognitive status and age. Participants in the jigsaw puzzle group will engage in 30 days of solving jigsaw puzzles (6 days/week over a period of 5 weeks for at least 1 h/day) and receive cognitive health counseling (15-minutes face-to-face counseling plus three telephone calls). The cognitive health counseling group will receive the same counseling intervention but will not solve any jigsaw puzzles during the intervention period. The SPIRIT 2013 Checklist provides an overview about the contents of this study protocol (see Additional file 1).
The Ethics Committee of Ulm University approved this study. We will invite individuals interested in participating in the study to a telephone-based interview. Here, they will receive detailed study information and give oral informed consent. A pre-screening will assess eligibility (t1, see Figs. 1 and 2). At an appointment at Ulm University, successfully pre-screened participants will be able to give written informed consent and will undergo further screening (t2A). For included participants, the procedure will consist of a 1.5-h pretest assessment composed of neuropsychological tests and questionnaires (t2B) followed by the face-to-face cognitive health counseling (t2C). Subsequently, non-blinded study staff will disclose the group allocation to the participants (t2D). Within 2 weeks after the baseline assessment, the 5-week intervention period will start. We will contact all participants three times via telephone for cognitive health counseling and the assessment of adverse events (AEs, t3 – t5). These telephone-based interviews will also serve to monitor the jigsaw puzzle experience and protocol adherence in the jigsaw puzzle group. Within 2 weeks after the intervention period, we will assess the same outcomes as in the pretest assessments in the 1.5-h posttest assessment at Ulm University (t6). Psychologists who are blind to group allocation will conduct the pretest and posttest assessments.
The study aims to include 100 participants who we will recruit via local newspaper articles and flyers. Inclusion criteria are 50 years of age or older, unimpaired cognition defined by a Mini-Mental State Examination (MMSE)  score ≥ 24, the commitment to invest at least 1 h per day for 30 days in solving jigsaw puzzles within a 5-week period, an interest in solving jigsaw puzzles, and low jigsaw puzzle experience in the past 5 years (fewer than five completed jigsaw puzzles).
Exclusion criteria are the participation in another interventional study and self-reported, uncorrected impairment in vision (e.g., red-green color blindness) or motor function of the upper extremity (e.g., hand tremor) that considerably impairs jigsaw puzzle performance. In addition, individuals with any self-reported psychiatric, neurological, or other diseases that could affect cognitive change over time will be excluded. These diseases comprise current major depression, dementia or Parkinson’s disease, a history of stroke with current impairment, epilepsy, multiple sclerosis, or a current malignant tumor. Apart from the cognitive impairment, which we will assess at the on-site screening (t2A), telephone-based pre-screening will examine inclusion and exclusion criteria after oral informed consent (t1, see Figs. 1 and 2).
All outcomes of the study are continuously scaled and we will assess the mean change between baseline (t1) and posttest assessments (t6, approximately 5 weeks after t1). The outcome domains and their specific measurement, and the assessment of participants’ expectations, predictive variables of cognitive decline, and adverse events are described in the following sections.
A composite score of global visuospatial cognition will depict the primary outcome reducing α-error inflation . This score will constitute the average of the eight, z-standardized visuospatial cognitive ability scores that include visual perception, visuoconstruction, mental rotation, processing speed, flexibility, working memory, reasoning, and episodic memory (see “Secondary outcomes”). We will calculate the individual composite scores, if at least five cognitive ability scores are available for both pretest and posttest for an individual. Analysis will be based on individuals for whom both pretest and posttest ability scores are available. We will z-standardize all test scores based on pretest means and standard deviations.
Secondary outcomes of visuospatial cognition will include the eight visuospatial cognitive ability scores. An adapted version of Benton’s Judgment of Line Orientation Test will assess visual perception . In addition to Benton’s 30 original test items, the version in this study will also include five new test items of greater difficulty to differentiate performance in the higher performance range (visual perception score: number of correct items). The Rey Complex Figure Test (pretest)  and the Taylor Complex Figure Test (posttest)  will serve to evaluate visuoconstruction and visuospatial episodic memory. Pretest and posttest assessments will apply different figures to minimize the risk that recall of the pretest figure affects posttest performance (visuoconstruction score: points in the copy trial; episodic memory score: sum of the points in the immediate and delayed free recall trials; two raters (DL and HA) will rate all trials; points for each trial depict the mean of both ratings). The Mental Rotations Test (MRT)-Letters (12 items; maximum (max.) time: 90 s) adapted from  and the MRT-A (items 1–12; max. time: 240 s)  will measure 2D and 3D mental rotation performance, respectively, in order to produce a score of mental rotation ability (2D and 3D sub-scores: seconds per correct item; in the case of no correct item, the score will depict twice the max. time; mental rotation score: average of both z-standardized sub-scores). The Trail Making Test (TMT) A and B will assess visuospatial processing speed and flexibility, respectively (both ability scores: seconds per correct connection; max. time: 180 s for TMT A and 300 s for TMT B) [34, 35]. The Visual Memory Span from the German edition of the Wechsler Memory Scale-Revised  will serve to measure visuospatial working memory (working memory score: sum of points for forward and backward block tapping). Finally, we apply the Block Design subtest from the German edition of the Wechsler Adult Intelligence Scale-III to assess visuospatial reasoning (reasoning score: sum of points) .
The study assesses secondary visuospatial daily functioning outcomes both objectively and subjectively. The objective assessment of daily life functioning comprises three visuospatial subtests of the Timed Instrumental Activities of Daily Living (TIADL) [38, 39] (sub-scores: seconds for correct completion of task A - finding a telephone number, task B - making change, and task C - reading the list of ingredients on cans; objective daily functioning score: average of all three z-standardized sub-scores). Eleven visuospatial items of the Cognitive Failures Questionnaire will assess subjective function in everyday life (subjective daily functioning score: sum of points) [40, 41].
Self-report questionnaires will serve to assess secondary psychological outcomes. We will measure psychological well-being during the past 2 weeks with the World Health Organization (WHO)-5 Well-Being Index , general self-efficacy with the Generalized Self-Efficacy Scale , and perceived stress during the past month with the Perceived Stress Scale-14 .
We will use a 40-piece jigsaw puzzle (image: Rothenburg ob der Tauber by Ravensburger Spieleverlag GmbH (RSV); piece size: ca. 2.45 × 2.4 cm) to measure jigsaw puzzle skill. Thereby participants will complete the frame first and then the inner section of the puzzle (sub-scores for frame and inner section: seconds per connected piece; max. time for each task: 300 s; jigsaw puzzle score: average of both sub-scores).
In case of floor or ceiling effects (skewness ≥ 1 or ≤ − 1), we will use skewness minimization transformations (Blom transformations ) for all relevant ability scores and sub-scores. To increase measurement reliability and therefore the power of the study, the same psychologist will conduct pretest and posttest assessment of each participant, if possible. In addition, we will apply different methods to detect data entry errors, including range checks, plotting of pretest and posttest scores, and assessment of the retest-reliability for each score. Low retest-reliability of the primary outcome (r < .80) will result in double data entry.
To account for potential effects of participants’ expectations regarding cognitive benefits of the interventions, we will assess these expectations within the last telephone call between week 3 and 4 after the start of the intervention (t5, see Figs. 1 and 2). Participants will be asked (1) whether they expect that their performance in the visuospatial cognitive tests has been influenced positively since the pretest (answers: “yes” or “no”), and (2) how much they expect their performance in the visuospatial cognitive tests to change from pretest to posttest assessment on a 5-point rating scale (answers range from “improve markedly” to “decline markedly”). We will use the same questions with respect to participants’ expectations of improvement in jigsaw puzzle performance.
Predictive variables of cognitive decline and dementia
The investigators will obtain the predictive socio-demographic variables age, gender, years of education, and main profession, using interview-based questionnaires. Three questions on the subjective degree of jigsaw puzzle experience on a 5-point rating scale (answers range from “very high” to “not at all”), the number of jigsaw puzzle hours, and the number of connected jigsaw puzzle pieces within participants’ lifetime will assess lifetime jigsaw puzzle experience. The assessment of risk factors for cognitive decline and dementia with self-rating questionnaires will include items on high blood pressure, hypercholesterolemia, diabetes mellitus, smoking, alcohol misuse, and obesity. The newly developed Challenging Leisure Activity Questionnaire is based on the CHAMPS Physical Activity Questionnaire for Older Adults  and will serve as a measure of the protective factors social, physical, and cognitive activities. Participants will indicate for each of 44 socially, physically, and cognitively challenging activities whether they performed them at least once during the past 4 weeks. A short 14-item Mediterranean diet questionnaire  will assess components of a Mediterranean diet. The measurement of risk and protective factors will serve as the basis for individual feedback in the cognitive health counseling and for the assessment of behavior changes between pretest and posttest assessments.
Non-blinded study staff will address potential adverse events at the beginning of the three telephone-based cognitive health counseling sessions (t3, t4, t5; see Figs. 1 and 2) and after completion of the posttest outcome measures.
Participants will be randomly assigned to one of two groups, the jigsaw puzzle group or the cognitive health counseling group (see Fig. 2). The jigsaw puzzle group will receive the 30-day jigsaw puzzle intervention and the cognitive health counseling, while the cognitive health counseling group will receive the cognitive health counseling only. We will ask the participants of the cognitive health counseling group not to solve any jigsaw puzzles within the 5-week intervention period. Participants of the cognitive health counseling group will receive a jigsaw puzzle after completion of the posttest assessments.
Cognitive health counseling
All participants will receive a 15-minute session of cognitive health counseling in an individual face-to-face setting, including a take-home brochure (see Figs. 1 and 2). The counseling will inform about modifiable protective factors and risk factors for cognitive decline and dementia according to current research evidence. It will be based on the guidelines of the German Association for Psychiatry, Psychotherapy, and Psychosomatics on dementia. In particular, the counselors will explain protective effects of physical, cognitive, and social activities, and a Mediterranean diet. The counseling will further inform about the modifiable risk factors obesity, hypertension, diabetes mellitus, high cholesterol and homocysteine levels, smoking, and alcohol misuse.
In addition, the cognitive health counseling will comprise three telephone calls during the 5-week intervention period. In the first call (t3; week 1), participants will receive individual feedback based on their responses in the questionnaires on modifiable risk and protective factors at the pretest assessment. Here, we will give information about potential behavior changes and ask the participants whether they are motivated to adapt any of them. In the second and third telephone-based interview, we will ask for changes in behavior with respect to the predictive factors. Taken together, the behavior change techniques of the cognitive health counseling include the shaping of knowledge about cognitively healthy behaviors (t2), providing individual feedback on these behaviors (t3), and monitoring behaviors by the study staff with participants’ awareness (t4 and t5, cf. ).
Jigsaw puzzle intervention
Participants of the jigsaw puzzle group will solve jigsaw puzzles on 6 days a week for 5 weeks for at least 1 h per day. Every participant will get the same 300 piece jigsaw puzzle at first (Beautiful Prague by RSV; piece size: 2.45 × 2.4 cm). The participants will select subsequent puzzles out of a catalogue with 200, 300, 500, 1000, and 1500 piece jigsaw puzzles of the RSV adult puzzle 2016 collection (piece sizes included: 2.8 × 3.0 cm; 2.45 × 2.4 cm; 2.0 × 1.8 cm; 1.9 × 1.7 cm; and 1.8 × 1.7 cm, respectively).
The intervention will take place at participants’ homes. They will protocol their jigsaw puzzle time in a diary immediately after each jigsaw puzzle session. On each jigsaw puzzle day, participants will note the jigsaw puzzle name, the jigsaw puzzle duration, and if necessary additional comments about their experiences. Immediately after each of the three telephone-based cognitive health counseling sessions, participants will report the content of the diary for the monitoring of the protocol adherence and of the jigsaw puzzle performance (time per connected piece). Finally, the telephone-based interview includes questions about participants’ jigsaw puzzle experience for each solved jigsaw. Jigsaw puzzle experience will include the desire to solve the jigsaw puzzle, the pleasure in solving the jigsaw puzzle, the experienced competence of solving the jigsaw puzzle, and the perceived difficulty of the jigsaw puzzle. We will evaluate all four measures with a single question and a 5-point rating scale that ranges from “very high” to “not at all”. Participants will be able to freely choose their preferred jigsaw puzzles. However, we will recommend them to constantly increase the difficulty and challenge of the jigsaw puzzles through the increase of pieces per puzzle - which is accompanied with a decrease in piece size - as long as this does not reduce their pleasure and fun. These recommendations will depend on the reported perceived difficulty, challenge, pleasure, and fun, and their jigsaw puzzle performance (time per connected piece). If participants report adverse conditions associated with solving jigsaw puzzles (e.g., muscle pain during jigsaw puzzling or the development of a strong craving to solve jigsaw puzzles), the study staff will recommend to reduce puzzle time, not to stick to the protocol of at least 1 h per day, or to stop solving jigsaw puzzles as appropriate.
We will use stratified, blocked randomization to avoid baseline differences in age and cognitive status between the cognitive health counseling group and the jigsaw puzzle group, while at the same time achieving groups of similar sizes. We will stratify participants into two age bands (50–64 years and 65 years and older) and two cognitive status bands (MMSE: 24–27 and 28–30) resulting in four strata (stratum 1, age ≥ 64 years, MMSE 28–30; stratum 2, age ≥ 64 years, MMSE 24–27; stratum 3, age 50–64 years, MMSE 28–30; and stratum 4, age 50–64 years, MMSE 24–27). In each stratum, randomized allocation of the participants will happen in blocks of four (two participants to each group) using the online randomization software random.org (https://www.random.org/). LSL will generate the random allocation sequence for each stratum and conceal it in sequentially numbered opaque envelopes which we will store in a separate box for each stratum. OCK, PF, and DL will conduct the telephone-based pre-screening. DL, MJR, or HA will enroll participants after on-site assessment of the MMSE inclusion criterion and conduct the blinded assessment. OCK or PF will conduct the face-to-face cognitive health counseling. Immediately afterwards, they will disclose group assignment. Thus, the research staff responsible for enrollment and the first part of the cognitive health counseling will be blinded to group assignment and not able to predict future group assignment.
Blinding and strategies to deal with expectation and motivation effects
Outcome assessors will be blinded to group allocation of participants. To prevent disclosure of group assignment by participants, we will remind them at the last telephone interview (t5) not to bring the solved jigsaw puzzles to the posttest assessment. Second, we will remind them at the last telephone interview (t5) and immediately before the posttest assessment (t6) not to tell the assessor anything that may give hints to the allocated group. Here, the participants will also sign a confirmation statement that they received this information. Blinding participants to the assigned group is by nature not feasible. Given the lack of a double-blind design, several strategies will serve to reduce potentially different expectations and motivation between groups . First, implementing an additional component in both groups (i.e., cognitive health counseling) aims to induce similar positive expectations regarding cognitive benefits (cf. component control design; [49, 50]). Second, the investigators will tell all participants before disclosure of group assignment that (a) both groups should benefit cognitively from the cognitive health counseling and that (b) it is currently not known whether solving jigsaw puzzles has a positive impact on cognition. Third, participants of both groups will receive the same amount of study staff contact during the intervention period (apart from questions regarding jigsaw puzzle experiences and adherence) and the same opportunities to express their concerns and to receive attention (face-to-face health counseling, three telephone calls, and the possibility to contact the study staff whenever wished). As differential expectations between groups are still likely to some degree and cannot be completely excluded, the study assesses expectations on a continuous and on a categorical scale in the last telephone call approximately 9 days before the follow-up test (see confounding variables section). We avoid an assessment at the follow-up, as this might either influence test performance through activated expectations (when assessed directly before the neuropsychological tests) or might alter expectations according to test performance (when assessed directly after the neuropsychological tests) . In addition, we will aim to keep test motivation high in both groups by asking participants again, directly before the follow up, whether they want to receive their normed individual test results after study completion. One item on a 5-point rating scale at the posttest assessment (t6) will assess test motivation.
Prevention of dropouts, noncompliance, and missing data
To ensure the application of the intention-to-treat principle, great effort must be invested to prevent dropouts, noncompliance, and missing outcome data, which introduce deviation from the randomization scheme [51, 52]. We will use different strategies including good personal contact through the telephone-based counseling; payment of 20€ for pretest and posttest assessments; communication of personal neuropsychological test results after the posttest assessments; interest in solving jigsaw puzzles and time commitment as study inclusion criteria; good availability of appointments for the pretest and posttest assessments (if appointments are not possible within the 2-week pretest and posttest period, we will arrange them as close as possible to this period); reminders for the posttest appointment at the last telephone-based counseling (t5); also if participants do not adhere to the intervention protocol, we will ask them to complete the posttest assessment; construction of a global ability score that allows some amount of missing data in the neuropsychological test battery; and prevention of excessive and insufficient mental demands through a large number of jigsaw puzzle difficulty levels (200 to 1500 piece puzzles; 2.8 × 3.0 cm to 1.8 × 1.7 cm piece sizes), adapted according to participants’ preferences, jigsaw puzzle experiences, and performance.
The primary efficacy analysis will be based on mixed-effects models' group × time interaction  in an intention-to-treat approach  that includes all randomly assigned participants with follow-up observations. Effect sizes will include standardized differences in the pretest-posttest change scores between both groups. Standardization will be based on (1) baseline scores and (2) pretest-posttest change scores. In additional analyses, we will account for potential confounding variables such as baseline performance, the number of challenging social, physical, and cognitive activities performed in the past 4 weeks, the pretest-posttest change in these activities, Mediterranean diet in the past 4 weeks, and pre-posttest change in diet, age, education, participants’ test motivation at the posttest assessment, and their expectations of cognitive benefits.
As the primary intention-to-treat analysis is a conservative method, which may underestimate the true effect size of solving jigsaw puzzles for individuals who follow the protocol, we will use a supportive per-protocol analysis, which includes only participants who completed at least 80% of the jigsaw puzzle protocol (≥24 jigsaw puzzle days with a minimum of 45 min). With this supportive analysis, we do not only assess the robustness of effects, but may also receive a more accurate estimate of the true effect size given optimal conditions.
For subgroup and moderator analyses, pre-specified variables comprise baseline global visuospatial cognition, amount of lifetime puzzle experience, number of challenging social, physical, and cognitive activities within the intervention period, age, MMSE, and experienced pleasure in solving jigsaw puzzles.
Finally, we will assess cognitive demands of solving jigsaw puzzles and the transfer potential of gains in jigsaw puzzle skill on gains in the study outcomes by calculating the correlation between jigsaw puzzle skill in the 40-piece puzzle and the study outcomes at baseline.
The probability to find a significant effect with 50 included participants per group, a dropout rate of 15%, a small true effect size of f = 0.1, pretest-posttest correlation of r = .85, and an α-error of 0.05 is 90%. We used G*Power 3.1.6. for power analysis .
Our upcoming findings might have a clinical implication for adults over 50 years of age who have low puzzle experience in the past 5 years but are interested in solving jigsaw puzzles. As solving jigsaw puzzles depicts a low-cost, intrinsically motivating leisure activity, which can be executed alone or with others, and without the need to operate a digital device, positive results would indicate a highly feasible cognitive intervention to improve visuospatial cognition and everyday functioning, and psychological outcomes in this population. We will not investigate the effect of jigsaw puzzling on overall cognitive functioning including cognitive domains such as language or verbal working memory as generalization to non-trained cognitive domains cannot be expected from a theoretical and an empirical point of view [56, 57]. However, as visuospatial dysfunctions (e.g., deficits in visuoconstruction or visuospatial episodic memory and missed traffic signs or relocated objects) are common in neurocognitive diseases such as mild cognitive impairment and dementia - especially due to Alzheimer’s disease, dementia with Lewy bodies, and posterior cortical atrophy  - lifelong jigsaw puzzle experience might be one out of many cognitive activities that may contribute to a delayed clinical manifestation of neurocognitive disorders.
Limitations of the study design are the lack of a long-term follow-up and of the investigation of biological mediators, and the lack of participants’ blinding to group allocation, which could lead to differential expectation effects. In addition, the selected outcomes may have limitations in assessing the effects of jigsaw puzzling on cognitive abilities and daily functioning. Finally, the cognitive health counseling might have different behavioral effects in the counseling and the puzzle group that could mask the effects of jigsaw puzzling.
To address the lack of long-term follow-up, we will ask participants after study completion whether they will be interested in future long-term follow-up that we aim to conduct approximately 1.5 years after posttest assessment.
Blinding of participants is by nature not feasible in behavioral intervention studies as participants are always aware of what they are doing. Thus, expectation effects can never be fully excluded. Multiple approaches to minimize expectation effects will be used and participants’ expectations with regard to performance improvement will be measured in a telephone-based interview approximately 9 days prior to the posttest assessment. Thus, it will be possible to statistically account for potential expectation effects.
Even if not expected, the selected outcomes of the study may not cover the cognitive abilities that are actually engaged and improved through jigsaw puzzling (e.g., verbal working memory) or may include abilities that are not recruited and improved through the intervention (e.g., cognitive flexibility). To prevent this problem, the selection of the outcomes was based on a cognitive task analysis of jigsaw puzzling that indicated the expected cognitive demands [58, 59]. Furthermore, we will assess the association between the outcome measures and jigsaw puzzle skill at baseline, in order to validate the recruited cognitive abilities of jigsaw puzzling  and the transfer potential of gains in jigsaw puzzle performance on gains in the respective outcomes . Finally, there is a not fully preventable risk that gains in outcomes may be a result of skill acquisition or newly learned strategies rather than the improvement of broad cognitive abilities . However, in contrast to many previous cognitive training studies, we use a large set of transfer tasks and these task paradigms are substantially dissimilar from the training task. Thus, we avoid the risk that skill-induced or strategy-induced gains in single and structurally similar tasks with the training task will be misinterpreted as gains in broad cognitive abilities.
Finally, we cannot fully exclude that the cognitive health counseling intervention that is conducted in both groups may have a differential effect between the groups. However, we will assess this potential by evaluating group differences in behavioral changes in cognitive, physical, and social activities, and in Mediterranean diet. In additional analyses of the group effect on the study outcomes, we will statistically account for these behavioral changes (see “Statistical analysis”).
In the case of positive results, future research should investigate maintenance of effects, biological mechanisms of effects, potential effects in other populations such as people with impairments in visuospatial cognition, and effects of long-term experience in solving jigsaw puzzles on the prevention of neurocognitive disorders such as mild cognitive impairment and dementia.
Mini-Mental State Examination
Mental Rotations Test
Jigsaw Puzzles As Cognitive Enrichment
Ravensburger Spieleverlag GmbH
Timed Instrumental Activities of Daily Living
Trail Making Test
Hurd MD, Martorell P, Delavande A, Mullen KJ, Langa KM. Monetary costs of dementia in the United States. N Engl J Med. 2013;368(14):1326–34.
Valenzuela MJ, Sachdev P. Brain reserve and cognitive decline: a non-parametric systematic review. Psychol Med. 2006;36(08):1065–73.
Valenzuela MJ, Sachdev P. Brain reserve and dementia: a systematic review. Psychol Med. 2006;36(4):441–54.
Barnes DE, Yaffe K. The projected effect of risk factor reduction on Alzheimer’s disease prevalence. Lancet Neurol. 2011;10(9):819–28.
Lampit A, Hallock H, Valenzuela M. Computerized cognitive training in cognitively healthy older adults: a systematic review and meta-analysis of effect modifiers. PLoS Med. 2014;11(11):e1001756.
Zelinski EM, Spina LM, Yaffe K, Ruff R, Kennison RF, Mahncke HW, Smith GE. Improvement in memory with plasticity based adaptive cognitive training: results of the 3 month follow up. J Am Geriatr Soc. 2011;59(2):258–65.
Karbach J, Verhaeghen P. Making working memory work: a meta-analysis of executive-control and working memory training in older adults. Psychol Sci. 2014;25(11):2027–37.
Hardy JL, Nelson RA, Thomason ME, Sternberg DA, Katovich K, Farzin F, Scanlon M. Enhancing cognitive abilities with comprehensive training: a large, online, randomized, active-controlled trial. PLoS One. 2015;10(9):e0134467.
Spencer-Smith M, Klingberg T. Benefits of a working memory training program for inattention in daily life: a systematic review and meta-analysis. PLoS One. 2015;10(3):e0119522.
Toril P, Reales JM, Ballesteros S. Video game training enhances cognition of older adults: a meta-analytic study. Psychol Aging. 2014;29(3):706–16.
Green CS, Bavelier D. Action video game modifies visual selective attention. Nature. 2003;423(6939):534–7.
Shute VJ, Ventura M, Ke F. The power of play: the effects of Portal 2 and Lumosity on cognitive and noncognitive skills. Comput Educ. 2015;80:58–67.
Basak C, Boot WR, Voss MW, Kramer AF. Can training in a real-time strategy video game attenuate cognitive decline in older adults? Psychol Aging. 2008;23(4):765–77.
Fissler P, Küster O, Schlee W, Kolassa IT. Novelty interventions to enhance broad cognitive abilities and prevent dementia: synergistic approaches for the facilitation of positive plastic change. Prog Brain Res. 2013;207:403–34.
Cheng ST, Chow PK, Song YQ, Yu EC, Chan AC, Lee TM, Lam JH. Mental and physical activities delay cognitive decline in older persons with dementia. Am J Geriatr Psychiatry. 2014;22(1):63–74.
Klusmann V, Evers A, Schwarzer R, Schlattmann P, Reischies F, Heuser I, Dimeo F. Complex mental and physical activity in older women and cognitive performance: a 6-month randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2010;65(6):680–8.
Park DC, Lodi-Smith J, Drew L, Haber S, Hebrank A, Bischof GN, Aamodt W. The impact of sustained engagement on cognitive function in older adults: the Synapse Project. Psychol Sci. 2013;25(1):103–12.
Noice H, Noice T. An arts intervention for older adults living in subsidized retirement homes. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2009;16(1):56–79.
Dykens EM. Are jigsaw puzzle skills ‘spared’ in persons with Prader-Willi syndrome? J Child Psychol Psychiatry. 2002;43(3):343–52.
Levine SC, Ratliff KR, Huttenlocher J, Cannon J. Early puzzle play: a predictor of preschoolers’ spatial transformation skill. Dev Psychol. 2012;48(2):530–42.
Lindstrom HA, Fritsch T, Petot G, Smyth KA, Chen CH, Debanne SM, Lerner AJ, Friedland RP. The relationships between television viewing in midlife and the development of Alzheimer’s disease in a case-control study. Brain Cogn. 2005;58(2):157–65.
Friedland RP, Fritsch T, Smyth KA, Koss E, Lerner AJ, Chen CH, Petot GJ, Debanne SM. Patients with Alzheimer’s disease have reduced activities in midlife compared with healthy control-group members. Proc Natl Acad Sci U S A. 2001;98(6):3440–5.
Possin KL. Visual Spatial Cognition in Neurodegenerative Disease. Neurocase. 2010;16(6):466–87.
Kelly ME, Loughrey D, Lawlor BA, Robertson IH, Walsh C, Brennan S. The impact of cognitive training and mental stimulation on cognitive and everyday functioning of healthy older adults: a systematic review and meta-analysis. Ageing Res Rev. 2014;15(1):28–43.
Slegers K, van Boxtel MP, Jolles J. Effects of computer training and internet usage on the well-being and quality of life of older adults: a randomized, controlled study. J Gerontol B Psychol Sci Soc Sci. 2008;63(3):176–84.
Borness C, Proudfoot J, Crawford J, Valenzuela M. Putting brain training to the test in the workplace: a randomized, blinded, multisite, active-controlled trial. PLoS One. 2013;8(3):e59982.
Folstein MF, Folstein SE, McHugh PR. “Mini-Mental State”: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98.
Feise R. Do multiple outcome measures require p-value adjustment? BMC Med Res Methodol. 2002;2(1):2–8.
Benton A, Sivan A, Hamsher K, Varney N, Spreen O. Contributions to neuropsychological assessment: a clinical manual. New York, USA: Oxford University Press; 1994.
Osterrieth PA. Le test de copie d'une figure complexe; contribution à l'étude de la perception et de la mémoire [Test of copying a complex figure; contribution to the study of perception and memory]. Arch Psychol. 1944;30:206–356.
Taylor L. Localisation of cerebral lesions by psychological testing. Clin Neurosurg. 1969;16:269–87.
Neuburger S, Jansen P, Heil M, Quaiser-Pohl C. Gender differences in pre-adolescents’ mental-rotation performance: do they depend on grade and stimulus type? Pers Individ Dif. 2011;50(8):1238–42.
Peters M, Laeng B, Latham K, Jackson M, Zaiyouna R, Richardson C. A redrawn Vandenberg and Kuse mental rotations test-different versions and factors that affect performance. Brain Cogn. 1995;28(1):39–58.
Welsh KA, Butters N, Mohs RC, Beekly D, Edland S, Fillenbaum G, Heyman A. The Consortium to Establish a Registry for Alzheimer’s Disease (CERAD). Part V. A normative study of the neuropsychological battery. Neurology. 1994;44(4):609–14.
Reitan RM. Validity of the Trail Making Test as an indicator of organic brain damage. Percept Motor Skills. 1958;8(3):271–6.
Härting C, Markowitsch H, Neufeld H, Calabrese P, Deisinger K, Kessler J. Wechsler Gedächtnis Test – Revidierte Fassung [Wechsler Memory Scale – Revised]. Bern: Huber; 2000.
Von Aster M, Neubauer A, Horn R. Wechsler Intelligenztest für Erwachsene (WIE). Deutschsprachige Bearbeitung und Adaptation des WAIS-III von David Wechsler [Wechsler Intelligence Scale for adults. German adaptation of the WAIS-III by David Wechsler]. Frankfurt/Main: Harcourt Test Services; 2006.
Owsley C, McGwin Jr G, Sloane ME, Stalvey BT, Wells J. Timed instrumental activities of daily living tasks: relationship to visual function in older adults. Optom Vis Sci. 2001;78(5):350–9.
Tucker-Drob EM. Neurocognitive functions and everyday functions change together in old age. Neuropsychology. 2011;25(3):368–77.
Klumb PL. Cognitive failures and performance differences: validation studies of a German version of the cognitive failures questionnaire. Ergonomics. 1995;38(7):1456–67.
Scholz A. Konzentration im Alltag: Erleben und Leistung [Attention in everyday life: subjective and objective performance]. Doctoral dissertation. Dresden: TU Dresden; 2006.
Brähler E, Mühlan H, Albani C, Schmidt S. Teststatistische Prüfung und Normierung der deutschen Versionen des EUROHIS-QOL Lebensqualität-Index und des WHO-5 Wohlbefindens-Index [Testing and standardization of the German version of the EUROHIS-QOL and WHO-5 quality-of life-indices]. Diagnostica. 2007;53(2):83–96.
Schwarzer R, Jerusalem M. Generalized Self-Efficacy scale. In: Weinman J, Wright S, Johnston M, editors. Measures in health psychology: a user’s portfolio. Causal and control beliefs. Windsor, UK: NFER-NELSON; 1995. p. 35–7.
Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96.
Blom G. Statistical estimates and transformed beta-variables. New York, NY: John Wiley & Sons; 1958.
Stewart AL, Mills KM, King AC, Haskell WL, Gillis D, Ritter PL. CHAMPS physical activity questionnaire for older adults: outcomes for interventions. Med Sci Sports Exerc. 2001;33(7):1126–41.
Martínez-González MA, García-Arellano A, Toledo E, Salas-Salvadó J, Buil-Cosiales P, Corella D, Covas MI, Schröder H, Arós F, Gómez-Gracia E, et al. A 14-item Mediterranean diet assessment tool and obesity indexes among high-risk subjects: the PREDIMED trial. PLoS One. 2012;7(8):e43134.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.
Boot WR, Simons DJ, Stothart C, Stutts C. The pervasive problem with placebos in psychology why active control groups are not sufficient to rule out placebo effects. Perspect Psychol Sci. 2013;8(4):445–54.
Willis SL. Methodological issues in behavioral intervention research with the elderly. In: Birren JE, Schaie KW, editors. Handbook of the psychology of aging, vol. 3. San Diego, CA, US: Academic Press; 2001. p. 78–108.
Altman DG. Missing outcomes in randomized trials: addressing the dilemma. Open Med. 2009;3(2):e51–3.
Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res. 2011;2(3):109–12.
Pinheiro J, Bates D, DebRoy S, Sarkar D, R Development Core Team. nlme: linear and nonlinear mixed effects models. R package version 3.1-97. Vienna: R Foundation for Statistical Computing; 2011.
Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.
Faul F, Erdfelder E, Lang A-G, Buchner A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91.
Lindenberger U, Wenger E, Lovden M. Towards a stronger science of human plasticity. Nat Rev Neurosci. 2017;18(5):261–2.
Lövdén M, Bäckman L, Lindenberger U, Schaefer S, Schmiedek F. A theoretical framework for the study of adult cognitive plasticity. Psychol Bull. 2010;136(4):659–76.
Fissler P, Kolassa I-T, Schrader C. Educational games for brain health: revealing their unexplored potential through a neurocognitive approach. Front Psychol. 2015;6:1056.
Militello LG, Hutton RJ. Applied Cognitive Task Analysis (ACTA): A practitioner’s toolkit for understanding cognitive task demands. Ergonomics. 1998;41(11):1618–41.
Baniqued PL, Lee H, Voss MW, Basak C, Cosman JD, DeSouza S, Severson J, Salthouse TA, Kramer AF. Selling points: What cognitive abilities are tapped by casual video games? Acta Psychol (Amst). 2013;142(1):74–86.
Jaeggi SM, Studer-Luethi B, Buschkuehl M, Su YF, Jonides J, Perrig WJ. The relationship between n-back performance and matrix reasoning - implications for training and transfer. Intelligence. 2010;38(6):625–35.
We thank Hellen Apel for conducting the outcome assessment, data entry, and the communication of participants’ results and Katharina Benecke for supporting PF and OCK in the project administration and for conducting parts of the telephone-based cognitive health counseling (primarily telephone-based counseling at t4 and t5) and data entry. Furthermore, we thank Prof. Dr. Dipl.-Psych. Ingo Uttner for critically contributing to the design of the methodology. For their contributions in the development of the cognitive health counseling within pilot projects, we thank Stephanie Spohn, Adelheid Maurer, Franziska Bilger, Jannika Pfeiffer, Miriam Mehler, Barbara Körner, Janina Lehmann, Maren Cichon, Melanie Wagner, Mona Schwarz, Nina Blahak, Sandra Kirschner, Sarah Hertle, Stefanie Nigel, Tine Schmidt, Heike Reichenauer, Ramona Sauter, Irmela Joos, and Sophia Haffa.
The trial is funded by Ravensburger Spieleverlag GmbH. The funder has no role or ultimate authority in study design; collection, management, analysis, and interpretation of data; writing of the manuscript; and the decision to submit the report for publication. RSV has no role in the study, apart from providing the jigsaw puzzles.
Availability of data and materials
The decision about an appropriate data repository has not been made yet. We are aware of the importance and aim to share the data. Information about the data repository will be available on ClincialTrials.gov.
Ethics approval and consent to participate
The study was approved by the Ethics Committee of Ulm University (401/15 – Zo/bal.). All participants will provide oral informed consent before the telephone-based pre-screening and written informed consent before the on-site screening (see “Procedures”).
Consent for publication
PF, OCK, LSL, DL, and MJR are employed within the PACE project that is funded by Ravensburger Spieleverlag GmbH (RSV). RSV may gain or lose financially from the publication of this and following manuscripts about the PACE project. The authors declare that they are not influenced in any way by RSV with regard to study design, collection, management, analysis, and interpretation of data; writing of the manuscript, and the decision to submit the report for publication. Apart from providing the jigsaw puzzles, RSV has no role in the study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents. (DOC 126 kb)
About this article
- Jigsaw puzzles
- Visuospatial cognition
- Cognitive aging
- Cognitive intervention
- Cognitive enrichment
- Cognitive impairment
- Daily functioning