Skip to main content

Table 2 Validity and reliability of the main and secondary outcomes

From: A prospective multicenter assessor-blinded randomized controlled study to compare the efficacy of short versus long protocols of electroconvulsive therapy as an augmentation strategy to clozapine in patients with ultra-resistant schizophrenia (SURECT study)

 

Validity

Test-retest reliability and/or sensitivity to change

Inter-rater reliability

Main outcome

 Positive and Negative Syndrome Scale (PANSS) [12]

High internal consistency with an alpha coefficient comprised between 0.73 and 0.83

Reliable test-retest accuracy (0.77 to 0.89)

High correlations, comprised between 0.83 and 0.87

Secondary outcomes

 Brief Psychiatric Rating Scale (BPRS) [20]

Internal consistency: alpha = 0.46 for general score [21]

Inter-rater reliability = between 0.87 and 0.97 [22]

 Young Mania Rating scale (YMRS) [23]

Concurrent validity: correlation between YMRS and Mania Assessment Scale was very high and statistically significant at each weekly assessment (r > 0.91, p < 0.001) [24]

Sensitivity to change because there was a statistically significant decline among 15 patients after 2 weeks of treatment [25]

Inter-rater reliability ICC > 0.89 [24]

 Modified Overt Aggression Scale (MOAS) [26]

Convergent validity: r = 0.75 with history of actual aggressive behavior (p < 0.001)

Divergent validity: r = − 0.09 with Eysenck Personality Questionnaire Extraversion [27]

ICC = 0.6 [28]

ICC = 0.96 [29]

 Clinical Global Impression Scale (CGI)-Severity [30]

Positive correlation between CGI-S and HAM-D, anticipatory anxiety, and panic frequency in a sample of 116 patients with panic disorder and depression [31]

Inter-rater reliability = 0.66 in 12 patients with dementia [32]

 Global Assessment of Functioning scale (GAF) [33]

The multiple regression between the GAF and the measures of symptoms and social behavior were large and highly significant (r = − 0.63 with the SANS total and r = − 0.46 with the Social Behavior Schedule [34]. A longer hospitalization was associated with lower baseline GAF (OR = 1.91) [35]

ICC = 0.89 to 0.95 [34]

 Mini-Mental Status Examination (MMSE) [36]

Convergent validity: r = 0.7 to 0.9 with other cognitive screening tests [37]

Test-retest reliability coefficients = 0.80 to 0.95 [37]

Inter-rater reliability was found to be high (mean kappa value = 0.97) [38]

 Subjective Scale to Investigate Cognition in Schizophrenia (SSTICS) [13]

Convergent validity: the SSTICS total score positively correlated with the Frankfurt-Pamplona Subjective Experiences Scale total score (r = .541, p < .01) [39]

Good internal consistency: Cronbach’s alpha = 0.858 [13]

Test-retest coefficient: r = 0.82 (p < 0.01) for the two global scores [13]

 RL/RI-16 [40]

RL/RI-16 is sensitive enough to differentiate patients with Alzheimer’s disease from those with mild cognitive impairment [41], vascular dementia [14] and fronto-temporal dementia [42].

Use of a parallel form whose performances are not different from the basic list except for free recall 2 and delayed free recall (parallel form > basic list)

 Doors test [15]

Moderately strong correlations with visual recognition memory task (r2 0.60) [43].

Inter-rater reliability: excellent agreement (r = .98) between two independent raters in a sample of 237 subjects [44]

 Test of attention D2 [16]

Internal consistency: Cronbach’s alpha = 0.97 for total score [45].

The ICCs for the seven subscores of the D2 between successive sessions were between 0.78 and 0.94 [46]

 

 The Rey-Osterrieth complex figure [17]

Test-retest reliability coefficients = 0.60 to 0.76 [47].

The inter-rater reliability for direct copying scores was r = 0.96 (p < 0.0001) [48].

  1. ICC intra-class correlation coefficient