Skip to main content

Table 2  Description of metrics to assess the primary and secondary outcome

From: A recommender system to quit smoking with mobile motivational messages: study protocol for a randomized controlled trial

Metric

Calculation

Comparisons

Pilot

Related secondary outcome

Primary outcome

 Smoking cessation rate

Total number of people who relapsed / total number of people in the group at 60 days, 120 days, and 180 days of their quitting date

• User engagement at an individual level

• User engagement at an aggregated level

• User mobile app usage

• User quitting attempts

• User lifestyle feedback

• Physical activity

• Clinical

• Public

System influence on smoking cessation and app influence on users physical activity levels

Secondary outcomes

 User engagement at an individual level

Messages read by the user / total number of messages sent to the user

• Smoking cessation rate

• Public

• Clinical

System influence on smoking cessation

 Engagement at an aggregated level

Mobile application rolling retention, session length distribution, session frequency, sessions per user, return rate

• Smoking cessation rate

• Public

• Clinical

System influence on. smoking cessation.

 User quitting attempts

Number and date of quitting attempts

• Smoking cessation rate

• Public

• Clinical

System influence on smoking cessation

 User app behavior

Time spent per app section

• User message ratings

• User satisfaction with messages

• Public

• Clinical

App usage. and opinions on messages the users received

 User satisfaction with messages

Satisfaction questionnaire

• User mobile app usage

• Mobile app behavior

• User message ratings

• Clinical

App usage and opinions on messages the users received

 User message ratings

Users’ votes for each message on a 5-star scale

• User app behavior

• Public

• Clinical

App usage and opinions on messages the users received

 User lifestyle feedback

Comparison of changes in user lifestyle (at baseline and after 6 months) through the questionnaires: EQ-5D-5 L, IPAQ for physical activity, and SF-36

• Smoking cessation rate

• Mobile app usage

• Clinical

App influence on users physical activity levels

 Physical activity

Total time (min) of activity per user, retrieved by GoogleFit

• Smoking cessation rate

• Mobile app usage

• Public

• Clinical

App influence on users physical activity levels

  1. EQ-5D-5 L EuroQol 5-dimension 5-level questionnaire, IPAQ International Physical Activity Questionnaire, SF-36 Short Form 36-item Health Survey