Table 2 Alternative consensus definitions
Category | Added/retained | Deleted directly | Deleted indirectly |
|---|---|---|---|
Round 1 | ≥ 2 stakeholders agree to add | ≥ 2 unqualified scales among M, FR, CV POR ≥ 10% ≥ 2 unqualified scales among M, FR, CV, POR, PIMR, PIDR M ≤ 60% of the full mark or FR ≤ 0.2 in round 1 | < 2 unqualified scales among M, FR, CV, POR, PIMR, and PIDR < 2 stakeholders advise to delete |
Action 1 | Outcome added for R2 | Outcome discarded before R2 | Outcome discarded before R2 (require expert panel’s approval), otherwise retained for R2 |
Round 2 | Not allowed to newly add outcomes | ≥ 2 unqualified scales among M, FR, CV POR ≥ 10% ≥ 2 unqualified scales among M, FR, CV, POR, PIMR, PIDR M ≤ 80% of the full mark or FR ≤ 0.3 in R2 | < 2 unqualified scales among M, FR, CV, POR, PIMR, PIDR < 2 stakeholders advise to delete |
Action 2 | Null | Outcome discarded before consensus meeting | Outcome discarded before consensus meeting (require expert panel’s approval), otherwise retained for consensus meeting |
Consensus meeting | All stakeholder group score as critical (7–9 points) ≥ 70% and not important (1–3 points) < 15% | Any stakeholder group score not important (1–3 points) by ≥ 70% and critical (7–9 points) by < 15% | Neither criterion of consensus in nor out are met |
Action 3 | Outcome retained | Outcome deleted | Outcomes retained for the next consensus meeting |