MATRICS: A Method for Aggregating The Reporting of Interventions in Complex Studies
© Thorne et al; licensee BioMed Central Ltd. 2011
Published: 13 December 2011
There are few rigorous methods for combining qualitative and quantitative findings from studies with complex interventions using multiple research methods and giving appropriate weight to each without introducing bias to the overall conclusions.
We developed a Method for Aggregating The Reporting of Interventions in Complex Studies (MATRICS) for the ENIGMA study (Evaluating Innovations in Gastroenterology by the NHS Modernisation Agency) – a multi-centre, mixed-methods study to evaluate the impact of the Modernising Endoscopy Services programme , funded by the UK National Institute for Health Research (NIHR SDO ref 08/1304/46).
List the types of effects identified by the study (from the aims objectives and outcome measures), and divide them between effects on: sample population (eg patients, carers); on the specialty being investigated (eg intensive care, outpatients) and on the rest of the organisation and society and give each a unique number.
List the methods used to explore each effect listed in step 1 and give each a unique letter (eg GP interviews, patient questionnaires, routine data linkage).
Create an alphanumeric code by cross matching the effects identified and the methods used to investigate them (eg patient satisfaction “1” was investigated using a patient questionnaire “A” = 1A).
List the explicit findings of the study and label them using the alphanumeric code (eg “patients were dissatisfied with waiting times – A1”).
Synthesise all consistent findings and list their alphanumeric codes alongside to characterise mutually confirmatory findings. Synthesis is best done independently by at least two researchers.
Reorder all contradictory findings and their alphanumeric codes adjacent to one another to better illustrate all conflicting findings.
The MATRICS tool greatly facilitated the unbiased factual reporting of findings from multiple methods for ENIGMA . Additionally, it was most beneficial for the qualitative synthesis of the findings of ENIGMA, a study unsuited to formal cost-benefit analysis, like most in this field.
We have also applied the MATRICS successfully to other complex studies using multiple methods.
If the experience of the study team regarding the MATRICS approach to synthesising results in complex studies is reflected by others, it could provide a formal structure for reporting the results of complex and/or multiple-method studies. Further application of this methodology will provide evidence of whether this reporting tool will improve a reader’s understanding of a study and its findings.
- Williams JG, Cheung WY, Cohen D, Hutchings H, Jerzembek G, Rapport F, Russell IT, Seagrove AC, Thorne K: Evaluating innovations in the delivery and organisation of gastroenterology services initiated directly or indirectly by the Modernising Endoscopy Services programme of the NHS Modernisation Agency. 2008, London: National Institute for Health Research Service Delivery and Organisation Programme, http://www.sdo.nihr.ac.uk/files/project/46-final-report.pdfGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.