- Study protocol
- Open Access
Rationale and design of individualized quality improvement based on the Computer Analysing system to improve Stroke management quality Evaluation (CASE): a multicenter historically controlled study
Trials volume 21, Article number: 677 (2020)
Guideline-based medical care has been identified to improve outcomes in stroke. However, data acquisition and medical quality management during hospital stay still need to be improved in China. We have developed a computer-based medical data collecting system, together with automated calculation of key performance indicators (KPIs) and regular individualized education, and thus aim to explore whether it can improve the medical care quality of acute ischemic stroke (AIS) during hospital stay in stroke centers.
The individualized quality improvement based on the Computer Analysing system to improve Stroke management quality Evaluation (CASE) trial is a prospective, multicenter, historical control study among 30 stroke centers in China. In this trial, the data is directly extracted from the saved original medical record of each AIS patient during hospital stay, regardless of different Electronic Medical Record System (EMRS) in each center. Then, the automated calculation of KPIs and the regular education via teleconference per month allow the clinicians to examine the causes of non-compliance of guideline-based care and develop programs to decrease their frequency.
We compare KPIs between pre-intervention stage and post-intervention stage (without or with education) among stroke centers. If proved effective, this approach might be generalized around China and even worldwide, where a unified EMRS is difficult to be applied and in-patient care needs to be improved.
ClinicalTrials.gov NCT03684629. Registered on 9 December 2018. Retrospectively registered.
Stroke burden has increased over the past three decades in China, emerging to be the leading cause of mortality [1, 2]. A systematic review indicated that implementing clinical guidelines improved the quality and efficiency of medical care . Moreover, studies such as GOLDEN BRIDGE , The Get With The Guidelines (GWTG) , and BRIDGE STROKE  also indicated that increased delivery of in-patient care based on guidelines could contribute to the favorable outcome of stroke patients .
To enhance the medical care quality by increasing the compliance with evidence-based performance in stroke patients, China Stroke Center Alliance (CSCA) has been launched in China in 2015. CSCA prompted 13 key performance indicators (KPIs) of acute ischemic stroke (AIS) to monitor the routine in-patient medical care quality, based on the AIS guidelines, involving intravenous thrombosis (IVT), antiplatelet therapy, anticoagulant therapy, and so on [8,9,10,11,12,13]. Then afterwards, CSCA annually collected the required data from about 20,000 in-patients among more than 1500 stroke centers , and calculated and feedback all of the KPIs to each center.
However, there is a huge diversity in the Electronic Medical Record System (EMRS) in different stroke centers in China currently, which makes it difficult to capture all KPIs from the original medical records by a unified system in each center. Accordingly, clinicians in each stroke center have to report the medical data online manually to achieve the feedback of KPIs from CSCA. Indeed, this is also the way data was collected in the above studies (GOLDEN BRIDGE, GWTG, BRIDGE STROKE).
Obviously, this kind of collection has its inherent shortcomings, including the vast cost of manpower and time from clinicians, and questioning of its authenticity due to the lack of traceability of original medical records and enough quality control of data. To minimize the above limitations, we thus developed a computer-based medical data collecting system, with subsequent automated calculation of KPIs and regular individualized education to improve the adherence to guideline-based care. The main purpose is to decrease the workload of clinicians in stroke centers on reporting data manually. We designed this individualized quality improvement based on the Computer Analysing system to improve Stroke management quality Evaluation (CASE) trial to explore whether this novel approach can improve inpatient medical care quality of AIS in each stroke center.
Method and design
This is an 18-month prospective, multicenter, historical control study among 30 stroke centers in Zhejiang Province, China. Stroke centers with in-hospital stroke patients voluntarily participate in this trial. All medical documents of consecutive AIS patients admitted in the stroke center according to ICD-10 (I63 and G45) are collected by investigators from Zhejiang Stroke Quality Control Center (ZSQCC). Only the de-identified documents are preserved in a safe information database. The clinical data involved in this study belong to the scope of information collection of routine clinical practice. The local infrastructure and characteristics of each recruited center are also recorded. The study protocol is approved by the Institutional Review Board of the Second Affiliated Hospital of Zhejiang University (SAHZU). Because patient information in the CASE is de-identified and anonymized before being released to the researchers, the informed consent requirement is waived by SAHZU Institutional Review Board. All the protocol item is standardized (see Additional file 1). It was registered at ClinicalTrials.gov (NCT03684629).
There are two stages in this trial: pre-intervention stage (the initial 6 months) and post-intervention stage (the next 12 months). We collect the consecutive data of each center during the pre-intervention stage without feedback of KPIs and then monthly send its own KPIs to each center during the post-intervention stage. We finally compare the changes of KPIs from pre-intervention stage to the last 6 months of post-intervention stage (Fig. 1).
The inclusion criteria for the analysis of medical documents
Patients 18 years or older
AIS confirmed by computed tomography (CT) or diffusion-weighted imaging (DWI)
Admitted within 7 days from symptom onset
Data monitoring and confidentiality
After discharge, the original medical document of each patient during hospital stay is saved as images or portable document format (PDF). Specific software recognizes and pre-processes the above material and sends it to multiple Optical Character Recognition (OCR)  engines to build documents with recognized text, which are subsequently re-segmented and synthesized in the post-processing. Required data is extracted from the processed text. Three hundred medical documents were randomly selected to evaluate the error rate of the extraction, i.e., the rate of inconsistent data extracted by computer-based medical data collecting system and manual input of neurologists, which was finally 3.4%. Previous report has also demonstrated generalizability and applicability of OCR with a positive predictive value of 94.6% . This software also allows the trained study investigators to quickly check the quality of extracted data by pointing out the original extraction site, enabling the authenticity and traceability of original data. The checked data are then imported into the analyzing system, and KPIs will be calculated according to the designed formula (Fig. 2).
Intervention for medical care improvement
Individualized quality improvement process is divided into 3 steps:
Each stroke center receives their own KPIs monthly, as well as the average KPI level of all 30 stroke centers as contrast, which are automatically calculated by computer analyzing system.
Based on the performance of KPI data, stroke experts from ZSQCC identify the items which need to be improved, provide each center with relevant education of guidelines, and help the clinicians to examine the causes of non-compliance of guideline-based care and develop programs to decrease their frequency via regular teleconference per month and face-to-face lectures quarterly. In the meantime, stroke centers with the best KPI performance also share their experiences on medical care improvement.
Each stroke center is then required to provide a detailed improvement plan for each KPI and check whether it is implemented one by one during the next teleconference.
The primary outcomes are as follows: 7 KPIs including the accomplishment of National Institutes of Health Stroke Scale (NIHSS), intravenous thrombosis within 4.5 h of onset, antiplatelet agent therapy within the first 48 h, statin use after hospitalization and at discharge, antithrombotic therapy at discharge, and anticoagulant treatment for patients with atrial fibrillation at discharge [8, 9, 11,12,13] (see Additional file 2).
The secondary outcomes are as follows: 9 KPIs including prevention of deep vein thrombosis, blood vessel evaluation within 1 week of hospitalization, swallowing function evaluation, blood lipid level assessment, rehabilitation evaluation and implementation, recommendation of life style change, anti-hypertensive therapy, hypoglycemic treatment at discharge, and recurrence rate [10, 11, 17] (see Additional file 2).
Among all the KPI, the adherence to intravenous thrombosis (IVT) was poor in china . Result of investigation in Zhejiang before the trial indicated that only approximately 8% of ischemic stroke patients received IVT 4.5 h after stroke onset. To detect 10% improvement in the adherence to IVT, with α = 0.05 and power = 90%, at least 16,570 patients will be needed in pre-intervention stage and post-intervention stage.
Planned data statistical analysis
Statistical analysis will be performed with SPSS 22.0 (SPSS, Inc., Chicago, USA). Baseline characteristics of each stroke center (see Additional file 3) and the patients enrolled will be analyzed. The achieved rates of all KPIs of 30 hospitals during pre-intervention stage and the last 6 months of post-intervention stage are compared by the paired t test. KPIs are also collected at multiple time points before and after intervention. Interrupted time series (ITS) analysis is performed to assess the efficiency on outcome 1 year after the intervention is carried out [19, 20]. The multiple time points before the intervention allow the underlying trend to be estimated, and the multiple time points after the intervention allow the intervention effect to be estimated accounting for the underlying trend. No additional adjusted analyses will be performed. All the information to calculate the KPIs was included in the medical records. The missing data not extracted by a computer will be extracted manually by a clinician. There are no anticipated problems that are detrimental to the participant so that there are no formal stopping rules for the trial. The schedule of enrolment, interventions, and assessments is included in Fig. 3.
Trial management and monitoring
The Trial Management Group (TMG) will be responsible for all aspects of local organization and the day-to-day running of the trial, including monitoring the operation and maintenance of the computer analyzing system, outcome data collection, and ensuring the feedback of KPIs to the relevant hospitals every month. The trial will be overseen by an independent Trial Steering Committee (TSC), which will meet at least monthly to consider and address strategic issues. A Data Monitoring Committee (DMC), members of which will act independently of the TSC, TMG, and funder, will monitor data, check the quality of extracted data, and make recommendations to the TSC on whether there are any ethical or safety reasons why the trial should not continue. The serious adverse events (SAEs) which will be recorded and reported in this trial are deaths by any cause in the 1 year after hospitalization. The DMC will monitor the occurrence of SAEs. Patient information in the CASE is de-identified and anonymized, extracted from medical document after discharge.
It is widely agreed that accuracy and reliability are of importance for data collection, which may interfere with the sample size and data quality for research . Manual report can lead to data errors, and the authenticity of data cannot be guaranteed without verification of original medical record. Even the Get With The Guidelines (GWTG)-Stroke program, a national stroke quality improvement for AIS and TIA via the web, also has missing data during the hospital participation in the program, possibly due to the manual input . Importantly, it is difficult for the clinicians to insist on quality improvement based on their manual reporting after busy clinical practice, when faced with a huge number of patients. Currently, it is also difficult to deliver automated calculation of KPIs via a unified EMRS around China. In CASE trial, data are directly extracted from the saved original record of each patient based on optimized OCR, having nothing to do with the work of EMRS itself. Theoretically, this approach can be implemented in all centers and the extraction saves the time of all clinicians.
Based on the reliable feedback, regular individualized education would further improve the adherence to guideline-based care [23, 24]. By providing the participating hospitals with improvement consultation, workshops, and webinars based on guidelines, GWTG-Stroke program achieved significant improvement of composite measure of care from 83.53 to 93.97% . Data analysis from 2010 to 2013 in Germany showed that the mortality was reduced by up to 6.26 (63.7%) deaths per year, if the average hospital boosts its performance to an efficient treatment of stroke patients . In CASE trial, the automated calculation of KPIs identifies the non-compliance of guideline-based care, which allows the clinicians to examine their cause and develop programs to decrease their frequency. The teleconference per month and the requirement of detailed improvement plan from each center would constitute into an upgraded dynamic feedback and improving system, leading to the enhanced surveillance and monitoring, and decreased medical care errors.
Therefore, it is reasonable to assume that this novel computer-based medical data collecting system, together with subsequent automated calculation of KPIs and regular individualized education, could increase the adherence to guideline-based care in each stroke center, finally improving the efficiency and quality of medical care of stroke patients.
This study has some limitations. First, it is a historical control study; thus, the quality of care in individual hospital may have changed over time, which can influence the general results of the trial. Second, the 30 hospitals were selected randomly from 78 voluntary hospitals rather than all hospitals in Zhejiang province. Randomizing has prevented issues around selection bias.
In summary, this is a new mode to improve in-patient medical care, which consists of advanced acquisition technique and personalized feedback with persistent education. It can yield real benefits in terms of increased delivery of guideline-based care and reduced manual reporting of clinicians. If proved effective in Zhejiang province, this new quality improvement approach might be generalized around China and even worldwide, where a unified EMRS is difficult to be applied.
The protocol version number is 1.0, finalized in July 2018. The date of recruitment began on August 16, 2018. The approximate date when recruitment will be completed is January 2020.
Availability of data and materials
The dataset is not publicly available due to confidentiality policies.
Key performance indicator
Acute ischemic stroke
The individualized quality improvement based on the Computer Analysing system to improve Stroke management quality Evaluation
Electronic Medical Record System
The Get With The Guidelines
China Stroke Center Alliance
Zhejiang Stroke Quality Control Center
The Second Affiliated Hospital of Zhejiang University
Portable document format
Optical Character Recognition
National Institutes of Health Stroke Scale
Interrupted time series
Li Z, Wang C, Zhao X, Liu L, Wang C, Li H, et al. Substantial progress yet significant opportunity for improvement in stroke care in China. Stroke. 2016;47(11):2843–9.
Zhou M, Wang H, Zhu J, Chen W, Wang L, Liu S, et al. Cause-specific mortality for 240 causes in China during 1990-2013: a systematic subnational analysis for the Global Burden of Disease Study 2013. Lancet. 2016;387(10015):251–72.
Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med. 2006;21(Suppl 2):S14–20.
Wang Y, Li Z, Xian Y, Zhao X, Li H, Shen H, et al. Rationale and design of a cluster-randomized multifaceted intervention trial to improve stroke care quality in China: the GOLDEN BRIDGE-Acute Ischemic Stroke. Am Heart J. 2015;169(6):767–74 e2.
Hassan AE, Ossowski SE, Malik AA, Sanchez C, Abantao E, Sanchez O, et al. Does hospitalist directed care for acute ischemic stroke patients improve adherence to “Get with the Guidelines”? J Vasc Interv Neurol. 2016;9(2):30–3.
Machline-Carrion MJ, Santucci EV, Damiani LP, Bahit C, Malaga G, Pontes-Neto OM, et al. An international cluster-randomized quality improvement trial to increase the adherence to evidence-based therapies for acute ischemic stroke and transient ischemic attack patients: rationale and design of the BRIDGE STROKE trial. Am Heart J. 2019;207:49–57.
Grau AJ, Eicke M, Biegler MK, Faldum A, Bamberg C, Haass A, et al. Quality monitoring of acute stroke care in Rhineland-Palatinate, Germany, 2001-2006. Stroke. 2010;41(7):1495–500.
Schade CP, Cochran BF, Stephens MK. Using statewide audit and feedback to improve hospital care in West Virginia. Jt Comm J Qual Saf. 2004;30(3):143–51.
Alyousif SM, Alsaileek AA. Quality of anticoagulation control among patients with atrial fibrillation: an experience of a tertiary care center in Saudi Arabia. J Saudi Heart Assoc. 2016;28(4):239–43.
Drury P, Levi C, D'Este C, McElduff P, McInnes E, Hardy J, et al. Quality in Acute Stroke Care (QASC): process evaluation of an intervention to improve the management of fever, hyperglycemia, and swallowing dysfunction following acute stroke. Int J Stroke. 2014;9(6):766–76.
Sherman DG, Albers GW, Bladin C, Fieschi C, Gabbai AA, Kase CS, et al. The efficacy and safety of enoxaparin versus unfractionated heparin for the prevention of venous thromboembolism after acute ischaemic stroke (PREVAIL Study): an open-label randomised comparison. Lancet. 2007;369(9570):1347–55.
Lees KR, Bluhmki E, von Kummer R, Brott TG, Toni D, Grotta JC, et al. Time to treatment with intravenous alteplase and outcome in stroke: an updated pooled analysis of ECASS, ATLANTIS, NINDS, and EPITHET trials. Lancet. 2010;375(9727):1695–703.
Amarenco P, Bogousslavsky J, Callahan A 3rd, Goldstein LB, Hennerici M, Rudolph AE, et al. High-dose atorvastatin after stroke or transient ischemic attack. N Engl J Med. 2006;355(6):549–59.
Wang Y, Li Z, Wang Y, Zhao X, Liu L, Yang X, et al. Chinese Stroke Center Alliance: a national effort to improve healthcare quality for acute stroke and transient ischaemic attack: rationale, design and preliminary findings. Stroke Vasc Neurol. 2018;3(4):256–62.
Li X, Hu G, Teng X, Xie G. Building structured personal health records from photographs of printed medical records. AMIA Annu Symp Proc. 2015;2015:833–42.
Rasmussen LV, Peissig PL, McCarty CA, Starren J. Development of an optical character recognition pipeline for handwritten form fields from an electronic health record. J Am Med Inform Assoc. 2012;19(e1):e90–5.
Nimptsch U, Mansky T. Quality measurement combined with peer review improved German in-hospital mortality rates for four diseases. Health Aff. 2013;32(9):1616–23.
Wang Y, Liao X, Zhao X, Wang DZ, Wang C, Nguyen-Huynh MN, et al. Using recombinant tissue plasminogen activator to treat acute ischemic stroke in China: analysis of the results from the Chinese National Stroke Registry (CNSR). Stroke. 2011;42(6):1658–64.
Weatherburn CJ. Benzodiazepines and non-benzodiazepine hypnotics - impact of a cluster adopted protocol on primary care prescribing. Scott Med J. 2019. https://doi.org/10.1177/0036933019849369.
Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309.
Dippel DW, Simoons ML. Improving adherence to guidelines for acute stroke management. Circulation. 2009;119(1):16–8.
Reeves MJ, Grau-Sepulveda MV, Fonarow GC, Olson DM, Smith EE, Schwamm LH. Are quality improvements in the get with the guidelines: stroke program related to better care or better data documentation? Circ Cardiovasc Qual Outcomes. 2011;4(5):503–11.
Purvis T, Moss K, Francis L, Borschmann K, Kilkenny MF, Denisenko S, et al. Benefits of clinical facilitators on improving stroke care in acute hospitals: a new programme for Australia. Intern Med J. 2017;47(7):775–84.
Middleton S, Bruch D, Martinez-Garduno C, Dale S, McNamara M. International uptake of a proven intervention to reduce death and dependency in acute stroke: a cross-sectional survey following the QASC trial. Worldviews Evid-Based Nurs. 2017;14(6):447–54.
Fonarow GC, Reeves MJ, Smith EE, Saver JL, Zhao X, Olson DW, et al. Characteristics, performance measures, and in-hospital outcomes of the first one million stroke and transient ischemic attack admissions in get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2010;3(3):291–302.
Pross C, Strumann C, Geissler A, Herwartz H, Klein N. Quality and resource efficiency in hospital service provision: a geoadditive stochastic frontier analysis of stroke quality of care in Germany. PLoS One. 2018;13(9):e0203017.
We thank all participating hospitals, their physicians and nurses.
This study was supported by the National Natural Science Foundation of China (81622017), the National Key Research and Development Program of China (2016YFC1301503), and the Science Technology Department of Zhejiang Province (2018C04011). The funders (sponsors) played no part in the study design; the collection, management, analysis, and interpretation of data; the writing of the report; or the decision to submit the report for publication.
Ethics approval and consent to participate
Central ethical approval has been confirmed from the Ethics Committee of the Second Affiliated Hospital, School of Medicine, Zhejiang University (Approval Number: (2018)伦审研第(095)号), and we did not begin recruiting at other centers in the trial until local ethical approval has been obtained. The informed consent requirement is waived by SAHZU Institutional Review Board.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents.
The primary and secondary outcome measures.
The baseline characteristics of primary stroke center (PSC) and comprehensive stroke center (CSC).
About this article
Cite this article
Chen, Y., Zhong, W., Gong, X. et al. Rationale and design of individualized quality improvement based on the Computer Analysing system to improve Stroke management quality Evaluation (CASE): a multicenter historically controlled study. Trials 21, 677 (2020). https://doi.org/10.1186/s13063-020-04598-3
- Acute ischemic stroke
- Computer-based analyzing system
- Key performance indicator
- Medical quality improvement