This article has Open Peer Review reports available.
Inefficacy of different strategies to improve guideline awareness – 5-year follow-up of the hypertension evaluation project (HEP)
© Hagemeister et al; licensee BioMed Central Ltd. 2008
Received: 29 October 2007
Accepted: 25 June 2008
Published: 25 June 2008
In spite of numerous guidelines for evidence based diagnostic and therapy adequate knowledge of current recommendations is disappointingly low. In the Hypertension Evaluation Project (HEP I) we showed that awareness of national hypertension guidelines under German practitioners was less than 25% in the year 2000. This indicates the need for efficient strategies to relevantly improve guideline awareness.
To asses different tools for amending guideline knowledge we used three strategies (guideline in print, interactive guideline, expert seminars) to train 8325 randomised physicians, who had participated in the HEP I trial. Guideline knowledge of the trained physicians was again tested with the HEP questionnaire and compared to a control group of HEP I physicians.
The return rate of questionnaires was 57.9% without a significant distinction between the groups. Overall guideline awareness was still low but remarkably improved compared to the results of HEP I (37.1% vs. 23.7%, p < 0.0001). There was no difference between the trained physicians and the control group (35.8% and 35.9% vs. 39.7%, p = n.s.).
We investigated the influence of different strategies to improve guideline awareness among German physicians. None of our interventions (guideline in print, interactive guideline, expert seminars) brought a notable benefit compared to control group. However, overall knowledge of guideline contents increased from 23.7% to 37.1% over five years. Therefore, other probably multimodal interventions are necessary to significantly improve guideline awareness beyond spontaneous advancement.
Guidelines are recognized as reasonable and necessary decision guidance to guarantee the highest quality level for medical care . Hence, many guidelines for various medical areas have been developed in the last years. In the implementation of guidelines many interface problems can occur, for example problems in the dissemination, the recognition, the acceptance and the practical transformation. Therefore we formerly assessed the knowledge of hypertension guidelines with a survey in a nationwide population of physicians in private practice in Germany in the year 2000. This survey showed that less than 25% of the physicians had adequate knowledge of current recommendations for diagnosis and treatment .
An important step for the improvement of the implementation of guidelines is an optimized dissemination of the recommendations within the physician community. The dissemination can be achieved in traditional (e.g. publication, short guideline, seminars) or in innovative (e.g. interactive software, internet) ways. The more traditional ways for information and implementation -publications or hand outs- seem to be ineffective in the light of the above data. Therefore, the goal of the present study was a systematic comparison of traditional and innovative ways for implementation of guideline knowledge for diagnosis and treatment of hypertension. The data collection was performed as a longitudinal study with a follow up duration of five years and was based on the study population of the Hypertension Evaluation Project (HEP I) of the year 2000.
Order of study for intervention and re-evaluation of guideline awareness.
Random sample (n = 8325)
Executed (n = 6027)
Questionnaire (n = 4500)
Response (rate) (n = 2474)
One intervention group (projected size n = 3825) was invited to a standardized education seminar. The seminar consisted of a casuistic based lecture of 60 minutes and a discussion of 30 minutes. The seminars were planned in Bremen, Dresden, Düsseldorf, Hannover und Karlsruhe. All study participants within a radius of 50 km were invited to the seminar. The number of participants was calculated with 20% of the invited physicians.
The printed summary of the hypertension guideline of the German Hypertension Society (edition of 2003) was sent to a randomized group (n = 1500) which was stratified for postal codes. An interactive version of the guideline, which was developed from the Agency for Quality in Medicine (ÄZQ) reflecting the content of the guideline of the German Hypertension Society, was sent to 1500 randomly selected physicians throughout Germany. These two intervention groups received in addition to the guideline also a thank-you letter for participation and a summary of the results of the previous study (HEP I).
The control group (n = 1500) was stratified by postal codes from the study group of HEP I.
Within 4–6 months after the intervention a re-evaluation of the guideline knowledge was conducted using a casuistic based questionnaire. The questionnaire was based on the guidelines of the German Hypertension Society and was identical with the HEP I questionnaire, which was previously published . The questionnaire comprises ten questions about diagnostic, therapy and therapy control of arterial hypertension.
The mailing of the questionnaires followed the rules of the total design method by Dillman . The questionnaires were mailed to all participants in October 2004. Two weeks later all participants were reminded by a post card. The post card expressed the gratitude to all participants who had returned the questionnaire and served also as a reminder to the other participants. In December 2004 a questionnaire was sent out to all participants who had not yet answered. A last mailing of the questionnaire took place in January 2005.
For the assessment of guideline knowledge 8 out of 10 questions were analyzed. Two questions were excluded from the final analysis because they were used for general orientation about diagnostic (question 2) and therapeutic (question 5) strategies. For each answer conforming to the guidelines one point was awarded and the result was analyzed univariately. A guideline adequate knowledge was certified with five correct answers, these correct answers had to include the correct definition of arterial hypertension (RR ≥ 140/90 mmHg). In addition at least four questions (> 50%) of the analyzed questions had to be answered correctly. The data where analyzed in an explorative way focussing on the differences between intervention groups and control group and between each of the participating physician groups. P < 0.05 was considered statistically significant.
Out of a corrected random sample of 4275 addresses 2474 questionnaires could be analyzed which was an effective response rate of 57.9%. The 225 failures of the initial random sample were two physicians who had died, 32 physicians who did not treat patients with hypertension, 50 physicians who had closed their private practice and 141 addresses could not be located by postal means.
After the first mailing process 1114 evaluable questionnaires were sent back corresponding to a return rate of 26.1% of the cleared sample. After the mailing of the post card as a first reminder 219 participants (5.1% of cleared sample) sent back the questionnaire. The second and third reminder (mailing of an additional copy of the questionnaire) were followed by 770 evaluable questionnaires (18%) and finally 371 questionnaires (8.7%).
The return quote for the intervention group with the printed summary of the guideline was 54.9% (n = 783) and for the group with the interactive version of the guideline 59.8% (n = 852). The control group had a return quote of 839 (58.9%) evaluable questionnaires (see Table 1).
Demographic data for study population (cleared sample), responders and non responders.
Cleared sample (n = 4275)
Responders (n = 2474)
Non responders (n = 1801)
Private practice < 5 years
Private practice > 20 years
Intervention group seminars
Only 2% of the invited physicians in Bremen (invited n = 830) and Karlsruhe (invited n = 732) participated in the seminar. Because of this marginal feedback this intervention arm was cancelled as no meaningful interpretation for this intervention group was possible. Thus, no re-evaluation of the guideline knowledge was performed in this intervention group.
Guideline awareness in relation to intervention groups
Guideline awareness in relation to intervention groups and professional specification
Guideline awareness in relation to professional specification
Guideline awareness in relation to duration of private practice
Within the subgroup of physicians with guideline adequate definition of arterial hypertension there was an adequate knowledge of guidelines in 68.6% (919/1339). This finding is slightly better than the result from HEP I (66.8%). For general practitioners this figure is 69.0% (310/458), for the internists 67.9% (549/808) and for the cardiologists 74.0% (53/73).
Complete data for response rate, guideline awareness and duration of private practice.
Overall response rate
Adequate guideline awareness
Subgroup with guideline-conform definition of hypertension ≤ 140/90 mmHg
Adequate guideline awareness
Adequate guideline awareness in relation to duration of private practice
< 2 years
> 20 years
These data show that mailing of printed or interactive information had no positive effect on guideline knowledge of physicians. The proportion of physicians with adequate knowledge was even higher in the control group (p = n.s.). Our study corroborates a metaanalysis from Grimshaw  for guideline implementation in the Anglo-American area also for Germany.
It is remarkable, that in the intervention group which was invited to a seminar only 2% of the invited physicians finally attended the meeting. Therefore, a continuation of this intervention group was not reasonable. The underlying reason for the modest attendance (lack of top speaker or lack of interest in the topic) can only be assumed.
In spite of the ineffective interventions, overall guideline knowledge improved between 2000 and 2005 from 23.7% to 37.1%. This increase in knowledge was found in all subgroups and was most significant in the group of general practitioners which showed an increase from 18.8% to 34.2%. In the group of cardiologists increase in guideline knowledge was small (37.1% to 46.6%). In summary, the difference between the various physician groups is less pronounced in comparison with the previous investigation in 2000. The deficiency in knowledge depending on the duration of private practice was also less than in the previous study.
The reason for this finding is most likely the combination of time and continuous multimodal interventions. Over a time period of five years there may be various exposures to publications, medical meetings, and internet and so on. This may cause a "contamination" of the study population, but it is thought to affect both, the interventional and control groups. However, our study showed that adding a single intervention over this time period, to this contamination has no additional effect on the guideline awareness. This is similar to the findings of Gross et al.  who showed, that single interventions for guideline implementation may sometimes have an effect but are most of the time ineffective. The strategies for implementation of guidelines should be multi-facetted to be effective.
Subgroup analyses of study participants with a guideline adequate definition of arterial hypertension (correct answer to question one: n = 1339) are remarkable. Here we found only a small increase of 0.8% of overall knowledge of guidelines between 2000 and 2005. This validates the knowledge of the correct definition of arterial hypertension as a reliable marker for adequate knowledge of the contents of guidelines and confirms the previous results. Regarding our data, question 1 has a sensitivity of about 70% for adequate knowledge of guidelines.
The unsatisfying level of knowledge about current recommendations for diagnosis and therapy of arterial hypertension partly explains the insufficient control of patients with hypertension in Germany . The HYDRA-Study  showed that only 64% of patients with known arterial hypertension in Germany are on treatment and only 19% have a controlled hypertension. In contrast the physicians attested 57% of the patients a well treated hypertension. In the USA 68% of the physicians attested the patients a well treated hypertension . In this study 43% of the patients with hypertension had a blood pressure value of less than 140/90 mmHg.
The MAHLER survey  showed for patients with heart failure that a consequent implementation of recommendations of guidelines leads to a significant reduction of hospitalisation.
We had an acceptable response rate of nearly 58% to our questionnaire, but still 42% of the study population (cleared sample) were non responders. Demographic data in Table 2 show that there were no relevant differences between responders and non responders. So it is likely that the results are representative for the total study group.
Over a time period of five years there may be various exposures to publications, medical meetings, and internet and so on. This may cause a "contamination" of the study population, but it is thought to affect both, the interventional and control groups.
Therefore, the goal must be to improve diagnosis and therapy of arterial hypertension by multimodal interventions. Furthermore there should be additional investigation in regard to the determinants of implementation and medical knowledge to optimize implementation strategies and finally optimize patient outcome.
HEP was supported by the Koeln Fortune Program/Faculty of Medicine, University of Cologne.
- Ollenschläger G, Marshall C, Qureshi S, Rosenbrand K, Burgers J, Mäkelä M, Slutsky J, Board of Trustees 2002, Guidelines International Network (G-I-N): Improving the quality of health care: using international collaboration to inform guideline programmes by founding the Guidelines International Network (G-I-N). Qual Saf Health Care. 2004, 13 (6): 455-460. 10.1136/qshc.2003.009761.View ArticlePubMedPubMed CentralGoogle Scholar
- Hagemeister J, Schneider CA, Barabas S, Schadt R, Wassmer G, Mager G, Pfaff H, Höpp HW: Hypertension guidelines and their limitations – the impact of physicians' compliance as evaluated by guideline awareness. J Hypertens. 2001, 19: 2079-2086. 10.1097/00004872-200111000-00020.View ArticlePubMedGoogle Scholar
- Dillman DA: The total design method. Mail and telephone surveys. Edited by: Dillman DA. 1978, New York: WileyGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.View ArticleGoogle Scholar
- Gross PA, Greenfield S, Cretin S, Ferguson J, Grimshaw J, Grol R, Klazinga N, Lorenz W, Meyer GS, Riccobono C, Schoenbaum SC, Schyve P, Shaw C: Optimal methods for guideline implementation: conclusions from Leeds Castle meeting. Med Care. 2001, 39 (8 suppl 2): 85-92.Google Scholar
- Lowel H, Meisinger C, Heier M, Hymer H, Alte D, Volzke H: Epidemiology of hypertension in Germany. Selected results of population-representative cross-sectional studies. Dtsch Med Wochenschr. 2006, 131: 2586-2591. 10.1055/s-2006-956253.View ArticlePubMedGoogle Scholar
- Sharma AM, Wittchen HU, Kirch W, Pittrow D, Ritz E, Goke B, Lehnert H, Tschope D, Krause P, Hofler M, Pfister H, Bramlage P, Unger T, HYDRA Study Group: High prevalence and poor control of hypertension in primary care: cross-sectional study. J Hypertens. 2004, 22: 479-486. 10.1097/00004872-200403000-00009.View ArticlePubMedGoogle Scholar
- Steiman MA, Fischer MA, Shlipak MG, Bosworth HB, Oddone EZ, Hoffman BB, Goldstein MK: Clinician awareness of adherence to hypertension guidelines. Am J Med. 2004, 117: 747-754. 10.1016/j.amjmed.2004.03.035.View ArticleGoogle Scholar
- Komajda M, Lapuerta P, Hermans N, Gonzalez-Juanatey JR, van Veldhuisen DJ, Erdmann E, Tavazzi L, Poole-Wilson P, Le Pen C: Adherence to guidelines is a predictor of outcome in chronic heart failure: the MAHLER survey. Eur Heart J. 2005, 26: 1653-1659. 10.1093/eurheartj/ehi251.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.