6. Conclusions and proposed actions

This report attempts to identify the evolution, trends and basic principles of external evaluation models in terms of the promotion of patient safety. These conclusions do not necessarily apply to external evaluation models of health care organisations when they address issues and dimensions of quality that do not directly relate to patient safety.

1. Adopting a minimum set of requirements or adopting core standards, practices and performance indicators for patient safety

Adopting a minimum safety platform with a minimum set of mandatory requirements and a corresponding surveillance system is a true challenge. The medical community must make significant effort to elaborate mimimum thresholds for acceptable standards and not to continue designing high cost and ultra best practices.

There is now evidence in the literature that simple measures that are not costly can show significant benefits (e.g. education, adopting a safe organisation of care, reporting, hand washing, phlebitis preventive protocols). This is an opportunity to involve new member countries while mobilising more advanced countries where very up to date practices may be pursued at the expense of basic ones that have been shown to have a large impact on the safety of patients and that rely less on technology than on individual and group practices.

This is a strong argument for the definition of specific safety priorities and for the organisation of external evaluation models around more targeted objectives. This does not imply that sustained quality improvement becomes a secondary goal but that the quest for excellence must build on a minimum platform
accessible to all.

There is a strong trend towards the development of mandatory programs of external evaluation of health care organisations in response to the need for accountability to the public and to their representatives the politicians and in response to the need for equity of access to safe care. As programs become mandatory, the objectives tend to become minimal standards applicable to most organisations that should take into account the organisation's and the country economic and cultural situation to avoid a strong pressure to violation leading to a paper policy and virtual safety.

This same trend leads to the development of programs which aim increasingly at national coverage and at the improvement of patient safety throughout a health system. A national approach has the added advantage of representing an opportunity for coordination of external evaluation activities to increase efficiency and decrease work load.

This implies the integration of specific strategies to identify and embed safe and well-evidenced professional practices such as national patient safety goals, required organisational practices, patient safety solutions and evidence-based bundles of care applicable to high risk situations.

Recommendations:

• External evaluation programs should integrate specific strategies to identify and embed patient safety objectives and well evidenced professional practices



• Standards should take into account the HCO's or the country's economic and cultural situation to avoid a strong pressure to violation leading to a paper policy and virtual safety



• There are advantages to a national approach to external evaluation including an improvement strategy for patient safety applicable throughout the health care system and a response to a strong demand for coordination of external evaluation activities to increase efficiency and diminish workload

2. Assessment of dynamic interfaces, resiliency and patient safety culture

There has been a change in focus in terms of targets for external evaluation of safety. From the physical safety of goods and individuals, to a focus on clinical standards and clinical governance, to the assessment of dynamic interfaces at all steps of the care pathway within the hospital and within shared care networks involving professionals and patients and, finally, concentrating on a systemic global approach associating commitment by top management, a proactive approach to risk and an emphasis on the responsibility of actors, on resilience strategies, on an open patient safety culture and on effective competence maintenance and development activities.

There is mounting evidence that leadership and mobilisation are key to implementation of safe practices and to the creation of an open and proactive safety culture. The external evaluation of dynamic interfaces, patient participation, safety culture and commitment of management and leadership are new frontiers in terms of external evaluation models that should be further researched.

External evaluation programs should be considered learning systems at the health care organisation level. Self-assessment will contribute to this objective leading to a global diagnosis, and to the identification of opportunities for improvement. Furthermore, the implementation of corrective actions prior to the survey will demonstrate to the external evaluation organisation the capacity of the hospital to effectively improve.

Recommendations:

• Methods should be developed to better assess recent trends such as dynamic interfaces, patient involvement, resiliency, safety culture and leadership



• External evaluation programs should be considered learning systems at the health care organisation level. Self-assessment will contribute to this objective.



• These programs do not assess the competence of individual professionals directly but may ask hospitals to demonstrate that they have effective competence maintenance and development activities, notably in the field of patient safety

3. Measurements are essential to any improvement strategy

Indicators should focus on different aspects of safe care that are easy to compare and standardise. Indicators for outcomes, processes, structure and context are available and will help to create a composite image of patient safety.

See the report of Work Package 4 on safety indicators

4. The external assessment process must be credible

The credibility of the external evaluation will depend on the strength of the three essential steps of these models.

* Safety objectives must be clear and follow the current trends of evolution in the field of patient safety. They must integrate the expectations and opinions of all stakeholders. They must be recognised as essential by the health care professionals.

* Credibility will depend on the methods to assess the achievement of the objectives. This raises the issues of reproducibility and competence of surveyors, of the ways to validate the objectivity of data through varied concrete approaches such as the patient tracer methodology, of audit frequency and of unscheduled surveys.

* Credibility will also depend on the quality of the decision process and on follow-up actions such targeted surveys relative to specific deficiencies. The publication of the results will contribute to the credibility of the process in the eyes of the professionals and patients.

Recommendations:

• Safety objectives must be consensual and clearly defined and should follow the current trends of evolution in the field of patient safety



• Surveyors should function as teams representing a mix of competences insuring a multifaceted approach, credibility, independence and consensus.



• It is essential that corrective actions be perceived as credible in regards to the risk detected in the organisation in order to build trust into the auditing program.



• The extent of publication of the results is debated:


~ The right to information of patients is recognised
~ Publication is a strong motivation to change
~ The information must be understandable to all stakeholders, including patients, and allow for national or regional comparison
~ The "accepted wisdom" amongst health professionals and health providers is that a safety culture is built in a "blame-free" setting and that publication may lead to the non disclosure and non correction of faults. However, feedback from patients suggests that more work is needed on agreeing an understanding of what these terms mean in practice and balancing the desire to encourage reporting with the ethical and professional requirement that patients or their families be fully informed of incidents affecting them
~ There must be a clear understanding by all of what is confidential and what can be published.

5. Towards strategies of European harmonisation

Recommendations:

• Make existing information available to member states on:
  
  ~ programs of external evaluation applicable to HCOs
  ~ on hospital quality based on the results of these programs



• Adopt common general goals and principles for external evaluation (on the model of those of the International Accreditation Program of ISQua) as well as a portfolio of common methods



• Incorporate into those principles European requirements on patient safety as they are being adopted



• Further harmonisation will be harder to achieve:




~ Common standards:



Easy: Physical standards
Relatively Easy: Clinical governance
Hard: Organisation and system approach

~ Monitoring of performance
~ Common processes of evaluation
~ Common logics of decision