Abstract
Background: Use of laboratory evidence-based patient health care in Tanzania remains a complex problem, as with many other countries in sub-Saharan Africa. As at 2010, 39 African countries, including Tanzania, had no clinical laboratories that met the minimum requirements for international laboratory standards (International Organization for Standardization [ISO] 15189).
Objective: The aim of this article is to share experience from Bugando Medical Centre laboratory’s milestones in reaching ISO 15189 accreditation.
Methods: Mentors to address the laboratory management and technical requirements performed a gap analysis using the Southern African Development Community Accreditation system checklist. Several non-conformances were detected. System and technical procedures were developed, approved and communicated. Quality indicators were established to measure laboratory improvement and to identify issues which require immediate and preventive actions.
Results: The departments’ external quality assessment performance increased after ISO 15189 implementation (e.g. Parasitology from 45% to 100%, Molecular Biology from no records to 100%, Biochemistry 50% to 95%, Tuberculosis Microscopy 60% to 100%, and Microbiology from 48.1% to 100%). There was a reduction in complaints, from eight to two per week. Rejected samples were reduced from 7.2% to 1.2%. Turn-around time was not recorded before implementation but reached 92% (1644/1786) of the defined targets, and the proportion of contamination in blood cultures decreased from 16% to 4%.
Conclusion: Our experience suggests that the implementation of a quality management system is possible in resource-limited countries like Tanzania. Mentorship is necessary and should be done by professional laboratory mentors trained in quality management systems. Financial resources and motivated staff are key to achieving ISO 15189 accreditation.
Background
The use of laboratory evidence-based patient healthcare in Tanzania remains a complex problem, as in many other countries in sub-Saharan Africa.1 Clinicians often believe that laboratory tests are additional health costs, because diagnosis and treatment are often done using empirical clinical judgement. Laboratory results are perceived to be unreliable, especially when they are found to be discordant with clinical indications.2
It has been emphasised that healthcare professionals should make clinical decisions based on the best available evidence.3 Access to unreliable diagnostic services and misdiagnosis causes confusion during patient management, and can result in unnecessary expenditure and in some cases death.4 There are recent global calls to provide more resources for the diagnosis, treatment and prevention of infectious diseases affecting the African population. In contrast, clinicians, financial controllers and public policy makers in resource-limited settings may be unaware of the importance of a laboratory-proven diagnosis for appropriate disease management.4
There is sufficient evidence that laboratory services are essential for guiding patient care. However, their central role has been neglected in resource-limited countries for decades.5 Laboratory results should guide about 70% of clinical decisions and promote excellence in providing the best patient care. Provision of accurate and reliable laboratory test results is only possible if the laboratory meets a minimum standard that provides credibility of the reported test results.6
Until 2010 there were 380 laboratories which met international standards for quality in Africa.7 Tanzania, along with 38 of the 49 African countries assessed, had no clinical laboratories that met the minimum requirements for international quality standards to ensure reliability of reported patient results and competence of staff.7
The Maputo Declaration of 2008 pointed out that strengthening of laboratory systems requires collaboration between laboratories, governments and supporting partners.8 This collaboration can only be met by creating and implementing individual country plans and strategies which utilise the laboratory for diagnosis of diseases.9
Before the Maputo Declaration, the Ministry of Health Community Development, Gender, Elderly and Children, in collaboration with the Clinical & Laboratory Standards Institute (CLSI), and with support from the President’s Emergency Plan for AIDS Relief, had been working together to implement quality management systems (QMS) in five zonal referral hospital laboratories. Bugando Medical Centre Laboratory was among the five referral hospital laboratories.10,11
The aim of this article is to share experience from the Bugando Medical Centre laboratory’s journey to International Organization for Standardization (ISO) 15189 accreditation. The experience will inform most laboratories currently implementing QMS to refamiliarise themselves with the actual steps required before inviting assessors to assess laboratories and give recommendations for ISO accreditation.
Methodology
Ethical considerations
We used data from routine laboratory QMS operations. No patient information was used; thus there was no ethical review required for this article.
Gap analysis
The laboratory gap analysis was done for both management and technical areas of the laboratory to establish baseline data. The approach was to evaluate current laboratory practices and compare it with laboratory standards as stipulated by ISO. The gap analysis revealed numerous non-conformances after comparing actual performance with the standard. The gaps identified included lack of knowledge about the laboratory standard, insufficient technical skills among staff and the use of unverified technical methods. Other gaps were: absence of established policies and technical procedures, samples tested by staff who were deemed incompetent, and lack of staff training and supervision to carry out a test (see Box 1).
BOX 1: List of gaps that were identified during the gap analysis. |
Implementation of the quality management system
Implementation of the QMS started with management: the hospital management appointed the Laboratory Director, Laboratory Manager and Quality Manager, whereafter the Laboratory Manager appointed section heads to form the laboratory management team as recommended by ISO. The laboratory organisational structure was set primarily to create lines of authority, reporting and communication, and to avoid overlapping of tasks during the QMS implementation process. The Laboratory Manager and Quality Manager attended several QMS training sessions which were organised by the Ministry of Health Community Development, Gender, Elderly and Children in collaboration with CLSI. These trainings were followed by awareness meetings that involved hospital management to make sure that they understood the processes and to ensure the availability of the resources required to enable the QMS implementation process. Hospital management became supportive after gaining a clear understanding of the advantages that a proper and functional QMS offers to both patients and the hospital itself.
Laboratory mentorship and document development
A laboratory mentor and an advisor were identified to guide laboratory management during the development of laboratory policies and procedures. The mentor was an employee of CLSI, the organisation that was supporting the system implementation. He was a laboratory professional who had a Master’s degree in business administration, and was trained in QMS mentorship and laboratory audits. The advisor was a biomedical laboratory scientist with a Master’s degree in public health and infectious disease. Available laboratory policies and procedures were formalised; those from outside the laboratory were adapted and contextualised to the laboratory setting to form the laboratory manual. The established policy manual formed the basis of other procedures, including the laboratory’s QMS procedures. The laboratory system procedures (Box 2) were developed to cover all quality system essentials, as directed by ISO,12 while documentation of technical procedures provided standardisation of all laboratory tests. Developed documents were approved by the Laboratory Director and communicated to all laboratory staff.
BOX 2: Laboratory quality management procedures. |
Apart from implementation of laboratory quality essentials (all processes in the laboratory workflow that provide the building blocks of quality, e.g. document control),13 the laboratory prioritised four components, which included staff training and competency, methods validation and verification, practising internal quality control in each testing procedure performed within the laboratory, as well as enrolment in external quality control programme schemes. Laboratory management established quality indicators to measure the laboratory’s improvement and to identify corrective and preventive actions.
Staff training and competency assessment
The laboratory developed a procedure to guide management in conducting training and assessing staff competencies. During the policies training session, the Quality Officer would first address the clause within ISO, then would make sure it had been properly interpreted among laboratory staff and adequately documented within the laboratory policy manual. System procedures were introduced to explain step-by-step approaches to ensure implementation among laboratory staff. Quality management system forms were designed to provide evidence of implementation of procedures, as documented in the laboratory policy manual.
Training sessions were concluded with ‘quizzes’ to check understanding of the discussed procedures. Staff that scored below 80% on the quizzes given after training were retrained and reassessed for competencies. The responsibility for training on technical procedures was assigned to heads of sections, who provided step-by-step guidance on technical procedures. Before staff were allowed to carry out a test, they were assessed by testing known samples, internal controls and external quality assessment materials for reproducibility of results, as well as being checked for all related activities for the respective procedures before being deemed competent. Staff competence procedures also included examination related to scores of 80% on tests. Heads of sections and the Laboratory Manager declared staff to be competent and any deviation of the expected requirements prompted retraining. The Quality Officer took responsibility for adequate implementation and filing of competence forms in personnel files.
Method validation and verification
The laboratory developed procedures to guide staff on how to validate or verify technical methods; the procedures clearly clarified the difference between verification and validation. Verification was defined as processes that are carried out to prove that the method can provide intended use only when capability data are available; it referred to standard methods used without modification. Validation14 was defined as processes that are carried out to prove that the method is fit for the laboratory intended use when no capability data are available; it referred to non-standard laboratory designed methods, which are subjected to subsequent modification. Therefore for validation, the laboratory has to set criteria to accept or reject the test method.
Qualitative tests
Samples from previously reported results were used to verify methods. Samples were selected randomly (diseased and non-diseased samples) and assigned, in a blinded study, to two different staff members (verifier 1 and verifier 2) deemed competent to carry out the test under verification. Staff carrying out the test were not aware of the results and were supervised, to avoid sharing of results. They were subjected to a similar testing set-up and provided with the method to conduct samples testing. The results produced were again compared to the expected results, also the sensitivity and specificity of the test methods were calculated. The verification results which met the set criteria or manufacturer claims provided sufficient evidence to prove the suitability of the test methods. The verification results which did not meet the criteria demonstrated unfitness of the method for testing of patients.
Validation or verification of quantitative tests
Accuracy, precision and linearity were determined for individual test methods. Manufactured quality control material was used during the validation or verification process, and control samples were analysed in duplicate three times a day for five days. Precision was calculated to determine coefficient of variation (%), and accuracy was determined to obtain ranges at 95% confidence. The ranges calculated were compared to that of the manufacturer. Linearity was performed by doing serial dilutions on control samples; the diluted samples were tested using the method under verification process, and the results obtained were analysed to obtain the linear line, which was then compared to that of the manufacturer. The laboratory management agreed that the method was fit for testing patients if an acceptable linear line could be visualised after analysis.
Internal and external quality assessments
The laboratory, with assistance from funding provided by the President’s Emergency Plan for AIDS Relief, procured internal quality control samples and enrolled in external quality assessment (EQA) schemes. Internal quality controls were performed as documented in the established internal quality control procedure. Laboratory staff were trained to evaluate the results of internal controls before they report a patient’s results. The laboratory received EQA samples from Thistle (South Africa), One World Accuracy (Canada), the National Quality Assessment Scheme (United Kingdom), the National Health Laboratory Quality Assurance & Training Centre (Tanzania) and the United States Centers for Disease Control and Prevention (United States).15 Samples were received and processed within the deadline, and results from EQA providers were reviewed to identify opportunities for improvement. EQA scores were set to be 80%; when this score was not achieved, it was documented as a non-conformance event, which required root cause analysis and implementation of an identified corrective action.
Quality indicators
Quality indicators were defined as any measure of the system whereby data collected in a specified period are analysed to determine the improvement of the established system.16 Examples of quality indicators which were established to measure laboratory improvement included: external quality assurance performance; number of customer complaints; sample turn-around time; number of rejected samples; equipment downtime; and blood culture sample contamination rate. The laboratory set targets were: (1) EQA performance above 80%, (2) five customer complaints per week, and (3) 90% of samples received to be tested and reported on within the established turn-around time. Turn-around time was defined as time taken from receiving a sample in the laboratory until dispatch of results to a patient. Neither rejected samples nor blood culture contamination should exceed 3% of the total samples received. Quality indicators were reviewed by section members, chaired by the heads of sections and the Quality Officer, and then in quarterly intervals by the quality assurance committee. Deviations from set targets prompted improvement actions.
Results
External quality assessment (percentage score) for the Parasitology section increased from 45% before implementation of ISO to 100% after implementation, the Biochemistry section performance increased from 50% to 95%, the Molecular biology section performance increased from no record to 100%, the Tuberculosis Microscopy section increased from 60% to 100%, and the Microbiology section increased from 48.1% to 100% (Table 1). The number of complaints decreased from eight to two complaints per week. Rejected samples decreased from 7.2% (18/250) to 1.2% (3/240). The overall turn-around time performance was not recorded before implementation, but reached 92% (1644/1786) of the defined targets, and contamination of blood culture samples decreased from 16% (25/160) to 4% (5/116).
TABLE 1: Quality indicators before and after implementation of ISO 15189, Bugando Medical Centre Clinical Laboratory, Tanzania. |
The gap analysis was conducted on 23 January 2012, the implementation started immediately to address the gaps obtained and accreditation was awarded on 26 March 2014. After QMS implemented laboratory quality improvement activities and monitoring of indicators were possible as displayed in Figures 1–3.
|
FIGURE 1: Parasitology turn-around times from January to December 2016. Gap analyses were conducted in January 2012, and implementation of laboratory quality improvement activities started immediately to address the gaps. Accreditation was awarded in March 2014 and indicators have been monitored since. |
|
|
FIGURE 2: Chemistry sample rejection from January to December 2016. |
|
|
FIGURE 3: Microbiology external quality assessment January–December 2016. |
|
Accreditation
After 24 months of intensive work, including mentoring activities, the laboratory was ISO 15189 accredited under a Southern African Development Community Accreditation Services/South African National Accreditation System (SADCAS/SANAS)17 partnership, with registration number MD002. Tests in five sections were accredited, including Microbiology, Parasitology, Molecular Biology, Biochemistry and Tuberculosis Microscopy. The laboratory witnessed visible advantages of implementing QMS. For example, work done being appreciated by customers, passing EQAs, decreased turn-around times and fewer complaints (Table 1), through monthly monitoring and review of established quality improvement indicators.
Discussion
Implementation of ISO 15189-based QMS in a routine clinical laboratory at the tertiary hospital, Bugando Medical Centre, was successful in preparing the laboratory for accreditation after 24 months of intense effort. The initial anxiety of staff was counteracted by supportive visits by the Ministry of Health and mentors and constructive advice. The newly-established heads of sections, Quality Officer, Laboratory Manager, Laboratory Director and top hospital management were informed to support the programme. However, the implementation procedures required close follow-up of staff to ensure adherence to the established system, which was not always easy. The laboratory management realised that implementation of QMS also provided regular objective assessment through internal and external audits, ensuring continous improvement in operations. Regular mentorship and a Quality Officer with strong leadership skills transformed the laboratory into a quality-driven organisation. A customer survey, conducted to measure what clinicians were saying about the laboratory services, revealed that clinicians of the hospital were able to trust and make clinical decisions supported by laboratory results.10 This was also observed in Botswana, where laboratories with mentorship, support from hospital management and ‘strong lab staff camaraderie’ supported the implementation process.18
Similar findings were observed in laboratories in Zimbabwe and Kenya, where mentorship played an important role in the successful implementation of the ISO standard.19,20 The laboratory experienced a marked increase of intrinsic motivation during the presence of external CLSI mentors, and the team started to demonstrate a high level of commitment, working beyond official hours without any financial expectations. Following successful accreditation, the Quality Officer observed a sudden decline in commitment of the team, as described in the life cycle of an organisation.21 Staff relaxed after their initial hard work, and the Laboratory Manager and Quality Officer were challenged to ensure timely intervention to avoid losing the achieved goals. The laboratory management ensured translation of the achieved goals into daily laboratory operations with its advantages to patient care. There may be a time where a short-term mentor must come in again, as was done in Zimbabwe, when trying to identify an optimal model for mentorship.22
Our observations are similar to that reported by a tuberculosis laboratory in Kisumu, Kenya, where culture contamination rate decreased from 15.4% to 5.3% compared to the reduction from 16% to 4% observed in our laboratory before and after implementation of the QMS. The only difference is that the laboratory in Kenya was implementing the standard in a tuberculosis laboratory and was on the implementation process, thus was not accredited as yet.23,24 Similar results were achieved by the Strengthening Laboratory Management Towards Accreditation programme in 47 African countries, where the programme is implementing its activities. It was observed in five years of operation that the Strengthening Laboratory Management Towards Accreditation approach formed a unique capacity to assist laboratories to make progress in improving quality of services as a way to achieve accreditation. However, our implementation of similar activities took 24 months of intensive work.17,25
Conclusions
Our experience suggests that implementation of a QMS is possible in resource-limited countries like Tanzania, if adequately supported with human and financial resources. To achieve this level of standard requires trained and well-motivated laboratory staff to implement the system. Mentorship is necessary and should be done by laboratory professionals trained in QMS, who have implemented the system. Financial resources and motivated staff are key to achieving ISO accreditation.
Acknowledgements
Competing interests
The authors declare that they have no financial or personal relationships which may have inappropriately influenced them in writing this article.
Sources of support
None.
Authors’ contributions
M.B., L.G.-A., C.K., K.J., B.M., H.S., S.E., C.M., D.M., M.M., W.M. and P.M. conceived the plan and structure of the laboratory quality management system in their respective departments and collected the data and indicators. M.B. and C.K. drafted the article, did the analysis and interpreted the data. All authors read and approved the final article.
References
- Niessen LW, Grijseels EW, Rutten FF. The evidence-based approach in health policy and health care delivery. Soc Sci Med. 2000;51(6):859–869. https://doi.org/10.1016/S0277-9536(00)00066-6
- Andiric LR, Massambu CG. Laboratory quality improvement in Tanzania. Am J Clin Pathol. 2015;143(4):566–572. https://doi.org/10.1309/AJCPAB4A6WWPYIEN
- Akobeng AK. Principles of evidence based medicine. Arch Dis Childhood. 2005;90(8):837–840. https://doi.org/10.1136/adc.2005.071761
- Petti CA, Polage CR, Quinn TC, Ronald AR, Sande MA. Laboratory medicine in Africa: A barrier to effective health care. Clin Infect Dis. 2006;42(3):377–382. https://doi.org/10.1086/499363
- Muula AS, Maseko FC. Medical laboratory services in Africa deserve more. Clin Infect Dis. 2006;42(10):1503. https://doi.org/10.1086/503678
- Guzel O, Guner EI. ISO 15189 Accreditation: Requirements for quality and competence of medical laboratories, experience of a laboratory I. Clin Biochem. 2009;42(4):274–278. https://doi.org/10.1016/j.clinbiochem.2008.09.011
- Schroeder LF, Amukele T. Medical laboratories in sub-Saharan Africa that meet international quality standards. Am J Clin Pathol. 2014;141(6):791–795. https://doi.org/10.1309/AJCPQ5KTKAGSSCFN
- Nkengasong JN, Nsubuga P, Nwanyanwu O, et al. Laboratory systems and services are critical in global health: Time to end the neglect? Am J Clin Pathol. 2010;134(3):368–373. https://doi.org/10.1309/AJCPMPSINQ9BRMU6
- Nkengasong JN, Mesele T, Orloff S, et al. Critical role of developing national strategic plans as a guide to strengthen laboratory health systems in resource-poor settings. Am J Clin Pathol. 2009;131(6):852–857. https://doi.org/10.1309/AJCPC51BLOBBPAKC
- Woodcock S, Fine G, McClure K, Unger B, Rizzo-Price P. The role of standards and training in preparing for accreditation. Am J Clin Pathol. 2010;134(3):388–392. https://doi.org/10.1309/AJCP03TFPBKEYYNT
- McClure K, Arbique J, Rendell A, Rizzo-Price P. CLSI: Building laboratory capacity in Africa. Clin Microbiol Newslett. 2009;31(13):95–99. https://doi.org/10.1016/j.clinmicnews.2009.06.001
- Gershy-Damet G-M, Rotz P, Cross D, et al. The World Health Organization African region laboratory accreditation process: Improving the quality of laboratory systems in the African region. Am J Clin Pathol. 2010;134(3):393–400. https://doi.org/10.1309/AJCPTUUC2V1WJQBM
- Soin SS. Total quality essentials: Using quality tools and systems to improve and manage your business. New York, NY: McGraw Hill Professional; 1999.
- Whiting P, Rutjes A, Dinnes J, et al. Development and validation of methods for assessing the quality of diagnostic accuracy studies. Health Technol Assess Winch Engl. 2004;8(25):iii, 1–234.
- Libeer J-C. Role of external quality assurance schemes in assessing and improving quality in medical laboratories. Clin Chim Acta. 2001;309(2):173–177. https://doi.org/10.1016/S0009-8981(01)00518-6
- Sciacovelli L, O’Kane M, Skaik YA, et al. Quality indicators in laboratory medicine: From theory to practice. Clin Chem Lab Med. 2011;49(5):835–844. https://doi.org/10.1515/CCLM.2011.128
- SADCAS. Accreditation process [homepage on the Internet]. N.d. [cited 2017 Sept 23]. Available from: http://www.sadcas.org/accreditation-process
- Mokobela K, Moatshe M, Modukanele M. Accelerating the spread of laboratory quality improvement efforts in Botswana. Afr J Lab Med. 2014;3(2):Art.# 207, 1–6.
- Ntshambiwa K, Ntabe-Jagwer W, Kefilwe C, Samuel F, Moyo S. Translating a National Laboratory Strategic Plan into action through SLMTA in a district hospital laboratory in Botswana: Original research. Afr J Lab Med. 2016;3(2):1–5.
- Makokha EP, Mwalili S, Basiye FL, et al. Using standard and institutional mentorship models to implement SLMTA in Kenya: Original research. Afr J Lab Med. 2016;3(2):1–8.
- Lester DL, Parnell JA, Carraher S. Organizational life cycle: A five-stage empirical scale. Int J Organ Anal. 2003;11(4):339–354. https://doi.org/10.1108/eb028979
- Nzombe P, Shumba E, Zimuto SN, et al. Maximising mentorship: Variations in laboratory mentorship models implemented in Zimbabwe: Original research. Afr J Lab Med. 2016;3(2):1–8.
- Musau S, McCarthy K, Okumu A, et al. Experience in implementing a quality management system in a tuberculosis laboratory, Kisumu, Kenya. Int J Tuberc Lung Dis. 2015;19(6):693–5. https://doi.org/10.5588/ijtld.14.0886
- Audu RA, Sylvester-Ikondu U, Onwuamah CK, et al. Experience of quality management system in a clinical laboratory in Nigeria: Lessons from the field. Afr J Lab Med. 2012;1(1):1–5.
- Yao K, Luman ET, Nkengasong JN, et al. The SLMTA programme: Transforming the laboratory landscape in developing countries: Lessons from the field. Afr J Lab Med. 2016;3(2):1–8.
|