ABCs of KMArtificial intelligenceFeatured StoriesKM & SDGs initiativeKM standards

The potential benefits of implementing the knowledge management and artificial intelligence ISO standards together

As part of World Standards Day celebrations this week, the International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Telecommunication Union (ITU) announced a joint effort to launch the 2025 International AI Standards Summit.

This initiative follows the adoption of the Global Digital Compact by world leaders in September, as part of the Pact for the Future. It is a direct response to a call to action by the United Nations (UN) to enhance artificial intelligence (AI) governance through international standards.

Given the emerging use of AI in knowledge management (KM), a tangible way that the global KM community can respond to the UN’s call for enhanced AI governance is through encouraging and facilitating adoption of the new ISO/IEC 42001:2023 Information technology—Artificial intelligence—Management system standard.

In a newly published paper1 in the journal Machine Learning and Knowledge Extraction, authors Natalia Khazieva, Alena Pauliková, and Henrieta Hrablik Chovanová propose that an effective way of doing this is through the joint implementation of the ISO/IEC 42001:2023 AI standard and ISO 30401:2018 Knowledge management systems—Requirements.

For their research, Khazieva, Pauliková, and Chovanovám carried out a literature review, an analysis of the application of the ISO/IEC 42001:2023 and ISO 30401:2018 management system standards, and interviews with European organisations. Because of the limitations of interviews as an objective research tool and the lack of global representativeness in a European research sample, only the literature review and standards analysis aspects of the research findings are discussed in this article.

Benefits of implementing an artificial intelligence management system (AIMS)

ISO/IEC 42001:2023 specifies the requirements and provides guidance for establishing, implementing, maintaining, and continually improving an AI management system (AIMS) within the context of an organisation.

Khazieva, Pauliková, and Chovanovám identify the main benefits of an AIMS as being:

  • framework for managing risk and opportunities
  • demonstration of responsible use of AI
  • traceability, transparency, and reliability
  • bridging information asymmetries between partners
  • increased level of trust and confidence among partners
  • cost savings and efficiency gains.

These benefits give effect to the UN’s call to action for enhanced artificial intelligence (AI) governance, with particular benefits addressing already identified serious issues with the use of AI. For example, the risk management, responsible use, transparency, reliability, and trust and confidence aspects of these benefits go to the heart of the serious “botshit” problems2 evident in the appalling horror cases of Australia’s robodebt scheme and the UK Post Office Horizon scandal. The ways in which an AIMS could rigorously address such issues include through the formal development and implementation of a risk management framework based on the AI Risk Repository3.

Synergies between an ISO/IEC 42001:2023 AIMS and ISO 30401:2018 KMS

ISO 30401:2018 includes the important Annex B, titled “Relation between Knowledge Management and Adjacent Disciplines.” This Annex highlights the relationships and synergy between the ISO 30401:2018 knowledge management system (KMS) and other management systems. As ISO 30401:2018 was released before ISO/IEC 42001:2023, Annex B of ISO 30401:2018 does not yet include the newly developed AI management system. However, Khazieva, Pauliková, and Chovanovám have extended the management systems in Annex B to include AI, as summarised in Figure 1.

Relationship between knowledge management and adjacent disciplines.
Figure 1. Relationship between knowledge management and adjacent disciplines. Source: Khazieva, Pauliková, &  Chovanovám, 2024, CC BY 4.0, inspired by Annex B of ISO 30401:2018.

Supporting this synergy, ISO/IEC 42001:2023 and ISO 30401:2018 both apply the same harmonised or consolidated structure developed to enhance alignment among management system standards (MSS), as shown in Figure 2. This consolidated structure includes identical clause numbers, clause titles, text, common terms, and core definitions. It means that organisations can much more readily and efficiently implement two or more MSS in an integrated way.

Consolidated structure of management system standards.
Figure 2. Consolidated structure of management system standards. Source: Khazieva, Pauliková, &  Chovanovám, 2024, CC BY 4.0.

Khazieva, Pauliková, and Chovanovám further suggest that there is also potential synergy with ISO 9001:2015 Quality management systems—Requirements. ISO 9001:2015 includes clause 7.1.6 Organisational knowledge, and as I’ve previously discussed, jointly implementing ISO 9001:2015 and ISO 30401:2018 can give effect to clause 7.1.6 of ISO 9001:2015.

Supporting this, Khazieva, Pauliková, and Chovanovám advise that the common characteristics of ISO 9001:2015 and ISO 30401:2018 are:

  • context of organisation, which means determination of interested parties and their requirements and establishment, implementation, maintenance, and continual improvement of the system, including needed processes and their interactions
  • leadership, which means the role and responsibilities of top management to support the process
  • planning, which means establishing objectives and how they can be reached
  • support, which means needed resources and capabilities, communication channels, creating and updating information, and documenting
  • performance evaluation, which means identifying points to monitor and evaluate, methods, and analysing the results
  • improvements, which mean continually improving the system’s suitability, adequacy, efficiency, and effectiveness.

KM problem prevention using ISO 30401:2018 together with ISO/IEC 42001:2023

From their literature review, Khazieva, Pauliková, and Chovanovám identify the most common problems experienced during implementation and deployment of a KMS as being:

  • Inconsistency of KM with general goals. The organisation should determine its general goals before developing any knowledge management system. This refers to making a profit and formulating clear, consistent, and reachable goals.
  • A lack of detailed planning and timing for the KM project and infrastructure. Organisations often do not indicate the deadlines, resources, working time distribution, and responsible people for implementing and running KM. An absence of special technical tools and software limits data collection and analysis.
  • Organisational mismatch. The organisation does not explain to its employees what it assumes from them regarding KM, nor when or how it correlates with their main duties and what is expected.
  • Lack of knowledge sharing. Sometimes, employees are unable or unwilling to share their knowledge. The main reasons for this are protecting their position and benefits within the organisation, distrust among employees, and an unfriendly environment as a whole.
  • Inefficient reward system. Participation in any KM is usually an additional task for employees, and employees believe that this performance should be appropriately appreciated.

Then, from their literature review and analysis of the synergies between an ISO/IEC 42001:2023 AIMS and ISO 30401:2018 KMS, they identify the following prevention suggestions for these problems:

Problem Prevention suggestions of ISO 30401:2018 with the support of ISO/IEC 42001:2023 (numbers in brackets are for identification of the clauses as well as the annexes of ISO 30401:2018 KMS and ISO/IEC 42001:2023 AIMS).
Inconsistency of KM with the general goals
  • The organisation should determine external and internal issues that are relevant to its purpose and that affect its ability to achieve the intended outcome(s)/result(s) (4.1 KMS and AIMS)
  • The organisation should establish objectives at relevant functions and levels. The objectives shall (a) be consistent with the policy; (b) take into account applicable requirements; (c) be measurable; (d) be monitored; (e) be communicated; and (f) be updated as appropriated (6.2 KMS and AIMS)
  • The organisation shall identify and document objectives to guide the responsible development systems, take those objectives into account, and integrate measures to achieve them in the development life cycle (Annex A, A6.1.2 and A9.3 AIMS)
  • The organisation should implement processes for the responsible design and development of systems (Annex B, B.6.1.and B.9.3 AIMS)
  • Potential AI-related organisational objectives and risk sources can be considered by the organisation when managing risks (Annex C, C.2 AIMS)
Lack of detailed planning and timing for KM project and infrastructure
  • When planning for the system, the organisation shall (a) give assurance that the system can achieve its intended outcome(s)/ result(s); (b) prevent or reduce undesired effects; and (c) achieve continual improvement (6.1 KMS and AIMS)
  • The organisation shall plan actions to address risks and opportunities to integrate and implement the actions into system processes and evaluate the effectiveness of these actions (6.1 KMS and AIMS)
Organisational mismatch
  • When planning how to achieve its objectives, the organisation shall determine (a) what will be done; (b) what resources will be required; (c) who will be responsible; (d) when it will be completed; and (e) how the results will be evaluated (6.2 KMS and AIMS)
  • The organisation shall identify and document objectives to guide the responsible use of systems (Annex A, A.9.3 and Annex B, B.9.3 AIMS)
  • Top management shall demonstrate leadership and commitment by (a) ensuring the policy objectives are established, compatible, and aligned with strategic direction; (b) ensuring the integration of the system requirements into the organisation’s business and project processes; (c) ensuring that resources are available; (d) communicating the importance of effective management and of conforming to the system requirements; (e) ensuring that the system achieves its intended outcome(s)/results; (f) promoting improvement; and (g) supporting other relevant management roles to demonstrate their leadership as it applies to their areas of responsibility (5.1 KMS and AIMS)
  • Top managers shall ensure that the responsibilities and authorities for relevant roles within the system are assigned and communicated within the organisation (5.3 KMS and AIMS)
  • Roles and responsibilities should be defined and allocated according to the organisation’s needs (Annex A, A.3.2 and Annex B, B.3.2 AIMS)
  • The organisation shall consider the competence level required for various types of workers (7.2 KMS and AIMS, Annex B, B.4.6 AIMS)
Lack of knowledge sharing
  • The organisation shall determine and provide the resources needed for the establishment, implementation, maintenance, measurement, and continual improvement of the system (7.1 KMS and AIMS, Annex A, A.4 and Annex B, B.4 AIMS)
  • The organisation shall (a) determine the necessary competence of person(s) doing work under its control that affects its performance; (b) ensure that these persons are competent based on appropriate education, training, or experience; (c) where applicable, take actions to acquire the necessary competence and evaluate the effectiveness of actions; and (d) retain appropriate information as evidence of competence (7.2 KMS and AIMS, Annex B, B.4.6 AIMS)
  • Documented information shall be controlled to ensure (a) its availability and suitability for use, where and when it is needed, and (b) it is adequately protected. To control the organisation, it shall address the distribution, access, retrieval, and use; (b) storage and preservation; (c) control of changes; and (d) retention and disposal. Documented information of external origin determined by the organisation to be necessary for the planning and operation of the system shall be identified, as appropriate, and controlled (7.5.3 KMS and AIMS)
Inefficient reward system
  • The organisation shall determine (a) what needs to be monitored and measured; (b) the methods for monitoring, measurement, analysis, and evaluation needed to ensure valid results; (c) when the monitoring and measuring shall be performed; and (d) when the results from monitoring and measurement shall be analysed and evaluated. The organisation shall evaluate the performance and the effectiveness of the system (9.1 KMS and AIMS)
  • Top management shall review the organisation’s system at planned intervals to ensure its continuing suitability, adequacy, and effectiveness. The management review shall consider (a) the status of actions from previous management reviews; (b) changes in external and internal issues that are relevant to the system; (c) information on the performance, including nonconformities and corrective actions, monitoring and measurement results, and audit results; (d) opportunity for improvement (9.3 KMS and AIMS); and (e) changes in needs and expectations of interested parties that are relevant to the AI management system (9.3 AIMS)

For an organisation seeking to implement these suggestions, Khazieva, Pauliková, and Chovanovám strongly emphasise the role of leadership and organisational culture in a KMS, as shown in Figure 3.

Content of the ISO 30401:2018 KMS standard,
Figure 3. Content of the ISO 30401:2018 KMS standard, Source:Khazieva, Pauliková, &  Chovanovám, 2024, CC BY 4.0.

They also stress the importance of:

  • Considering risks that may occur in ISO 30401:2018 KMS certification. These are the risk of low uptake, the risk of low-quality certification, the risk that organisations implement the KM standard symbolically rather than meaningfully, and the risk that the standard is not specific enough or too specific.
  • The use of an agile approach to continually retrain and refresh AI models is a must. AI systems must undergo rigorous and continuous monitoring and maintenance to continue performing as trained, meet the desired outcome, and solve the business challenges

Article source: © Khazieva, Pauliková,, & Chovanová, 2024, CC BY 4.0.

Header image source: fauxels on Pexels.

References:

  1. Khazieva, N., Pauliková, A., & Chovanová, H. H. (2024). Maximising Synergy: The Benefits of a Joint Implementation of Knowledge Management and Artificial Intelligence System Standards. Machine Learning and Knowledge Extraction, 6(4), 2282-2302.
  2. Hannigan, T. R., McCarthy, I. P., & Spicer, A. (2024). Beware of Botshit: How to Manage the Epistemic Risks of Generative Chatbots. Business Horizons.
  3. Slattery, P., Saeri, A. K., Grundy, E. A., Graham, J., Noetel, M., Uuk, R., … & Thompson, N. (2024). The AI Risk Repository: A Comprehensive Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence. arXiv preprint arXiv:2408.12622.
5/5 - (1 vote)

Bruce Boyes

Bruce Boyes (www.bruceboyes.info) is a knowledge management (KM), environmental management, and education professional with over 30 years of experience in Australia and China. His work has received high-level acclaim and been recognised through a number of significant awards. He is currently a PhD candidate in the Knowledge, Technology and Innovation Group at Wageningen University and Research, and holds a Master of Environmental Management with Distinction. He is also the editor, lead writer, and a director of the award-winning RealKM Magazine (www.realkm.com), and teaches in the Beijing Foreign Studies University (BFSU) Certified High-school Program (CHP).

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button