Стратегии на образователната и научната политика

https://doi.org/10.53656/str2024-5s-25-cyc

2024/5s, стр. 255 - 262

RESEARCH AND APPLICATION OF THE PDCA CYCLE IN ARTIFICIAL INTELLIGENCE MANAGEMENT SYSTEMS

Tzvetelin Gueorguiev
OrcID: 0000-0002-2023-6032
E-mail: tzgeorgiev@uni-ruse.bg
University of Ruse “Angel Kanchev”
8, Studentska St.
7017 Ruse, Bulgaria

Резюме: The Plan – Do – Check – Act (PDCA) cycle is the basis of the process approach applied in ISO management system standards. The experience gained in working with management systems and summarized in the author’s monograph have been creatively adapted and applied in the analysis of the requirements of ISO/IEC 42001:2023 – the first standard for artificial intelligence management systems. This paper presents a method for determining the type of each requirement of the ISO/IEC 42001:2023 standard in relation to the PDCA cycle. The application of the PDCA cycle is demonstrated for selected processes and is used for creating process flowcharts. They can be based on the standards with requirements for quality, educational organizations, research and innovation centres, etc. Further on they can serve as the foundations for developing relevant documented procedures that comprise the artificial intelligence management system.

Ключови думи: PDCA cycle; artificial intelligence (AI); management systems (MS); ISO/IEC 42001:2023

1. Introduction

Modern management systems based on ISO standards (ISO 2024a) often follow an identical high-level structure, common terms and definitions, also known as Annex SL. In February 2024 a special communique has been published by the International Accreditation Forum (IAF) and the International Organization for Standardization (ISO). It is related to climate changes, and their effect on more than 30 international standards (IAF&ISO 2024). This change also affects Annex SL that has also been updated in the end of April 2024 (ISO 2024b). It is expected that this update will have an impact on more than 70 standards that use Annex SL as a basis onto which discipline or industry sector specific requirements are added.

All of the abovementioned standards apply the so called “Process Approach” to management. Invariably this is related to process management using the PDCA or Deming cycle. Aligned to this cycle, the four main management stages (types of process steps) are: planning (Plan), implementation (Do), verification (Check), and improvement (Act).

Specific examples how the PDCA cycle is applied at the system level of ISO management system standards, that are also accepted as Bulgarian standards, are:

– ISO 9001:2015 Quality management systems — Requirements (ISO 2015a);

– ISO 10014:2021 Quality management systems — Managing an organization for quality results — Guidance for realizing financial and economic benefits (ISO 2021a);

– ISO 10015:2019 Quality management — Guidelines for competence management and people development (ISO 2019a);

– ISO 14001:2015 Environmental management systems — Requirements with guidance for use (ISO 2015b);

– ISO 19011:2018 Guidelines for auditing management systems (ISO 2018a);

– ISO 21001:2018 Educational organizations — Management systems for educational organizations — Requirements with guidance for use (ISO 2018b);

– ISO 22163:2023 Railway applications — Railway quality management system — ISO 9001:2015 and specific requirements for application in the railway sector (ISO 2023);

– ISO 37002:2021 Whistleblowing management systems — Guidelines (ISO 2021b);

– ISO 45001:2018 Occupational health and safety management systems — Requirements with guidance for use (ISO 2018c);

– ISO 50001:2018 Energy management systems — Requirements with guidance for use (ISO 2018d);

– ISO 56002:2019 Innovation management — Innovation management system — Guidance (ISO 2019b), including the standard with requirements ISO/FDIS 56001:2024 that is expected to be published later in 2024;

– and many other standards for management systems.

The research hypothesis is whether such a well-known and widely applied management cycle like the PDCA can be also applied to the standard for AI management systems ISO/IEC 42001:2023 (ISO/IEC 2023).

This paper aims to answer this research question based on the requirements of the ISO/IEC 42001:2023 standard and the author’s rich experience that is summarized in his monograph devoted to the research and applications of the PDCA cycle in quality management systems (Gueorguiev 2023). The implementation of the PDCA cycle in public universities is recently discussed by (Do & Treve 2024). The way this leads to continuous quality improvement in higher education institutions is the focus of (Jha et al. 2024). Comprehending quality management in a strategic context is successfully justified by (Georgieva 2022), and (Atanasov & Ivanova 2022) present a framework for the evaluation of learning content. The focus on innovation supported by innovation and the human factor is substantiated in another recent research (Kalaydzhieva 2023).

2. Discussion

The research and application of the PDCA cycle in artificial intelligence (AI) management systems (MS) is developed and realized on two levels:

– the system level, and

– the process level based on the clauses in the structure of ISO/IEC 42001:2023.

The PDCA at the System Level

The structure of ISO/IEC 42001:2023 consists of: Foreword, Introduction, three more general clauses (1. Scope; 2. Normative references, and 3. Terms and definitions), seven clauses with requirements (see Table 1), two normative annexes (Annex А – Reference control objectives and controls, and Annex В – Implementation guidance for AI controls), as well as two informative annexes (Annex C – Potential AI-related organizational objectives and risk sources, and Annex D – Use of the AI management system across domains or sectors).

Regardless of the fact that the PDCA at system level is not explicitly expressed as a figure, similar to other ISO management system standards, the use of the structure of Annex SL significantly facilitates the process of identification of the steps Plan-Do-Chek-Act.

Table 1 presents the structure of the clauses having requirements (from Clause 4 to Clause 10), organized and aligned to the PDCA cycle.

Table 1

Clause of ISO/IEC 42001:2023Stage in thePDCACycle4. Context of the organization4.1. Understanding the organization and its context4.2. Understanding the needs and expectations of interested parties4.3. Determining the scope of theAI MS4.4. AIMSPlan(P)5. Leadership5.1. Leadership and commitment5.2. AIpolicy5.3. Roles, responsibilities and authoritiesPlan(P)6. Planning6.1.Actions to address risks and opportunities6.1.1. General6.1.2.AI risk assessment6.1.3.AI risk treatment6.1.4.AI system impact assessment6.2.AI goals and planning to achieve them6.3.Planning of changesPlan(P)
7. Support7.1. Resources7.2. Competence7.3. Awareness7.4. Communication7.5. Documented informationDo(D)8. Operations8.1. Operational planning and control8.2.AI risk assessment8.3.AI risk treatment8.4.AI system impact assessmentDo(D))9. Performance evaluation9.1. Monitoring, measurement, analysis and evaluation9.2. Internal audit9.3. Management reviewCheck(C)10. Improvement10.1. Continual improvement10.2. Nonconformity and corrective actionAct(A)

In general, one should first identify the core processes (type Do), namely Clause 8 Operations, and Clause 7 Support. Any process that sets the stage for the core processes is considered as type Plan, and what follows the core processes will correspond to type Act. The comparison of type Do with type Plan is considered type Check.

The PDCA cycle at the process level

In order to demystify the type of the ISO/IEC 42001:2023 requirements in relation to the PDCA cycle at the process level, it is necessary to carry out a meticulous and in-depth analysis of the text of each one of the clauses of the standard. The requirements in ISO/IEC 42001:2023 are formulated after the word “shall”. The number of individual requirements in each sentence depends on the number of the verbs contained in it. If words such as “to determine” and “to plan” are encountered in the text, this means that the requirement is of type “Plan”. If one reads the words “to carry out”, “to perform”, “to implement”, etc., then the type of the requirement is of type “Do”. If there is a comparison between what has been done and the criteria for it, for example, “to verify”, “to control”, “to validate”, “to audit” or “to monitor”, then the requirement is of type “Check”. The type of requirement is “Act” if the text contains words or phrases such as “to improve”, “to update”, “to make changes”, etc.

Figure 1 presents an overall flowchart for the process of allocating roles, responsibilities and authorities within the organization. It is based on the requirements of ISO/IEC 42001:2023. Nevertheless, the same flowchart can be applied to the processes with identical titles in the standards for quality (ISO 9001:2015), educational organizations (ISO 21001:2018), innovation management (ISO 56002:2019), etc. The specific responsibilities and authorities may differ, but the type and sequence of activities within the process remains unchanged.

Figure 1. A flowchart using the PDCA cycle for the process devoted to roles, responsibilities and authorities

Arguably the most important clause in respect to educational policies, strategies, and digital competencies is Clause 7.2. Figure 2 uses the same methodology applied for Clause 5.3 “Roles, responsibilities and authorities” and focuses on the process steps and PDCA cycle for competence management within an organization.

Similar flowcharts are developed by the author for all of the remaining AI MS processes. They can be used for developing documented procedures and work instructions for the AI MS, and can help in integrating its requirements with other management systems based on ISO standards. The University of Ruse has established, implemented and maintains a quality management system based on ISO 9001, and has developed additional elements and modules that allow integration with ISO 21001, ISO 56002, and ISO/IEC 42001.

Figure 2. A flowchart using the PDCA cycle for the process devoted to competence

3. Conclusions

The PDCA cycle is widely used in many management systems based on ISO standards. This paper proves that the PDCA cycle is also applicable to an AI management system developed in conformity with ISO/IEC 42001:2023 requirements.

In the context of educational and research organizations, the application of the PDCA cycle can significantly facilitate the integration of several management systems with requirements and guidance for quality (ISO 9001), educational organizations (ISO 21001), innovation management (ISO 56001 and ISO 56002), intellectual property management (ISO 56005), and AI (ISO/IEC 42001).

The continuation of this particular research uncovers new opportunities for continual improvement of the management system. This positive effect will be based on the scanning for best practices and the latest state-of-the-art in the field of technologies, including educational technologies, and enhancing digital competences of both students and university employees (professors and administrative staff).

Acknowledgments & Funding

This study is financed by the European Union – NextGenerationEU, through the National Recovery and Resilience Plan of the Republic of Bulgaria, project № BG-RRP-2.013-0001-C01.

REFERENCES

ATANASOV, V. & IVANOVA, A., 2022. A framework for evaluation of web-based learning content. International Journal on Information Technologies & Security, vol. 14, pp. 13 – 24, ISSN 1313-8251.

DO, D-T, TREVE, M., 2024. Developing the quality culture in public universities: a case study in Vietnam. International Journal of Management in Education, vol. 18, no. 3, pp. 198 – 213. DOI: 10.1504/ IJMIE.2024.138241.

GEORGIEVA, S. D., 2022. Strategies for Education Quality Management. Strategies for Policy in Science and Education-Strategii na Obrazovatelnata i Nauchnata Politika, vol. 30, no. 5. DOI: 10.53656/ str2022-5-4-str.

GUEORGUIEV, T., 2023. Research and Applications of the PDCA Cycle in Quality Management Systems. Monograph, Primax, Ruse, 185 p. ISBN 978-619-7726-14-5.

JHA, S.; KAUR, R. & SAKLANI, A., 2024. Impact of stakeholder involvement in continuous quality improvement in Indian higher education institutions. Evaluating Global Accreditation Standards for Higher Education, pp. 309 – 328. DOI: 10.4018/979-8-3693-1698-6. ch021.

KALAYDZHIEVA, V., 2023.The role of education and the human factor in innovation activity. Strategies for Policy in Science and EducationStrategii na Obrazovatelnata i Nauchnata Politika, vol. 31, no. 5. DOI: 10.53656/str2023-5-2-rol.

International Accreditation Forum [IAF] & International Organization for Standardization [ISO]. IAF/ISO Joint Communiqu on the addition of Climate Change considerations to Management Systems Standards. [Online]. Available at: https://www.iso.org/files/live/sites/ isoorg/files/standards/popular_standards/management_systems/ISOIAF%20Joint%20Communique%20Feb%202024.pdf [viewed 10 May 2024].

ISO (2024a). Management system standards [Online]. Available at: https:// www.iso.org/management-system-standards.html [viewed 10 May 2024].

ISO (2024b). Annex SL Guidance documents, [Online]. Available at: https://www.iso.org/committee/54996.html?t=-Duqtv8HDoUiDQTNCpLN0UhREpjaZ130Orwm4_WLY97n2yln9bslL_ OpNRJZCit&view=documents#section-isodocuments-top [viewed 10 May 2024].

ISO (2015a) ISO 9001:2015 Quality management systems – Requirements.

ISO (2015b) ISO 14001:2015 Environmental management systems.

ISO (2018a) ISO 19011:2018 Guidelines for auditing management systems.

ISO (2018b) ISO 21001:2018 Educational organizations – Management systems for educational organizations — Requirements with guidance for use.

ISO (2018c) ISO 45001:2018 Occupational health and safety management systems.

ISO (2018d) ISO 50001:2018 Energy management systems.

ISO (2019a) ISO 10015:2019 Quality management – Guidelines for competence management and people development.

ISO (2019b) ISO 56002:2019 Innovation management – Innovation management system.

ISO (2021a) ISO 10014:2021 Quality management systems – Managing an organization for quality results — Guidance for realizing financial and economic benefits, ISO.

ISO (2021b) ISO 37002:2021 Whistleblowing management systems — Guidelines, ISO.

ISO (2023) ISO 22163:2023 Railway applications — Railway quality management system — ISO 9001:2015 and specific requirements for application in the railway sector, ISO.

ISO / International Electrotechnical Commission [IEC] (2023) ISO/ IEC 42001:2023 Information technology – Artificial intelligence – Management system, ISO/IEC.

2025 година
Книжка 6
UNLOCKING THE POTENTIAL OF ESG AND AI IN HIGHER EDUCATION FINANCE: INSIGHTS FROM A STUDY ACROSS FIVE EUROPEAN COUNTRIES

Tina Vukasović, Rok Strašek, Liliya Terzieva;, Elenita Velikova, Justyna Tomala, Maria Urbaniec, Jarosław Pawlik, Michael Murg, Anita Maček

THE ROLE OF HIGHER EDUCATION FOR THE PROFESSIONAL REALIZATION OF STUDENTS – PROBLEMS AND PROSPECTS

Anny Atanasova, Viktoriya Kalaydzhieva, Radostina Yuleva-Chuchulayna, Kalina Durova-Angelova

Книжка 5
Книжка 4
ТРАНСФОРМАЦИИ НА ПАЗАРА НА ТРУДА И НУЖДАТА ОТ ОБРАЗОВАТЕЛНИ РЕФОРМИ

Ваня Иванова, Андрей Василев, Калоян Ганев, Ралица Симеонова-Ганева

Книжка 3
FORMING ENTREPRENEURIAL CULTURE THROUGH EDUCATION

Milena Filipova, Adriana Atanasova

Книжка 2s
THE STATE OF INCLUSION IN ADAPTED BASKETBALL

Stefka Djobova, Ivelina Kirilova

Книжка 2
MODEL OF PROFESSIONALLY DIRECTED TRAINING OF FUTURE ENGINEER-TEACHERS

Ivan Beloev, Valentina Vasileva, Іnna Savytska, Oksana Bulgakova, Lesia Zbaravska, Olha Chaikovska

DETERMINANTS AFFECTING ACADEMIC STAFF SATISFACTION WITH ONLINE LEARNING IN HIGHER MEDICAL EDUCATION

Miglena Tarnovska, ;, Rumyana Stoyanova, ;, Angelina Kirkova-Bogdanova;, Rositsa Dimova

Книжка 1s
AN INNOVATIVE MODEL FOR DEVELOPING DIGITAL COMPETENCES OF SOCIAL WORKERS

Lyudmila Vekova, Tanya Vazova, Penyo Georgiev, Ekaterina Uzhikanova-Kovacheva

Книжка 1
2024 година
Книжка 6s
DISRUPTIVE TECHNOLOGIES RISK MANAGEMENT

Miglena Molhova-Vladova, Ivaylo B. Ivanov

Книжка 6
AN INTEGRATIVE APPROACH TO ORGANIZING THE FORMATION OF STUDENTS’ COGNITIVE INDEPENDENCE IN CONDITIONS OF INTENSIFICATION OF LEARNING ACTIVITIES

Albina Volkotrubova, Aidai Kasymova, Zoriana Hbur, Antonina Kichuk, Svitlana Koshova, Svitlana Khodakivska

ИНОВАТИВЕН МОДЕЛ НА ПРОЕКТНО БАЗИРАНО ОБУЧЕНИЕ НА ГИМНАЗИАЛНИ УЧИТЕЛИ: ДОБРА ПРАКТИКА ОТ УниБИТ

Жоржета Назърска, Александър Каракачанов, Магдалена Гарванова, Нина Дебрюне

Книжка 5s
КОНЦЕПТУАЛНА РАМКА ЗА ИЗПОЛЗВАНЕ НА ИЗКУСТВЕНИЯ ИНТЕЛЕКТ ВЪВ ВИСШЕТО ОБРАЗОВАНИЕ

Акад. Христо Белоев, Валентина Войноховска, Ангел Смрикаров

ИЗСЛЕДВАНЕ ПРИЛОЖИМОСТТА НА БЛОКОВИ ВЕРИГИ ОТ ПЪРВО НИВО (L1) В СИСТЕМА ЗА ЕЛЕКТРОННО ОБУЧЕНИЕ

Андриан Минчев, Ваня Стойкова, Галя Шивачева, Доц Анелия Иванова

ПРЕДИЗВИКАТЕЛСТВА ПРИ ПРОМЯНА НА ПЛАТФОРМИ ЗА ДИСТАНЦИОННО ОБУЧЕНИЕ

Антон Недялков, Милена Кирова, Мирослава Бонева

APPLICATION OF ZSPACE TECHNOLOGY IN THE DISCIPLINES OF THE STEM CYCLE

Boyana Ivanova, Kamelia Shoilekova, Desislava Atanasova, Rumen Rusev

TEACHERS' ADAPTATION TO CHANGES IN AN INCREASINGLY COMPLEX WORLD THROUGH THE USE OF AI

Zhanat Nurbekova, Kanagat Baigusheva, Kalima Tuenbaeva, Bakyt Nurbekov, Tsvetomir Vassilev

АТОСЕКУНДНОТО ОБУЧЕНИЕ – МЕТАФОРА НА ДНЕШНОТО ОБРАЗОВАНИЕ

Юлия Дончева, Денис Асенов, Ангел Смрикаров, Цветомир Василев

Книжка 5
Книжка 4s
Книжка 4
MANAGERIAL ASPECTS OF COOPERATION AMONG HIGHER EDUCATION INSTITUTIONS AND THEIR STAKEHOLDERS

Olha Prokopenko, Svitlana Perova, Tokhir Rakhimov, Mykola Kunytskyi, Iryna Leshchenko

Книжка 3s
Книжка 3
Книжка 2
FORMATION OF PROFESSIONAL SKILLS OF AGRICULTURAL ENGINEERS DURING LABORATORY PRACTICE WHEN STUDYING FUNDAMENTAL SCIENCE

Ivan Beloev, Oksana Bulgakova, Oksana Zakhutska, Maria Bondar, Lesia Zbaravska

ИМИДЖ НА УНИВЕРСИТЕТА

Галя Христозова

Книжка 1s
COMPETITIVENESS AS A RESULT OF CREATIVITY AND INNOVATION

Nikolay Krushkov, Ralitza Zayakova-Krushkova

INTELLECTUAL PROPERTY AND SECURITY IN THE INTEGRATED CIRCUITS INDUSTRY

Ivan Nachev, Yuliana Tomova, Iskren Konstantinov, Marina Spasova

Книжка 1
PROBLEMS AND PERSPECTIVES FOR SOCIAL ENTREPRENEURSHIP IN HIGHER EDUCATION

Milena Filipova, Olha Prokopenko, Igor Matyushenko, Olena Khanova, Olga Shirobokova, Ardian Durmishi

2023 година
Книжка 6s
DEVELOPMENT OF A COMMON INFORMATION SYSTEM TO CREATE A DIGITAL CAREER CENTER TOGETHER WITH PARTNER HIGHER SCHOOLS

Yordanka Angelova, Rossen Radonov, Vasil Kuzmov, Stela Zhorzh Derelieva-Konstantinova

DRAFTING A DIGITAL TRANSFORMATION STRATEGY FOR PROJECT MANAGEMENT SECTOR – EMPIRICAL STUDY ON UAE

Mounir el Khatib, Shikha al Ali, Ibrahim Alharam, Ali Alhajeri, Gabriela Peneva, Jordanka Angelova, Mahmoud Shanaa

VOYAGE OF LEARNING: CRUISE SHIPS WEATHER ROUTING AND MARITIME EDUCATION

Svetlana Dimitrakieva, Dobrin Milev, Christiana Atanasova

СТРУКТУРНИ ПРОМЕНИ В ОБУЧЕНИЕТО НА МЕНИДЖЪРИ ЗА ИНДУСТРИЯ 5.0

Недко Минчев, Венета Христова, Иван Стоянов

RESEARCH OF THE INNOVATION CAPACITY OF AGRICULTURAL PRODUCERS

Siya Veleva, ; Margarita Mondeshka, Anka Tsvetanova

Книжка 6
Книжка 5s
ВИДОВЕ ТРАВМИ В ПАРАШУТИЗМА И ПРЕВЕНЦИЯТА ИМ

Капитан III ранг Георги Калинов

Книжка 5
Книжка 4s
DETERMINING THE DEGREE OF DIGITALIZATION OF A HIGHER EDUCATION INSTITUTION

Acad. Hristo Beloev, Angel Smrikarov, Valentina Voinohovska, Galina Ivanova

ОТ STEM КЪМ BEST: ДВА СТАНДАРТА, ЕДНА ЦЕЛ

Андрей Захариев, Стефан Симеонов, Таня Тодорова

Книжка 4
EFFECT OF RESILIENCE ON BURNOUT IN ONLINE LEARNING ENVIRONMENT

Radina Stoyanova, Sonya Karabeliova, Petya Pandurova, Nadezhda Zheckova, Kaloyan Mitev

Книжка 3s
INTELLIGENT ANIMAL HUSBANDRY: FARMER ATTITUDES AND A ROADMAP FOR IMPLEMENTATION

Dimitrios Petropoulos, Koutroubis Fotios, Petya Biolcheva, Evgeni Valchev

Книжка 3
STUDY OF THE DEVELOPMENT OF THE USE OF COMMUNICATIVE TECHNOLOGIES IN THE EDUCATIONAL PROCESS OF ENGINEERS TRAINING

Ivan Beloev, Valentina Vasileva, Sergii Bilan, Maria Bondar, Oksana Bulgakova, Lyubov Shymko

Книжка 2
РАЗПОЛОЖЕНИЕ НА ВИСШИТЕ УЧИЛИЩА В БЪЛГАРИЯ В КОНТЕКСТА НА ФОРМИРАНЕ НА ПАЗАРА НА ТРУДА

Цветелина Берберова-Вълчева, Камен Петров, Николай Цонков

Книжка 1
MODERNIZATION OF THE CONTENT OF THE LECTURE COURSE IN PHYSICS FOR TRAINING FUTURE AGRICULTURAL ENGINEERS

Ivan Beloev, Valentina Vasileva, Vasyl Shynkaruk, Oksana Bulgakova, Maria Bondar, Lesia Zbaravska, Sergii Slobodian

2022 година
Книжка 6
ORGANIZATION OF AN INCLUSIVE EDUCATIONAL ENVIRONMENT FOR THE STUDENTS WITH SPECIAL NEEDS

Halyna Bilavych, Nataliia Bakhmat, Tetyana Pantiuk, Mykola Pantiuk, Borys Savchuk

ДИГИТАЛИЗАЦИЯ НА ОБРАЗОВАНИЕТО В БЪЛГАРИЯ: СЪСТОЯНИЕ И ОБЩИ ТЕНДЕНЦИИ

Теодора Върбанова, Албена Вуцова, Николай Нетов

Книжка 5
ПРАВОТО НА ИЗБОР В ЖИВОТА НА ДЕЦАТА В РЕПУБЛИКА БЪЛГАРИЯ

Сийка Чавдарова-Костова, Даниела Рачева, Екатерина Томова, Росица Симеонова

Книжка 4
DIAGNOSIS AS A TOOL FOR MONITORING THE EFFECTIVENESS OF ADDICTION PREVENTION IN ADOLESCENTS

O.A. Selivanova, N.V. Bystrova, I.I. Derecha, T.S. Mamontova, O.V. Panfilova

Книжка 3
ПУБЛИЧНОТО РАЗБИРАНЕ НА НАУКАТА В МРЕЖОВИЯ СВЯТ

Светломир Здравков, Мартин Й. Иванов, Петя Климентова

Книжка 2
Книжка 1
ДИГИТАЛНАТА ИНТЕРАКЦИЯ ПРЕПОДАВАТЕЛ – СТУДЕНТ В ОНЛАЙН ОБУЧЕНИЕТО В МЕДИЦИНСКИТЕ УНИВЕРСИТЕТИ

Миглена Търновска, Румяна Стоянова, Боряна Парашкевова, Юлияна Маринова

2021 година
Книжка 6
Книжка 5
Книжка 4s
SIGNAL FOR HELP

Ina Vladova, Milena Kuleva

Книжка 4
PREMISES FOR A MULTICULTURAL APPROACH TO EDUCATION

Anzhelina Koriakina, Lyudmila Amanbaeva

Книжка 3
Книжка 2
ПЪРВА СЕДМИЦА ДИСТАНЦИОННО ОБУЧЕНИЕ В СУ „ИВАН ВАЗОВ“ В СТАРА ЗАГОРА

Тони Чехларова, Динко Цвятков, Неда Чехларова

Книжка 1
METHODOLOGY OF SAFETY AND QUALITY OF LIFE ON THE BASIS OF NOOSPHERIC EDUCATION SYSTEM FORMATION

Nataliia Bakhmat, Nataliia Ridei, Nataliia Tytova, Vladyslava Liubarets, Oksana Katsero

2020 година
Книжка 6
HIGHER EDUCATION AS A PUBLIC GOOD

Yulia Nedelcheva, Miroslav Nedelchev

Книжка 5
НАСЪРЧАВАНЕ НА СЪТРУДНИЧЕСТВОТО МЕЖДУ ВИСШИТЕ УЧИЛИЩА И БИЗНЕСА

Добринка Стоянова, Блага Маджурова, Гергана Димитрова, Стефан Райчев

Книжка 4
THE STRATEGY OF HUMAN RIGHTS STUDY IN EDUCATION

Anush Balian, Nataliya Seysebayeva, Natalia Efremova, Liliia Danylchenko

Книжка 3
Книжка 2
МИГРАЦИЯ И МИГРАЦИОННИ ПРОЦЕСИ

Веселина Р. Иванова

SOCIAL STATUS OF DISABLED PEOPLE IN RUSSIA

Elena G. Pankova, Tatiana V. Soloveva, Dinara A. Bistyaykina, Olga M. Lizina

Книжка 1
ETHNIC UPBRINGING AS A PART OF THE ETHNIC CULTURE

Sholpankulova Gulnar Kenesbekovna

2019 година
Книжка 6
EMOTIONAL COMPETENCE OF THE SOCIAL TEACHER

Kadisha K. Shalgynbayeva, Ulbosin Zh.Tuyakova

Книжка 5
Книжка 4
Книжка 3
УЧИЛИЩЕТО НА БЪДЕЩЕТО

Наталия Витанова

Книжка 2
Книжка 1
POST-GRADUATE QUALIFICATION OF TEACHERS IN INTERCULTURAL EDUCATIONAL ENVIRONMENT

Irina Koleva, Veselin Tepavicharov, Violeta Kotseva, Kremena Yordanova

ДЕЦАТА В КОНСТИТУЦИОННИТЕ НОРМИ НА БЪЛГАРИЯ

Румен Василев, Весела Марева

СЪСТОЯНИЕ НА БЪЛГАРСКОТО ОБРАЗОВАНИЕ

Анелия Любенова, Любомир Любенов

ЕДИН НОВ УЧЕБНИК

Ирина Колева

2018 година
Книжка 6
Книжка 5
A NEW AWARD FOR PROFESSOR MAIRA KABAKOVA

Irina Koleva, Editor-in-

Книжка 4
Книжка 3
BLENDED EDUCATION IN HIGHER SCHOOLS: NEW NETWORKS AND MEDIATORS

Nikolay Tsankov, Veska Gyuviyska, Milena Levunlieva

ВЗАИМОВРЪЗКАТА МЕЖДУ СПОРТА И ПРАВОТО

Ивайло Прокопов, Елица Стоянова

ХИМЕРНИТЕ ГРУПИ В УЧИЛИЩЕ

Яна Рашева-Мерджанова

Книжка 2
Книжка 1
2017 година
Книжка 6
ЗНАЧИМОСТТА НА УЧЕНЕТО: АНАЛИЗ НА ВРЪЗКИТЕ МЕЖДУ ГЛЕДНИТЕ ТОЧКИ НА УЧЕНИЦИ, РОДИТЕЛИ И УЧИТЕЛИ

Илиана Мирчева, Елена Джамбазова, Снежана Радева, Деян Велковски

Книжка 5
ОРГАНИЗАЦИОННА КУЛТУРА В УЧИЛИЩЕ

Ивайло Старибратов, Лилия Бабакова

Книжка 4
КОУЧИНГ. ОБРАЗОВАТЕЛЕН КОУЧИНГ

Наталия Витанова, Нели Митева

Книжка 3
Книжка 2
Книжка 1
ЕМПАТИЯ И РЕФЛЕКСИЯ

Нели Кънева, Кристиана Булдеева

2016 година
Книжка 6
Книжка 5
Книжка 4
Книжка 3
Книжка 2
Книжка 1
2015 година
Книжка 6
Книжка 5
Книжка 4
ПРАГМАТИЧНАТА ДИДАКТИКА

Николай Колишев

Книжка 3
Книжка 2
Книжка 1
2014 година
Книжка 6
Книжка 5
КОХЕРЕНТНОСТ НА ПОЛИТИКИ

Албена Вуцова, Лиляна Павлова

Книжка 4
USING THE RESULTS OF A NATIONAL ASSESSMENT OF EDUCATIONAL ACHIEVEMENT

Thomas Kellaghan, Vincent Greaney, T. Scott Murray

Книжка 3
USING THE RESULTS OF A NATIONAL ASSESSMENT OF EDUCATIONAL ACHIEVEMENT

Thomas Kellaghan, Vincent Greaney, T. Scott Murray

Книжка 2
PROFESSIONAL DEVELOPMENT OF UNIVERSITY FACULTY: А SOCIOLOGICAL ANALYSIS

Gulnar Toltaevna Balakayeva, Alken Shugaybekovich Tokmagambetov, Sapar Imangalievich Ospanov

USING THE RESULTS OF A NATIONAL ASSESSMENT OF EDUCATIONAL ACHIEVEMENT

Thomas Kellaghan, Vincent Greaney, T. Scott Murray

Книжка 1
РЕФЛЕКСИЯТА В ИНТЕГРАТИВНОТО ПОЛЕ НА МЕТОДИКАТА НА ОБУЧЕНИЕТО ПО БИОЛОГИЯ

Иса Хаджиали, Наташа Цанова, Надежда Райчева, Снежана Томова

USING THE RESULTS OF A NATIONAL ASSESSMENT OF EDUCATIONAL ACHIEVEMENT

Thomas Kellaghan, Vincent Greaney, T. Scott Murray

2013 година
Книжка 6
Книжка 5
Книжка 4
QUESTIONNAIRE DEVELOPMENT

ÎÖÅÍßÂÀÍÅÒÎ

Книжка 3
MASS MEDIA CULTURE IN KAZAKHSTAN

Aktolkyn Kulsariyeva Yerkin Massanov Indira Alibayeva

РЪКОВОДСТВО ЗА СЪСТАВЯНЕ НА ТЕСТОВЕ*

Фернандо Картрайт, Джери Мусио

РОССИЙСКАЯ СИСТЕМА ОЦЕНКИ КАЧЕСТВА ОБРАЗОВАНИЯ: ГЛАВНЫЕ УРОКИ

В. Болотов / И. Вальдман / Г. Ковалёва / М. Пинская

Книжка 2
ОЦЕНЯВАНЕ НА ГРАЖДАНСКИТЕ КОМПЕТЕНТНОСТИ НА УЧЕНИЦИТЕ: ПРЕДИЗВИКАТЕЛСТВА И ВЪЗМОЖНОСТИ

Светла Петрова Център за контрол и оценка на качеството на училищното образование

РЪКОВОДСТВО ЗА СЪСТАВЯНЕ НА ТЕСТОВЕ*

Фернандо Картрайт, Джери Мусио

Книжка 1
Уважаеми читатели,

вет, както и от международния борд за предоставените статии и студии, за да могат да бъдат идентифицирани в полето на образованието пред широката аудитория от педа- гогически специалисти във всички степени на образователната ни система. Благодаря за техния всеотдаен и безвъзмезден труд да създават и популяризират мрежа от научни съобщества по профила на списанието и да насърчават научните изследвания. Благодаря на рецензентите от национално представените висши училища, на- учни институции и

РЪКОВОДСТВО ЗА СЪСТАВЯНЕ НА ТЕСТОВЕ

Фернандо Картрайт, Джери Мусио

2012 година
Книжка 6
DEVELOPMENT OF SCIENCE IN KAZAKHSTAN IN THE PERIOD OF INDEPENDENCE

Aigerim Mynbayeva Maira Kabakova Aliya Massalimova

Книжка 5
Книжка 4
Книжка 3
СИСТЕМАТА ЗА РАЗВИТИЕ НА АКАДЕМИЧНИЯ СЪСТАВ НА РУСЕНСКИЯ УНИВЕРСИТЕТ „АНГЕЛ КЪНЧЕВ“

Христо Белоев, Ангел Смрикаров, Орлин Петров, Анелия Иванова, Галина Иванова

Книжка 2
ПРОУЧВАНЕ НА РОДИТЕЛСКОТО УЧАСТИЕ В УЧИЛИЩНИЯ ЖИВОТ В БЪЛГАРИЯ

* Този материал е изготвен въз основа на резултатите от изследването „Parental Involvement in Life of School Matters“, проведено в България в рамките на проек- та „Advancing Educational Inclusion and Quality in South East Europe“, изпълняван

ВТОРИ ФОРУМ ЗА СТРАТЕГИИ В НАУКАТА

Тошка Борисова В края на 2011 г. в София се проведе второто издание на Форум за страте- гии в науката. Основната тема бе повишаване на международната видимост и разпознаваемост на българската наука. Форумът се организира от „Elsevier“ – водеща компания за разработване и предоставяне на научни, технически и медицински информационни продукти и услуги , с подкрепата на Министер- ството на образованието, младежта и науката. След успеха на първото издание на Форума за стратегии в науката през

Книжка 1
РЕЙТИНГИ, ИНДЕКСИ, ПАРИ

Боян Захариев