Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine
The evolution of methodological approaches for evaluation of efficiency of different scientific institutions used in Ukraine is considered. The analysis of current regulatory acts and the methodological approach to state certification and evaluation of the activities of scientific institutions, whic...
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | article |
| Lenguaje: | EN UK |
| Publicado: |
State Statistics Service of Ukraine, the National Academy of Statistics, Accounting and Audit (NASAA), the National Academy for Public Administration (NAPA) under the President of Ukraine
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/aecbbfba149e48a283654cdd73639c35 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:aecbbfba149e48a283654cdd73639c35 |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:aecbbfba149e48a283654cdd73639c352021-11-08T07:54:38ZEvolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine2519-18532519-1861https://doaj.org/article/aecbbfba149e48a283654cdd73639c352021-06-01T00:00:00Zhttps://su-journal.com.ua/index.php/journal/article/view/328https://doaj.org/toc/2519-1853https://doaj.org/toc/2519-1861The evolution of methodological approaches for evaluation of efficiency of different scientific institutions used in Ukraine is considered. The analysis of current regulatory acts and the methodological approach to state certification and evaluation of the activities of scientific institutions, which has been used after gaining the independence, indicates their orientation on a system of quantitative parameters. Evaluation of the effectiveness of a scientific institution’s activities by a single indicator based on complex and ambiguously defined calculations does not meet international standards, which are implemented in the EU countries. In order to implement measures, mentioned in the Concept of Development of the National Academy of Sciences of Ukraine for 2014-2023, different approach to evaluation of activities of scientific institutions, was applied in the National Academy of Sciences of Ukraine (NASAU). The introduced Methodology for evaluating the effectiveness of scientific institutions of the National Academy of Sciences of Ukraine is based on the methods, principles and approaches to assessment, defined in the Leiden manifesto of the leading specialists on scientometrics. According to this methodology, procedure of assessment could not be reduced to the utilization of selected quantitative indicators only, despite their importance. In the NASAU, the adoption of evaluation results is carried out on the basis of a qualitative analysis, which covers various aspects of the activities of the institution and its divisions. It is executed by the independent experts, who are specialists in scientific areas of the institution’s activities and who have high reputation among their colleagues. The main differences between two approaches to the evaluation methods, which are used today in Ukraine to assess the activities of scientific institutions of the National Academy of Sciences of Ukraine, are considered. The results obtained are analyzed and compared. The positive aspects of evaluating scientific institutions of NASU through expert judgment are identified, and the problems that arise during the assessment procedure are assessed. As a conclusion, shift from determining the results of the activities of scientific institutions by calculating a single indicator provides an opportunity for experts to evaluate institutions as a whole and their divisions, taking into account the uniqueness and specific features, which depend on the scientific disciplines and research areas. This also opens the way to determine the development prospects and place of the research institutions in the national and international ‘scientific map’.І. A. ZhukovychI. Yu. YehorovState Statistics Service of Ukraine, the National Academy of Statistics, Accounting and Audit (NASAA), the National Academy for Public Administration (NAPA) under the President of Ukrainearticleresearch organization, evaluation methodology, evaluation criteria, peer review, comprehensive indicator, performance based research funding.StatisticsHA1-4737ENUKСтатистика України , Vol 92, Iss 2, Pp 4-15 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN UK |
| topic |
research organization, evaluation methodology, evaluation criteria, peer review, comprehensive indicator, performance based research funding. Statistics HA1-4737 |
| spellingShingle |
research organization, evaluation methodology, evaluation criteria, peer review, comprehensive indicator, performance based research funding. Statistics HA1-4737 І. A. Zhukovych I. Yu. Yehorov Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| description |
The evolution of methodological approaches for evaluation of efficiency of different scientific institutions used in Ukraine is considered. The analysis of current regulatory acts and the methodological approach to state certification and evaluation of the activities of scientific institutions, which has been used after gaining the independence, indicates their orientation on a system of quantitative parameters. Evaluation of the effectiveness of a scientific institution’s activities by a single indicator based on complex and ambiguously defined calculations does not meet international standards, which are implemented in the EU countries.
In order to implement measures, mentioned in the Concept of Development of the National Academy of Sciences of Ukraine for 2014-2023, different approach to evaluation of activities of scientific institutions, was applied in the National Academy of Sciences of Ukraine (NASAU).
The introduced Methodology for evaluating the effectiveness of scientific institutions of the National Academy of Sciences of Ukraine is based on the methods, principles and approaches to assessment, defined in the Leiden manifesto of the leading specialists on scientometrics. According to this methodology, procedure of assessment could not be reduced to the utilization of selected quantitative indicators only, despite their importance. In the NASAU, the adoption of evaluation results is carried out on the basis of a qualitative analysis, which covers various aspects of the activities of the institution and its divisions. It is executed by the independent experts, who are specialists in scientific areas of the institution’s activities and who have high reputation among their colleagues.
The main differences between two approaches to the evaluation methods, which are used today in Ukraine to assess the activities of scientific institutions of the National Academy of Sciences of Ukraine, are considered. The results obtained are analyzed and compared. The positive aspects of evaluating scientific institutions of NASU through expert judgment are identified, and the problems that arise during the assessment procedure are assessed.
As a conclusion, shift from determining the results of the activities of scientific institutions by calculating a single indicator provides an opportunity for experts to evaluate institutions as a whole and their divisions, taking into account the uniqueness and specific features, which depend on the scientific disciplines and research areas. This also opens the way to determine the development prospects and place of the research institutions in the national and international ‘scientific map’. |
| format |
article |
| author |
І. A. Zhukovych I. Yu. Yehorov |
| author_facet |
І. A. Zhukovych I. Yu. Yehorov |
| author_sort |
І. A. Zhukovych |
| title |
Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| title_short |
Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| title_full |
Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| title_fullStr |
Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| title_full_unstemmed |
Evolution of Methodological Approaches to Evaluating the Efficiency of the Activities of Research Organizations in Ukraine |
| title_sort |
evolution of methodological approaches to evaluating the efficiency of the activities of research organizations in ukraine |
| publisher |
State Statistics Service of Ukraine, the National Academy of Statistics, Accounting and Audit (NASAA), the National Academy for Public Administration (NAPA) under the President of Ukraine |
| publishDate |
2021 |
| url |
https://doaj.org/article/aecbbfba149e48a283654cdd73639c35 |
| work_keys_str_mv |
AT íazhukovych evolutionofmethodologicalapproachestoevaluatingtheefficiencyoftheactivitiesofresearchorganizationsinukraine AT iyuyehorov evolutionofmethodologicalapproachestoevaluatingtheefficiencyoftheactivitiesofresearchorganizationsinukraine |
| _version_ |
1718442843182202880 |