|
| |
|
|
Experiences with a bibliometric indicator for performance-based funding of research institutions in Norway
Sivertsen, Gunnar
In 2005, Norway implemented a performance based funding model for the Higher Education Sector with a weighted indicator based on complete data (in journals, series and books) for the scientific publication output at the level of institutions. A similar indicator was implemented in Denmark and Flanders (Belgium) in 2009 and is presently being developed in Finland for implementation in 2015. Norway has recently made all publicly funded research institutions outside the Higher Education Sector use the indicator as well. The data source for the indicator is a national Current Research Information System which is partially supported by import from other relevant sources, such as the ISI Web of Science. An evaluation of the indicator took place in Denmark in 2012. Another one will soon start up in Norway. I will describe how the indicator was designed and report from the experiences with it since 2005, partly by referring the main concerns, discussions and criticisms and partly by demonstrating trends empirically with bibliometrics.
Slides: idr-471_1 -  PDF
Video: idr-471_2 -  MP4
|
|
|
The Role of Scientometric Criteria in the Formation of Budget and Qualification Growth at Pavol Jozef Šafárik University in Košice, the Slovak Republic
Černák, Juraj
Pavol Jozef Šafárik University in Košice, according to the number of its students (approx. 8,700), belongs to the group of smaller-size public universities in Slovakia. The major part of its budget income (approx. two thirds) comes from a direct state subsidy. The subsidy amount is defined by the Methodology of the Ministry of Education, Science, Research and Sport of the Slovak Republic that is modified yearly. This Methodology uses various input data that are related to research activities of a university, the results of the last complex evaluation, the amount of financial resources obtained from home grant agencies and from abroad, as well as the publications of lecturers, research staff and students of a university, etc. The amount of publications as a scientometric criterion was for the first time used in 2005 and since then its proportional representation has risen substantially and it represents a strong motivational aspect for universities in Slovakia. The number of publications also plays important role in the qualification growth of P. J. Šafárik University lecturers and research staff. The specific requirements as to the categories and numbers of publications to be met by a candidate for the habilitation (associate professor status) and inauguration (full professor status) are defined by several legislative documents and are further specified by the documents approved by the Scientific Board of the University. The qualification growth of lecturers is also important for the University as it has its influence on the amount of the direct state subsidy. The presentation will focus on the importance of the publication activities as one of the scientific criterion relevant to the research and scientific activities of the University and the methods of publication registration by the Ministry and the University, their strengths and weaknesses will be discussed.
Slides: idr-470_2 - PDF
Video: idr-470_1 - MP4
|
|
|
Research assessment and institutional financing in Estonia: 20 years of experience
Saluveer, Madis
The Estonian R&D and higher education system have undergone profound changes over the last 20 years. The institutional reforms in 1990s, continuous evaluation of R&D activities at various levels, focus on high-quality research, and recent investments into the development of R&D infrastructure have increased the competitiveness of Estonian research and researchers internationally. The presentation will tackle the issues of types, scope and frequency of research evaluations in Estonia, use of “metrics” in research assessment as well as the impact of evaluation outcomes upon the research funding system.
Slides: idr-469_1 - PDF
Video: idr-469_2 - MP4
|
|
|
New rules of evaluation of scholarly journals and scholarly institutions in Poland
Fenrich, Wojciech
Recent amendments to laws on Polish science and higher education have resulted in changes in the system of evaluation of both research institutions and scholarly journals. The final result of the assessment will be a new categorization of academic units. As the majority of scientific institutions in Poland are publicly funded, new criteria will have significant impact on their financing. The next evaluation will be conducted in 2013 and will be supported by currently developed computer applications. The address will present the rules of evaluation of journals and research units in Poland and will iscuss the main allegations made against them.
Slides: idr-468_2 - PDF
Video: idr-468_1 - MP4
|
|
|
How to proceed in evaluating and financing science: International Audit recommendations
Moravcová, Jitka
British company Technopolis Group and their partners performed between 2010 and 2011 a deep and complex analysis of the Research, Development and Innovation System in the Czech Republic. The outputs of this analysis are exceptional documents drawn by an internationally recognized authority with extensive experience in the field of management, evaluation and financing of research and development that give us for the first time an independent view of our system. The audit results are a very good starting point for the update of strategic documents such as Research, Development and Innovation System Reform or Research, Development and Innovation National Policy that should lead to the visible improvement of the RDI system effectiveness and contribute to the improved competitiveness of the Czech Republic. All the documents are accessible to general public on the Ministry of Education, Youth and Sports web sites http://audit-vav.reformy-msmt.cz/. The paper will inform about the most important recommendations concerning RDI management, financing and evaluation on all levels.
Slides: idr-467_1 - PDF
Video: idr-467_2 - MP4
|
|
|
Institutional financing principles
Rákosník, Jiří
The system of funding research institutions from public resources in the Czech Republic has undergone a complicated development since 1990 and, particularly during the last decade, arrived at a very unsatisfactory state. The decision process about which organisations should receive institutional support for R&D, and at which level, lacks strategic information. It relies on mere mechanical recording of outputs, with the rules changing every year, and ad hoc measures must then compensate for serious flaws. One of the main goals of the Individual National Project “Effective Evaluation and Financing System for Research, Development and Innovation” is to propose mechanisms for effective public funding of research institutions based on a new evaluation system and emphasizing excellence, motivation and medium-term stability.
Slides: idr-466_2 - PDF
Video: idr-466_1 - MP4
|
|
|
Evaluation Principles: Effective evaluation and financing system for research, development and innovation
Münich, Daniel
The objective of Ipn project “Effective evaluation and financing system for research, development and innovation“) is to replace from 2015 the existing Methodology of evaluating the results achieved by research institutions with a more effective system of institutional evaluation based on the international quality standards. The new evaluation in the form of informed peer-review will reflect the Ipn Audit recommendations as well as Long Term Evaluation Principles adopted by RVVI (Research, Development and Innovations Council). The new system will combine quantitative and qualitative evaluation of outputs and contributions of the creative activity of research institutions with clear and future oriented indicators in order to facilitate evaluation of their development dynamics, evaluate their outputs from the point of view of their quality, relevance, impact and effectiveness while respecting the departmental and institutional differences. It should enable periodic evaluation of the performance of Czech Research, Development and Innovation system as a whole and of its individual components in comparison with the global standards. The evaluation results should facilitate strategic management on the level of public administration as well as on the level of individual institutions and their departments. The evaluation process should be resistant to nepotism and should be supported by high quality international expert evaluators and bibliometrical criteria.
Slides: idr-465_1 - PDF
Video: idr-465_2 - MP4
|
|
|
Effective System of Evaluation and Financing of Research, Development and Innovations Project: hopes and expectations
Hronová, Stanislava
Since 2004 the methodology of evaluating research and development results (later: methodology of evaluating results achieved by research institutions) applied in the Czech Republic has gone through many revisions which however have not changed the principles of what was devised as a not very suitable system. The deformations resulting from such evaluation became fully apparent when the results were directly linked to the distribution of funds provided for the long term development of a given organisation. In 2011 the Council for Research, Development and Innovation decided on the basis of discussions within expert community about the fate of evaluation methodology, negative effects it had on research institutions, partial outputs (at that time) of the RDI System International Audit in the Czech Republic to adopt the Long Term Principles of Evaluating the Research Institutions Results. These principles are the backbone of IPn Methodology Project that should provide the scientific community as well as the public administration with an instrument of evaluating research institutions and with the system of research and development in the Czech Republic respecting international standards and departmental differences, based on quantitative and qualitative criteria
Slides: idr-464_2 - PDF
Video: idr-464_1 - MP4
|
|
| |
guest ::
