|
|
Experience with Using EIR for Research Evaluation
Mika, Pavel
This post introduces basic applications of electronic information resources for research evaluation in terms of bibliometrics, ie quantitative methods of data analysis. Current research information systems (CRIS) and commercial citation databases contain information useful for evaluating individual scientists, scientific institutions and organizations, but also the entire scientific disciplines or regions in the global comparison. Information obtained by the analysis of stored data – bibliographic records or citation relationships between them can say something about the evaluated unit rated in terms of numbers of scientific impact and partly quality (measured by citation rate) of various kinds of scientific results and their share in domestic or global production. The most interesting information can be provided by citation data. It is also possible to focus on research field or current topics by keywords analysis. We can get a view on international network of scientists by analyzing the author's cooperation.
|
|
|
An international comparison of the quality of academic publication output in the Czech Republic
Jurajda, Štěpán ; Kozubek, Stanislav ; Münich, Daniel ; Škoda, Samuel
In the recent study Jurajda a Münich (2015) we presented a field-by-field comparison of Czech research publication output. This comparison of the relative strength of output by research institutes in each field within the Czech Republic (CR), could not comment on which Czech institutes are working at international level, and which lag behind their foreign counterparts. It is possible, for example, that an institute that is not at the forefront of its field in the CR may nevertheless be performing research at a standard comparable with international competitors, because it is working in a field in which the Czech Republic is performing very high level research. In this study we offer a first step towards comparing the research output of Czech institutes on an international scale: we compare the publication output of each research field, overall, in the Czech Republic with its international equivalent. Our comparison is based on articles published between 2010 and 2014 which are included in the Web of Science (WoS) database. The comparison includes eleven small and medium sized countries, only one of which has English as its native language. Five of the countries are European countries previously within the Soviet bloc, four are Western European countries and two are non-European countries.
|
|
|
Czech research centres' publication performance in the period 2008-2012, by field of research
Jurajda, Štěpán ; Münich, Daniel
Three years ago, we were the first in the Czech Republic to offer, in IDEA study 3/2012, a comparison of research publication performance (not productivity) based on data about the results of research and development in the period 2006-2010 for the research fields whose ouputs are largely recorded in the Web of Science database run by Thomson Reuters (WoS). For each field of research, we showed which Czech centre has the most results published in journals with a high impact factor (IF). In this study, we bring that comparison up to date for the period 2008-2012. This type of comparison, which is based on the Information Register of R&D Results [Rejstřík informací o výsledcích] (RIV) collated by the government's Council for Research, Development and Innovation (RVVI), identifies the research centres with the most prolific output of excellent results in a given field in the Czech Republic. It also enables us to compare fields in terms of the concentration of their journal publication output in individual research centres, and to look at the relationship between "points-based" RIV assessment and excellence of results.
|
|
|
Altmetrics: An alternative route for evaluation of the impact of scientific articles
Szarzec, Jakub
Trends in measuring of the impact of research results does not change often. The number of citations is still a traditional way how to quantitative measure the impact of the articles on the scientific community. The presentation will be discussed how innovative Altmetrics tool that uses social networks. It will be offered a comparison between this instrument and the current situation. Do these methods affect the sharing of scientific information? Are social networks the right way for measuring the quality of scholarly publications?
Slides: idr-482_1 -  PDF
Video: idr-482_2 -  MP4
|
|
|
Where is the best research in the Czech Republic?
Jurajda, Štěpán ; Münich, Daniel
In the Czech Republic, a system of research and development (R&D) evaluation, which offers useful and adequate comparison of outputs across research workplaces and scientific fields, and which helps indentifying research excellence, remains missing. Therefore, there is a lack of information on where high-quality research is concentrated, which is necessary for efficient governance of the R&D system. Despite the Council for Research, Development and Innovation maintains a comprehensive database of R&D outputs, on the base of which an in-depth evaluation is clearly possible to perform in most scientific fields, the existing evaluations use this data far below its potential. To help in closing this gap, we used this database to conduct a relatively simple but comprehensive overview of R&D outputs of research organizations. The database allows us to derive a relatively objective criteria for the identification of workplaces with the highest concentration of excellent research outputs and at the same time reveal the amount of research published in scientific journals by scientific fields. The study has three main goals: i) To provide the academic community as well as the broader public with previously non-existent comparison of the extent of excellent scientific results in workplaces financed by public resources within scientific fields, (ii) To shed a light on the advantages, pitfalls and limitations of bibliometric analyses for the purposes of evaluation of research workplaces and scientific fields, and (iii) To draw attention to the serious flaws in the current evaluation mechanism which is central in the system of R&D governance in the Czech Republic.
|
|
|
Knowledge, Research & Education at University and in Industry
Vobecký, Jan
After twenty five years of experience in the research, education and industrial cooperation at the Czech Technical University in Prague, the author of this contribution left into the industry. Working in the field of research and technology development of the multinational high-tech company, he has received a complementary picture on the organization, methodology and control strategies governing the Knowledge, Research and Education (KRE) in the industry. With the personal experience from these two worlds, he will talk about contemporary approaches to the KRE at both the University and Industry. He will present state-of-the-art practices from Knowledge Management Control, planning, reviewing and efficiency metrics of Research, the application of Learning Management Systems, etc. Their brief discussion aims to answer the question: What can today's University learn from modern Industry and vice versa in favor of a future growth?
Slides: PDF
|
|
|
A short story about multi-dimensional research assessment and SciVal applications
Verheggen, Joep
Research assessment is a abroad endeavour. At the root it is an attempt to measure the return on investment in scientific –scholarly research. Research assessment includes the evaluation of research quality and measurements of research inputs, outputs and impacts and embraces both qualitative and quantitative methodologies. In his talk the presenter provides a concise overview of developments in research assessment and evaluation practices and will address a conceptual model for multi-dimensional research assessment. He will further address Elsevier’s involvement in research management through its “SciVal” portfolio of research performance, - planning and - funding applications. The presenter will demonstrate how this portfolio can meaningful contribute to both national/regional and institutional assessment exercises. He will subsequently provide a number of examples to illustrate how Governments and/or HE Institutions and organisations like Elsevier can collaborate to improve the quality of Research Management and the assessment exercise process.
Slides: PDF
|
|
| |
|
| |
guest ::
