Research programme › Science policy


SCIENTOMETRICS; 2003; 57(2):257 - 280

Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence

Authors: van Leeuwen TN, Visser MS, Moed HF, Nederhof TJ, van Raan AFJ
Affiliations: Leiden Univ

Abstract:
Evaluation studies of scientific performance conducted during the past years more and more focus on the identification of research of the 'highest quality', 'top' research, or 'scientific excellence'. This shift in focus has lead to the development of new bibliometric methodologies and indicators. Technically, it meant a shift from bibliometric impact scores based on average values such as the average impact of all papers published by some unit to be evaluated towards indicators reflecting the top of the citation distribution, such as the number of 'highly cited' or 'top' articles. In this study we present a comparative analysis of a number of standard and new indicators of research performance or 'scientific excellence', using techniques applied in studies conducted by CWTS in recent years. It will be shown that each type of indicator reflects a particular dimension of the general concept of research performance. Consequently, the application of one single indicator only may provide an incomplete picture of a unit's performance. It is argued that one needs to combine the various types of indicators in order to offer policy makers and evaluators valid and useful assessment tools.

Publication type:
Article in Journal

Journals:
Scientometrics
  
Authors (4)
Research programs (1)
  
Dr. T.N. (Thed) van Leeuwen
Centre for Science and Technology Studies
Senior Researcher. MSc 1987 Political Sciences, University of Amsterdam, From February 1989 at CWTS. PhD Science Studies, 2004, Leiden. Coordinator for research performance projects. Currently involved in most bibliometric evaluations projects. Member of CWTS management team.
MSc M. (Martijn) Visser
Researcher. Completing degree in history, Leiden. Currently involved in many research performance projects. From March 1996 at CWTS.
Dr. A.J. (Ton) Nederhof
Senior Researcher. Psychologist, MSc 1978 Leiden University; Ph.D. in Psychology, Leiden, 1981. Lecturer and researcher in Leiden(from 1979), Washington State University (Fulbright Visiting Scholar, 1981-1982) and Auckland (ZWO Visiting Scholar, 1982). Previous work on methods and techniques in ...
Prof. A.F.J. (Ton) van Raan
Professor of Science Studies. From 1985 to 2010 Director of CWTS. MSc Physics 1969 University of Utrecht; Ph.D. Physics, Utrecht, 1973. Lecturer and researcher (physics, astrophysics) in Utrecht (1969-1973), Bielefeld (1973-1979), Leiden (from 1977). Visiting scientist in several universities and ...