x
[quotes_form]
Measuring Research Success: H-index Scores in Science

Measuring Research Success: H-index Scores in Science

What Are H-index Scores?

H-index scores are popular metrics used to assess scientific performance. They can indicate both the quantity and quality of a scientist’s work, based on the number of publications they have published and their citation rates. The larger the number of cited papers a researcher has, the higher the h-index they get. H-index scores are also employed by funding bodies and employers to determine funding and career decisions.

Note that bibliometrics and scientometrics, such as the h-index, impact factor, and eigenfactor, are increasing in popularity to assess the impact a scientist, an organization, or a journal has within research settings, as well as the dissemination of knowledge and innovations. Given the abundance of research projects and academic publications across the globe, transparent statistical methods are becoming essential tools to reveal scientific success, productivity, and impact.

 

How to Calculate H-indexes?

H-index scores are becoming highly popular in research settings, as their calculation is pretty straightforward. The h-index is calculated as a function of the total number of publications and the total number of cited papers an author has; in other words, it’s influenced by how many h of publications have at least h citations. For example, if a researcher has 15 publications with at least 15 citations each, their h-index will be 15.

Platforms, such as Scopus and Web of Science, can compute h-index scores automatically. At the same time, h-index scores can be calculated manually. To do that, one should organize a researcher’s articles in a descending order (highest to lowest), based on the citation rates for each publication. Note that databases, such as Google Scholar and PsychINFO, can be used to extract citation information and facilitate calculations (“How do I calculate my h-index?”).

The h-index is based on the last position in which the rank of publications is greater or equal to the number of citations. For example, if a researcher has five published papers (A, B, C, D, E) with 20 citations for paper A, 15 for B, seven for C, four for D, and one for E, their h-index will be four because their fourth publication (D) has four citations (or the rank of the paper is equal to the number of citations). In this scenario, h-index=4 means that the author has four citations that have been cited at least once.

Another way to calculate h-indexes is to visualize the number of publications and citations. One can plot the number of papers versus the number of citations; the h-index is the number of articles at which the 45-degree line crosses the plot curve (or when the rank of the articles is equal or greater than the number of citations).

 

The History of H-index

H-index scores have a relatively short but intense history. The h-index, known as the Hirsch index, was introduced by physicist Jorge Hirsch in 2005 to measure both the productivity and impact of individual scientists. Hirsch stated, “I propose the index h, defined as the number of papers with citation number ≥h, as a useful index to characterize the scientific output of a researcher” (Hirsch, 2005). This bibliometric measure has been quickly adopted by institutions as its calculation is pretty simple and can even have predictive power for a researcher’s future success. Hirsch claims that after 20 years of research, and h-index=20 is good, 30 is outstanding, and 40 is exceptional.

Interestingly, the h-index can be used beyond theoretical physics – it can be applied to authors, institutions, and journals as an indicator of scientific achievements. However, factors, such as academic experience, fields of work, and average citation rates, should be considered to provide objectivity and transparency.

 

H-index: Pros & Cons

The h-index is a powerful academic footprint, which reveals numerous advantages when compared to other metrics. One of the benefits of h-index scores is that they reveal a researcher’s productivity and impact, as well as how citations are distributed over a set of articles. Note that as single highly cited articles do not influence h-index scores, h-index values encourage impactful research and high performance. The h-index can be easily calculated and used to compare scientists with similar academic experience, in similar research fields, and within similar journal categories (“Calculate your academic footprint: Your h-index, 2019”).

However, the h-index has its cons. H-index values are time-dependent measures proportional to the academic “age” of a researcher (e.g., senior authors would have had more time to publish their work and receive more citations). They are also prone to bias and mass self-citation. Another limitation is that the h-index does not account for the number of authors on a publication; for example, a researcher who is the author of a highly-cited paper would get the same credit as a researcher who is on a similar paper with ten other co-authors. The h-index can’t be used to compare authors across different research disciplines either; note that in some disciplines, research output is books and conferences, which are not well presented by online databases. Moreover, online resources that calculate h-index scores give different values as each database has different coverage of publications and citations, with review articles being cited more frequently than original papers (Oswald).

 

Improving Your H-Index: Do’s & Don’ts

H-index scores are vital indicators to measure a researcher’s footprint in research. As h-index scores are widely used in academic settings – with a high impact on job applications and funding decisions – many researchers focus on their h-index and ways to improve it. However, there are some unacceptable techniques to increase academic metrics, which can lead to ostracism and even legal issues:

  • Frequent and mass self-citations and citation circles of friends and colleagues: As explained above, the number of citations affects a researcher’s h-index. Some researchers may abuse the fact that some systems do not account for self-citations and may produce low-quality papers just to cite their own work or the work of their fellow researchers.
  • Publishing the same work in different places solely to increase the number of publications or choosing low-quality journals without a credible editor committee: Each publication should be unique and able to contribute to real-life settings. Thus, publishing or repeating low-quality work just to increase the number of articles is seen as an unethical way to improve h-index scores.
  • Plagiarism: Research should be original and beneficial. Therefore, plagiarism, defined as copying another’s researcher ideas or work, often leads to ostracism and legal problems.

To increase an h-index ethically, on the other hand, a researcher should consider the following techniques:

  • Publishing original work, which can be applied in practice settings: With the increasing importance of knowledge translational and implementation science research, publications should be beneficial to real-world settings, and researchers should be active in spreading knowledge and innovations into practice.
  • Joining research circles of recognized authors whose work is cited frequently and attending research meetings and conferences: The truth is that no matter how innovative one’s work is, recognized authors are cited more frequently than early researchers. Thus, connecting with other prominent researchers becomes crucial to one’s scientific success.
  • Publishing in well-established journals with an appropriate audience and open access: Choosing a journal is crucial to improving one’s credibility. While well-established journals can improve a researcher’s h-index, we should mention that publishing in open access can not only increase h-index values but benefit non-experts and institutions in low-income countries that can’t gain access to costly research platforms.
  • Establishing social media presence: In today’s digital era, establishing social media presence through blogging, micro-blogging, and social networking is vital (Kienc, 2015). Twitter, for instance, is highly valued by life science researchers and policymakers.

 

Other Metrics Determining Scientific Success

As we can see, metrics are becoming essential indicators of academic success. In fact, metrics can be divided into three categories: portfolio-based indicators, ratio-based indicators, and network-based indicators. The h-index, in particular, is the most popular portfolio-based indicator used to reveal a researcher’s impact and future success. Note that a prominent variation is the so-called h-5 value, which covers articles published in the previous five years.

Ratio-based indicators and network-based indicators are also essential. Impact factors are perhaps the most popular ratio-based indicators used to measure the importance of a journal. They are defined as the frequency with which a particular article from a scientific journal has been cited within the past few years. For example, if a paper has a large number of citations, the journal that has published the paper is more likely to be highly ranked. Impact per publication is another popular indicator, which is assessed over a three-year window and based on papers that are clearly defined as articles, reviews, and conference publications.

Network-based indicators, on the other hand, are used to reveal the importance of a journal in a whole citation network; popular network-based metrics include eigenfactors, SCImago journal ranks, and relative citation ratios.

 

H-index and Social Media

Even though h-index scores are used mainly across academic environments, it’s interesting to mention that h-indexes have also been implemented in the evaluation of a person’s contribution to Internet media. For instance, the h-index can be adapted and applied to YouTube video creators. In combination with index g, h-index scores can capture one’s productivity and impact based on the number of videos and view counts (Hovden, 2013)..

Note that Web 2.0 technologies and sharing platforms, such as YouTube, have become popular tools in knowledge translation. YouTube can be used to spread audio and visual material related to scientific topics and innovations, even among non-experts.

 

H-index: Conclusion

The h-index is a powerful portfolio-based indicator used to show how productive and influential a scientist is in his or her field of work. In simple words, researchers with a wide range of papers with high levels of citations receive good h-index scores. H-index scores are used for evaluating job and grant applicants and can help even non-experts catch a glimpse of a researcher’s success.

At the same time, metrics are often prone to bias. H-indexes can be influenced by inappropriate methods, such as mass self-citation and plagiarism. Moreover, experts claim that metrics are slowly creating a research culture where numbers replace quality content, innovation, and personal skills. To provide an example, h-indexes between three and five are common for new assistant professors, scores between eight and 12 are enough for a promotion to tenured associate professor, and h-index values between 15 and 20 are satisfactory for becoming a full professor. Yet, some full professors and deans have relatively low h-index scores, while exceptional researchers with scores over 10 might still be working on a post-doctorate project. In the end, although h-indexes provide transparency and make sense of the abundance of scientific projects and publications across the world, h-indexes are just rough metrics. As Hirsch said himself, “Obviously a single number can never give more than a rough approximation to an individual’s multifaceted profile, and many other factors should be considered in combination to evaluate an individual. This and the fact that there can always be exceptions to rules should be kept in mind, especially in a life-changing decision such as the granting or denying of tenure” (Oswald). In other words, while researchers should focus on their h-index scores and ways to improve them, people should not forget that factors, such as personal attitude, motivation, teaching projects, and real-life efforts, matter the most.

 

References
  1. Calculate your academic footprint: You h-index (May 16, 2019) Retrieved from https://subjectguides.uwaterloo.ca/calculate-academic-footprint/YourHIndex
  2. Hirsch, J. (2005). An index to quantify an individual’s scientific research output. PNAS, 102 (46).
  3. Hovden, R. (2013). Bibliometrics for Internet media: Applying the h-index to YouTube.
  4. How do I calculate my h-index? Retrieved from https://www.wur.nl/en/article/How-do-I-calculate-my-hindex.htm (September 27, 2019).
  5. Kienc, W. (2015). Should you care about your h-index, and if so, how to improve it? Open Science Resources.
  6. Oswald, N. Does your h-index measure up? Retrieved from https://bitesizebio.com/13614/does-your-h-index-measure-up/ (September 27, 2019).