We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

astro-ph.IM

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Astrophysics > Instrumentation and Methods for Astrophysics

Title: Metrics of research impact in astronomy: Predicting later impact from metrics measured 10-15 years after the PhD

Authors: John Kormendy
Abstract: This paper calibrates how metrics derivable from the SAO/NASA Astrophysics Data System can be used to estimate the future impact of astronomy research careers and thereby to inform decisions on resource allocation such as job hires and tenure decisions. Three metrics are used, citations of refereed papers, citations of all publications normalized by the numbers of co-authors, and citations of all first-author papers. Each is individually calibrated as an impact predictor in the book Kormendy (2020), "Metrics of Research Impact in Astronomy" (Astron Soc Pac Conference Series Monograph 8, San Francisco). How this is done is reviewed in the first half of this paper. Then, I show that averaging results from three metrics produces more accurate predictions. Average prediction machines are constructed for different cohorts of 1990-2007 PhDs and used to postdict 2017 impact from metrics measured 10, 12, and 15 years after the PhD. The time span over which prediction is made ranges from 0 years for 2007 PhDs to 17 years for 1990 PhDs using metrics measured 10 years after the PhD. Calibration is based on perceived 2017 impact as voted by 22 experienced astronomers for 510 faculty members at 17 highly-ranked university astronomy departments world-wide. Prediction machinery reproduces voted impact estimates with an RMS uncertainty of 1/8 of the dynamic range for people in the study sample. The aim of this work is to lend some of the rigor that is normally used in scientific research to the difficult and subjective job of judging people's careers.
Comments: This preprint is being criticized based on a perception that it furthers bias against women and minorities. My book on the subject documents evidence for bias and develops machinery aimed in part to redress it. Further explanation is posted at this http URL . Wishing to protect PNAS from controversy, I have withdrawn the PNAS paper. I therefore withdraw the preprint
Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Earth and Planetary Astrophysics (astro-ph.EP); Solar and Stellar Astrophysics (astro-ph.SR); Digital Libraries (cs.DL)
Cite as: arXiv:2110.14115 [astro-ph.IM]
  (or arXiv:2110.14115v3 [astro-ph.IM] for this version)

Submission history

From: John Kormendy [view email]
[v1] Wed, 27 Oct 2021 01:36:42 GMT (2504kb)
[v2] Fri, 29 Oct 2021 17:00:25 GMT (2503kb)
[v3] Mon, 1 Nov 2021 19:13:53 GMT (0kb,I)

Link back to: arXiv, form interface, contact.