-
Assessing your Observatory's Impact: Best Practices in Establishing and Maintaining Observatory Bibliographies
Authors:
Observatory Bibliographers Collaboration,
Raffaele D'Abrusco,
Monique Gomez,
Uta Grothkopf,
Sharon Hunt,
Ruth Kneale,
Mika Konuma,
Jenny Novacescu,
Luisa Rebull,
Elena Scire,
Erin Scott,
Donna Thompson,
Lance Utley,
Christopher Wilkinson,
Sherry Winkelman
Abstract:
Observatories need to measure and evaluate the scientific output and overall impact of their facilities. An observatory bibliography consists of the papers published using that observatory's data, typically gathered by searching the major journals for relevant keywords. Recently, the volume of literature and methods by which the publications pool is evaluated has increased. Efficient and standardi…
▽ More
Observatories need to measure and evaluate the scientific output and overall impact of their facilities. An observatory bibliography consists of the papers published using that observatory's data, typically gathered by searching the major journals for relevant keywords. Recently, the volume of literature and methods by which the publications pool is evaluated has increased. Efficient and standardized procedures are necessary to assign meaningful metadata; enable user-friendly retrieval; and provide the opportunity to derive reports, statistics, and visualizations to impart a deeper understanding of the research output. In 2021, a group of observatory bibliographers from around the world convened online to continue the discussions presented in Lagerstrom (2015). We worked to extract general guidelines from our experiences, techniques, and lessons learnt. The paper explores the development, application, and current status of telescope bibliographies and future trends. This paper briefly describes the methodologies employed in constructing databases, along with the various bibliometric techniques used to analyze and interpret them. We explain reasons for non-standardization and why it is essential for each observatory to identify metadata and metrics that are meaningful for them; caution the (over-)use of comparisons among facilities that are, ultimately, not comparable through bibliometrics; and highlight the benefits of telescope bibliographies, both for researchers within the astronomical community and for stakeholders beyond the specific observatories. There is tremendous diversity in the ways bibliographers track publications and maintain databases, due to parameters such as resources, type of observatory, historical practices, and reporting requirements to funders and outside agencies. However, there are also common sets of Best Practices.
△ Less
Submitted 29 December, 2023;
originally announced January 2024.
-
ESO telbib: learning from experience, preparing for the future
Authors:
Uta Grothkopf,
Silvia Meakins,
Dominic Bordelon
Abstract:
The ESO telescope bibliography (telbib) dates back to 1996. During the 20+ years of its existence, it has undergone many changes. Most importantly, the telbib system has been enhanced to cater to new use cases and demands from its stakeholders. Based on achievements of the past, we will show how a system like telbib can not only stay relevant through the decades, but gain importance, and provide a…
▽ More
The ESO telescope bibliography (telbib) dates back to 1996. During the 20+ years of its existence, it has undergone many changes. Most importantly, the telbib system has been enhanced to cater to new use cases and demands from its stakeholders. Based on achievements of the past, we will show how a system like telbib can not only stay relevant through the decades, but gain importance, and provide an essential tool for the observatory's management and the wider user community alike.
△ Less
Submitted 22 June, 2018;
originally announced June 2018.
-
The ESO Survey of Non-Publishing Programmes
Authors:
F. Patat,
H. M. J. Boffin,
D. Bordelon,
U. Grothkopf,
S. Meakins,
S. Mieske,
M. Rejkuba
Abstract:
One of the classic ways to measure the success of a scientific facility is the publication return, which is defined as the number of refereed papers produced per unit of allocated resources (for example, telescope time or proposals). The recent studies by Sterzik et al. (2015, 2016) have shown that 30-50 % of the programmes allocated time at ESO do not produce a refereed publication. While this ma…
▽ More
One of the classic ways to measure the success of a scientific facility is the publication return, which is defined as the number of refereed papers produced per unit of allocated resources (for example, telescope time or proposals). The recent studies by Sterzik et al. (2015, 2016) have shown that 30-50 % of the programmes allocated time at ESO do not produce a refereed publication. While this may be inherent to the scientific process, this finding prompted further investigation. For this purpose, ESO conducted a Survey of Non-Publishing Programmes (SNPP) within the activities of the Time Allocation Working Group, similar to the monitoring campaign that was recently implemented at ALMA (Stoehr et al. 2016). The SNPP targeted 1278 programmes scheduled between ESO Periods 78 and 90 (October 2006 to March 2013) that had not published a refereed paper as of April 2016. The poll was launched on 6 May 2016, remained open for four weeks, and returned 965 valid responses. This article summarises and discusses the results of this survey, the first of its kind at ESO.
△ Less
Submitted 6 March, 2018; v1 submitted 9 February, 2018;
originally announced February 2018.
-
On the Availability of ESO Data Papers on arXiv/astro-ph
Authors:
Uta Grothkopf,
Dominic Bordelon,
Silvia Meakins,
Eric Emsellem
Abstract:
Using the ESO Telescope Bibliography database telbib, we have investigated the percentage of ESO data papers that were submitted to the arXiv/astro-ph e-print server and that are therefore free to read. Our study revealed an availability of up to 96% of telbib papers on arXiv over the years 2010 to 2017. We also compared the citation counts of arXiv vs. non-arXiv papers and found that on average,…
▽ More
Using the ESO Telescope Bibliography database telbib, we have investigated the percentage of ESO data papers that were submitted to the arXiv/astro-ph e-print server and that are therefore free to read. Our study revealed an availability of up to 96% of telbib papers on arXiv over the years 2010 to 2017. We also compared the citation counts of arXiv vs. non-arXiv papers and found that on average, papers submitted to arXiv are cited 2.8 times more often than those not on arXiv. While simulations suggest that these findings are statistically significant, we cannot yet draw firm conclusions as to the main cause of these differences.
△ Less
Submitted 10 January, 2018;
originally announced January 2018.
-
ALMA Cycle 0 Publication Statistics
Authors:
Felix Stoehr,
Uta Grothkopf,
Silvia Meakins,
Marsha Bishop,
Ayako Uchida,
Leonardo Testi,
Daisuke Iono,
Kenichi Tatematsu,
Al Wootten
Abstract:
The scientific impact of a facility is the most important measure of its success. Monitoring and analysing the scientific return can help to modify and optimise operations and adapt to the changing needs of scientific research. The methodology that we have developed to monitor the scientific productivity of the ALMA Observatory, as well as the first results, are described. We focus on the outcome…
▽ More
The scientific impact of a facility is the most important measure of its success. Monitoring and analysing the scientific return can help to modify and optimise operations and adapt to the changing needs of scientific research. The methodology that we have developed to monitor the scientific productivity of the ALMA Observatory, as well as the first results, are described. We focus on the outcome of the first cycle (Cycle 0) of ALMA Early Science operations. Despite the fact that only two years have passed since the completion of Cycle 0 and operations have already changed substantially, this analysisconfirms the effectiveness of the underlying concepts. We find that ALMA is fulfilling its promise as a transformational facility for the observation of the Universe in the submillimetre.
△ Less
Submitted 18 January, 2016;
originally announced January 2016.
-
Two years of ALMA bibliography - lessons learned
Authors:
Silvia Meakins,
Uta Grothkopf,
Marsha J. Bishop,
Felix Stoehr,
Ken Tatematsu
Abstract:
Telescope bibliographies are integral parts of observing facilities. They are used to associate the published literature with archived observational data, to measure an observatory's scientific output through publication and citation statistics, and to define guidelines for future observing strategies.
The ESO and NRAO librarians as well as NAOJ jointly maintain the ALMA (Atacama Large Millimete…
▽ More
Telescope bibliographies are integral parts of observing facilities. They are used to associate the published literature with archived observational data, to measure an observatory's scientific output through publication and citation statistics, and to define guidelines for future observing strategies.
The ESO and NRAO librarians as well as NAOJ jointly maintain the ALMA (Atacama Large Millimeter/submillimeter Array) bibliography, a database of refereed papers that use ALMA data.
In this paper, we illustrate how relevant articles are identified, which procedures are used to tag entries in the database and link them to the correct observations, and how results are communicated to ALMA stakeholders and the wider community. Efforts made to streamline the process will be explained and evaluated, and a first analysis of ALMA papers published after two years of observations will be given.
△ Less
Submitted 25 July, 2014;
originally announced July 2014.
-
Swift publication statistics: a comparison with other major observatories
Authors:
S. Savaglio,
U. Grothkopf
Abstract:
Swift is a satellite equipped with gamma-ray, X-ray, and optical-UV instruments aimed at discovering, localizing and collecting data from gamma-ray bursts (GRBs). Launched at the end of 2004, this small-size mission finds about a hundred GRBs per year, totaling more than 700 events as of 2012. In addition to GRBs, Swift observes other energetic events, such as AGNs, novae, and supernovae. Here we…
▽ More
Swift is a satellite equipped with gamma-ray, X-ray, and optical-UV instruments aimed at discovering, localizing and collecting data from gamma-ray bursts (GRBs). Launched at the end of 2004, this small-size mission finds about a hundred GRBs per year, totaling more than 700 events as of 2012. In addition to GRBs, Swift observes other energetic events, such as AGNs, novae, and supernovae. Here we look at its success using bibliometric tools; that is the number of papers using Swift data and their impact (i.e., number of citations to those papers). We derived these for the publication years 2005 to 2011, and compared them with the same numbers for other major observatories. Swift provided data for 1101 papers in the interval 2005-2011, with 24 in the first year, to 287 in the last year. In 2011, Swift had more than double the number of publications as Subaru, it overcame Gemini by a large fraction, and reached Keck. It is getting closer to the ~400 publications of the successful high-energy missions XMM-Newton and Chandra, but is still far from the most productive telescopes VLT (over 500) and HST (almost 800). The overall average number of citations per paper, as of November 2012, is 28.3, which is comparable to the others, but lower than Keck (41.8). The science topics covered by Swift publications have changed from the first year, when over 80% of the papers were about GRBs, while in 2011 it was less than 30%.
△ Less
Submitted 25 January, 2013; v1 submitted 12 December, 2012;
originally announced December 2012.
-
Linking Publications and Observations - the ESO Telescope Bibliography
Authors:
Silvia Meakins,
Uta Grothkopf
Abstract:
Bibliometric studies have become increasingly important in evaluating individual scientists, specific facilities, and entire observatories. In this context, the ESO Library has developed and maintains two tools: FUSE, a full-text search tool, and the Telescope Bibliography (telbib), a content management system that is used to classify and annotate ESO-related scientific papers.
The new public te…
▽ More
Bibliometric studies have become increasingly important in evaluating individual scientists, specific facilities, and entire observatories. In this context, the ESO Library has developed and maintains two tools: FUSE, a full-text search tool, and the Telescope Bibliography (telbib), a content management system that is used to classify and annotate ESO-related scientific papers.
The new public telbib interface provides faceted searches and filtering, autosuggest support for author, bibcode and program ID searches, hit highlighting as well as recommendations for other papers of possible interest. It is available at http://telbib.eso.org
△ Less
Submitted 22 December, 2011;
originally announced December 2011.
-
Astronomy Librarians - Quo Vadis?
Authors:
Jill Lagerstrom,
Uta Grothkopf
Abstract:
"You don't look like a librarian" is a phrase we often hear in the astronomy department or observatory library. Astronomy librarians are a breed apart, and are taking on new and non-traditional roles as information technology evolves. This talk will explore the future of librarians and librarianship through the lens of the recent talks given at the sixth "Libraries and Information Services in Astr…
▽ More
"You don't look like a librarian" is a phrase we often hear in the astronomy department or observatory library. Astronomy librarians are a breed apart, and are taking on new and non-traditional roles as information technology evolves. This talk will explore the future of librarians and librarianship through the lens of the recent talks given at the sixth "Libraries and Information Services in Astronomy" conference held in Pune, India in February 2010. We will explore the librarian's universe, illustrating how librarians use new technologies to perform such tasks as bibliometrics, how we are re-fashioning our library spaces in an increasingly digital world and how we are confronting the brave new world of open access, to name but a few topics.
△ Less
Submitted 6 April, 2011;
originally announced April 2011.
-
Telescope Bibliometrics 101
Authors:
Uta Grothkopf,
Jill Lagerstrom
Abstract:
During recent years, bibliometric studies have become increasingly important in evaluating individual scientists, institutes, and entire observatories. In astronomy, often librarians are involved in maintaining publication databases and compiling statistics for their institutions. In this paper, we present a look behind the scenes to understand who is interested in bibliometric statistics, which m…
▽ More
During recent years, bibliometric studies have become increasingly important in evaluating individual scientists, institutes, and entire observatories. In astronomy, often librarians are involved in maintaining publication databases and compiling statistics for their institutions. In this paper, we present a look behind the scenes to understand who is interested in bibliometric statistics, which methodologies astronomy librarians apply, and what kind of features next-generation bibliographies may include.
△ Less
Submitted 28 March, 2011;
originally announced March 2011.
-
Creating Telescope Bibliographies Electronically -- Are We There Yet?
Authors:
Sarah Stevens-Rayburn,
Uta Grothkopf
Abstract:
Observatory libraries traditionally have maintained databases of publications resulting from usage of their facilities. In the era of electronic publication, the methodology of the creation of these databases has perforce changed as well. In this poster, we will compare a variety of methods for obtaining this information electronically and point out the advantages and shortcomings of each.
Observatory libraries traditionally have maintained databases of publications resulting from usage of their facilities. In the era of electronic publication, the methodology of the creation of these databases has perforce changed as well. In this poster, we will compare a variety of methods for obtaining this information electronically and point out the advantages and shortcomings of each.
△ Less
Submitted 11 October, 2006;
originally announced October 2006.
-
Introducing the H-Index in Telescope Statistics
Authors:
Uta Grothkopf,
Sarah Stevens-Rayburn
Abstract:
This paper analyzes the performance of observatories based on the so-called h-index (Hirsch 2005), a new, easy-to-use parameter that quantifies scientists' research impact and relevance. Compared to other bibliometric criteria, like total number of publications or citations, the h-index is less biased. Using NASA's Astrophysics Data System (ADS), we investigate the performance of selected observ…
▽ More
This paper analyzes the performance of observatories based on the so-called h-index (Hirsch 2005), a new, easy-to-use parameter that quantifies scientists' research impact and relevance. Compared to other bibliometric criteria, like total number of publications or citations, the h-index is less biased. Using NASA's Astrophysics Data System (ADS), we investigate the performance of selected observatories, taking into account their specific number of years of operation.
△ Less
Submitted 10 October, 2006;
originally announced October 2006.
