Assessing the Quality of Scientific Papers

Authors : Roman Vainshtein, Gilad Katz, Bracha Shapira, Lior Rokach

A multitude of factors are responsible for the overall quality of scientific papers, including readability, linguistic quality, fluency,semantic complexity, and of course domain-specific technical factors.

These factors vary from one field of study to another. In this paper, we propose a measure and method for assessing the overall quality of the scientific papers in a particular field of study.

We evaluate our method in the computer science domain, but it can be applied to other technical and scientific fields.Our method is based on the corpus linguistics technique. This technique enables the extraction of required information and knowledge associated with a specific domain.

For this purpose, we have created a large corpus, consisting of papers from very high impact conferences. First, we analyze this corpus in order to extract rich domain-specific terminology and knowledge.

Then we use the acquired knowledge to estimate the quality of scientific papers by applying our proposed measure. We examine our measure on high and low scientific impact test corpora.

Our results show a significant difference in the measure scores of the high and low impact test corpora. Second, we develop a classifier based on our proposed measure and compare it to the baseline classifier.

Our results show that the classifier based on our measure over-performed the baseline classifier. Based on the presented results the proposed measure and the technique can be used for automated assessment of scientific papers.

URL : https://arxiv.org/abs/1908.04200

Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

Authors : Erin C McKiernan, Lesley A Schimanski, Carol Muñoz Nieves, Lisa Matthias, Meredith T Niles, Juan P Alperin

We analyzed how often and in what ways the Journal Impact Factor (JIF) is currently used in review, promotion, and tenure (RPT) documents of a representative sample of universities from the United States and Canada. 40% of research-intensive institutions and 18% of master’s institutions mentioned the JIF, or closely related terms.

Of the institutions that mentioned the JIF, 87% supported its use in at least one of their RPT documents, 13% expressed caution about its use, and none heavily criticized it or prohibited its use. Furthermore, 63% of institutions that mentioned the JIF associated the metric with quality, 40% with impact, importance, or significance, and 20% with prestige, reputation, or status.

We conclude that use of the JIF is encouraged in RPT evaluations, especially at research-intensive universities, and that there is work to be done to avoid the potential misuse of metrics like the JIF.

URL : Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

DOI : https://doi.org/10.7554/eLife.47338.001

The Transcript OPEN Library Political Science Model: A Sustainable Way into Open Access for E-Books in the Humanities and Social Science

Authors : Alexandra Jobmann, Nina Schönfelder

The strategic goal of the project “National Contact Point Open Access OA2020-DE” is to create the conditions for a large-scale open-access transformation in accordance with the Alliance of German Science Organizations.

In close collaboration with the publisher transcript, we developed a business model that strengthens the transformation process for e-books in the humanities and social sciences.

It largely addresses the drawbacks of existing models. Moreover, it is manageable, sustainable, transparent, and scalable for both publishers and libraries. This case report describes the setup of the model, its successful implementation for the branch “political science” of transcript in 2019, and provides a Strengths–Weaknesses–Opportunities–Threats (SWOT) analysis.

We believe that it has the potential to become one of the major open-access business models for research monographs and anthologies in the humanities and social sciences, especially for non-English e-books.

URL : The Transcript OPEN Library Political Science Model: A Sustainable Way into Open Access for E-Books in the Humanities and Social Science

DOI : https://doi.org/10.3390/publications7030055

Acceptance rates of scholarly peer-reviewed journals: A literature survey

Author : Bo-Christer Bjórk

The acceptance rate of scholarly journals is an important selection criterion for authors choosing where to submit their manuscripts. Unfortunately, information about the acceptance (or rejection rates) of individual journals is seldom available.

This article surveys available systematic information and studies of acceptance rates. The overall global average is around 35-40%. There are significant differences between fields of science, with biomedicine having higher acceptance rates compared to for instance the social sciences.

Open access journals usually have higher acceptance rates than subscription journals, and this is particularly true for so-called OA mega-journals, which have peer review criteria focusing on sound science only.

URL : https://recyt.fecyt.es/index.php/EPI/article/view/epi.2019.jul.07

Perceptions of Educational Leadership Faculty Regarding Open Access Publishing

Authors : Jayson W. Richardson, Scott McLeod, Todd Hurst

There is a dearth of research on the perceptions of faculty members in educational leadership regarding open access publications. This reality may exist because of a lack of funding for educational leadership research, financial obstacles, tenure demands, or reputation concerns.

It may be that there are simply fewer established open access publishers with reputable impact factors to encourage publication by members in the field.

The current study seeks to answer the following question: “What are the perceptions of educational leadership faculty members in UCEA about open access publishing?”

The results are based on responses from 180 faculty members in the field of educational leadership.

URL : Perceptions of Educational Leadership Faculty Regarding Open Access Publishing

DOI : https://doi.org/10.22230/ijepl.2019v15n5a817

Publication in a medical student journal predicts short- and long-term academic success: a matched-cohort study

Authors : Ibrahim S. Al-Busaidi, Cameron I. Wells, Tim J. Wilkinson

Background

Medical student journals play a critical role in promoting academic research and publishing amongst medical students, but their impact on students’ future academic achievements has not been examined.

We aimed to evaluate the short- and long-term effects of publication in the New Zealand Medical Student Journal (NZMSJ) through examining rates of post-graduation publication, completion of higher academic degrees, and pursuing an academic career.

Methods

Student-authored original research publications in the NZMSJ during the period 2004–2011 were retrospectively identified. Gender-, university- and graduation year-matched controls were identified from publicly available databases in a 2:1 ratio (two controls for each student authors).

Date of graduation, current clinical scope of practice, completion of higher academic degrees, and attainment of an academic position for both groups were obtained from Google searches, New Zealand graduate databases, online lists of registered doctors in New Zealand and Australia, and author affiliation information from published articles.

Pre- and post-graduation PubMed®-indexed publications were identified using standardised search criteria.

Results

Fifty publications authored by 49 unique students were identified. The median follow-up period after graduation was 7.0 years (range 2–12 years). Compared with controls, studentauthors were significantly more likely to publish in PubMed®-indexed journals (OR 3.09, p = 0.001), obtain a PhD (OR 9.21, p = 0.004) or any higher degree (OR 2.63, p = 0.007), and attain academic positions (OR 2.90, p = 0.047) following graduation.

Conclusion

Publication in a medical student journal is associated with future academic achievement and contributes to develop a clinical academic workforce. Future work should aim to explore motivators and barriers associated with these findings.

URL : Publication in a medical student journal predicts short- and long-term academic success: a matched-cohort study

 

Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations

Authors : Meredith T. Niles, Lesley A. Schimanski, Erin C. McKiernan, Juan P. Alperin

Using an online survey of academics at 55 randomly selected institutions across the US and Canada, we explore priorities for publishing decisions and their perceived importance within review, promotion, and tenure (RPT).

We find that respondents most value journal readership, while they believe their peers most value prestige and related metrics such as impact factor when submitting their work for publication.

Respondents indicated that total number of publications, number of publications per year, and journal name recognition were the most valued factors in RPT. Older and tenured respondents (most likely to serve on RPT committees) were less likely to value journal prestige and metrics for publishing, while untenured respondents were more likely to value these factors.

These results suggest disconnects between what academics value versus what they think their peers value, and between the importance of journal prestige and metrics for tenured versus untenured faculty in publishing and RPT perceptions.

URL : Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations