What is replication?

Authors : Brian A. Nosek, Timothy M. Errington

Credibility of scientific claims is established with evidence for their replicability using new data. According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs. This definition is intuitive, easy to apply, and incorrect.

We propose that replication is a study for which any outcome would be considered diagnostic evidence about a claim from prior research. This definition reduces emphasis on operational characteristics of the study and increases emphasis on the interpretation of possible outcomes.

The purpose of replication is to advance theory by confronting existing understanding with new evidence. Ironically, the value of replication may be strongest when existing understanding is weakest.

Successful replication provides evidence of generalizability across the conditions that inevitably differ from the original study; Unsuccessful replication indicates that the reliability of the finding may be more constrained than recognized previously.

Defining replication as a confrontation of current theoretical expectations clarifies its important, exciting, and generative role in scientific progress.

URL : What is replication?

DOI : https://doi.org/10.1371/journal.pbio.3000691

La tension entre la pratique de recherche et l’intégrité scientifique : l’exemple de l’activité bibliographique

Auteurs/Authors : Sophie Kennel, Elsa Poupardin

L’activité bibliographique des chercheurs va de la constitution d’une culture savante à l’enrichissement de la connaissance scientifique par la publication. Notre étude interroge le lien entre l’intégrité scientifique et les constituants de cette production scientifique.

Elle permet de situer les connaissances et les positionnements des chercheurs sur la question de l’intégrité scientifique et montre les tensions entre l’activité prescrite, induite et l’activité réelle de lecture et de citation des chercheurs souvent déterminée par les normes d’évaluation.

URL : https://lesenjeux.univ-grenoble-alpes.fr/2018/04-Kennel-Poupardin/

The Transnational and the Text-Searchable: Digitized Sources and the Shadows They Cast

Statut

“This working paper explores the consequences for historians’ research practice of the twinned transnational and digital turns. The accelerating digitization of historians’ sources (scholarly, periodical, and archival) and the radical shift in the granularity of access to information within them has radically changes historians’ research practice. Yet this has incited remarkably little reflection regarding the consequences for individual projects or collective knowledge generation. What are the implications for international research in particular? This essay heralds the new kinds of historical knowledge-generation made possible by web access to digitized, text-searchable sources. It also attempts an accounting of all that we formerly, unwittingly, gained from the frictions inherent to international research in an analog world. What are the intellectual and political consequences of that which has been lost?”

URL : http://d-scholarship.pitt.edu/20882/

Main basse sur la science publique : Le «coût de génie» de l’édition scientifique privée

Imaginez un monde où les chercheurs des établissements publics de recherche et des universités seraient rétribués individuellement en fonction de leur contribution au chiffre d’affaire d’un oligopole de grands groupes privés, et où les moyens humains et financiers affectés à leurs recherches en dépendraient.

Projet d’un think-tank ultra-libéral, voire science-fiction pensez-vous ?… ou alors cas particulier de quelques fraudes liées à l’industrie du médicament ? Non, non, regardez bien autour de vous, c’est déjà le cas, dans l’ensemble du monde scientifique (sciences de la nature, médicales, agronomiques…), et ce à l’insu de la grande majorité des gens, et de trop de chercheurs ! Mais une prise de conscience est en train de s’opérer et une bataille s’engage sur tous les continents.”

URL : http://www.inra.cgt.fr/actions/revendications/Main_basse_sur_la_Science.pdf

When Copyright Law and Science Collide: Empowering Digitally Integrated Research Methods on a Global Scale

Automated knowledge discovery tools have become central to the scientific enterprise in a growing number of fields and are widely employed in the humanities as well. New scientific methods, and the evolution of entirely new fields of scientific inquiry, have emerged from the integration of digital technologies into scientific research processes that ingest vast amounts of published data and literature. The Article demonstrates that intellectual property laws have not kept pace with these phenomena.

Copyright law and science co-existed for much of their respective histories, with a benign tradition of the former giving way to the needs of the latter. Today, however, the formidable array of legislative maneuvers to tighten the grip of copyright laws in defense of cultural industries whose business models were upended in the online environment have, deliberately or not, undermined the ability of the scientific community to access, use, and reuse vast amounts of basic knowledge inputs. Database protection laws, reinforced by electronic fences and contracts of adhesion, further subject copy-reliant technologies to the whims of publishers and hinder the pooling of publicly funded resources that empower collaborative research networks and the formation of science commons in general.

The authors analyze the different components of a complicated transnational legislative fabric that have changed world copyright law into a science-hostile environment. Given the global nature of digital scientific research, they focus attention on comparative laws that fragment research inputs into diversely accessible territorial compartments. This analysis shows that users of automated knowledge discovery tools will likely become collective infringers of both domestic and international property laws.

In response to this challenge, the authors discuss possible solutions to the problems that intellectual property laws have created for digitally integrated scientific research from two very different angles. First, the authors skeptically consider the kinds of legal reforms that would be needed if commercial publishers continued to act as intermediaries between producers and users of scientific information and data, as they do today, without regard to the likelihood that such reforms would ever be enacted.

The authors then reconsider the role of publishers and ask whether, from a cost-benefit perspective, it should be significantly modified or abandoned altogether. Finally, the authors examine alternative strategies that the scientific community itself could embrace in a concerted effort to manage its own upstream knowledge assets in ways that might avoid, or at least attenuate, the obstacles to digitally empowered scientific research currently flowing from a flawed intellectual property regime.

The Article concludes by stressing the need to bridge the current disconnect between private rights and public science, in the overall interest of both innovation and the advancement of knowledge.

URL : http://scholarship.law.duke.edu/faculty_scholarship/2675/

The internet and science communication blurring the boundaries…

The internet and science communication: blurring the boundaries :

“Scientific research is heavily dependent on communication and collaboration. Research does not exist in a bubble; scientific work must be communicated in order to add it to the body of knowledge within a scientific community, so that its members may ‘stand on the shoulders of giants’ and benefit from all that has come before. The effectiveness of scientific communication is crucial to the pace of scientific progress: in all its forms it enables ideas to be formulated, results to be compared, and replications and improvements to be made. The sharing of science is a foundational aspect of the scientific method. This paper, part of the policy research within the FP7 EUROCANCERCOMS project, discusses how the Internet has changed communication by cancer researchers and how it has the potential to change it still more in the future. It will detail two broad types of communication: formal and informal, and how these are changing with the use of new web tools and technologies.”

URL : http://digital-scholarship.org/digitalkoans/2011/08/29/an-open-access-future-report-from-the-eurocancercoms-project/

Working Together to Reduce Plagiarism and Promote Academic Integrity: A Collaborative Initiative at Leicester

This staff student collaboration arose from a staff-led research project that examined the potential for an American-style honor code system to reduce plagiarism in higher education.

This system promotes the positive benefits of good scholarship, encourages students to take responsibility for their own learning and is based on a community of trust between staff and students. Students’ Union Education Officers, student course representatives and academic staff worked together to re-frame advice given to students on plagiarism in a more positive light.

This ongoing collaboration has resulted in joint recommendations from staff and students to the institution on how to reduce plagiarism and promote a culture of academic integrity.”

URL : https://lra.le.ac.uk/handle/2381/9108