scholarly journals Science Needs Systematic Replicability Audits

2021 ◽  
Author(s):  
Aurélien Allard ◽  
Simine Vazire

The credibility revolution in social science has highlighted the importance of conducting replication studies. Despite this growing awareness, the value of direct replications is still hotly debated. In this article, we identify three main functions served by replication. We argue that replications are valuable when they target important or influential studies, when they provide a general estimate of the replicability rate of a population of published articles, and when they create incentives favoring replicable research. We therefore argue that the scientific community should organize systematic large-scale replication audits of two subsets of journals’ published articles: a subset of the most-cited articles, and a subset of randomly selected articles that would provide an estimate of the replicability of the journals' articles. These replicability audits should pave the way for more general quality audits of scientific journals.

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.


2021 ◽  
Vol 30 (2) ◽  
Author(s):  
Jan Martijn Abrahamse

Summary This article deals with the reception of Billy Graham and modern evangelicalism in the fragmented society of the Netherlands in 1954. It takes its departure from the stream of newspaper articles published between February and June in response to the Greater London Crusade and Graham’s first large scale rally in Amsterdam’s Olympic Stadium. The analysis of the reports in different newspapers, which represent the different social groups (catholic, protestant, socialist and liberal) in Dutch society, reveals a significant shift in the way Billy Graham was perceived: from initial scepticism to mild appreciation. This change in press coverage, it is concluded, is mainly due to the different way in which Billy Graham presented himself compared with the large-scale publicity which surrounded his campaign.


Author(s):  
Joseph Soeters

Organizational cultures in military organizations consist of symbols, practices, habits, hidden assumptions, and beliefs about what needs to be done, and what is appropriate and what is not, before, during, and after operations. Generally speaking, organizational cultures in military institutions are similar to those in any other work organization. Upon closer examination, however, it appears that the military’s 24/7, communal life outside society, its emphasis on hierarchy and discipline, and in particular its license to use large-scale force make it different. Relatedly, the way in which the military’s organizational cultures are created and recreated has aspects and emphases that are less common in conventional work organizations. Recruiting and socialization patterns of new organizational members in the military have been studied frequently because they are so distinctive in the armed forces. Military organizational cultures are not identical worldwide. Military organizations differ internationally, as military organizations are still strongly connected to their national backgrounds, including the languages, legal regimes, political atmospheres, and general ways of living in the many nations across the globe. National societies and their histories shape military organizational cultures in multiple ways. Dramatic experiences at the national level, for instance during World War II, may lead to a continuation or, just the opposite, the disruption of armed forces’ organizational cultures. Yet despite the differences, something of a world culture impacting on the use of force seems to emerge as well. In an era when international alliances carry out most missions, different national backgrounds influence strategic decision making and the way operations are conducted. Most of the time, national armed forces operate separately, in their own area (or time) of operations, sometimes guiding troops from smaller and less wealthy partnering nations. The coordination of actions between the various areas of operation is generally not very well elaborated. This applies not only to combat operations but also to peace missions. A full integration of national armed forces, such as in a United Nations security force or a European army, is an ideal that some may dream of, but it is still far from reality. The greatest degree of integration is likely to be found in international headquarters.


2015 ◽  
Vol 4 (1) ◽  
pp. 37-43
Author(s):  
Enrico Petrilli ◽  
Franca Beccaria

Petrilli, E., & Beccaria, F. (2015). The Italian “alcohol question” from 1860 to 1930: Two opposing scientific interpretations. The International Journal Of Alcohol And Drug Research, 4(1), 37-43. doi:http://dx.doi.org/10.7895/ijadr.v4i1.193Background: In recent years, English-speaking and Northern European alcohol researchers have turned a historical gaze towards their subject, and in particular have explored how a medical view attempted to describe and explain phenomena such as alcohol abuse and addiction. Although there was a heated and prolific debate in Italy in the late 19th and early 20th centuries, there are few historical studies of the first scholars’ thoughts on alcohol-related problems.Aims: The article depicts how the Italian scientific community interpreted and explained alcohol-related concerns following the emergence of the alcohol issue in the late 19th century. Specifically, the stances of the two main groups of scientists who dealt with the issue, the Positive School of Criminology and Legal Socialism, are examined.Method: The article is based on the materials collected by the Italian research group during a comparative study carried out as part of the ALICE RAP project. More than 40 books and five scientific journals were consulted.Results: Medical-related concerns were never predominant in the late 19th-century Italian debate on the alcohol question, but were addressed in the broader discussion of criminality, where positivists’ and legal socialists’ perspectives both focused mainly on social consequences, albeit with differing interpretations of causalities and remedies.


Politologija ◽  
2019 ◽  
Vol 94 (2) ◽  
pp. 56-80
Author(s):  
Lukas Pukelis ◽  
Vilius Stančiauskas

Artificial Neural Networks (ANNs) are being increasingly used in various disciplines outside computer science, such as bibliometrics, linguistics, and medicine. However, their uptake in the social science community has been relatively slow, because these highly non-linear models are difficult to interpret and cannot be used for hypothesis testing. Despite the existing limitations, this paper argues that the social science community can benefit from using ANNs in a number of ways, especially by outsourcing laborious data coding and pre-processing tasks to machines in the early stages of analysis. Using ANNs would enable small teams of researchers to process larger quantities of data and undertake more ambitious projects. In fact, the complexity of the pre-processing tasks that ANNs are able to perform mean that researchers could obtain rich and complex data typically associated with qualitative research at a large scale, allowing to combine the best from both qualitative and quantitative approaches.


2020 ◽  
Vol 16 (2) ◽  
pp. 69-89
Author(s):  
Adnan Mohamed Yusoff ◽  
Abdoul Karim Toure

Animals and livestock are part of the main phenomenon of the Quran which highlights its intimacy with nature and human life. Names, types, properties, stories or matters that are related to animals and livestock appear specifically, scientifically and strategically in the Quran. This phenomenon attracts researchers to observe this emerging trend from a statistical point of view including the type of animal, frequency and place of emergence, as well as the objective of its mention either in actual form or as a metaphor. Thus, this study aims to identify the name or type of animal that has been selected to be immortalised in this Holy Book, the frequency and condition of its appearance, and subsequently the objective of its mention in the verse or surah. This is very important as basic data which will pave the way to a more advanced study in highlighting the majesty and miracles of the Quran in various dimensions that are related to natural resources. Correspondingly, this is a library study that is based on research on the text, especially the books of authentic interpretation, contemporary tafsir studies, the Ulum Quran, scientific journals, and other related texts. Among the important findings of the study is that animals and livestock are not a side element that comes to complete the beauty of the Quranic word or metaphor, or the physical design framework of its arrangement alone, for the presence of each of these animals or livestock is to carry the mission and certain objectives that cannot be played by other components in it. This study also paves the way for various further studies that can be explored by interested researchers, as well as in tadabbur activities that successfully attract the interest of today's society to get closer to the Quran.


mBio ◽  
2021 ◽  
Author(s):  
Alfredo G. Torres ◽  
Maria Elena Bottazzi ◽  
Floyd L. Wormley

The way that diversity, equity, and inclusion impact scientific careers varies for everyone, but it is evident that institutions providing an environment where being different or having differences creates a sense of being welcomed, supported, and valued are beneficial to the scientific community at large. In this commentary, three short stories from Texas-based microbiologists are used to depict (i) the importance of bringing the guiding principles of diversity, equity, and inclusion within their professional roles, (ii) the need to apply and translate those principles to support and enable successful scientific careers among peers and trainees, and (iii) the impact of effective science communication to increase the understanding of microbial environments among the community at large.


2021 ◽  
Author(s):  
Antoine Doury ◽  
Samuel Somot ◽  
Sébastien Gadat ◽  
Aurélien Ribes ◽  
Lola Corre

Abstract Providing reliable information on climate change at local scale remains a challenge of first importance for impact studies and policymakers. Here, we propose a novel hybrid downscaling method combining the strengths of both empirical statistical downscaling methods and Regional Climate Models (RCMs). The aim of this tool is to enlarge the size of high-resolution RCM simulation ensembles at low cost.We build a statistical RCM-emulator by estimating the downscaling function included in the RCM. This framework allows us to learn the relationship between large-scale predictors and a local surface variable of interest over the RCM domain in present and future climate. Furthermore, the emulator relies on a neural network architecture, which grants computational efficiency. The RCM-emulator developed in this study is trained to produce daily maps of the near-surface temperature at the RCM resolution (12km). The emulator demonstrates an excellent ability to reproduce the complex spatial structure and daily variability simulated by the RCM and in particular the way the RCM refines locally the low-resolution climate patterns. Training in future climate appears to be a key feature of our emulator. Moreover, there is a huge computational benefit in running the emulator rather than the RCM, since training the emulator takes about 2 hours on GPU, and the prediction is nearly instantaneous. However, further work is needed to improve the way the RCM-emulator reproduces some of the temperature extremes, the intensity of climate change, and to extend the proposed methodology to different regions, GCMs, RCMs, and variables of interest.


2015 ◽  
Vol 4 (1) ◽  
pp. 37-43
Author(s):  
Enrico Petrilli ◽  
Franca Beccaria

Petrilli, E., & Beccaria, F. (2015). The Italian “alcohol question” from 1860 to 1930: Two opposing scientific interpretations. The International Journal Of Alcohol And Drug Research, 4(1), 37-43. doi:http://dx.doi.org/10.7895/ijadr.v4i1.193Background: In recent years, English-speaking and Northern European alcohol researchers have turned a historical gaze towards their subject, and in particular have explored how a medical view attempted to describe and explain phenomena such as alcohol abuse and addiction. Although there was a heated and prolific debate in Italy in the late 19th and early 20th centuries, there are few historical studies of the first scholars’ thoughts on alcohol-related problems.Aims: The article depicts how the Italian scientific community interpreted and explained alcohol-related concerns following the emergence of the alcohol issue in the late 19th century. Specifically, the stances of the two main groups of scientists who dealt with the issue, the Positive School of Criminology and Legal Socialism, are examined.Method: The article is based on the materials collected by the Italian research group during a comparative study carried out as part of the ALICE RAP project. More than 40 books and five scientific journals were consulted.Results: Medical-related concerns were never predominant in the late 19th-century Italian debate on the alcohol question, but were addressed in the broader discussion of criminality, where positivists’ and legal socialists’ perspectives both focused mainly on social consequences, albeit with differing interpretations of causalities and remedies.


Author(s):  
Richard Swedberg

This chapter looks at the role of theory in theorizing. Knowing theory, in order to be good at theorizing in social science, is not the same as having a knowledge of the history of social theory. It is true that it is helpful to have some of the skills of an intellectual historian when one tries to figure out what a concept means, why a theory looks the way it does today, and similar issues. However, this is not the kind of knowledge that one basically needs to have in order to be good at theorizing. The two types of knowledge that are needed in order to theorize well are knowledge of the basics of social theory and knowledge of a number of concepts, mechanisms, and theories.


Sign in / Sign up

Export Citation Format

Share Document