Badly specified theories are not responsible for the replication crisis in social psychology: Comment on Klein

2016 ◽  
Vol 26 (4) ◽  
pp. 540-548 ◽  
Author(s):  
David Trafimow ◽  
Brian D. Earp
Keyword(s):  
Social Psychology ◽  
Replication Crisis

scholarly journals Editorial Essay: The Tumult over Transparency: Decoupling Transparency from Replication in Establishing Trustworthy Qualitative Research

2019 ◽  
Vol 65 (1) ◽  
pp. 1-19 ◽  
Author(s):  
Michael G. Pratt ◽  
Sarah Kaplan ◽  
Richard Whittington
Keyword(s):  
Social Psychology ◽  
Qualitative Research ◽  
Experimental Social Psychology ◽  
Research Management ◽  
The Core ◽  
Replication Crisis ◽  
Methodological Approaches ◽  
Core Issues ◽  
Editorial Essay

Management journals are currently responding to challenges raised by the “replication crisis” in experimental social psychology, leading to new standards for transparency. These approaches are spilling over to qualitative research in unhelpful and potentially even dangerous ways. Advocates for transparency in qualitative research mistakenly couple it with replication. Tying transparency tightly to replication is deeply troublesome for qualitative research, where replication misses the point of what the work seeks to accomplish. We suggest that transparency advocates conflate replication with trustworthiness. We challenge this conflation on both ontological and methodological grounds, and we offer alternatives for how to (and how not to) think about trustworthiness in qualitative research. Management journals need to tackle the core issues raised by this tumult over transparency by identifying solutions for enhanced trustworthiness that recognize the unique strengths and considerations of different methodological approaches in our field.

scholarly journals The past, present, and future of ego depletion

2019 ◽  
Author(s):  
Michael Inzlicht ◽  
Malte Friese
Keyword(s):  
Social Psychology ◽  
Ego Depletion ◽  
Open Science ◽  
Science Practices ◽  
Current State ◽  
Scientific Status ◽  
Replication Crisis ◽  
History Of ◽  
Controversial Topic ◽  
Mere Existence

At the center of social psychology just a few years ago, ego depletion is now widely seen as a controversial topic, one of the chief victims of the replication crisis. Despite over 600 studies of apparent support, many are now asking if ego depletion is even real. Here, we comment on the articles included in this Special Issue: Ego Depletion. Specifically, we delineate the contributions and limitations of these articles by embedding them in a brief history of ego depletion, describing the current state of uncertainty about ego depletion’s scientific status, and outlining necessary steps for the study of ego depletion to have a healthy future. To us, the most troubling aspect of this controversy is not what is suggests about ego depletion; but what it suggests about social psychology more broadly. If the mere existence of ego depletion is seriously doubted by many, what can be confidently regarded as real in social psychology? By increasing the precision of our theories, continuously validating our manipulations and measures, and practicing the full suite of open science practices we have the potential to identify legitimate and robust effects and build a cumulative and trustworthy psychological science.

scholarly journals The statistical crisis in science: How is it relevant to clinical neuropsychology?

2016 ◽  
Author(s):  
andrew gelman
Keyword(s):  
Social Psychology ◽  
Neuropsychological Assessment ◽  
Learning Process ◽  
Scientific Practice ◽  
Open Data ◽  
Lessons Learned ◽  
Clinical Neuropsychology ◽  
Good Scientific Practice ◽  
Replication Crisis

There is currently a statistical (and replication) crisis in science. Social psychology has been at the heart of this crisis, but the lessons learned are relevant for other fields. We discuss three examples of replication challenges and some proposed solutions, and then consider the applicability of these ideas to clinical neuropsychology. In addition to procedural developments such as preregistration and open data and criticism, we recommend that data be collected and analyzed with more recognition that each new study is a part of a learning process. The goal of improving neuropsychological assessment, care, and cure is too important to not take good scientific practice seriously.

scholarly journals The Past, Present, and Future of Ego Depletion

2019 ◽  
Vol 50 (5-6) ◽  
pp. 370-378 ◽  
Author(s):  
Michael Inzlicht ◽  
Malte Friese
Keyword(s):  
Social Psychology ◽  
Ego Depletion ◽  
Open Science ◽  
Self Control ◽  
Science Practices ◽  
Current State ◽  
Replication Crisis ◽  
History Of ◽  
Controversial Topic ◽  
Mere Existence

Abstract. At the center of social psychology just a few years ago, ego depletion is now widely seen as a controversial topic, one of the chief victims of the replication crisis. Despite over 600 studies of apparent support, many are now asking if ego depletion is even real. Here, we comment on the articles included in this Special Issue: Ego Depletion and Self-Control: Conceptual and Empirical Advances. Specifically, we delineate the contributions and limitations of these articles by embedding them in a brief history of ego depletion, describing the current state of uncertainty about ego depletion’s scientific status, and outlining necessary steps for the study of ego depletion to have a healthy future. To us, the most troubling aspect of this controversy is not what it suggests about ego depletion, but what it suggests about social psychology more broadly. If the mere existence of ego depletion is seriously doubted by many, what can be confidently regarded as real in social psychology? By increasing the precision of our theories, continuously validating our manipulations and measures, and practicing the full suite of open science practices, we have the potential to identify legitimate and robust effects and build a cumulative and trustworthy psychological science.

scholarly journals On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists

2020 ◽  
Vol 46 (12) ◽  
pp. 1702-1711 ◽  
Author(s):  
Khandis R. Blake ◽  
Steven Gangestad
Keyword(s):  
Social Psychology ◽  
Measurement Error ◽  
Statistical Power ◽  
Best Practice ◽  
Effect Sizes ◽  
Social Psychology Bulletin ◽  
Replication Crisis ◽  
Positive Results

The replication crisis has seen increased focus on best practice techniques to improve the reliability of scientific findings. What remains elusive to many researchers and is frequently misunderstood is that predictions involving interactions dramatically affect the calculation of statistical power. Using recent papers published in Personality and Social Psychology Bulletin (PSPB), we illustrate the pitfalls of improper power estimations in studies where attenuated interactions are predicted. Our investigation shows why even a programmatic series of six studies employing 2 × 2 designs, with samples exceeding N = 500, can be woefully underpowered to detect genuine effects. We also highlight the importance of accounting for error-prone measures when estimating effect sizes and calculating power, explaining why even positive results can mislead when power is low. We then provide five guidelines for researchers to avoid these pitfalls, including cautioning against the heuristic that a series of underpowered studies approximates the credibility of one well-powered study.

scholarly journals Dealing with the Experimenter Effect

2020 ◽  
Vol 34 (4) ◽  
pp. 703-709
Author(s):  
Dick Bierman ◽  
Jacob J. Jolij
Keyword(s):  
Social Psychology ◽  
Human Studies ◽  
Experimental Science ◽  
Experimenter Effect ◽  
Replication Crisis ◽  
Experimenter Effects ◽  
Psychological Experiments

Methods in experimental science assume objective facts, and those effects are generally independent of the observer or experimenter. This objectivity assumption is not warranted in the field of human studies. Results of psychological experiments tend to be dependent on among other things the expectations of the experimenter. The experimenter effect togther with the replication crisis in social psychology are major issues in experimental parapsychology. We use Houtkooper's Hierarchical Observational Theory to look at a model for dealing with this issue, and conclude that multiple-experimenter projects might be able to sort out experimenter effects from intrinisic effects. Keywords: experimenter effect; replication crisis; psi; parapsychology

scholarly journals When open data closes the door: Problematising a one size fits all approach to open data in journal submission guidelines

2021 ◽  
Author(s):  
Annayah Miranda Beatrice Prosser ◽  
Richard Hamshaw ◽  
Johanna Meyer ◽  
Ralph Bagnall ◽  
Leda Blackwood ◽  
...  
Keyword(s):  
Social Psychology ◽  
Qualitative Research ◽  
Data Sharing ◽  
Open Data ◽  
Ethical Challenges ◽  
Qualitative Approaches ◽  
Replication Crisis ◽  
Journal Policies ◽  
Data Requirements ◽  
Current Journal

Opening data promises to improve research rigour and democratise knowledge production. But it also poses practical, theoretical, and ethical risks for qualitative research. Despite discussion about open data in qualitative social psychology predating the replication crisis, the nuances of this discussion have not been translated into current journal policies. Through a content analysis of 261 journals in the domain of social psychology, we establish the state of current journal policies for open data. We critically discuss how these expectations may not be adequate for establishing qualitative rigour, can introduce ethical challenges, and may place those who wish to use qualitative approaches at a disadvantage in peer review and publication processes. We assert that open data requirements should include clearer guidelines that reflect the nuance of data sharing in qualitative research, and move away from a universal ‘one-size-fits-all’ approach to data sharing.

Special Issue on “New Media and Social Psychology”

2006 ◽  
Vol 37 (2) ◽  
pp. 57-57
Author(s):  
Bernad Batinic ◽  
Anja Goeritz
Keyword(s):  
Social Psychology ◽  
New Media ◽  
Special Issue
Sign in / Sign up

Export Citation Format

Share Document