Supplemental Material for Upending Racism in Psychological Science: Strategies to Change How Science Is Conducted, Reported, Reviewed, and Disseminated

Diversity Accountability Index for Journals (DAI-J): Increasing awareness and establishing accountability across psychology journals

10.31234/osf.io/zp9em ◽

2021 ◽

Author(s):

NiCole T. Buchanan ◽

Marisol Perez ◽

Mitchell J Prinstein ◽

Idia Thurston

Keyword(s):

Social Norms ◽

Tipping Point ◽

Partial Credit ◽

Majority Opinion ◽

Credit Score ◽

American Psychologist ◽

Psychological Science ◽

Full Credit ◽

Science Strategies

To increase awareness and establish accountability, we propose that journals rate themselves using this table with an emerging list of accountability benchmarks. Recommendations are derived from Buchanan, Perez, Prinstein, & Thurston's 2021 paper, Upending Racism in Psychological Science: Strategies to Change How Our Science is Conducted, Reported, Reviewed, and Disseminated. Benchmarks were based on Centola et al., 2018, which showed 25% as the tipping point for shifting majority opinion on social norms. In order to over-correct for racism that has permeated our science, we suggest partial credit (score of 1) for journals that meet the 25% threshold and full credit (score of 2) for journals that go well above this threshold (i.e., 33% or one third of their publications). In the present table, “Most” refers to 70-100% of published articles, “Some” refers to 30-50% of published articles, and “Few” refers to 0-10% of published articles. See: Buchanan, N. T., Perez, M., Prinstein, M., & Thurston, I. (invited resubmission). Upending Racism in Psychological Science: Strategies to Change How Our Science is Conducted, Reported, Reviewed, and Disseminated. American Psychologist. PsyArXiv. https://psyarxiv.com/6nk4x

Download Full-text

Diversity Accountability Index for Journals (DAI-J): Increasing awareness and establishing accountability across psychology journals

10.31219/osf.io/3pkb5 ◽

2021 ◽

Author(s):

NiCole T. Buchanan ◽

Marisol Perez ◽

Mitchell J Prinstein ◽

Idia Thurston

Keyword(s):

Social Norms ◽

Tipping Point ◽

Public Access ◽

Partial Credit ◽

Majority Opinion ◽

Credit Score ◽

American Psychologist ◽

Psychological Science ◽

Full Credit ◽

Science Strategies

To increase awareness and establish accountability, we propose that journals rate themselves using this table with an emerging list of accountability benchmarks. Recommendations are derived from Buchanan, Perez, Prinstein, & Thurston's 2021 paper, Upending Racism in Psychological Science: Strategies to Change How Our Science is Conducted, Reported, Reviewed, and Disseminated. Benchmarks were based on Centola et al., 2018, which showed 25% as the tipping point for shifting majority opinion on social norms. In order to over-correct for racism that has permeated our science, we suggest partial credit (score of 1) for journals that meet the 25% threshold and full credit (score of 2) for journals that go well above this threshold (i.e., 33% or one third of their publications). In the present table, “Most” refers to 70-100% of published articles, “Some” refers to 30-50% of published articles, and “Few” refers to 0-10% of published articles. Buchanan, N. T., Perez, M., Prinstein, M. J., & Thurston, I. (invited resubmission). Upending Racism in Psychological Science: Strategies to Change How Our Science is Conducted, Reported, Reviewed, and Disseminated. American Psychologist. (PsyArXiv Public Access: https://psyarxiv.com/6nk4x)

Download Full-text

Upending racism in psychological science: Strategies to change how science is conducted, reported, reviewed, and disseminated.

American Psychologist ◽

10.1037/amp0000905 ◽

2021 ◽

Vol 76 (7) ◽

pp. 1097-1112

Author(s):

NiCole T. Buchanan ◽

Marisol Perez ◽

Mitchell J. Prinstein ◽

Idia B. Thurston

Keyword(s):

Psychological Science ◽

Science Strategies

Download Full-text

A pragmatist philosophy of psychological science and its implications for replication

Behavioral and Brain Sciences ◽

10.1017/s0140525x18000626 ◽

2018 ◽

Vol 41 ◽

Cited By ~ 3

Author(s):

Ana Gantman ◽

Robin Gomila ◽

Joel E. Martinez ◽

J. Nathan Matias ◽

Elizabeth Levy Paluck ◽

...

Keyword(s):

William James ◽

Mental Processes ◽

Psychological Science ◽

Behavioral Measurement ◽

The World ◽

Pragmatist Philosophy

AbstractA pragmatist philosophy of psychological science offers to the direct replication debate concrete recommendations and novel benefits that are not discussed in Zwaan et al. This philosophy guides our work as field experimentalists interested in behavioral measurement. Furthermore, all psychologists can relate to its ultimate aim set out by William James: to study mental processes that provide explanations for why people behave as they do in the world.

Download Full-text

Replications can cause distorted belief in scientific progress

Behavioral and Brain Sciences ◽

10.1017/s0140525x18000584 ◽

2018 ◽

Vol 41 ◽

Cited By ~ 2

Author(s):

Michał Białek

Keyword(s):

Real World ◽

Scientific Progress ◽

The Public ◽

Psychological Science

AbstractIf we want psychological science to have a meaningful real-world impact, it has to be trusted by the public. Scientific progress is noisy; accordingly, replications sometimes fail even for true findings. We need to communicate the acceptability of uncertainty to the public and our peers, to prevent psychology from being perceived as having nothing to say about reality.

Download Full-text

Values in Psychological Science

10.1017/9781316471302 ◽

2018 ◽

Cited By ~ 1

Author(s):

Lisa Osbeck

Keyword(s):

Psychological Science

Download Full-text

Translocation Relative to Range

Methodology ◽

10.1027/1614-2241.4.3.132 ◽

2008 ◽

Vol 4 (3) ◽

pp. 132-138 ◽

Cited By ~ 3

Author(s):

Michael Höfler

Keyword(s):

Risk Difference ◽

Binary Outcomes ◽

Number Needed To Treat ◽

Likert Scales ◽

Psychological Science ◽

The Absolute ◽

The Difference ◽

Variance Parameters ◽

Standardized Index ◽

Maximum Possible Magnitude

A standardized index for effect intensity, the translocation relative to range (TRR), is discussed. TRR is defined as the difference between the expectations of an outcome under two conditions (the absolute increment) divided by the maximum possible amount for that difference. TRR measures the shift caused by a factor relative to the maximum possible magnitude of that shift. For binary outcomes, TRR simply equals the risk difference, also known as the inverse number needed to treat. TRR ranges from –1 to 1 but is – unlike a correlation coefficient – a measure for effect intensity, because it does not rely on variance parameters in a certain population as do effect size measures (e.g., correlations, Cohens d). However, the use of TRR is restricted on outcomes with fixed and meaningful endpoints given, for instance, for meaningful psychological questionnaires or Likert scales. The use of TRR vs. Cohens d is illustrated with three examples from Psychological Science 2006 (issues 5 through 8). It is argued that, whenever TRR applies, it should complement Cohens d to avoid the problems related to the latter. In any case, the absolute increment should complement d.

Download Full-text