No Strong Evidence of Stereotype Threat in Females: A Reassessment of the Meta-Analysis

Recently, Picho-Kiroga (2021) published a meta-analysis on the effect of stereotype threat on females. Their conclusion was that the average effect size for stereotype threat studies was d = .28, but that effects are overstated because the majority of studies on stereotype threat in females include methodological characteristics that inflate the apparent effect size. In this response, I show that Picho-Kiroga et al. (2021) committed fundamental errors in their meta-analysis that undermine confidence in the article and warrant major corrections. But even if the data were not flawed, the conclusion that Picho-Kiroga et al. (2021) should have reached is that their results are most consistent with a population effect size of zero. There is no compelling evidence that stereotype threat is a real phenomenon in females.

EFEKTIVITAS MODEL PEMBELAJARAN TERHADAP PENINGKATAN PEMAHAMAN KONSEP FISIKA SISWA SMA: META-ANALISIS

ABSTRAKTujuan dari penelitian ini adalah untuk melihat efektivitas dari beberapa model pembelajaran dalam meningkatkan pemahaman konsep fisika siswa SMA. Penelitian ini merupakan penelitian meta-analisis yang menggambarkan effect size dari penelitian-penelitian pendidikan mengenai pengaruh model-model pembelajaran terhadap pemahaman konsep fisika siswa SMA. Model pembelajaran yang di bandingkan dalam penelitian meta-analisis ini adalah model pembelajaran Discovery Learning, Inkuiri, Kooperatif, Direct Instruction, dan Problem Based Learning. Model pembelajaran yang memiliki efektivitas tertinggi adalah model pembelajaran Langsung (Direct Instruction) dengan nilai rata-rata effect size 1.43 yang termasuk dalam kategori tinggi. Model pembelajaran lain yang juga memiliki nilai rata-rata effect size yang termasuk dalam kategori tinggi adalah model pembelajaran Inkuiri dengan nilai rata-rata effect size 1.39, model pembelajaran Kooperatif dengan nilai rata-rata effect size 1.11, model pembelajaran Discovery Learning dengan nilai rata-rata effect size 0.96, serta model pembelajaran Problem Based Learning dengan nilai rata-rata effect size 0.92. Kata kunci: Meta-Analisis; Discovery Learning; Inkuiri; Kooperatif; Direct Instruction; Problem Based Learning; Pemahaman Konsep; Fisika ABSTRACT The purpose of this study was to see the effectiveness of several learning models in improving the understanding of physics concepts for high school students. This research is a meta-analysis that describes the effect size of educational studies regarding the influence of learning models on the understanding of physics concepts for high school students. The learning models compared in this meta-analysis are the Discovery Learning, Inquiry, Cooperative, Direct Instruction, and Problem Based Learning learning models. The learning model that has the highest effectiveness is the Direct Instruction model with an average effect size value of 1.43 which is included in the high category. Other learning models that also have an average effect size value that is included in the high category are the Inquiry learning model with an average effect size value of 1.39, the Cooperative learning model with an average effect size value of 1.11, and the Discovery Learning learning model with an average value. the average effect size is 0.96, as well as the Problem Based Learning model with an average effect size value of 0.92. Keywords: Meta-Analysis; Discovery Learning; Inquiry; Cooperative; Direct Instruction; Problem Based Learning; Concept Understanding; Physics.

Antecedents and Consequences of Social Adjustment of Undergraduate Students in Thailand: A Meta-Analysis Study

Social adjustment of undergraduate students is an issue that every educational institution worldwide regards as essential; this also includes educational institutions in Thailand. The systematic study, collection, and synthesis of antecedent factors affecting student’s social adjustment are, therefore, necessary as the data obtained from the abundance of research available can lead to new findings which can be used to design, strategize and promote students’ social adjustment, effectively addressing the social adjustment issues of students which have long been problematic. Therefore, this research’s objective is to synthesize available knowledge in the dimension of antecedent factors and consequences regarding to undergraduate students’ social adjustment in Thailand through the examination of various research publications available in the past 10 years (from year A.D. 2009-2019) through meta-analysis. Research that was used to synthesize 50 studies. Research results found that the individual’s internal factors affected student social adjustment the most. The variable of self-control has the largest average effect size. The variables of self-reliance and abstraction have negative consequences and large average effect sizes. Among the factors in the category of individuals’ external factors, the variable of participation in student activities had the largest average effect size, followed by interpersonal relationships, and participation in religious activities, respectively. In addition, under demographic factors, the variable of student age had the largest average effect size, followed by academic achievement, gender, source of funding received, and religion, respectively. These findings can be helpful in furthering strategic planning to ameliorate the social adjustment of students in higher education.

Cross-linguistic influence in simultaneous and early sequential bilingual children: a meta-analysis

Although cross-linguistic influence at the level of morphosyntax is one of the most intensively studied topics in child bilingualism, the circumstances under which it occurs remain unclear. In this meta-analysis, we measured the effect size of cross-linguistic influence and systematically assessed its predictors in 750 simultaneous and early sequential bilingual children in 17 unique language combinations across 26 experimental studies. We found a significant small to moderate average effect size of cross-linguistic influence, indicating that cross-linguistic influence is part and parcel of bilingual development. Language dominance, operationalized as societal language, was a significant predictor of cross-linguistic influence, whereas surface overlap, language domain and age were not. Perhaps an even more important finding was that definitions and operationalisations of cross-linguistic influence and its predictors varied considerably between studies. This could explain the absence of a comprehensive theory in the field. To solve this issue, we argue for a more uniform method of studying cross-linguistic influence.

Serum cytokine patterns are modulated in infants fed formula with probiotics or milk fat globule membranes: A randomized controlled trial

Background Proteins and lipids of milk fat globule membrane (MFGM) and probiotics are immunomodulatory. We hypothesized that Lactobacillus paracasei ssp. paracasei strain F19 (F19) would augment vaccine antibody and T helper 1 type immune responses whereas MFGM would produce an immune response closer to that of breastfed (BF) infants. Objective To compare the effects of supplementing formula with F19 or bovine MFGM on serum cytokine and vaccine responses of formula-fed (FF) and BF infants. Design FF infants were randomized to formula with F19 (n = 195) or MFGM (n = 192), or standard formula (SF) (n = 194) from age 21±7 days until 4 months. A BF group served as reference (n = 208). We analyzed seven cytokines (n = 398) in serum at age 4 months using magnetic bead-based multiplex technology. Using ELISA, we analyzed anti-diphtheria IgG (n = 258) and anti-poliovirus IgG (n = 309) concentrations in serum before and after the second and third immunization, respectively. Results Compared with SF, the F19 group had greater IL-2 and lower IFN-γ concentrations (p<0.05, average effect size 0.14 and 0.39). Compared with BF, the F19 group had greater IL-2, IL-4 and IL-17A concentrations (p<0.05, average effect size 0.42, 0.34 and 0.26, respectively). The MFGM group had lower IL-2 and IL-17A concentrations compared with SF (p<0.05, average effect size 0.34 and 0.31). Cytokine concentrations were comparable among the MFGM and BF groups. Vaccine responses were comparable among the formula groups. Conclusions Contrary to previous studies F19 increased IL-2 and lowered IFN-γ production, suggesting that the response to probiotics differs across populations. The cytokine profile of the MFGM group approached that of BF infants, and may be associated with the previous finding that infectious outcomes for the MFGM group in this cohort were closer to those of BF infants, as opposed to the SF group. These immunomodulatory effects support future clinical evaluation of infant formula with F19 or MFGM.

Meta-Analisis: Pengaruh Bahan Ajar Berbasis Pendekatan STEM Pada Pembelajaran Ekologi

Abstrak: Tujuan penelitian ini untuk menganalisis pengaruh bahan ajar ekologi berbasis pendekatan STEM terhadap pembelajaran Abad-21. Metode penelitian ini adalah meta-analisis dengan menelaah sumber data yang berasal dari jurnal nasional atau internasional terbitan empat tahun terakhir (2016-2020). Hasil penelitian menunjukan bahwa studi meta-analisis berpengaruh pada bahan ajar ekologi berdasarkan pendekatan STEM berdasarkan tingkat pendidikan, jenis media yang digunakan, dan pendekatan STEM dalam pembelajaran ekologi. Temuan penelitian menunjukkan bahwa pengaruh bahan ajar ekologi berdasarkan pendekatan ilmiah memiliki harga rata-rata lebih tinggi di tingkat SMA dibandingkan dengan sekolah dasar dan menengah pertama. Harga ukuran efek rata-rata untuk tingkat pendidikan menengah atas, menengah pertama dan dasar adalah: 1,63; 1,56; dan 1,19 pada kategori tinggi. Sedangkan dari segi media pembelajaran akan lebih efektif jika diaplikasikan dalam modul, dibandingkan dengan media lain, rata-rata effect size modul, LKS/LKPD, dan bahan ajar masing-masing adalah: 2,05; 1,14; dan 0,62 pada kategori tinggi. Berdasarkan hasil belajar kognitif dan keterampilan siswa, pengaruh harga rata-rata terhadap effect size proses sains, hasil belajar, berpikir kritis, dan pemecahan masalah adalah 1,32; 1,61; 2.32; dan 1.83 dengan kategori tinggi maka diikuti kompetensi siswa dengan memberikan pengaruh pada kategori sedang yaitu: 0,61. Kata Kunci: Bahan Ajar, Pendekatan STEM, Ekologi Abstract: The purpose of this study was to analyze the effect of ecology teaching materials based on the STEM approach on 21st-century learning. This research method is a meta-analysis by examining data sources from national or international journals published in the last four years (2016-2020). The results showed that the meta-analysis study affected ecology teaching materials based on the STEM approach based on the level of education, the type of media used, and the STEM approach in ecological learning. The research findings showed that the effect size of ecological teaching materialbased on scientific approach has a higher average prize at senior secondary level compared to primary and junior secondary. The average effect size prices for senior secondary, junior secondary, and primary education levels were: 1.63; 1.56; and 1.19 in the high category. Meanwhile, in terms of learning media, it will be more effective if applied in modules, compared to other media, the average effect size of the module, student worksheet, and teaching materials respectively are: 2.05; 1.14; and 0.62 in the high category. Based on students' cognitive learning outcomes and skills, the effect of the average price on the effect size of the science process, learning outcomes, critical thinking, and problem-solving was 1.32; 1.61; 2.32; and 1.83 with the high category, followed by student competence by giving influence to the medium category, namely: 0.61. Keywords: Teaching Materials, STEM, ecology

Correcting for outcome reporting bias in a meta-analysis: A meta-regression approach

Outcome reporting bias (ORB) refers to the biasing effect caused by researchers selectively reporting outcomes based on their statistical significance. ORB leads to inflated average effect size estimates in a meta-analysis if only the outcome with the largest effect size is reported due to ORB. We propose a new method (CORB) to correct for ORB that includes an estimate of the variability of the outcomes' effect size as a moderator in a meta-regression model. An estimate of the variability of the outcomes' effect size can be computed by assuming a correlation among the outcomes. Results of a Monte-Carlo simulation study showed that effect size in meta-analyses may be severely overestimated without any correction for ORB. The CORB method accurately estimates effect size when overestimation caused by ORB is the largest. Applying the new method to a meta-analysis on the effect of playing violent video games on aggressive cognition showed that the average effect size estimate decreased when correcting for ORB. We recommend to routinely apply methods to correct for ORB in any meta-analysis. We provide annotated R code and functions to facilitate researchers to apply the CORB method.

A Meta-Analysis of the Effect of Physical Activity on Depressive Symptoms: Influence of the COVID-19 Pandemic

Due to the COVID-19 pandemic, a significant number of people experienced higher levels of depression. Concerning the unprecedented impact of depression on physical health, it is important to combat this situation. Physical activity (PA) has been found to have a positive effect on reducing depression (Schuch et al., 2018). However, there is a lack of a systematic review of the association between PA and depression during these unique times of the COVID-19 pandemic. This study was designed to serve as a meta-analysis of the overall effects of PA on depression in studies conducted before and during the COVID-19 pandemic. Empirical studies on the link between PA and depression were searched from academic databases including PubMed and EBSCO. A total of 15 studies (total participants were 170,195) qualified for inclusion in the meta-analysis. Comprehensive Meta-Analysis version 3 was used to compute weighted average effect size and random-effects analyses were conducted. The average effect size (odds ratio) across all 15 studies was 0.722 (95% CI = 0.651, 0.800, Z = -6.229, p < .001), demonstrating that study participants with high levels of PA had lower incidence of depression, compared to those with low PA levels. For the subgroup analysis, significant effects of high PA were found in the 11 studies conducting before the COVID 19 as well as in the four studies that assessed the influence of the COVID-19 (odds ratio = .734, p < .001; odds ratio = .683, p < .001 respectively). The Q-value (Q = 41.061, p < .001) and I-squared value (65.904) demonstrated that the studies were heterogeneous. The main finding of this study supported the evidence that PA can play an important role in reducing depression, especially during the COVID-19 pandemic. Public health professionals should incorporate the significance of improving PE levels into social distancing guidelines (CDC, 2020).

Effect Sizes, Power, and Biases in Intelligence Research: A Meta-Meta-Analysis

In this meta-study, we analyzed 2442 effect sizes from 131 meta-analyses in intelligence research, published from 1984 to 2014, to estimate the average effect size, median power, and evidence for bias. We found that the average effect size in intelligence research was a Pearson’s correlation of 0.26, and the median sample size was 60. Furthermore, across primary studies, we found a median power of 11.9% to detect a small effect, 54.5% to detect a medium effect, and 93.9% to detect a large effect. We documented differences in average effect size and median estimated power between different types of intelligence studies (correlational studies, studies of group differences, experiments, toxicology, and behavior genetics). On average, across all meta-analyses (but not in every meta-analysis), we found evidence for small-study effects, potentially indicating publication bias and overestimated effects. We found no differences in small-study effects between different study types. We also found no convincing evidence for the decline effect, US effect, or citation bias across meta-analyses. We concluded that intelligence research does show signs of low power and publication bias, but that these problems seem less severe than in many other scientific fields.

Effects of age and speed on the ankle–foot system’s power during walking

Structural and functional changes in the foot have been associated with age-related changes in gait mechanics, but walking speed may be a confounding factor in this relationship. The aim of this study was to investigate the effect of aging and speed on the ankle–foot power output during level walking. The effects of speed and aging on features of the mechanical power and work of the ankle and foot were quantified with a gait analysis of 24 young and 16 older individuals walking at different speeds. We observed gait speed having a significant effect on all the investigated features: peak power and positive and negative work of the ankle, foot, and sum of the ankle and foot (average effect size: 0.64 ± 0.22, from 0.26 to 0.87). We observed age having no effect on these same features (average effect size: 0.23 ± 0.12, from 0.03 to 0.39), with the exception of age’s effect when combined with speed on the negative work of the foot. We performed additional analysis to illustrate how the speed can become a confounding factor to the understanding of the age effect on the gait biomechanics. Based on the influence of gait speed on the mechanical power of the ankle–foot system, it is essential that studies control for the effect of gait speed if there is interest in understanding age-related effects, particularly when studying frail older individuals.