Characterizing change in students' self-assessments of understanding when engaged in instructional activities

Author(s):  
Jenna Tashiro ◽  
Daniela Parga ◽  
John Pollard ◽  
Vicente Talanquer

Students’ abilities to self-assess their understanding can influence their learning and academic performance. Different factors, such as performance level, have been shown to relate to student self-assessment. In this study, hierarchical linear modeling was used to identify factors and quantify their effects on the changes observed in chemistry students’ self-assessed understanding when engaging in instructional activity. This study replicates and expands on previous findings regarding performance by showing that the worse students performed on a task, the more likely they were to lower their self-assessed understanding after that activity. Task difficulty was found to be a significant effect on change in students' self assessments with students being more likely to lower their self-assessed understanding after a more difficult task and raise it following an easier task independent of performance. Perceived comparative understanding (how students thought they compared to their surrounding peers) was also found to be a significant effect. Students who later reported their understanding to be lower than their peers, as compared to those who later reported their understanding to be about the same as their peers, were observed to have lowered their self-assessed understanding. Actual comparative performance (difference in performance of the student to their surrounding peers), gender, and feedback were not found to be significant effects on change in students’ self-assessed understanding. The results of this investigation may inform instructors on how their instructional decisions differentially impact changes in students’ judgements about their understanding.

2018 ◽  
Author(s):  
Robert D McIntosh ◽  
Elizabeth Fowler ◽  
Tianjiao Lyu ◽  
Sergio Della Sala

The Dunning-Kruger effect (DKE) is the finding that, across a wide range of tasks, poor performers greatly overestimate their ability, while top performers make more accurate self-assessments. The original account of the DKE involves the idea that metacognitive insight requires the same skills as task performance, so that unskilled people perform poorly and lack insight. However, typical global measures of self-assessment are prone to statistical and other biases that could explain the same pattern. We used psychophysical methods to examine metacognitive insight in simple movement and spatial memory tasks: pointing at a dot, or recalling its position after a short delay. We measured task skill in an initial block, and self-assessment in a second block, in which participants judged after every trial whether they had hit the target or not. Metacognitive calibration and sensitivity were indeed related to task skill, and partially mediated the DKE. In a second study, we again measured task skill in an initial block, but titrated task difficulty in the second block so that all participants performed the task with equivalent levels of success. Metacognitive measures were again related to skill, but the DKE pattern itself was eliminated. In a third study, we used statistical modelling to illuminate these findings, showing that differences in metacognitive calibration and sensitivity can contribute to the DKE, but are neither necessary nor sufficient for it. This general analysis explains and quantifies how metacognitive insight and other factors interact to determine this famous effect.


2019 ◽  
Vol 18 (2) ◽  
pp. 106-111
Author(s):  
Fong-Yi Lai ◽  
Szu-Chi Lu ◽  
Cheng-Chen Lin ◽  
Yu-Chin Lee

Abstract. The present study proposed that, unlike prior leader–member exchange (LMX) research which often implicitly assumed that each leader develops equal-quality relationships with their supervisors (leader’s LMX; LLX), every leader develops different relationships with their supervisors and, in turn, receive different amounts of resources. Moreover, these differentiated relationships with superiors will influence how leader–member relationship quality affects team members’ voice and creativity. We adopted a multi-temporal (three wave) and multi-source (leaders and employees) research design. Hypotheses were tested on a sample of 227 bank employees working in 52 departments. Results of the hierarchical linear modeling (HLM) analysis showed that LLX moderates the relationship between LMX and team members’ voice behavior and creative performance. Strengths, limitations, practical implications, and directions for future research are discussed.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Robert Garrett ◽  
Shaunn Mattingly ◽  
Jeff Hornsby ◽  
Alireza Aghaey

PurposeThe purpose of this study is to evaluate the effect of opportunity relatedness and uncertainty on the decision of a corporate entrepreneur to pursue a venturing opportunity.Design/methodology/approachThe study uses a conjoint experimental design to reveal the structure of respondents' decision policies. Data were gathered from 47 useable replies from corporate entrepreneurs and were analyzed with hierarchical linear modeling (HLM).FindingsResults show that product relatedness, market relatedness, perceived certainty about expected outcomes and slack resources all have a positive effect on the willingness of a corporate entrepreneur to pursue a new venture idea. Moreover, slack was found to diminish the positive effect of product relatedness on the likelihood to pursue a venturing opportunity.Practical implicationsBy providing a better understanding of decision-making schemas of corporate entrepreneurs, the findings of this study help improve the practice of entrepreneurship at the organizational level. In order to make more accurate opportunity assessments, corporate entrepreneurs need to be aware of their cognitive strategies and need to factor in the salient criteria affecting such assessments.Originality/valueThis paper adds to the limited understanding of corporate-level decision-making with regard to pursuing venturing opportunities. More specifically, the paper adds new insights regarding how relatedness and uncertainty affect new venture opportunity assessments in the presence (or lack thereof) of slack resources.


2021 ◽  
Vol 11 (3) ◽  
pp. 96
Author(s):  
Hee Jung Gong ◽  
Jung Eun Hong

This study is concerned with the central issues of community service engagement (CSE) in 21st century democratic societies around the world. To examine the factors influencing postsecondary education attainment’s relationship to CSE, this study utilized data from the Organization for Economic Co-operation and Development (OECD) countries using ordinary least square (OLS) and two-level hierarchical linear modeling (HLM) methods, including various factors for each country’s individual and country levels. The results show that attainment in postsecondary education at the individual level and investment and enrollments in tertiary education both have an influence on increasing CSE in 18 OECD countries. The present study is expected to contribute to an understanding of the relationship between postsecondary education and CSE across the world.


Sign in / Sign up

Export Citation Format

Share Document