Designing performance-based measures to assess the scientific thinking skills of chemistry undergraduate researchers

2016 ◽  
Vol 17 (4) ◽  
pp. 808-817 ◽  
Author(s):  
Joseph A. Harsh
Keyword(s):  
Research Training ◽  
Undergraduate Research ◽  
Thinking Skills ◽  
Self Report ◽  
Face Validity ◽  
Scientific Thinking ◽  
Research Experience ◽  
Good Reliability ◽  
Research Experiences ◽  
Chemistry Students

Undergraduate research (UR) is a vetted educational tool that is commonly perceived to prepare students for entering graduate school and careers in STEM fields; however, scholarly attention to date has largely relied on self-report data, which may limit inferences about the causal effects on student outcomes. In light of this, recent calls have been made for innovative and rigorous assessment strategies to better understand the efficacy and impact of UR on key disciplinary skills, both in classroom and internship UR models, that can help inform decisions about educational refinement. To more accurately measure the effect of UR on students, well-designed performance-based assessments can be used to provide direct evidence to the development of targeted skills during their research experience. Given the limited availability of tested, adaptable (and freely available) performance measures for assessing undergraduate chemistry students' scientific thinking skills, this article outlines a five-step process drawn from the literature about how reliable tasks and rubrics can be developed by faculty interested in assessing the effect of research training in the lab and classroom. For this purpose, as an applied example, the manuscript describes the development, testing, and validation of the Performance assessment of Undergraduate Research Experiences (PURE) instrument, which was designed to directly characterize the effects of research experiences on chemistry students' analytical and data-driven decision-making through open-response tasks situated in real-world scientific problems. Initial results reveal that the PURE instrument has high face validity and good reliability in measuring the scientific thinking skills of chemistry student researchers, and documents differences in UR students' answer quality over time supporting the effect of UR on research skill growth and the viability of performance data to assess these changes.

Evaluating the development of chemistry undergraduate researchers’ scientific thinking skills using performance-data: first findings from the performance assessment of undergraduate research (PURE) instrument

2017 ◽  
Vol 18 (3) ◽  
pp. 472-485 ◽  
Author(s):  
Joseph Harsh ◽  
John J. Esteb ◽  
Adam V. Maltese
Keyword(s):  
Undergraduate Research ◽  
Thinking Skills ◽  
Performance Data ◽  
Self Report ◽  
Scientific Thinking ◽  
Research Experiences ◽  
Chemistry Students ◽  
Primary Literature ◽  
Report Data ◽  
Self Report Data

National calls in science, technology, engineering, and technology education reform efforts have advanced the wide-scale engagement of students in undergraduate research for the preparation of a workforce and citizenry able to attend to the challenges of the 21st century. Awareness of the potential benefits and costs of these experiences has led to an emerging literature base outlining gains in participants’ cognitive, affective, and conative domains to support the impact of undergraduate research for students of all backgrounds; however, the majority of this work has relied on self-report data limiting inferences to the causal effects on student learning. As part of a larger project on apprentice-like undergraduate research experiences (UREs) in the physical sciences, the present exploratory study complemented indirect self-report data with direct performance data to assess the development of chemistry students’ scientific thinking skills over a research experience. Performance data were collected using the Performance assessment of Undergraduate Research Experiences (PURE) instrument, a validated tool designed to assess changes in chemistry students’ analytical and data driven decision-making skills through open-response tasks situated in real-world problems from primary literature. Twenty-four summer research students in chemistry (46% women; 50% 1st/2nd year students; 42% first time URE participant) from seven colleges and universities provided baseline and post-intervention performance data. Differences in pre/post-response task correctness provided a direct measure of individual changes in student competencies. Early study findings indicate the positive contributions of UREs to student's competencies in the areas of problem-solving, experimental design and the use of research techniques, data analysis and the interpretation of results, and the evaluation of primary literature. Survey data were also collected on students’ self-skill ratings to allow comparisons between perceived and demonstrated competencies, which were found to be weakly correlated. This work begins to offer direct evidence to the effect of UREs on student learning progressions as well as the potential use of performance test data in evaluating the success of research training interventions designed to improve scientific thinking skills.

A Course-Based Undergraduate Research Experience in Biofluid Mechanics

2019 ◽  
Vol 141 (12) ◽  
Author(s):  
Alisa Morss Clyne ◽  
Adrian C. Shieh ◽  
Jennifer S. Stanford
Keyword(s):  
Flipped Classroom ◽  
Engineering Students ◽  
Undergraduate Research ◽  
Self Report ◽  
Research Experience ◽  
Biofluid Mechanics ◽  
Research Experiences ◽  
In Vivo Experiments

Abstract Course-based undergraduate research experiences (CURE) are a valuable tool to increase research exposure for larger undergraduate cohorts. We implemented a CURE within a senior-level biofluid mechanics course that was primarily taught using a flipped classroom approach. Due to the large class size, the students analyzed data that was publicly available and produced by one of our laboratories. Student teams then developed hypotheses based on the data analysis and designed a set of in vitro and in vivo experiments to test those hypotheses. The hypotheses and experiments that were most highly rated by the class were then tested in our laboratory. At the end of the class, student gains were assessed by self-report and compared to those self-reported by students engaging in a traditional freshman undergraduate summer research experience. While the students in the CURE reported moderate gains in self-assessment of research-based skills, their self-reported gains were statistically significantly lower than those reported by students who participated in the traditional research experience. We believe that the CURE could be improved through implementation in a lower level class, enabling students to observe laboratory experiments, and providing additional feedback throughout the hypothesis development and experimental design process. Overall, the CURE is an innovative way to expand research experiences, in particular for engineering students who often do not participate in hypothesis-driven research during their undergraduate education.

Role of Research Educator in sequential course-based undergraduate research experience program

2019 ◽  
Vol 366 (12) ◽  
Author(s):  
Caitlin Light ◽  
Megan Fegley ◽  
Nancy Stamp
Keyword(s):  
Research Training ◽  
Undergraduate Research ◽  
Work Load ◽  
Assistant Professor ◽  
First Year ◽  
Research Experience ◽  
Research Experiences ◽  
Microbial Biofilms ◽  
Research Track ◽  
Teaching Responsibilities

ABSTRACT In our First-Year Research Immersion (FRI) program, students take a sequence of three CUREs (course-based undergraduate research experiences). Each Research Educator (Research Assistant Professor, aka RE) oversees the day-to-day work of about 30 first-year and 25 second-year students in a dedicated research-training lab. Instead of the typical work-load division for faculty between their teaching responsibilities (typically lecture) and research programs, REs combine these two responsibilities into one endeavour that better engages and teaches beginning students intending to major in science or engineering. Although more challenging for REs, their work in FRI expands their professional development substantially. Examples from the microbiology research track (specifically, Microbial Biofilms in Human Health) illustrate both the challenges and rewards for the REs.

Outcomes from a research experience for undergraduates (REU) program focused on behavioral research with real-world implications

2018 ◽  
Vol 62 (1) ◽  
pp. 1156-1156
Author(s):  
Patricia R. DeLucia ◽  
Jeong-Hee Kim ◽  
Ngan Nguyen ◽  
Eugene W. Wang ◽  
James Yang
Keyword(s):  
Training Program ◽  
Real World ◽  
Research Training ◽  
Undergraduate Research ◽  
Human Robot Interaction ◽  
Research Experience ◽  
Structured Interviews ◽  
Research Skills ◽  
Research Experiences ◽  
National Science Foundation Research

The current study examined a National Science Foundation Research Experience for Undergraduates (REU) Site which provided research training to eight female undergraduates. Although it is well known that undergraduate research experiences benefit students and help them pursue careers in science (e.g., Eagan et al., 2011; Taraban & Logue, 2012; Willis et al., 2013), it is important for students to recognize the association between their research and real-world issues (ASHA, 2015; Rhoten & Pfirman, 2007). Human Factors/Ergonomics provides rich opportunities to enhance research experiences for undergraduates. In the current study, students conducted research focused on real-world implications with topics such as driving, human-robot interaction, and relationships. Qualitative and quantitative analyses were performed to assess the effectiveness of the training. Measures included students’ ratings on the Undergraduate Research Questionnaire and the Kardash Ratings of Interns’ Research Skills; diaries of training experiences, and semi-structured interviews. Students and their faculty mentors perceived improvements in the students’ research skills after the completion of the training program. In addition, the students described positive experiences from the training and thought they gained preparation for their careers. The strengths and weakness of the training program that were identified by the students will be useful to improve REUs that are conducted in the future. In conclusion, consistent with prior research, undergraduate research training (or experience) focused on real-world applications was effective.

scholarly journals The Kungullanji Program: Creating an Undergraduate Research Experience to Raise Aspirations of Australian Aboriginal and Torres Strait Islander Students in the Sciences

2021 ◽  
Vol 4 (3) ◽  
pp. 67-75
Author(s):  
Jennifer Leigh Campbell ◽  
◽  
Sushila Chang
Keyword(s):  
Torres Strait Islander ◽  
Research Training ◽  
Undergraduate Research ◽  
Research Experience ◽  
Research Experiences ◽  
Australian Aboriginal ◽  
Self Confidence ◽  
Torres Strait ◽  
Summer Research Program ◽  
Initial Results

The Kungullanji Summer Research Program offers research experiences for Australian Aboriginal and Torres Strait Islander undergraduates while recognizing their contributions to research. The Kungullanji program approach is a strengths-based research training framework that recognizes existing ability outside of institutional definitions of success and adapts to student needs with multilayered support. Initial results suggest that this approach increases students’ self-confidence and interest.

scholarly journals OCEAN EDUCATION • Virtual and Remote—Hands-On Undergraduate Research in Plankton Ecology During the 2020 Pandemic: COVID-19 Can’t Stop This!

Oceanography ◽  
2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Pierre Marrec ◽  
◽  
Andria Miller ◽  
Lucie Maranda ◽  
Susanne Menden-Deuer
Keyword(s):  
Research Training ◽  
Undergraduate Research ◽  
Learning Goals ◽  
Research Experience ◽  
Research Experiences ◽  
Safe Delivery ◽  
Research Fellowship ◽  
Hands On ◽  
Internship Programs ◽  
The University

The pandemic has had innumerable impacts on the oceanographic community, including on summer research internship programs that expose undergraduates to diverse career paths in oceanography while immersed in an active laboratory. For many students, these internships are formative in their career choices. The Summer Undergraduate Research Fellowship in Oceanography (SURFO) at the University of Rhode Island’s Graduate School of Oceanography is one of the Research Experiences for Undergraduates (REU) programs that proceeded remotely during the summer of 2020. Here, we highlight one project that, although remote, maintained a hands-on research experience focused on quantitative skill building. The pandemic forced the REU advisors to identify key learning goals and ensure their safe delivery, given the circumstances. Although all participants agreed that in-person instruction would have been preferable, we were pleased that we did not let a virus halt essential oceanographic research training.

scholarly journals Assessment of Course-Based Undergraduate Research Experiences: A Meeting Report

2014 ◽  
Vol 13 (1) ◽  
pp. 29-40 ◽  
Author(s):  
Lisa Corwin Auchincloss ◽  
Sandra L. Laursen ◽  
Janet L. Branchaw ◽  
Kevin Eagan ◽  
Mark Graham ◽  
...  
Keyword(s):  
Undergraduate Research ◽  
Biology Education ◽  
Operational Definition ◽  
Future Research ◽  
Meeting Report ◽  
Research Experience ◽  
Research Experiences ◽  
Undergraduate Research Experiences ◽  
Foundation Program ◽  
Definition Of

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a “research experience”; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.

Using undergraduate research to develop transferable skills for the modern workforce

2016 ◽  
Vol 37 (2) ◽  
pp. 84
Author(s):  
Jack TH Wang
Keyword(s):  
Biological Sciences ◽  
Large Scale ◽  
Undergraduate Research ◽  
Learning Experiences ◽  
Thinking Skills ◽  
Critical Thinking Skills ◽  
Global Knowledge ◽  
Research Experiences ◽  
Transferable Skills ◽  
Authentic Learning Experiences

In the increasingly competitive global knowledge marketplace, Australian tertiary educators are looking to enrich their program offerings by providing authentic learning experiences for their students. In the biological sciences, this authenticity is best represented by hands-on inquiry and laboratory experimentation, often within the context of research internships. Authentic Large-Scale Undergraduate Research Experiences (ALUREs) aim to broaden the scope of these learning experiences by embedding research into coursework activities accessible by all students within the program. These experiences can promote learning gains in laboratory, analytical, and critical thinking skills, providing students with a transferable skillset applicable to many career paths across the science sector.

scholarly journals Early year undergraduate researchers’ reflections on the values and perceived costs of their research experience

2020 ◽  
Vol 7 (1) ◽  
Author(s):  
Gaye D. Ceyhan ◽  
John W. Tillotson
Keyword(s):  
Achievement Motivation ◽  
Undergraduate Students ◽  
Undergraduate Research ◽  
Intrinsic Value ◽  
Value Theory ◽  
Research Experience ◽  
Expectancy Value ◽  
Research Experiences ◽  
Research Findings ◽  
Future Work

Abstract Background Prior research reported that motivational beliefs that individuals attach to specific tasks predict continuing interest and persistence in the task. A motivational approach may be particularly useful for understanding undergraduate students’ engagement with research in their first and second years in college. The current study utilizes the expectancy-value theory of achievement motivation to qualitatively explore how much and in what ways early year undergraduate researchers value their research experience and what kinds of costs they associate with it. Results The results revealed that intrinsic value had the highest expression in participants’ motivation to engage in research. The second most expressed value type was the utility value of undergraduate research with regards to obtaining the desired outcomes, and attainment value played the least important role in participants’ motivation to engage in research. Findings also indicated that some of the participants associated a cost(s) to their research experience. The highest mentioned perceived cost was opportunity cost, where participants commented on losing other valued alternatives when engaging in research. Participants commented on the time, effort, or amount of work needed to engage in research, and a few participants commented on the emotional cost associated with their research experience in terms of the fear of failure. Conclusion As perceived cost is the least studied in the expectancy-value framework, this study contributes to cost values within college students, particularly about early year undergraduate researchers. The findings of this study can form the basis for future work on exploring ways to increase the values and decrease the costs students experience in their undergraduate research experiences.

scholarly journals Student music stimuli composition in a scaffolded course-based undergraduate research experience

2020 ◽  
Vol 1 (1) ◽  
pp. 1-32
Author(s):  
Abbey L. Dvorak ◽  
Eugenia Hernandez-Ruiz ◽  
Halle Nick ◽  
Ruowen Qi ◽  
Celeste Alderete ◽  
...  
Keyword(s):  
Music Education ◽  
Music Therapy ◽  
Undergraduate Research ◽  
Lessons Learned ◽  
Teaching Model ◽  
Research Experience ◽  
Education Students ◽  
Research Experiences ◽  
Graduate Assistants ◽  
Undergraduate Research Experiences

Course-based undergraduate research experiences (CURE) allow students opportunities to develop research skills. In a scaffolded CURE, music therapy and music education students composed, evaluated, and selected the music stimuli used in a music and mindfulness study with non-musicians at Site 1 and musicians at Site 2. The purposes of this paper are to (a) describe the process of student music stimuli composition and evaluation for use in a course-based undergraduate research experience and (b) identify benefits, challenges, and lessons learned from the viewpoints of students, graduate assistants, and faculty who participated in the multi-site study. Eight students, two graduate assistants, and two faculty provide an overview of the CURE teaching model and assignments, and share first-person accounts of their experiences participating in this CURE.  

Sign in / Sign up

Export Citation Format

Share Document