scholarly journals Analysis of Process Data of PISA 2012 Computer-Based Problem Solving: Application of the Modified Multilevel Mixture IRT Model

2018 ◽  
Vol 9 ◽  
Author(s):  
Hongyun Liu ◽  
Yue Liu ◽  
Meijuan Li
Keyword(s):  
Problem Solving ◽  
Process Data ◽  
Irt Model ◽  
Pisa 2012 ◽  
Mixture Irt ◽  
Computer Based

scholarly journals Interactive computer based assessment tasks: How problem-solving process data can inform instruction

2010 ◽  
Vol 26 (5) ◽  
Author(s):  
Nathan Zoanetti
Keyword(s):  
Problem Solving ◽  
A Priori ◽  
Individual Student ◽  
Process Data ◽  
Evidence Map ◽  
Traditional Assessment ◽  
Targeted Instruction ◽  
Computer Based ◽  
Problem Solving Process ◽  
Key Steps

<span>This article presents key steps in the design and analysis of a computer based problem-solving assessment featuring interactive tasks. The purpose of the assessment is to support targeted instruction for students by diagnosing strengths and weaknesses at different stages of problem-solving. The first focus of this article is the task piloting methodology, which demonstrates the relationship between process data and a priori documented problem-solving behaviours. This work culminated in the design of a </span><em>Microsoft Excel</em><span> template for data transcription named a </span><em>Temporal Evidence Map</em><span>. The second focus of this article is to illustrate how evidence from process data can be accumulated to produce and report instructionally useful information not available through traditional assessment approaches. This is demonstrated through the production of reports profiling individual student outcomes against important aspects of problem solving.</span>

Analyzing Process Data from Problem-Solving Items with N-Grams

2016 ◽  
pp. 750-777 ◽  
Author(s):  
Qiwei He ◽  
Matthias von Davier
Keyword(s):  
Problem Solving ◽  
Task Performance ◽  
Language Processing ◽  
Large Scale ◽  
Process Data ◽  
Action Sequence ◽  
Sequential Action ◽  
Item Development ◽  
Sequence Patterns ◽  
Computer Based

This chapter draws on process data recorded in a computer-based large-scale program, the Programme for International Assessment of Adult Competencies (PIAAC), to address how sequences of actions recorded in problem-solving tasks are related to task performance. The purpose of this study is twofold: first, to extract and detect robust sequential action patterns that are associated with success or failure on a problem-solving item, and second, to compare the extracted sequence patterns among selected countries. Motivated by the methodologies of natural language processing and text mining, we utilized feature selection models in analyzing the process data at a variety of aggregate levels and evaluated the different methodologies in terms of predictive power of the evidence extracted from process data. It was found that action sequence patterns significantly differed by performance groups and were consistent across countries. This study also demonstrated that the process data were useful in detecting missing data and potential mistakes in item development.

Scientific Problem Solving in a Virtual Laboratory: A Comparison Between Individuals and Pairs

2008 ◽  
Vol 67 (2) ◽  
pp. 71-83 ◽  
Author(s):  
Yolanda A. Métrailler ◽  
Ester Reijnen ◽  
Cornelia Kneser ◽  
Klaus Opwis
Keyword(s):  
Visual Search ◽  
Problem Solving ◽  
Process Data ◽  
Scientific Problem ◽  
Domain Specific ◽  
Scientific Problem Solving ◽  
Before And After ◽  
Verbal Data ◽  
Psychological Knowledge ◽  
Problem Solving Task

This study compared individuals with pairs in a scientific problem-solving task. Participants interacted with a virtual psychological laboratory called Virtue to reason about a visual search theory. To this end, they created hypotheses, designed experiments, and analyzed and interpreted the results of their experiments in order to discover which of five possible factors affected the visual search process. Before and after their interaction with Virtue, participants took a test measuring theoretical and methodological knowledge. In addition, process data reflecting participants’ experimental activities and verbal data were collected. The results showed a significant but equal increase in knowledge for both groups. We found differences between individuals and pairs in the evaluation of hypotheses in the process data, and in descriptive and explanatory statements in the verbal data. Interacting with Virtue helped all students improve their domain-specific and domain-general psychological knowledge.

The Genetics Lab - A new computer-based problem solving scenario to assess intelligence

2011 ◽  
Author(s):  
Philipp Sonnleitner ◽  
Martin Brunner ◽  
Ulrich Keller ◽  
Romain Martin ◽  
Thibaud Latour
Keyword(s):  
Problem Solving ◽  
Computer Based

Computer-based Information Search and Ill-Defined Problem Solving

2002 ◽  
Author(s):  
Jody J. Illies ◽  
Jennifer A. Nies ◽  
Roni Reiter-Palmon
Keyword(s):  
Problem Solving ◽  
Information Search ◽  
Computer Based

Proses Berpikir Logis Siswa Sekolah Dasar Bertipe Kecerdasan Logis Matematis dalam Memecahkan Masalah Matematika

2014 ◽  
Vol 2 (2) ◽  
Author(s):  
Liska Yanti Pane ◽  
Kamid Kamid ◽  
Asrial Asrial
Keyword(s):  
Problem Solving ◽  
Learning Process ◽  
Qualitative Method ◽  
Logical Thinking ◽  
Think Aloud ◽  
Process Data ◽  
Thinking Process ◽  
Problem Solving Process ◽  
Problem Solving Strategy ◽  
Solving Strategy

This research aims to describe logical thinking process of a logical-mathematical intelligence student. We employ qualitative method to disclose the subject’s learning process. Data are collected by interview and modified think aloud methods. The results show that subject has capability to find and organize problems and data correctly. Subject describes conditions that are needed to do the steps of problem solving strategy. The steps are done systematically until the end of problem solving process.

scholarly journals Using process data to understand problem-solving strategies and processes for drag-and-drop items in a large-scale mathematics assessment

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Yang Jiang ◽  
Tao Gong ◽  
Luis E. Saldivia ◽  
Gabrielle Cayton-Hodges ◽  
Christopher Agard
Keyword(s):  
Problem Solving ◽  
Time Allocation ◽  
Large Scale ◽  
Solution Process ◽  
Process Data ◽  
Mathematics Assessments ◽  
Assessment Design ◽  
Eighth Grade Students ◽  
Problem Solving Strategies ◽  
Drag And Drop

AbstractIn 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to study the cognitive and behavioral processes that underlie test-takers’ performances in ways that are not otherwise possible with the response data alone. In this exploratory study, we investigated the problem-solving processes and strategies applied by the nation’s fourth and eighth graders by analyzing the process data collected during their interactions with two technology-enhanced drag-and-drop items (one item for each grade) included in the first digital operational administration of the NAEP’s mathematics assessments. Results from this research revealed how test-takers who achieved different levels of accuracy on the items engaged in various cognitive and metacognitive processes (e.g., in terms of their time allocation, answer change behaviors, and problem-solving strategies), providing insights into the common mathematical misconceptions that fourth- and eighth-grade students held and the steps where they may have struggled during their solution process. Implications of the findings for educational assessment design and limitations of this research are also discussed.

scholarly journals Computer-based application for high school physics exams using IRT model 1P

2021 ◽  
Author(s):  
Yetti Supriyati ◽  
Dwi Susanti ◽  
Slamet Maulana
Keyword(s):  
High School ◽  
Irt Model ◽  
High School Physics ◽  
Computer Based
Sign in / Sign up

Export Citation Format

Share Document