Process-Oriented Dynamic Testing in a Complex Figure Task

Process-oriented dynamic testing aims to investigate the processes children use to solve cognitive tasks, and evaluate changes in these processes as a result of training. For the current study, a dynamic complex figure task was constructed, using the graduated prompts approach, to investigate the processes involved in solving a complex figure task and changes in these processes as a consequence of training. A new process-oriented measure was developed, which used computer-automated scoring to evaluate children's organization in drawing the figure. Participants were 106 regular primary school children (M = 7.8 years, standard deviation [SD] = 0.42 years). The graduated prompts training led to significantly more progression in complex figure drawing accuracy from pre-test to post-test, compared to unguided control. The level of organization of the figure also became more advanced as a result of training, as reflected by the highest category of organization being attained by trained children only. However, the training did not lead to transfer from the trained domain to an inductive reasoning task.

Dynamic Assessment and Computerized Adaptive Tests in Reading Processes

The development of novel educational assessment models founded on item response theory (IRT), as well as software tools designed to implement these models, has contributed to the surge in computerized adaptive tests (CATs). The distinguishing characteristic of CATs is that the sequence of items on a test progressively adapts to the performance levels of students as they are taking it. An important advantage of CATs is that they can reduce the duration of the assessment by automatically excluding in real time those items that are either too easy or too hard for a student’s capabilities. Furthermore, a CAT can provide real-time feedback to students based on their ongoing performance on the test. More recently, dynamic CATs have emerged that include special features (e.g., graduated prompts, pretest and posttest assessment items, cognitive scaffolding items) to assess the proximal development zone of the students. This allows test administrators to obtain information about the kind and level of mediation required by the students to reach their optimal performance. The following article presents some initial results from the experimental application of a computerized adaptive dynamic assessment battery of reading processes in a sample of Spanish-speaking elementary school students. Specifically, the aim was to analyze the effect of the graduated prompts implemented in a syntactic awareness test on the results obtained. In addition, preliminary results regarding the predictive and incremental validity of dynamic scores on reading competence are presented and discussed.

Differences in Need for Instruction: Dynamic Testing in Children with Arithmetic Difficulties

In this paper we investigated the contribution of a dynamic testing procedure, including multiple graduated prompts protocols, in identifying differences in need for instruction of second grade children (N = 120) with arithmetic difficulties. The training was adaptive and prompts were provided according to one of six protocols, each focusing on a different problem solving step. Results showed that based on the number of prompts required from each protocol different patterns of problem solving could be identified, and further four profiles of instructional needs could be distinguished. The results provide starting points for individualized instruction and support the use of dynamic testing procedures in educational settings.

Pretest Versus No Pretest: An Investigation Into the Problem-Solving Processes in a Dynamic Testing Context

Proponents of dynamic testing have advocated its use as a replacement or addition to conventional tests. This research aimed to investigate the effects of using versus not using a pretest on both the outcome on the posttest and the processes used in solving inductive reasoning tasks in dynamic testing using a graduated prompts training. Sixty-seven 7- to 8-year-old children were assigned to either a group that received a pretest or a group that did not receive a pretest, using a randomized blocking procedure. No significant differences were found between both groups of children on posttest accuracy, process measures, number of hints needed during training, amount of time needed for testing, and the prediction of school related measures. This article concluded that the decision of whether or not a pretest is necessary should be based on the research question to be answered because it does not appear to influence posttest results.

Dynamic Testing: Measuring Inductive Reasoning in Children With Developmental Disabilities and Mild Cognitive Impairments

The main aim of this study was to evaluate the use of dynamic testing based on a graduated prompts techniques training in a clinical educational setting. We examined the question of whether it would be possible to administer a four session dynamic test to a specific group of children with complex behavioral and psychiatric problems, developmental disabilities, and often very weak school performance. We further examined whether children would show different change patterns in their use of solving strategies when presented with a figural analogies task, and we explored the relationship between existing intelligence measures, school achievement measures, and dynamic testing outcomes. Data revealed that the children with these complex problems were able to solve figural analogies and progressed in their accuracy in solving the task after training. We also found that trained children employed more sophisticated problem solving after graduated prompts training, and individual differences in progression paths from pretest to posttest were apparent. Furthermore, we were able to identify groups of children differing in the number and type of instructions needed during training. IQ scores and teacher ratings of school performance were highly correlated, although IQ scores were not related to objectively measured school achievement scores. Dynamic test scores revealed lower correlations with teacher ratings of school performance but were the best predictors of school achievement. It was concluded that dynamic test measures gave the best indication of the children’s scholastic achievement and their potential for learning.

Do All Dynamic Assessment Techniques Assess Learning Potential?

It is not only that different dynamic assessment (DA) techniques evaluate different “learning potentials” of the individual; some such techniques do not evaluate any kind of learning potential. In particular, graduated prompts techniques, rather than evaluating learning potential of the individual, evaluate the level of his or her mastery of a certain problemsolving procedure. On the other hand, DA techniques that target the qualitative level at which the individual is able to learn a brand new problem-solving procedure evaluate indeed the individual’s general learning potential.