Relationship between grammatical and pragmatic competence in EFL of Spanish learners through a computer adaptive test

The work at hand is part of a wider study by Martín-Marchante (2015), the objective of which was to study the way pragmatics assessment is approached in the Oxford Online Placement Test (OOPT) which is, currently, one of the most profusely administered computer adaptive tests (CAT). This paper aims, now, to find out the degree of difficulty of the pragmatic items in the OOPT and how much importance is given to pragmatic competence in this test. Furthermore, we analyze the relationship between grammatical and pragmatic competence in EFL of a group of Spanish un- dergraduate students, who took this test. To this end, a descriptive analysis and a multiple linear regression analysis was carried out. The results showed that the quality of the pragmatic items in the OOPT could be improved. Also, we have found that the pragmatic items were somehow related to the student’s final score but not so much as other items of the test, such as those related to gram- mar and reading comprehension. Additionally, the results indicated that there was no correlation between the grammatical and the pragmatic competence of this group of students.

The PROMIS CAT Demonstrates Responsiveness in Patients After ACL Reconstruction Across Numerous Health Domains

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS) has emerged as a dynamic, efficient, and validated patient-reported outcome measure in the field of orthopaedics. However, the responsiveness, which is defined as the ability to detect changes in scores over time, of PROMIS computer adaptive tests (CATs) after anterior cruciate ligament reconstruction (ACLR) has not been well documented. Purpose: To investigate the responsiveness up to 1 year postoperatively of multiple PROMIS CAT domains in patients undergoing ACLR. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: All patients who underwent ACLR by 1 of 2 fellowship-trained sports medicine orthopaedic surgeons, with preoperative and at least 6 months postoperative visits, were included in this study. PROMIS CAT physical function (PF), pain interference (PI), and depression (D) scores from each visit were collected and analyzed. Preoperative patient-centric factors, including demographic factors and meniscal pathology, were analyzed for associations with improvements in PROMIS scores. Results: A total of 100 patients (62 male patients and 38 female patients; mean age, 27.6 ± 11.8 years) with an average follow-up of 338.5 ± 137.5 days were included in this study. Preoperative PF, PI, and D scores improved significantly from 38.5 ± 7.3, 60.3 ± 7.0, and 47.9 ± 9.1, respectively, to 53.6 ± 10.3, 48.1 ± 8.5, and 41.0 ± 9.9, respectively ( P < .001 for each domain). Lower preoperative PF scores, PI scores, and a lower body mass index (BMI) were predictive for greater improvements in PF. Higher preoperative PI scores and a lower BMI were predictors for greater improvements in PI. Meniscal pathology was not predictive of improvement in PROMIS scores. Conclusion: PROMIS CAT assessments of PF, PI, and D demonstrated responsiveness in patients undergoing ACLR up to 1 year. Worse preoperative PROMIS scores and a lower BMI were predictive of greater improvements in PROMIS scores.

Pediatric PROMIS Computer Adaptive Tests Are Highly Correlated With Adult PROMIS Computer Adaptive Tests in Pediatric Sports Medicine Patients

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS) is a powerful set of patient-reported outcome measures (PROMs) that are gaining popularity throughout orthopaedic surgery. The use of both adult and pediatric PROMIS questionnaires in orthopaedic sports medicine limits the value of the PROMIS in routine sports medicine clinical care, research, and quality improvement. Because orthopaedic sports medicine surgeons see patients across a wide age range, simplifying the collection of PROMIS computer adaptive tests (CATs) to a single set of questionnaires, regardless of age, is of notable value. Purpose/Hypothesis: The purpose was to determine the strength of the correlation between the pediatric and adult PROMIS questionnaires. We hypothesized that there would be a high correlation between the adult and pediatric versions for each PROMIS domain, thereby justifying the use of only the adult version for most sports medicine providers, regardless of patient age. Study Design: Cohort study (Diagnosis); Level of evidence, 2. Methods: Between December 2018 and December 2019, all pediatric sports medicine patients presenting to a single, academic, orthopaedic sports medicine clinic were asked to participate in the present study with their parents’ consent. Patients were asked to complete a set of adult PROMIS domains (Physical Function and/or Upper Extremity, Pain Interference, and Depression) as well as a set of pediatric PROMIS domains (Mobility and/or Upper Extremity, Pain Interference, and Depressive Symptoms). Concurrent validity was assessed using Pearson correlation coefficients ( r). Ceiling and floor effects were determined. Results: A total of 188 patients met our inclusion criteria. The correlation between the adult and pediatric PROMIS Upper Extremity, Physical Function and Mobility, Pain Interference, and Depression and Depressive Symptoms forms were high-moderate ( r = 0.68; P < .01), high-moderate ( r = 0.69; P < .01), high ( r = 0.78; P < .01), and high ( r = 0.85; P < .01), respectively. Both adult and pediatric depression-related PROMIS domains demonstrated notable floor effects (adult: 38%; pediatric: 24%). The pediatric PROMIS Upper Extremity domain demonstrated a ceiling effect (20%). Conclusion: Adult PROMIS CATs may be used in an orthopaedic sports medicine clinic for both adult and pediatric patients. Our findings will help decrease the amount of resources needed for the implementation and use of PROMs for patient care, research, and quality improvement in orthopaedic sports medicine clinics.

Case Study: Students’ Code-Tracing Skills and Calibration of Questions for Computer Adaptive Tests

Computer adaptive testing (CAT) enables an individualization of tests and better accuracy of knowledge level determination. In CAT, all test participants receive a uniquely tailored set of questions. The number and the difficulty of the next question depend on whether the respondent’s previous answer was correct or incorrect. In order for CAT to work properly, it needs questions with suitably defined levels of difficulty. In this work, the authors compare the results of questions’ difficulty determination given by experts (teachers) and students. Bachelor students of informatics in their first, second, and third year of studies at Subotica Tech—College of Applied Sciences had to answer 44 programming questions in a test and estimate the difficulty for each of those questions. Analyzing the correct answers shows that the basic programming knowledge, taught in the first year of study, evolves very slowly among senior students. The comparison of estimations on questions difficulty highlights that the senior students have a better understanding of basic programming tasks; thus, their estimation of difficulty approximates to that given by the experts.