scholarly journals A Web-Based Computerized Adaptive Testing (CAT) to Assess Patient Perception in Hospitalization

2011 ◽  
Vol 13 (3) ◽  
pp. e61 ◽  
Author(s):  
Tsair-Wei Chien ◽  
Wen-Chung Wang ◽  
Sheng-Yun Huang ◽  
Wen-Pin Lai ◽  
Julie Chi Chow
Keyword(s):  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Patient Perception ◽  
Web Based

scholarly journals Classification and Regression Tree and Computer Adaptive Testing in Cardiac Rehabilitation: Instrument Validation Study (Preprint)

2018 ◽  
Author(s):  
Linda Peute ◽  
Thom Scheeve ◽  
Monique Jaspers
Keyword(s):  
Cardiac Rehabilitation ◽  
Data Quality ◽  
Sensitivity And Specificity ◽  
Computerized Adaptive Testing ◽  
Regression Tree ◽  
Adaptive Testing ◽  
Classification And Regression Tree ◽  
Web Based ◽  
Classification And Regression ◽  
Multiple Domains

BACKGROUND There is a need for shorter-length assessments that capture patient questionnaire data while attaining high data quality without an undue response burden on patients. Computerized adaptive testing (CAT) and classification and regression tree (CART) methods have the potential to meet these needs and can offer attractive options to shorten questionnaire lengths. OBJECTIVE The objective of this study was to test whether CAT or CART was best suited to reduce the number of questionnaire items in multiple domains (eg, anxiety, depression, quality of life, and social support) used for a needs assessment procedure (NAP) within the field of cardiac rehabilitation (CR) without the loss of data quality. METHODS NAP data of 2837 CR patients from a multicenter Cardiac Rehabilitation Decision Support System (CARDSS) Web-based program was used. Patients used a Web-based portal, MyCARDSS, to provide their data. CAT and CART were assessed based on their performances in shortening the NAP procedure and in terms of sensitivity and specificity. RESULTS With CAT and CART, an overall reduction of 36% and 72% of NAP questionnaire length, respectively, was achieved, with a mean sensitivity and specificity of 0.765 and 0.817 for CAT, 0.777 and 0.877 for classification trees, and 0.743 and 0.40 for regression trees, respectively. CONCLUSIONS Both CAT and CART can be used to shorten the questionnaires of the NAP used within the field of CR. CART, however, showed the best performance, with a twice as large overall decrease in the number of questionnaire items of the NAP compared to CAT and the highest sensitivity and specificity. To our knowledge, our study is the first to assess the differences in performance between CAT and CART for shortening questionnaire lengths. Future research should consider administering varied assessments of patients over time to monitor their progress in multiple domains. For CR professionals, CART integrated with MyCARDSS would provide a feedback loop that informs the rehabilitation progress of their patients by providing real-time patient measurements.

scholarly journals Classification and Regression Tree and Computer Adaptive Testing in Cardiac Rehabilitation: Instrument Validation Study

10.2196/12509 ◽  
2020 ◽  
Vol 22 (1) ◽  
pp. e12509
Author(s):  
Linda Peute ◽  
Thom Scheeve ◽  
Monique Jaspers
Keyword(s):  
Cardiac Rehabilitation ◽  
Data Quality ◽  
Sensitivity And Specificity ◽  
Computerized Adaptive Testing ◽  
Regression Tree ◽  
Adaptive Testing ◽  
Classification And Regression Tree ◽  
Web Based ◽  
Classification And Regression ◽  
Multiple Domains

Background There is a need for shorter-length assessments that capture patient questionnaire data while attaining high data quality without an undue response burden on patients. Computerized adaptive testing (CAT) and classification and regression tree (CART) methods have the potential to meet these needs and can offer attractive options to shorten questionnaire lengths. Objective The objective of this study was to test whether CAT or CART was best suited to reduce the number of questionnaire items in multiple domains (eg, anxiety, depression, quality of life, and social support) used for a needs assessment procedure (NAP) within the field of cardiac rehabilitation (CR) without the loss of data quality. Methods NAP data of 2837 CR patients from a multicenter Cardiac Rehabilitation Decision Support System (CARDSS) Web-based program was used. Patients used a Web-based portal, MyCARDSS, to provide their data. CAT and CART were assessed based on their performances in shortening the NAP procedure and in terms of sensitivity and specificity. Results With CAT and CART, an overall reduction of 36% and 72% of NAP questionnaire length, respectively, was achieved, with a mean sensitivity and specificity of 0.765 and 0.817 for CAT, 0.777 and 0.877 for classification trees, and 0.743 and 0.40 for regression trees, respectively. Conclusions Both CAT and CART can be used to shorten the questionnaires of the NAP used within the field of CR. CART, however, showed the best performance, with a twice as large overall decrease in the number of questionnaire items of the NAP compared to CAT and the highest sensitivity and specificity. To our knowledge, our study is the first to assess the differences in performance between CAT and CART for shortening questionnaire lengths. Future research should consider administering varied assessments of patients over time to monitor their progress in multiple domains. For CR professionals, CART integrated with MyCARDSS would provide a feedback loop that informs the rehabilitation progress of their patients by providing real-time patient measurements.

scholarly journals An App for Detecting Bullying of Nurses Using Convolutional Neural Networks and Web-Based Computerized Adaptive Testing: Development and Usability Study (Preprint)

2019 ◽  
Author(s):  
Shu-Ching Ma ◽  
Willy Chou ◽  
Tsair-Wei Chien ◽  
Julie Chi Chow ◽  
Yu-Tsen Yeh ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Workplace Bullying ◽  
Computerized Adaptive Testing ◽  
Early Stage ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
Adaptive Testing ◽  
Web Based ◽  
Nurse Bullying

BACKGROUND Workplace bullying has been measured in many studies to investigate its effects on mental health issues. However, none have used web-based computerized adaptive testing (CAT) with bully classifications and convolutional neural networks (CNN) for reporting the extent of individual bullying in the workplace. OBJECTIVE This study aims to build a model using CNN to develop an app for automatic detection and classification of nurse bullying-levels, incorporated with online Rasch computerized adaptive testing, to help assess nurse bullying at an earlier stage. METHODS We recruited 960 nurses working in a Taiwan Ch-Mei hospital group to fill out the 22-item Negative Acts Questionnaire-Revised (NAQ-R) in August 2012. The k-mean and the CNN were used as unsupervised and supervised learnings, respectively, for: (1) dividing nurses into three classes (n=918, 29, and 13 with suspicious mild, moderate, and severe extent of being bullied, respectively); and (2) building a bully prediction model to estimate 69 different parameters. Finally, data were separated into training and testing sets in a proportion of 70:30, where the former was used to predict the latter. We calculated the sensitivity, specificity, and receiver operating characteristic curve (area under the curve [AUC]), along with the accuracy across studies for comparison. An app predicting the respondent bullying-level was developed, involving the model’s 69 estimated parameters and the online Rasch CAT module as a website assessment. RESULTS We observed that: (1) the 22-item model yields higher accuracy rates for three categories, with an accuracy of 94% for the total 960 cases, and accuracies of 99% (AUC 0.99; 95% CI 0.99-1.00) and 83% (AUC 0.94; 95% CI 0.82-0.99) for the lower and upper groups (cutoff points at 49 and 66 points) based on the 947 cases and 42 cases, respectively; and (2) the 700-case training set, with 95% accuracy, predicts the 260-case testing set reaching an accuracy of 97. Thus, a NAQ-R app for nurses that predicts bullying-level was successfully developed and demonstrated in this study. CONCLUSIONS The 22-item CNN model, combined with the Rasch online CAT, is recommended for improving the accuracy of the nurse NAQ-R assessment. An app developed for helping nurses self-assess workplace bullying at an early stage is required for application in the future.

scholarly journals HASIL PENGUJIAN SOFTWARE COMPUTERIZED ADAPTIVE TESTING (CAT) MATA PELAJARAN PENDIDIKAN AGAMA ISLAM (PAI) DALAM MEMBUAT REKAM MEDIK PEMBELAJARAN (RMP) UNTUK MENDIAGNOSIS KEMAMPUAN SISWA DI SEKOLAH

INFERENSI ◽  
2012 ◽  
Vol 6 (2) ◽  
pp. 183
Author(s):  
Winarno Winarno
Keyword(s):  
Research And Development ◽  
Religious Education ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Estimation Result ◽  
Web Based ◽  
Test Items ◽  
Islamic Religion ◽  
Development Approach ◽  
Quantitative Descriptive

This research aims at  producing a Computerized Adaptive Testing (CAT) software Islamic religion education subject (CAT PAI) for the year 7 students of public junior high schoo and  to see the results of CAT software in making rekam medik pembelajaran (RMP) to diagnose student’s ability. This research used the research and development approach. The data was collected by doing observation and documentation. Analyzedto use quantitative descriptive technique. The findings of the research shows the CAT can be developed web-based, and The CAT is able to in estimating student’s ability correct be seen RMP. Overall, the CAT software can perform the tasks well in order to select test items and to measure student’s ability from correlation value between ability estimation result (è) in CAT with  Islamic religious education subjects enough tall that is 0,69.

scholarly journals Estimation of an Examinee's Ability in the Web-Based Computerized Adaptive Testing Program IRT-CAT

2006 ◽  
Vol 3 ◽  
pp. 4 ◽  
Author(s):  
Yoon-Hwan Lee ◽  
Jung-Ho Park ◽  
In-Yong Park
Keyword(s):  
Rasch Model ◽  
Computerized Adaptive Testing ◽  
Logistic Models ◽  
Adaptive Testing ◽  
Database Management System ◽  
Web Based ◽  
User Input ◽  
System A ◽  
Computer Based ◽  
The Web

We developed a program to estimate an examinee's ability in order to provide freely available access to a web-based computerized adaptive testing (CAT) program. We used PHP and Java Script as the program languages, PostgresSQL as the database management system on an Apache web server and Linux as the operating system. A system which allows for user input and searching within inputted items and creates tests was constructed. We performed an ability estimation on each test based on a Rasch model and 2- or 3-parametric logistic models. Our system provides an algorithm for a web-based CAT, replacing previous personal computer-based ones, and makes it possible to estimate an examinee?占퐏 ability immediately at the end of test.

scholarly journals PENERAPAN SISTIM PENDUKUNG KEPUTUSAN DALAM SISTEM PENGUJIAN COMPUTERIZED ADAPTIVE TESTING

2011 ◽  
Vol 5 (3) ◽  
pp. 71
Author(s):  
Rukli Rukli ◽  
Sri Hartati
Keyword(s):  
Decision Support ◽  
Decision Support System ◽  
Support System ◽  
Logistic Model ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Difficulty Level ◽  
Design Decision ◽  
Web Based ◽  
Key Word

This study aims to make design decision support system adaptive to examinee ability to go to college.Decision support systems are made using one parameter logistic model by taking into account the difficulty level of questions adapted to the ability of the examinee. Questions are selected so that the items follow the ability of examinee more accurate assessment of ability with a lesser number of items.CAT a web-based applications require lesser number of items in determining the ability of examinee. College can determine the appropriate characteristics of the ability of examinee acceptance criteria for each department with domain weighting, and then determine the minimum level of capability that will be received and an appropriate amount to be received. Key word: Decision Support System, Computerized Adaptive Testing

scholarly journals Web-Based Computerized Adaptive Testing Via An Open-Source Platform

2018 ◽  
Vol 21 ◽  
pp. S54
Author(s):  
S Pandit ◽  
F Jansen ◽  
A Lapets ◽  
MD Slavin
Keyword(s):  
Open Source ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Web Based

scholarly journals Introduction to the LIVECAT web-based computerized adaptive testing platform

2020 ◽  
Vol 17 ◽  
pp. 27
Author(s):  
Dong Gi Seo ◽  
Jeongwook Choi
Keyword(s):  
Item Response ◽  
Computerized Adaptive Testing ◽  
Likelihood Estimation ◽  
Adaptive Testing ◽  
Test Construction ◽  
Response Model ◽  
Item Response Model ◽  
Weighted Likelihood ◽  
Web Based ◽  
Testing Platform

This study introduces LIVECAT, a web-based computerized adaptive testing platform. This platform provides many functions, including writing item content, managing an item bank, creating and administering a test, reporting test results, and providing information about a test and examinees. The LIVECAT provides examination administrators with an easy and flexible environment for composing and managing examinations. It is available at http://www.thecatkorea.com/. Several tools were used to program LIVECAT, as follows: operating system, Amazon Linux; web server, nginx 1.18; WAS, Apache Tomcat 8.5; database, Amazon RDMS – Maria DB; and languages, JAVA8, HTML5/CSS, Javascript, and jQuery. The LIVECAT platform can be used to implement several item response theory (IRT) models such as the Rasch and 1-,2-,3-parameter logistic models. The administrator can choose a specific model of test construction in LIVECAT. Multimedia data such as images, audio files, and movies can be uploaded to items in LIVECAT. Two scoring methods (maximum likelihood estimation and expected a posteriori) are available in LIVECAT and the maximum Fisher information item selection method is applied to every IRT model in LIVECAT. The LIVECAT platform showed equal or better performance compared with a conventional test platform. The LIVECAT platform enables users without psychometric expertise to easily implement and perform computerized adaptive testing at their institutions. The most recent LIVECAT version only provides a dichotomous item response model and the basic components of CAT. Shortly, LIVECAT will include advanced functions, such as a polytomous item response model with weighted likelihood estimation and content balancing.

Sign in / Sign up

Export Citation Format

Share Document