scholarly journals Intra- and Interrater Reliability of Infrared Image Analysis of Facial Acupoints in Individuals with Facial Paralysis

2020 ◽  
Vol 2020 ◽  
pp. 1-9 ◽  
Author(s):  
Xulong Liu ◽  
Jinghui Feng ◽  
Jingmin Luan ◽  
Chenxi Dong ◽  
Hefei Fu ◽  
...  
Keyword(s):  
Image Analysis ◽  
Temperature Measurement ◽  
Facial Paralysis ◽  
Temperature Difference ◽  
Interrater Reliability ◽  
Influencing Factor ◽  
Intraclass Correlation ◽  
Infrared Image ◽  
Infrared Thermal Imaging ◽  
Difference Measurement

Infrared thermography (IRT), as a noncontact tool for temperature measurement, is widely applied in the study of acupuncture modernization. The aim of this study was to assess the intra- and interrater reliability of infrared image analysis of facial acupoints of subjects with facial paralysis and determine the factors influencing the variability of the measured values. A total of 26 patients with facial paralysis on one side, aged 26 to 53 years, participated voluntarily in the study. Facial infrared thermal images of all participants were analyzed by two trained raters at two different time points at a one-week interval. The intraclass correlation coefficient (ICC) was used to determine the intra- and interrater reliability of IRT measurements. The ICC values varied depending on the analyzed acupoints. The reliability of temperature measurement ranged from moderate to excellent (intrarater, ICC ranged from 0.669 to 0.990; interrater, ICC ranged from 0.661 to 0.987). The reliability of temperature difference measurement ranged from low to excellent (intrarater, ICC ranged from 0.412 to 0.882; interrater, ICC ranged from 0.334 to 0.828). The main influencing factor of reliability is the incomplete consistency in selecting acupoint positions when repeatedly positioning the same acupoint manually. Despite low reliability of temperature difference measurement at some acupoints, some auxiliary measures can be used to reduce the error of manual positioning. Thus, infrared thermal imaging still has the potential to assist in objective and quantitative research on acupuncture.

scholarly journals Intrarater and Interrater Reliability of Infrared Image Analysis of Forearm Acupoints before and after Moxibustion

2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Jiali Lou ◽  
Yongliang Jiang ◽  
Hantong Hu ◽  
Xiaoyu Li ◽  
Yajun Zhang ◽  
...  
Keyword(s):  
Image Analysis ◽  
Correlation Coefficient ◽  
Temperature Change ◽  
Intraclass Correlation Coefficient ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Infrared Image ◽  
Infrared Images ◽  
Intrarater Reliability ◽  
Before And After

The objective of this study was to determine the intrarater and interrater reliabilities of infrared image analysis of forearm acupoints before and after moxibustion. In this work, infrared images of acupoints in the forearm of 20 volunteers (M/F, 10/10) were collected prior to and after moxibustion by infrared thermography (IRT). Two trained raters performed the analysis of infrared images in two different periods at a one-week interval. The intraclass correlation coefficient (ICC) was calculated to determine the intrarater and interrater reliabilities. With regard to the intrarater reliability, ICC values were between 0.758 and 0.994 (substantial to excellent). For the interrater reliability, ICC values ranged from 0.707 to 0.964 (moderate to excellent). Given that the intrarater and interrater reliability levels show excellent concordance, IRT could be a reliable tool to monitor the temperature change of forearm acupoints induced by moxibustion.

Infrared Thermal Imaging of Power Grid Fault Information Acquisition System Based on GIS

2013 ◽  
Vol 791-793 ◽  
pp. 1892-1896
Author(s):  
Wei Gang Zheng ◽  
Zai Lin Piao ◽  
Dong Ming Tan ◽  
Zhe Yuan Wang
Keyword(s):  
Temperature Measurement ◽  
Ant Colony Optimization ◽  
Information Acquisition ◽  
Power Grid ◽  
Infrared Image ◽  
Ant Colony ◽  
Detection Methods ◽  
Measurement Technology ◽  
Power Equipment ◽  
Infrared Thermal Imaging

nfrared temperature measurement technology is an important means that early detection of equipment external overheating fault and internal insulation fault, and advanced detection methods of power equipment condition monitoring.Infrared temperature measurement technology found the hidden dangers of electrical equipment heating of the external connection points, has been widely applied in power system. With comparing the original ant colony optimization, this paper presents an improved weighted Ant Colony Optimization path planning algorithm based on Infrared image acquisition noise reduction processing and combining WCDMA network transmission mode, and constitute a visual background management system with rural power network .The system could capture power equipment infrared images and reduction noise simply, send it to the background server through the 3G network, for artificial auxiliary to predicting grid failure, scientific planning repair inspection path with improved navigation algorithm, and improve the stability of the power grid operation.

scholarly journals Measurement of Scapular Asymmetry and Assessment of Shoulder Dysfunction Using the Lateral Scapular Slide Test: A Reliability and Validity Study

2001 ◽  
Vol 81 (2) ◽  
pp. 799-809 ◽  
Author(s):  
Corrie J Odom ◽  
Andrea B Taylor ◽  
Christine E Hurd ◽  
Craig R Denegar
Keyword(s):  
Sensitivity And Specificity ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Distance Measures ◽  
Intrarater Reliability ◽  
Shoulder Dysfunction ◽  
Difference Measurement ◽  
Slide Test ◽  
The Difference

Abstract Background and Purpose. The Lateral Scapular Slide Test (LSST) is used to determine scapular position with the arm abducted 0, 45, and 90 degrees in the coronal plane. Assessment of scapular position is based on the derived difference measurement of bilateral scapular distances. The purpose of this study was to assess the reliability of measurements obtained using the LSST and whether they could be used to identify people with and without shoulder impairments. Subjects. Forty-six subjects ranging in age from 18 to 65 years (X̄=30.0, SD=11.1) participated in this study. One group consisted of 20 subjects being treated for shoulder impairments, and one group consisted of 26 subjects without shoulder impairments. Methods. Two measurements in each test position were obtained bilaterally. From the bilateral measurements, we derived the difference measurement. Intraclass correlation coefficients (ICC [1,1]) and the standard error of measurement (SEM) were calculated for intrarater and interrater reliability of the difference in side-to-side measures of scapular distance. Sensitivity and specificity of the LSST for classifying subjects with and without shoulder impairments were also determined. Results. The ICCs for intrarater reliability were .75, .77, and .80 and .52, .66, and .62, respectively, for subjects without and with shoulder impairments in 0, 45, and 90 degrees of abduction. The ICCs for interrater reliability were .67, .43, and .74 and .79, .45, and .57, respectively, for subjects without and with shoulder impairments in 0, 45 and 90 degrees of abduction. The SEMs ranged from 0.57 to 0.86 cm for intrarater reliability and from 0.79 to 1.20 cm for interrater reliability. Using the criterion of greater than 1.0 cm difference, sensitivity and specificity were 35% and 48%, 41% and 54%, and 43% and 56%, respectively, for 0, 45, and 90 degrees of abduction. Sensitivity and specificity based on the criterion of greater than 1.5 cm difference were 28% and 53%, 50% and 58%, and 34% and 52%, respectively, for the 3 scapular positions. Conclusion and Discussion. Our results suggest that measurements of scapular positioning based on the difference in side-to-side scapular distance measures are not reliable. Furthermore, the results suggest that sensitivity and specificity of the LSST measurements are poor and that the LSST should not be used to identify people with and without shoulder dysfunction.

scholarly journals Ultrasound estimates of muscle quality in older adults: reliability and comparison of Photoshop and ImageJ for the grayscale analysis of muscle echogenicity

PeerJ ◽  
2016 ◽  
Vol 4 ◽  
pp. e1721 ◽  
Author(s):  
Michael O. Harris-Love ◽  
Bryant A. Seamon ◽  
Carla Teixeira ◽  
Catheeja Ismail
Keyword(s):  
Older Adults ◽  
Image Analysis ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Histogram Analysis ◽  
Muscle Quality ◽  
Coefficient Of Determination ◽  
Selection Methods ◽  
Mean Differences

Background.Quantitative diagnostic ultrasound imaging has been proposed as a method of estimating muscle quality using measures of echogenicity. The Rectangular Marquee Tool (RMT) and the Free Hand Tool (FHT) are two types of editing features used in Photoshop and ImageJ for determining a region of interest (ROI) within an ultrasound image. The primary objective of this study is to determine the intrarater and interrater reliability of Photoshop and ImageJ for the estimate of muscle tissue echogenicity in older adults via grayscale histogram analysis. The secondary objective is to compare the mean grayscale values obtained using both the RMT and FHT methods across both image analysis platforms.Methods.This cross-sectional observational study features 18 community-dwelling men (age = 61.5 ± 2.32 years). Longitudinal views of the rectus femoris were captured using B-mode ultrasound. The ROI for each scan was selected by 2 examiners using the RMT and FHT methods from each software program. Their reliability is assessed using intraclass correlation coefficients (ICCs) and the standard error of the measurement (SEM). Measurement agreement for these values is depicted using Bland-Altman plots. A pairedt-test is used to determine mean differences in echogenicity expressed as grayscale values using the RMT and FHT methods to select the post-image acquisition ROI. The degree of association among ROI selection methods and image analysis platforms is analyzed using the coefficient of determination (R2).Results.The raters demonstrated excellent intrarater and interrater reliability using the RMT and FHT methods across both platforms (lower bound 95% CI ICC = .97–.99,p< .001). Mean differences between the echogenicity estimates obtained with the RMT and FHT methods was .87 grayscale levels (95% CI [.54–1.21],p< .0001) using data obtained with both programs. The SEM for Photoshop was .97 and 1.05 grayscale levels when using the RMT and FHT ROI selection methods, respectively. Comparatively, the SEM values were .72 and .81 grayscale levels, respectively, when using the RMT and FHT ROI selection methods in ImageJ. Uniform coefficients of determination (R2= .96–.99,p< .001) indicate strong positive associations among the grayscale histogram analysis measurement conditions independent of the ROI selection methods and imaging platform.Conclusion.Our method for evaluating muscle echogenicity demonstrated a high degree of intrarater and interrater reliability using both the RMT and FHT methods across 2 common image analysis platforms. The minimal measurement error exhibited by the examiners demonstrates that the ROI selection methods used with Photoshop and ImageJ are suitable for the post-acquisition image analysis of tissue echogenicity in older adults.

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

CODEM Instrument

GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel
Keyword(s):  
Convergent Validity ◽  
Interrater Reliability ◽  
Discriminant Validity ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Well Being ◽  
Communication Behavior ◽  
People With Dementia ◽  
Pearson's R ◽  
Pearson’S R

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.

Reliability of a Modified Medication Appropriateness Index in Community Pharmacies

2003 ◽  
Vol 37 (1) ◽  
pp. 40-46
Author(s):  
Rosemin Kassam ◽  
Linda G Martin ◽  
Karen B Farris ◽  
Homero A Monsanto ◽  
Jean-Marie Kaiser
Keyword(s):  
Community Pharmacy ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Community Setting ◽  
Medication Appropriateness Index ◽  
Paired Samples ◽  
Psychometric Data ◽  
Ambulatory Patients ◽  
Pharmacy Setting ◽  
Medication Appropriateness

Background The medication appropriateness index (MAI) has demonstrated reliability in selected outpatient clinics where medical data were easily accessible from medical charts. However, its use in the community setting where patient data may be limited has not been examined. Objective To evaluate the usefulness of a modified MAI for use in the community pharmacy setting by testing interrater reliability using 3 different rating schemes. Methods Two raters evaluated 160 medications for 32 elderly ambulatory patients. Patient information was acquired using community pharmacist-collected medication histories. A summated MAI score, percent agreement, κ, positive agreement, negative agreement, and intraclass correlation coefficient were calculated for each criterion using 3 scoring schemes. A paired samples t-test (95% CI) was used to test interrater reliability. Results The κ statistics were >0.75 for indication and effectiveness, but good (0.41–0.66) for the remaining criteria using the Hanlon scoring scheme. The intraclass coefficients (0.82, 0.86, 0.87) and overall κ (0.65, 0.66, 0.61) were similar for the 3 schemes. Conclusions This study suggests that the modified MAI has the potential to detect medication appropriateness and inappropriateness in the community pharmacy setting; however, it is not without limitations. Because the MAI has the most clinimetric and psychometric data available, the instrument should be studied further to increase its reliability and generalizability.

scholarly journals In vitro validation of Digital Image Analysis Sequence (DIAS) for the assessment of the marginal fit of cement-retained implant-supported experimental crowns

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Aristeidis A. Villias ◽  
Stefanos G. Kourtis ◽  
Hercules C. Karkazis ◽  
Gregory L. Polyzois
Keyword(s):  
Image Analysis ◽  
Digital Image ◽  
Confidence Level ◽  
Digital Image Analysis ◽  
Statistical Tests ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Marginal Fit ◽  
Smallest Detectable Change ◽  
The Mean

Abstract Background The replica technique with its modifications (negative replica) has been used for the assessment of marginal fit (MF). However, identification of the boundaries between prosthesis, cement, and abutment is challenging. The recently developed Digital Image Analysis Sequence (DIAS) addresses this limitation. Although DIAS is applicable, its reliability has not yet been proven. The purpose of this study was to verify the DIAS as an acceptable method for the quantitative assessment of MF at cemented crowns, by conducting statistical tests of agreement between different examiners. Methods One hundred fifty-one implant-supported experimental crowns were cemented. Equal negative replicas were produced from the assemblies. Each replica was sectioned in six parts, which were photographed under an optical microscope. From the 906 standardized digital photomicrographs (0.65 μm/pixel), 130 were randomly selected for analysis. DIAS included tracing the profile of the crown and the abutment and marking the margin definition points before cementation. Next, the traced and marked outlines were superimposed on each digital image, highlighting the components’ boundaries and enabling MF measurements. One researcher ran the analysis twice and three others once, independently. Five groups of 130 measurements were formed. Intra- and interobserver reliability was evaluated with intraclass correlation coefficient (ICC). Agreement was estimated with the standard error of measurement (SEM), the smallest detectable change at the 95% confidence level (SDC95%), and the Bland and Altman method of limits of agreement (LoA). Results Measured MF ranged between 22.83 and 286.58 pixels. Both the intra- and interobserver reliability were excellent, ICC = 1 at 95% confidence level. The intra- and interobserver SEM and SDC95% were less than 1 and 3 pixels, respectively. The Bland–Altman analysis presented graphically high level of agreement between the mean measurement of the first observer and each of the three other observers’ measurements. Differences between observers were normally distributed. In all three cases, the mean difference was less than 1 pixel and within ± 3 pixels LoA laid at least 95% of differences. T tests of the differences did not reveal any fixed bias (P > .05, not significant). Conclusion The DIAS is an objective and reliable method able to detect and quantify MF at ranges observed in clinical practice.

scholarly journals Using Differential Item Functioning to Test for Interrater Reliability in Constructed Response Items

2020 ◽  
Vol 80 (4) ◽  
pp. 808-820
Author(s):  
Cindy M. Walker ◽  
Sakine Göçer Şahin
Keyword(s):  
Differential Item Functioning ◽  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Promising Alternative ◽  
Constructed Response ◽  
Polytomous Item ◽  
Item Functioning

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared with traditional interrater reliability measures. Three different procedures that can be used as measures of interrater reliability were compared: (1) intraclass correlation coefficient (ICC), (2) Cohen’s kappa statistic, and (3) DIF statistic obtained from Poly-SIBTEST. The results of this investigation indicated that DIF procedures appear to be a promising alternative to assess the interrater reliability of constructed response items, or other polytomous types of items, such as rating scales. Furthermore, using DIF to assess interrater reliability does not require a fully crossed design and allows one to determine if a rater is either more severe, or more lenient, in their scoring of each individual polytomous item on a test or rating scale.

Sign in / Sign up

Export Citation Format

Share Document