Career Indecision Profile-65 Scores: Test–Retest Reliability and Measurement Equivalence in College and Noncollege Samples

2018 ◽  
Vol 27 (3) ◽  
pp. 510-526 ◽  
Author(s):  
Casey J. Zobell ◽  
Margaret M. Nauta ◽  
Matthew S. Hesson-McInnis
Keyword(s):  
Career Counseling ◽  
Measurement Equivalence ◽  
Career Indecision ◽  
Future Research ◽  
Confirmatory Factor Analyses ◽  
Student Sample ◽  
Retest Reliability ◽  
College Student Sample ◽  
Two Samples ◽  
Test Retest Reliability

The Career Indecision Profile-65 (CIP-65) is a relatively new measure of career indecision that appears to have promise for use in career counseling and research. We sought to expand the information available to those evaluating the CIP-65 for potential use by assessing its measurement equivalence in college ( N = 529) and noncollege ( N = 472) samples and its scores’ test–retest reliability in a subset of the college–student sample ( n = 107). Six-week test–retest reliability coefficients ranged from .58 (interpersonal conflicts) to .85 (choice/commitment anxiety) for the subscale scores. Confirmatory factor analyses revealed that the CIP-65’s four-factor structure fit the data well in both the college and noncollege samples. The CIP-65 scores were configurally invariant in the two samples, but we did not find support for metric invariance. We offer explanations for these findings, discuss implications for practice, and present ideas for future research.

Development of the Fear of Intimacy Components Questionnaire (FICQ)

2015 ◽  
Vol 31 (4) ◽  
pp. 302-309 ◽  
Author(s):  
Maria Pedro Sobral ◽  
Maria Emília Costa
Keyword(s):  
Convergent Validity ◽  
Discriminant Validity ◽  
Two Dimensions ◽  
Dimensional Structure ◽  
Future Research ◽  
Fear Of Intimacy ◽  
Confirmatory Factor Analyses ◽  
New Instrument ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.

scholarly journals Affective and cognitive components of students’ attitudes towards communication learning - validation of the Communication Skills Attitude Scale in a cohort of polish medical students

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Piotr Przymuszała ◽  
Magdalena Cerbin-Koczorowska ◽  
Patrycja Marciniak-Stępak ◽  
Łucja Zielińska-Tomczak ◽  
Martyna Piszczek ◽  
...  
Keyword(s):  
Medical Students ◽  
Communication Skills ◽  
Behavioral Control ◽  
Attitude Scale ◽  
Future Research ◽  
Perceived Behavioral Control ◽  
Negative Attitudes ◽  
Retest Reliability ◽  
Cognitive Components ◽  
Test Retest Reliability

Abstract Background The Communication Skills Attitude Scale (CSAS) is a recognized tool for assessment of attitudes towards communication learning. In the original version, it consists of 26 items divided on theoretical assumptions into two subscales: Positive and Negative Attitudes Scales. However, the evidence for its structure seems unsatisfactory, and a simple division into positive and negative attitudes may be insufficient to describe attitudes of medical students towards communication learning. Moreover, the existing evidence of the test-retest reliability of the CSAS seems limited. Consequently, this study aimed to provide more evidence on its psychometric properties while validating the CSAS questionnaire in a cohort of Polish medical students. Methods The CSAS was translated, adapted into Polish, and validated in a cohort of 389 Polish medical students. Statistical analysis involved, among others, parallel analysis to determine the number of factors, confirmatory factor analysis to compare the proposed model with theory-based ones, and test-retest reliability analysis. Results Conducted analysis revealed that in the examined population, the CSAS should rather consist of four than two subscales. Proposed four subscales addressed perceived outcomes of communication learning, positive and negative attitudes towards it (affective components), and factors motivating students to learn communication (a cognitive component of attitudes). Results of test-retest reliability were satisfactory for individual items and subscales. Conclusions This study presented a valid and reliable version of the Communication Skills Attitude Scale for Polish medical students and confirmed previous assumptions that CSAS may also be appropriate for assessment of affective and cognitive components of attitudes. Future research should, based on Ajzen’s Theory of Planned Behavior, make attempts to develop a tool assessing not only attitudes but also subjective norms and perceived behavioral control.

A Test-Retest Reliability Generalization Meta-Analysis of Judgments Via the Policy-Capturing Technique

2021 ◽  
pp. 109442812110115
Author(s):  
Ze Zhu ◽  
Alan J. Tomassetti ◽  
Reeshad S. Dalal ◽  
Shannon W. Schrader ◽  
Kevin Loo ◽  
...  
Keyword(s):  
Best Practice ◽  
Meta Analysis ◽  
Temporal Stability ◽  
Future Research ◽  
Policy Capturing ◽  
Reliability Estimate ◽  
Reliability Generalization ◽  
Retest Reliability ◽  
Reliability Estimates ◽  
Test Retest Reliability

Policy capturing is a widely used technique, but the temporal stability of policy-capturing judgments has long been a cause for concern. This article emphasizes the importance of reporting reliability, and in particular test-retest reliability, estimates in policy-capturing studies. We found that only 164 of 955 policy-capturing studies (i.e., 17.17%) reported a test-retest reliability estimate. We then conducted a reliability generalization meta-analysis on policy-capturing studies that did report test-retest reliability estimates—and we obtained an average reliability estimate of .78. We additionally examined 16 potential methodological and substantive antecedents to test-retest reliability (equivalent to moderators in validity generalization studies). We found that test-retest reliability was robust to variation in 14 of the 16 factors examined but that reliability was higher in paper-and-pencil studies than in web-based studies and was higher for behavioral intention judgments than for other (e.g., attitudinal and perceptual) judgments. We provide an agenda for future research. Finally, we provide several best-practice recommendations for researchers (and journal reviewers) with regard to (a) reporting test-retest reliability, (b) designing policy-capturing studies for appropriate reportage, and (c) properly interpreting test-retest reliability in policy-capturing studies.

scholarly journals The Reliability, Validity and Normative Scores of the Bene-Anthony Family Relations Test for Use With Arab Children

2021 ◽  
Vol 12 ◽  
Author(s):  
Abdrabo Soliman ◽  
Abdel-Salam G. Abdel-Salam ◽  
Mervat Ahmed
Keyword(s):  
Family Relations ◽  
Clinical Status ◽  
Psychological Disorder ◽  
Normative Values ◽  
Future Research ◽  
Retest Reliability ◽  
Arab Children ◽  
Starting Point ◽  
Test Retest Reliability ◽  
The Impact

Background: The Bene-Anthony Family Relations Test (BAFRT) is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic and back-translated to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children (n = 269) and children diagnosed with a psychological disorder (n = 125), all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area.

scholarly journals Brazilian version of the Quality of Care Scale: the perspective of people with disabilities

2014 ◽  
Vol 48 (4) ◽  
pp. 583-593 ◽  
Author(s):  
Juliana Bredemeier ◽  
Marilyn Agranonik ◽  
Tatiana Spalding Perez ◽  
Marcelo Pio de Almeida Fleck
Keyword(s):  
Quality Of Care ◽  
Intellectual Disabilities ◽  
Principal Components ◽  
Discriminant Validity ◽  
Physical Disabilities ◽  
Metropolitan Region ◽  
Retest Reliability ◽  
Two Samples ◽  
Test Retest Reliability

OBJECTIVE To analyze evidence of the validity and reliability of a Brazilian Portuguese version of the Quality of Care Scale from the perspective of people with physical and intellectual disabilities.METHODS There were 162 people with physical disabilities and 156 with intellectual disabilities from Porto Alegre and metropolitan region, who participated in the study in 2008. Classical psychometrics was used to independently analyze the two samples. Hypotheses for evidence of criterion validity (concurrent type) were tested with the Mann-Whitney test for non-normal distributions. Principal components analysis was used to explore factorial models. Evidence of reliability was calculated with Cronbach alpha for the scales and subscales. Test-retest reliability was analyzed for individuals with intellectual disabilities through intra-class correlation coefficient and the Willcoxon test.RESULTS The principal components in the group with physical disabilities replicated the original model presented as a solution to the international project data. Evidence of discriminant validity and test-retest reliability was found.CONCLUSIONS The transcultural factor model found within the international sample project seems appropriate for the samples investigated in this study, especially the physical disabilities group. Depression, pain, satisfaction with life and disability may play a mediating role in the evaluation of quality of care. Additional research is needed to add to evidence of the validity of the instruments.

scholarly journals Gait Asymmetry Post-Stroke: Determining Valid and Reliable Methods Using a Single Accelerometer Located on the Trunk

Sensors ◽  
2019 ◽  
Vol 20 (1) ◽  
pp. 37 ◽  
Author(s):  
Christopher Buckley ◽  
M. Encarna Micó-Amigo ◽  
Michael Dunne-Willows ◽  
Alan Godfrey ◽  
Aodhán Hickey ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Future Research ◽  
Validity And Reliability ◽  
Gait Symmetry ◽  
Retest Reliability ◽  
Post Stroke ◽  
Gait Asymmetry ◽  
Test Retest Reliability ◽  
Cardinal Symptom

Asymmetry is a cardinal symptom of gait post-stroke that is targeted during rehabilitation. Technological developments have allowed accelerometers to be a feasible tool to provide digital gait variables. Many acceleration-derived variables are proposed to measure gait asymmetry. Despite a need for accurate calculation, no consensus exists for what is the most valid and reliable variable. Using an instrumented walkway (GaitRite) as the reference standard, this study compared the validity and reliability of multiple acceleration-derived asymmetry variables. Twenty-five post-stroke participants performed repeated walks over GaitRite whilst wearing a tri-axial accelerometer (Axivity AX3) on their lower back, on two occasions, one week apart. Harmonic ratio, autocorrelation, gait symmetry index, phase plots, acceleration, and jerk root mean square were calculated from the acceleration signals. Test–retest reliability was calculated, and concurrent validity was estimated by comparison with GaitRite. The strongest concurrent validity was obtained from step regularity from the vertical signal, which also recorded excellent test–retest reliability (Spearman’s rank correlation coefficients (rho) = 0.87 and Intraclass correlation coefficient (ICC21) = 0.98, respectively). Future research should test the responsiveness of this and other step asymmetry variables to quantify change during recovery and the effect of rehabilitative interventions for consideration as digital biomarkers to quantify gait asymmetry.

scholarly journals Validation of a general nutrition knowledge questionnaire in a Turkish student sample

2012 ◽  
Vol 15 (11) ◽  
pp. 2074-2085 ◽  
Author(s):  
A Aylin Alsaffar
Keyword(s):  
Construct Validity ◽  
Undergraduate Students ◽  
Eating Habits ◽  
Nutrition Knowledge ◽  
Internal Reliability ◽  
Student Sample ◽  
Retest Reliability ◽  
Knowledge Questionnaire ◽  
Turkish People ◽  
Test Retest Reliability

AbstractObjectiveTo validate the general nutrition knowledge questionnaire developed by Parmenter and Wardle (1999) in a Turkish student sample.DesignThe original questionnaire of Parmenter and Wardle (1999) was modified and translated into Turkish. The modified questionnaire was administered to second year undergraduate students. Some students completed the questionnaire twice for the measurement of test–retest reliability. Statistical analysis was performed on the responses to measure the internal reliability, test–retest reliability and construct validity.SettingStudents completed the questionnaire under supervision. The questionnaire was completed at the end of lectures. Retest was carried out two weeks after first administration of the test.SubjectsA total of 195 undergraduate students studying either nutrition and dietetics (n 90) or engineering (n 105) participated in the study. Of these, 125 students completed the questionnaire on two occasions.ResultsOverall internal reliability (Cronbach's α = 0·89) and test–retest reliability (0·86) were high. Significant differences between the scores of the two groups of students indicated that the questionnaire had satisfactory construct validity.ConclusionsThe modified version of the general nutrition knowledge questionnaire can be used as a tool to examine the nutrition knowledge of adults in Turkey. In the next stage of the study, some adjustments need to be made to the items that led to low reliability values so that these items will be more applicable to the eating habits and patterns of Turkish people.

Exploring the Interrelationships Among Academic Entitlement, Academic Performance, and Satisfaction With Life in a College Student Sample

2017 ◽  
Vol 22 (2) ◽  
pp. 186-204 ◽  
Author(s):  
Rebekah H. Reysen ◽  
Suzanne Degges-White ◽  
Matthew B. Reysen
Keyword(s):  
At Risk ◽  
Academic Performance ◽  
Satisfaction With Life ◽  
Significant Negative Correlation ◽  
Future Research ◽  
Academic Entitlement ◽  
Student Sample ◽  
Grade Point ◽  
College Student Sample ◽  
Academically At Risk

The purpose of this study was to explore the relationship among academic entitlement, life satisfaction, and academic performance as measured by cumulative grade point average. When comparing academically at-risk versus non-at-risk college students, academically at-risk students scored significantly lower on satisfaction with life than their non-at-risk peers. In addition, a significant negative correlation was found between academic entitlement and satisfaction with life for all students. Implications and suggestions for future research are discussed.

Therapists' Attitudes as Explanation of Underservice of Elderly in Mental Health: Testing an Old Hypothesis

1986 ◽  
Vol 22 (4) ◽  
pp. 261-269 ◽  
Author(s):  
Bob Knight
Keyword(s):  
Mental Health ◽  
Health Workers ◽  
Reliability And Validity ◽  
The Elderly ◽  
Mental Health Workers ◽  
Future Research ◽  
Negative Attitudes ◽  
Major Barrier ◽  
Student Sample ◽  
College Student Sample

The literature in mental health and aging has long argued that the presumably negative attitudes of therapists toward the aged are a major barrier to the aged receiving psychotherapy services. This investigation compared two measures of attitudes in a college student sample in order to test the reliability and validity of two commonly used measures of attitude in the general population. The same scales were then used in a sample of sixty-six mental health workers. The results suggest that Likert ratings and semantic differentials, although tapping a common dimension, differ in sensitivity to personal experience with the aged, that therapists had more positive beliefs about the elderly than did college students, and that therapist attitudes were not correlated with either proportion of elderly clients seen or desire to work with elderly. Work site emerged as an important predictor of numbers of elderly seen by therapists. It is argued that future research ought to focus on systems level variables in seeking to overcome barriers to therapy.

Sign in / Sign up

Export Citation Format

Share Document