Indexing dynamic collective constructs using computer-aided text analysis: Construct validity evidence and illustrations featuring team processes.

2021 ◽  
Author(s):  
John E. Mathieu ◽  
Mikhail A. Wolfson ◽  
Semin Park ◽  
Margaret M. Luciano ◽  
Wendy L. Bedwell-Torres ◽  
...  
Keyword(s):  
Construct Validity ◽  
Text Analysis ◽  
Validity Evidence ◽  
Team Processes ◽  
Computer Aided

scholarly journals Unpacking the Quantifying and Qualifying Potential of Semi-Open Job Satisfaction Questions through Computer-Aided Sentiment Analysis

2021 ◽  
Author(s):  
Indy Wijngaards ◽  
Martijn Burger ◽  
Job van Exel
Keyword(s):  
Job Satisfaction ◽  
Sentiment Analysis ◽  
Text Analysis ◽  
Discriminant Validity ◽  
Added Value ◽  
Information Richness ◽  
Convergent And Discriminant Validity ◽  
Computer Aided ◽  
Satisfaction Question ◽  
Open Question

AbstractDespite their suitability for mitigating survey biases and their potential for enhancing information richness, open and semi-open job satisfaction questions are rarely used in surveys. This is mostly due to the high costs associated with manual coding and difficulties that arise when validating text measures. Recently, advances in computer-aided text analysis have enabled researchers to rely less on manual coding to construct text measures. Yet, little is known about the validity of text measures generated by computer-aided text analysis software and only a handful of studies have attempted to demonstrate their added value. In light of this gap, drawing on a sample of 395 employees, we showed that the responses to a semi-open job satisfaction question can reliably and conveniently be converted into a text measure using two types of computer-aided sentiment analysis: SentimentR, and Linguistic Inquiry and Word Count (LIWC) 2015. Furthermore, the substantial convergence between the LIWC2015 and, in particular, SentimentR measure with a closed question measure of job satisfaction and logical associations with closed question measures of constructs that fall within and outside job satisfaction’s nomological network, suggest that a semi-open question has adequate convergent and discriminant validity. Finally, we illustrated that the responses to our semi-open question can be used to fine-tune the computer-aided sentiment analysis dictionaries and unravel antecedents of job satisfaction.

The DOG Scale

2008 ◽  
Vol 29 (1) ◽  
pp. 17-24 ◽  
Author(s):  
H. Michael Crowson ◽  
Teresa K. DeBacker ◽  
Kendrick A. Davis
Keyword(s):  
Construct Validity ◽  
Discriminant Validity ◽  
Factorial Validity ◽  
Validity Evidence ◽  
Convergent And Discriminant Validity ◽  
Validity Criterion ◽  
The 1960S ◽  
Additional Support

Abstract. Since the 1960s Rokeach's conception and measurement of dogmatism has dominated the landscape of dogmatism research. In 1996, Altemeyer proposed a new conception of dogmatism, suggesting that it is best defined as an unchangeable and unjustified certainty in one's beliefs. This conception was operationalized in the form of the DOG Scale with validity evidence generally coming in the form of relationships between the measure and several criterion-related variables. The present study assessed the factorial validity of the measure and tested for convergent and discriminant validity. Criterion-related validity evidence was also reconsidered. The DOG Scale demonstrated reasonable factorial, discriminant, convergent, and criterion-related validity, providing additional support for the measure's construct validity.

scholarly journals What national governance codes say about corporate culture

2020 ◽  
Vol 20 (5) ◽  
pp. 903-917
Author(s):  
Marie-Fleur Lobrij ◽  
Muel Kaptein ◽  
Mijntje Lückerath-Rovers
Keyword(s):  
Corporate Governance ◽  
Corporate Culture ◽  
Text Analysis ◽  
Design Methodology ◽  
Three Dimensions ◽  
Analysis Program ◽  
Content Type ◽  
Corporate Governance Codes ◽  
Computer Aided ◽  
Insight Into

Purpose This study aims to provide insight into the current incorporation of corporate culture in national corporate governance codes. The authors identify three levels of incorporation for each of the following three dimensions: layers of corporate culture (the “what”), the alignment of corporate culture in the organization (the “for whom”) and the board’s roles regarding corporate culture (the “how”). Design/methodology/approach To assess the extent to which national codes have incorporated corporate culture, the authors used a sample of 88 national corporate governance codes. The authors performed a content analysis of these codes using a computer-aided text analysis program. The first step involved the identification of dimensions of corporate culture per national code. These dimensions were then assessed based on three levels of incorporation. Finally, the authors ranked national codes with similar levels of incorporation per dimension and aggregated the dimensions. Findings The data show that five of the 88 national corporate governance codes that the authors analysed scored the highest level in all three dimensions of corporate culture. Originality/value This is the first study to provide an overview of what national corporate governance codes say about corporate culture. The authors address two gaps in the existing literature. First, the authors develop and use a richer conceptualization of how corporate culture can be addressed in national corporate governance codes. Second, the authors analyse these corporate governance codes worldwide.

Establishing construct validity evidence for the Sport Multidimensional Perfectionism Scale

2006 ◽  
Vol 7 (1) ◽  
pp. 57-79 ◽  
Author(s):  
John G.H. Dunn ◽  
Janice Causgrove Dunn ◽  
John K. Gotwals ◽  
Jeffrey K.H. Vallance ◽  
Janelle M. Craft ◽  
...  
Keyword(s):  
Construct Validity ◽  
Validity Evidence

The Application of Computer-Aided Text Analysis in Social Entrepreneurship Research

2014 ◽  
Vol 2014 (1) ◽  
pp. 10117
Author(s):  
Aaron Anglin ◽  
Thomas H. Allison ◽  
Aaron Francis McKenny ◽  
Lowell W. Busenitz
Keyword(s):  
Social Entrepreneurship ◽  
Text Analysis ◽  
Entrepreneurship Research ◽  
Computer Aided

Sexual Trauma Screening for Men and Women: Examining the Construct Validity of a Two-Item Screen

2019 ◽  
Vol 34 (1) ◽  
pp. 175-193
Author(s):  
Michelle A. Mengeling ◽  
Kelly Hyman Burkitt ◽  
Gala True ◽  
Susan L. Zickmund ◽  
Sarah S. Ono ◽  
...  
Keyword(s):  
Construct Validity ◽  
Department Of Defense ◽  
Military Service ◽  
Universal Screening ◽  
Sexual Trauma ◽  
The United States ◽  
Validity Evidence ◽  
Veterans Health ◽  
Health Administration ◽  
Men And Women

The Veterans Health Administration (VHA), the largest integrated healthcare system in the United States, has conducted universal screening for military sexual trauma (MST) to facilitate MST-related care since 2002. VHA defines MST as sexual assault or repeated, threatening sexual harassment that occurred during military service. Evidence of construct validity, the degree to which the screen is measuring what it purports to measure (i.e., MST), was examined using the 23-item Sexual Experiences Questionnaire-Department of Defense (SEQ-DoD). Results showed individuals who endorsed no SEQ-DoD items screened MST negative. Those who had experienced more SEQ-DoD behaviors with greater frequency, and across all four SEQ-DoD domains, were more likely to screen MST positive. Findings were similar for men and women. These findings contribute to the validity evidence for the VHA MST screen.

What Doesn’t Get Measured Does Exist: Improving the Accuracy of Computer-Aided Text Analysis

2016 ◽  
Vol 44 (7) ◽  
pp. 2909-2933 ◽  
Author(s):  
Aaron F. McKenny ◽  
Herman Aguinis ◽  
Jeremy C. Short ◽  
Aaron H. Anglin
Keyword(s):  
Measurement Error ◽  
Text Analysis ◽  
Best Practice ◽  
Error Variance ◽  
Theory And Practice ◽  
Future Research ◽  
Specific Factor ◽  
Computer Aided ◽  
Measurement Error Variance ◽  
Reduce Measurement Error

Computer-aided text analysis (CATA) is a form of content analysis that enables the measurement of constructs by processing text into quantitative data based on the frequency of words. CATA has been proposed as a useful measurement approach with the potential to lead to important theoretical advancements. Ironically, while CATA has been offered to overcome some of the known deficiencies in existing measurement approaches, we have lagged behind in regard to assessing the technique’s measurement rigor. Our article addresses this knowledge gap and describes important implications for past as well as future research using CATA. First, we describe three sources of measurement error variance that are particularly relevant to studies using CATA: transient error, specific factor error, and algorithm error. Second, we describe and demonstrate how to calculate measurement error variance with the entrepreneurial orientation, market orientation, and organizational ambidexterity constructs, offering evidence that past substantive conclusions have been underestimated. Third, we offer best-practice recommendations and demonstrate how to reduce measurement error variance by refining existing CATA measures. In short, we demonstrate that although measurement error variance in CATA has not been measured thus far, it does exist and it affects substantive conclusions. Consequently, our article has implications for theory and practice, as well as how to assess and minimize measurement error in future CATA research with the goal of improving the accuracy of substantive conclusions.

Sign in / Sign up

Export Citation Format

Share Document