scholarly journals Validity Evidence for Off-the-Shelf Language-Based Personality Assessment Using Video Interviews: Convergent and Discriminant Relationships with Self and Observer Ratings

2019 ◽  
Vol 5 (3) ◽  
Author(s):  
Louis Hickman ◽  
Louis Tay ◽  
Sang Eun Woo
Keyword(s):  
Personality Assessment ◽  
Validity Evidence ◽  
Personality Assessments ◽  
Assessment Scores ◽  
Personnel Assessment ◽  
Technological Advances ◽  
Assessment Techniques ◽  
Observer Ratings ◽  
Ibm Watson ◽  
Automated Methods

Technological advances have led to the development of automated methods for personnel assessment that are purported to augment or outperform human judgment. However, empirical research providing validity evidence for such techniques in the selection context remains scarce. In addressing this void, this study focuses on language-based personality assessments using an off-the-shelf, commercially available product (i.e., IBM Watson Personality Insights) in the context of video-based interviews. The scores derived from the language-based assessment were compared to self and observer ratings of personality to examine convergent and discriminant relationships. The language-based assessment scores showed low convergence with self-ratings for openness, and with self- and observer ratings for agreeableness. No validity evidence was found for extraversion and conscientiousness. For neuroticism, the patterns of correlations were in the opposite of what was theoretically expected, which raised a significant concern. We suggest more validation work is needed to further improve emerging assessment techniques and to understand when and how such approaches can appropriately be applied in personnel assessment and selection.

scholarly journals Focusing Personality Assessment on the Person: Modeling General, Shared, and Person Specific Processes in Personality and Psychopathology

2017 ◽  
Author(s):  
Aidan G.C. Wright ◽  
Kathleen Gates ◽  
Cara Arizmendi ◽  
Stephanie Lane ◽  
William Woods ◽  
...  
Keyword(s):  
Personality Assessment ◽  
General Structure ◽  
Assessment Practices ◽  
Model Estimation ◽  
Multiple Model ◽  
Personality Assessments ◽  
Dynamic Data ◽  
Daily Diaries ◽  
Assessment Techniques ◽  
Method Group

Personality and psychopathology are composed of dynamic and interactive processes among diverse psychological systems, manifesting over time and in response to an individual’s natural environment. Ambulatory assessment techniques promise to revolutionize assessment practices by allowing access to the dynamic data necessary to study these processes directly. Assessing manifestations of personality and psychopathology naturalistically in an individual’s own ecology allows for dynamic modeling of key behavioral processes. However, advances in dynamic data collection have highlighted the challenges of both fully understanding an individual (via idiographic models) and how s/he compares to others (as seen in nomothetic models). Methods are needed that can simultaneously model idiographic (i.e., person-specific) processes and nomothetic (i.e., general) structure from intensive longitudinal personality assessments. Here we present a method, Group Iterative Multiple Model Estimation (GIMME) for simultaneously studying general, shared (i.e., in subgroups), and person-specific processes in intensive longitudinal behavioral data. We first provide introduction to the GIMME method, followed by a demonstration of its use in a sample of individuals diagnosed with personality disorder who completed daily diaries over 100 consecutive days.

Attitudes toward Clinical Assessment by Members of the AABT

1984 ◽  
Vol 55 (3) ◽  
pp. 831-838 ◽  
Author(s):  
Chris Piotrowski ◽  
John W. Keller
Keyword(s):  
Clinical Assessment ◽  
Personality Assessment ◽  
Behavioral Assessment ◽  
Assessment Practices ◽  
The Past ◽  
Projective Measures ◽  
Assessment Techniques ◽  
Professional Practitioners ◽  
Future Utility ◽  
Rate Of Response

The present survey investigated the attitudes toward projective, objective, and behavioral assessment practices from members of the Association for Advancement of Behavior Therapy (AABT). Of the 531 persons in the AABT sample, 171 returned the questionnaire for a 32.2% rate of response. In terms of future emphasis it appeared that both behavioral and objective personality assessment were deemed as continuing in popularity, while projective techniques were viewed with little future utility. However, professional practitioners were expected to be familiar with standard projective measures and tests of intelligence by about half the respondents. Further, AABT members felt somewhat pessimistic about the empirical credibility of assessment techniques in general. The implications of these findings for academic and applied emphasis in clinical assessment were discussed and compared to the findings of a previous survey of AABT members by Wade, Baker, and Hartmann in 1979. The emerging practical emphasis over the past several years on behavioral assessment has not yet matured in the academic and applied setting.

Not Aggressive or Just Faking It? Examining Faking and Faking Detection on the Conditional Reasoning Test of Aggression

2017 ◽  
Vol 23 (1) ◽  
pp. 96-123 ◽  
Author(s):  
Nathan E. Wiita ◽  
Rustin D. Meyer ◽  
Elnora D. Kelly ◽  
Brian J. Collins
Keyword(s):  
Construct Validity ◽  
Present Article ◽  
Detection System ◽  
Conditional Reasoning ◽  
Promising Method ◽  
Validity Evidence ◽  
Inside Information ◽  
Personality Assessments ◽  
Reasoning Test

Substantial research has been dedicated to examining and combating respondent misrepresentation (i.e., “faking”) on personality assessments. Two approaches to combat faking that have garnered particular attention include: (a) designing systems to identify likely fakers and (b) developing difficult-to-fake measures. Consistent with suggestions to combine these strategies, the present article examines a new faking detection system specifically designed for a difficult-to-fake measure (i.e., the Conditional Reasoning Test for Aggression; CRT-A). Four studies (a) help elucidate the conditions under which the CRT-A is fakeable, (b) provide initial construct validity evidence for the faking detection system developed here, (c) examine the effects of faking and faking detection on the CRT-A’s criterion-oriented validity, and (d) show that participants identify CRT-based faking detection items at worse-than-chance levels even when they are fully informed about how these items work. Taken together, these studies reinforce the importance of maintaining the indirect nature of CRTs but also show that the faking detection system developed here represents a promising method of identifying those who may have used inside information to manipulate their scores.

Development of LaserPro System for External Corrosion Mapping With Integrated Assessment

2004 ◽  
Author(s):  
Paul Holloway ◽  
Vaughn Inman ◽  
Duane Cronin
Keyword(s):  
Position Measurement ◽  
Data Set ◽  
Depth Measurement ◽  
Assessment Techniques ◽  
Corrosion Defects ◽  
Automatic Tool ◽  
External Corrosion ◽  
The University ◽  
Online Feedback ◽  
Automated Methods

This paper presents the design and application of a new semi-automatic tool for mapping external pipeline corrosion. The device hardware is complemented by the implementation of current corrosion assessment techniques via online software. The development of this device is based on over 10 years of experience in external corrosion mapping and automated scanner development, in support of an experimental research program at the University of Waterloo. The mapping device hardware consists of a novel position measurement system which is coupled to a laser-based depth measurement device to generate a surface map of corrosion defects. Direct comparison with manual (pit gauge) and fully automated measurements has shown that a given defect can be quickly and accurately mapped using the new system. Automated data capture and evaluation has demonstrated significant improvements over fully manual pit gauge-based methods. In addition, the manual position of the measurement head allows the user to map only those areas which are pertinent to the assessment. This is in contrast to fully automated methods which require continuous measurements over predefined areas of a pipe. Online feedback compliments this system and allows the operator to determine if the data set is complete by providing information on the convergence of the predicted failure pressure. Using this new mapping device, measured surface maps of natural complex corrosion defects are shown to compare favorably with other mapping devices and manually measured defect dimensions.

Relation of Photo-Trait-Attribution Method of Personality Assessment to Standard Assessment Techniques

1968 ◽  
Vol 22 (1) ◽  
pp. 95-102
Author(s):  
Ralph B. Vacchiano ◽  
Robert J. Adrian ◽  
Lewis R. Lieberman ◽  
David C. Schiffman
Keyword(s):  
Factor Analysis ◽  
Factor Structure ◽  
Personality Assessment ◽  
Criterion Measure ◽  
Standard Assessment ◽  
Trait Attribution ◽  
Assessment Techniques

The validity of the photo-trait-attribution method of personality assessment was explored by comparison of the attribution task with TAT projective analysis (attribution of need descriptions to TAT hero) and three criterion measures, TAT performance, reputation, and self-description. All measures were based on the same personality constructs, Murray's need system. Although relatively little relationship was exhibited between the criterion measures and the photo-attribution technique when correlation and factor analysis were carried out, the logical factor structure of the photo-attribution scores suggested that this method gave as valid an assessment of personality as did the well-known criterion measure.

scholarly journals Social Desirability in Spouse Ratings

2018 ◽  
Vol 122 (2) ◽  
pp. 593-608
Author(s):  
Vaka Vésteinsdóttir ◽  
Eva D. Steingrimsdottir ◽  
Adam Joinson ◽  
Ulf-Dietrich Reips ◽  
Fanney Thorsdottir
Keyword(s):  
Social Desirability ◽  
Personality Assessment ◽  
Openness To Experience ◽  
Socially Desirable Responding ◽  
Social Desirability Scale ◽  
External Criterion ◽  
Self Reports ◽  
Observer Ratings ◽  
One Year ◽  
Do So

Whether or not socially desirable responding is a cause for concern in personality assessment has long been debated. For many researchers, McCrae and Costa laid the issue to rest when they showed that correcting for socially desirable responding in self-reports did not improve the agreement with spouse ratings on the Neuroticism, Extraversion, and Openness to Experience Personality Inventory. However, their findings rest on the assumption that observer ratings in general, and spouse ratings in particular, are an unbiased external criterion. If spouse ratings are also susceptible to socially desirable responding, correcting for the bias in self-rated measures cannot be assumed to increase agreement between self-reports and spouse ratings, and thus failure to do so should not be taken as evidence for the ineffectiveness of measuring and correcting for socially desirable responding. In the present study, McCrae and Costa’s influential study was replicated with the exception of measuring socially desirable responding with the Marlowe–Crowne Social Desirability Scale, in both self-reports and spouse ratings. Analyses were based on responses from 70 couples who had lived together for at least one year. The results showed that both self-reports and spouse ratings are susceptible to socially desirable responding and thus McCrae and Costa’s conclusion is drawn into question.

scholarly journals Protocol for Investigating the Process Underlying Responses in Personality Assessments

2020 ◽  
Vol 30 ◽  
Author(s):  
Lucas de Francisco Carvalho ◽  
Fernanda Silveira ◽  
Ananias Queiroga de Oliveira Filho ◽  
Ana Maria Reis
Keyword(s):  
Personality Assessment ◽  
Content Validity ◽  
Personality Inventory ◽  
Self Report ◽  
Personality Assessments ◽  
Personality Tests ◽  
Response Process ◽  
Response Strategies ◽  
Dsm 5 ◽  
Consistent Information

Abstract The literature investigating the process underlying the answers given in self-report tests for personality assessments is scarce. This study aimed to develop a protocol to investigate the response process of people who responded to a self-report instrument for personality assessment. It also sought evidence of content validity for this protocol. The protocol presented focused on grandiosity, representing the narcissistic functioning. A total of 35 people answered the Dimensional Clinical Personality Inventory (IDCP) and the Personality Inventory for DSM-5 (PID-5). Favorable evidence was identified, indicating the proper functioning of the developed protocol, since the literature showed consistent information about it. For example, it was observed that people who scored higher in grandiosity on self-report tests were those who chose the alternatives that represented grandiosity characteristics and were also those who presented a higher baseline to consider someone as narcissistic. The protocol is expected to be replicable by other researchers who aim to verify the response strategies adopted in self-report type personality tests.

Using Mobile Sensors to Study Personality Dynamics

2020 ◽  
pp. 1-13
Author(s):  
Brenton M. Wiernik ◽  
Deniz S. Ones ◽  
Benjamin M. Marlin ◽  
Casey Giordano ◽  
Stephan Dilchert ◽  
...  
Keyword(s):  
Machine Learning ◽  
Personality Assessment ◽  
Mobile Sensors ◽  
Sensor Data ◽  
Practical Implementation ◽  
Personality Assessments ◽  
New Approach ◽  
Machine Learning Methods ◽  
Research Designs ◽  
Over Time

Abstract. Research interest in personality dynamics over time is rapidly growing. Passive personality assessment via mobile sensors offers an intriguing new approach for measuring a wide variety of personality dynamics. In this paper, we address the possibility of integrating sensor-based assessments to enhance personality dynamics research. We consider a variety of research designs that can incorporate sensor-based measures and address pitfalls and limitations in terms of psychometrics and practical implementation. We also consider analytic challenges related to data quality and model evaluation that researchers must address when applying machine learning methods to translate sensor data into composite personality assessments.

Sign in / Sign up

Export Citation Format

Share Document