scholarly journals Psychometric Properties of the Korean Version of the PsyMate Scale Using a Smartphone App: Ecological Momentary Assessment Study (Preprint)

2020 ◽  
Author(s):  
Yong Sook Yang ◽  
Gi Wook Ryu ◽  
Philippe A E G Delespaul ◽  
Mona Choi

BACKGROUND Ecological momentary assessment (EMA) is a method for capturing the changes in the variables in daily life with increased accuracy and decreased recall bias. The PsyMate scale assesses momentary moods in daily life and can be used in various settings. OBJECTIVE The aim of this study was to develop a Korean version of the PsyMate (K-PsyMate) scale and evaluate its psychometric properties by using the EMA method in patients with moyamoya disease (MMD) in South Korea. METHODS Patients with MMD aged over 18 years were recruited from July 2018 to January 2019 at the inpatient and outpatient departments of a university hospital in South Korea. The K-PsyMate scale comprising 13 items was developed following a translation/back translation approach of the English version and loaded onto a mobile app. Participants were instructed to enter their moods 4 times a day for 7 consecutive days. Content validity index, factor analysis, and Pearson’s correlation were performed for validity analysis. For reliability, intraclass correlation coefficients between the first and last measurements were estimated by mean rating, absolute agreement, and a 2-way mixed-effects model. Usability was analyzed through a descriptive analysis, 2-tailed t test, and analysis of variance, and the results were confirmed by Mann-Whitney U test and the Kruskal-Wallis test, as the dependent variable was not normally distributed. RESULTS In total, 1929 assessments from 93 patients were analyzed. The mean age of the participants was 40.59 (SD 10.06) years, and 66 (71%) of the 93 participants were women. Content validity was excellent as content validity index was 0.99, and 2 factors, negative affect and positive affect, were derived by an exploratory factor analysis. The correlations between the subdomains of the K-PsyMate scale and Hospital Anxiety and Depression Scale were significant (<i>P</i>&lt;.001). The agreement between the first and last measurements was poor to moderate according to the obtained intraclass correlation coefficient values. Usability was evaluated by 67 (72%) out of the 93 participants. The participants rated the accuracy of assessing their momentary moods on the app at 4.13 (SD 0.97), easiness in understanding questions, operating, and inputting answers at 4.12 (SD 0.88), and interruption by the survey alarms at 2.48 (SD 1.02) out of 5. CONCLUSIONS The K-PsyMate scale has good validity but poor to moderate agreement, which reflects the characteristics of the EMA data collected in real and natural living environments without control. The findings of our study show that the K-PsyMate scale uploaded in a mobile app can be a valid and reliable tool for evaluating the momentary mood of patients with MMD because using a mobile app is convenient and patients are familiar with their own smartphones, which they use in their daily lives.

10.2196/17926 ◽  
2020 ◽  
Vol 8 (7) ◽  
pp. e17926
Author(s):  
Yong Sook Yang ◽  
Gi Wook Ryu ◽  
Philippe A E G Delespaul ◽  
Mona Choi

Background Ecological momentary assessment (EMA) is a method for capturing the changes in the variables in daily life with increased accuracy and decreased recall bias. The PsyMate scale assesses momentary moods in daily life and can be used in various settings. Objective The aim of this study was to develop a Korean version of the PsyMate (K-PsyMate) scale and evaluate its psychometric properties by using the EMA method in patients with moyamoya disease (MMD) in South Korea. Methods Patients with MMD aged over 18 years were recruited from July 2018 to January 2019 at the inpatient and outpatient departments of a university hospital in South Korea. The K-PsyMate scale comprising 13 items was developed following a translation/back translation approach of the English version and loaded onto a mobile app. Participants were instructed to enter their moods 4 times a day for 7 consecutive days. Content validity index, factor analysis, and Pearson’s correlation were performed for validity analysis. For reliability, intraclass correlation coefficients between the first and last measurements were estimated by mean rating, absolute agreement, and a 2-way mixed-effects model. Usability was analyzed through a descriptive analysis, 2-tailed t test, and analysis of variance, and the results were confirmed by Mann-Whitney U test and the Kruskal-Wallis test, as the dependent variable was not normally distributed. Results In total, 1929 assessments from 93 patients were analyzed. The mean age of the participants was 40.59 (SD 10.06) years, and 66 (71%) of the 93 participants were women. Content validity was excellent as content validity index was 0.99, and 2 factors, negative affect and positive affect, were derived by an exploratory factor analysis. The correlations between the subdomains of the K-PsyMate scale and Hospital Anxiety and Depression Scale were significant (P<.001). The agreement between the first and last measurements was poor to moderate according to the obtained intraclass correlation coefficient values. Usability was evaluated by 67 (72%) out of the 93 participants. The participants rated the accuracy of assessing their momentary moods on the app at 4.13 (SD 0.97), easiness in understanding questions, operating, and inputting answers at 4.12 (SD 0.88), and interruption by the survey alarms at 2.48 (SD 1.02) out of 5. Conclusions The K-PsyMate scale has good validity but poor to moderate agreement, which reflects the characteristics of the EMA data collected in real and natural living environments without control. The findings of our study show that the K-PsyMate scale uploaded in a mobile app can be a valid and reliable tool for evaluating the momentary mood of patients with MMD because using a mobile app is convenient and patients are familiar with their own smartphones, which they use in their daily lives.


2021 ◽  
Author(s):  
Saeideh Heshmati ◽  
Zita Oravecz

Most assessments of well-being have relied on retrospective accounts, measured by global evaluative well-being scales. Following the recent debates focused on the assessment of hedonic and eudaimonic well-being based on the elements of the PERMA theory, the current study aimed to shed further light onto the measurement of PERMA elements in daily life and their temporal dynamics. Through an Ecological Momentary Assessment (EMA) design (N=160), we examined the dynamics of change (e.g., baselines and intra-individual variability) in the PERMA elements using the mPERMA measure, which is an EMA-adapted version of the PERMA Profiler. Findings revealed that momentary experiences of well-being, quantified via PERMA elements, map onto their corresponding hedonic or eudaimonic well-being components, and its dynamical features provide novel insights into predicting global well-being. This work offers avenues for future research to assess well-being in real-time and real-world contexts in ecologically valid ways, while eliminating recall bias.


Assessment ◽  
2018 ◽  
Vol 27 (8) ◽  
pp. 1683-1698 ◽  
Author(s):  
Stacey B. Scott ◽  
Martin J. Sliwinski ◽  
Matthew Zawadzki ◽  
Robert S. Stawski ◽  
Jinhyuk Kim ◽  
...  

Despite widespread interest in variance in affect, basic questions remain pertaining to the relative proportions of between-person and within-person variance, the contribution of days and moments, and the reliability of these estimates. We addressed these questions by decomposing negative affect and positive affect variance across three levels (person, day, moment), and calculating reliability using a coordinated analysis of seven daily diary, ecological momentary assessment (EMA), and diary-EMA hybrid studies (across studies age = 18-84 years, total Npersons = 2,103, total Nobservations = 45,065). Across studies, within-person variance was sizeable (negative affect: 45% to 66%, positive affect: 25% to 74%); in EMA more within-person variance was attributable to momentary rather than daily level. Reliability was adequate to high at all levels of analysis (within-person: .73-.91; between-person: .96-1.00) despite different items and designs. We discuss the implications of these results for the design of future intensive studies of affect variance.


2019 ◽  
Vol 32 (6) ◽  
pp. 765-774 ◽  
Author(s):  
A. Roefs ◽  
B. Boh ◽  
G. Spanakis ◽  
C. Nederkoorn ◽  
L. H. J. M. Lemmens ◽  
...  

Cephalalgia ◽  
2006 ◽  
Vol 26 (11) ◽  
pp. 1335-1343 ◽  
Author(s):  
H Kikuchi ◽  
K Yoshiuchi ◽  
N Miyasaka ◽  
K Ohashi ◽  
Y Yamamoto ◽  
...  

Recalled evaluation of headache intensity is often affected by several factors. Recently, computerized ecological momentary assessment (EMA) has been developed to avoid such problems as recall bias. Here, we compared recalled headache intensity with momentary headache intensity using EMA in tension- type headache (TTH). Forty patients with TTH wore watch-type computers for 1 week to record momentary headache intensity and also rated their headache intensities by recall. We calculated intraclass correlation coefficients between recalled headache intensity and indices from EMA recordings in the whole study population and in two subgroups divided by variability of momentary headache intensity. The results showed that consistency and agreement of momentary and recalled headache intensity were low, and this was especially marked in the subjects whose headache varied widely. These observations suggested that variability of headache intensity may affect recall of headache intensity and this should be taken into consideration in both clinical and research settings.


Sign in / Sign up

Export Citation Format

Share Document