intercoder agreement
Recently Published Documents


TOTAL DOCUMENTS

14
(FIVE YEARS 2)

H-INDEX

5
(FIVE YEARS 0)

2021 ◽  
Author(s):  
Jeffrey W. Paul ◽  
Renato Bezerra Rodrigues ◽  
Jillian Seniuk Cicek

Author(s):  
Teresa K. Naab ◽  
Constanze Küchler

The ‘clarity’ of user comments is an indicator for the quality of statements made in online discussions. User comments below news content on websites or in social media can be examined to determine whether they are clearly written, that is comprehensible to the reader in terms of form, style, and content. Clarity of user comments is essential for the contribution of a comment to a discussion and the exchange between commenters. Field of application/theoretical foundation: As a complement to various further criteria (e.g. coherence, occurrence of arguments), the variable ‘clarity’ of a user comment indicates the comment’s contribution to the deliberative quality of online discussions. Normative approaches to discourse ethics (e.g. Habermas, 1992) assume that contributions to discussions should be phrased understandably to be more valuable for the success of a discussion.  Example studies: Medium Measure Unit of analysis Studies Online; online discussions below news posts Clarity Individual user comment Naab & Küchler (work in progress) Ziegele & Quiring (2015)   Info about variables Variable name/definition: Verständlichkeit eines Nutzerkommentars Operationalization/coding instructions: Es wird kodiert, wie leicht sich Leser*innen der Sinn eines Nutzerkommentars erschließt, wie gut er nachvollziehbar ist. Hierbei zählt der Gesamteindruck. Indikatoren für eine hohe Verständlichkeit sind: Ein verständlicher Sprachstil überwiegend Standardsprache ohne akademische Begriffe bzw. Fremdwörter Vermeidung von Reimen oder literarischen Schreibformen Vermeidung von übertriebenem Cyberslang oder Umgangssprache Keine Verwendung von Fremdsprachen Eine klare, wenig verschachtelte Satzstruktur Keine auffälligen Rechtschreib- und Grammatikfehler Eine eindeutige rhetorische Gestaltung durch den Verzicht auf Ironie, Metaphern und abstrakte Bilder Eine hohe Prägnanz der Aussagen im Sinne der Verbindung von „Bedeutungsreichtum mit einem hohen Maß an Klarheit, Angemessenheit, Anschaulichkeit und Einfachheit“ Verzicht auf das Voraussetzen von speziellem Hintergrundwissen, das beim Durchschnittsleser nicht vorausgesetzt werden kann. Der Kodierer kann sich die Frage stellen: Wie leicht erschließt sich mir der Sinn des Kommentars, wie nachvollziehbar ist er? „Baseline“ ist der Code „0“.  Level of analysis: einzelner Nutzerkommentar Values: 0/ normal verständlich, 1/ schwer verständlich, 2/ überhaupt nicht verständlich, 99/ nicht eindeutig zuzuordnen  Intercoder reliability: The variable showed good performance in tests for intercoder agreement (percentage agreement = 86%; Krippendorf’s alpha = .72) in the study by Ziegele, Breiner, & Quiring (2014).   References Habermas, J. (1992). Faktizität und Geltung: Beiträge zur Diskurstheorie des Rechts und des demokratischen Rechtsstaates. Suhrkamp. Naab, T.K. & Küchler, C. (work in progress). Unveröffentlichtes Codebuch aus dem DFG-Projekt „Gegenseitige Sanktionierung unter NutzerInnen von Kommentarbereichen auf Nachrichtenwebseiten und auf Facebook“. Augsburg. Steenbergen, M. R., Bächtiger, A., Spörndli, M., & Steiner, J. (2003). Measuring political deliberation: A discourse quality index. Comparative European Politics, 1(1), 21–48. doi:10.1057/palgrave.cep.6110002 Ziegele, M., Breiner, T., & Quiring, O. (2014). What creates interactivity in online news discussions? An exploratory analysis of discussion factors in user comments on news items. Journal of Communication, 64(6), 1111–1138. doi:10.1111/jcom.12123 Ziegele, M. & Quiring, O. (2015). Codebuch: Der Diskussionswert von Online-Nachrichten. Unveröffentlichtes Codebuch aus dem DFG-Projekt „Vom Nachrichtenwert zum Diskussionswert“. Mainz.


2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
H Kucukali ◽  
AN Balci Yapalak

Abstract Background While some of the health advice is arousing interest in large audiences, others are neglected. It is known that the presentation of health contents affects their adoption. However, there are not enough studies on popular health books as a medium. The aim of the study is to find out how popular health books are presented to arouse interest in health advice. Methods Promotional descriptions of books may reveal the prominent characteristics of the presentation of health advice and sales of the books may be a proxy of public interest. Public data of 5320 books that are listed in the health category collected from the most popular online bookstore in Turkey (Alexa rank=109) via a web mining program which is developed for this study. A qualitative coding scheme is created after familiarisation with data. Two researchers independently coded promotional descriptions of best selling 95 books that appeared to constitute the 50.1% of all 780,617 sales in health category by February 2020. Results The 95 best selling health books have been written by 61 different authors. They were found to be mostly about advice on nutrition/ diet (33.7%), weight loss (16.8%) and traditional medicine (14.9%) with a substantial intercoder agreement (κ = 0.756). A common narrative discovered in data which usually contains the number of following components: a claim of a paradigm shift, a saviour, a path to salvation, the evil, believers and non-believers and their aftermath, a single responsible for most health problems and an easy single solution for them. Conclusions Best selling health books are presented in a way that its health advice were ideologies or some kind of belief systems. Even it is arguable to recommend this approach for practice, our findings may help to address contemporary challenges in health communication such as epidemics of disinformation. Further studies may consider to analyze the data from a variety of sources and also compare books from different categories. Key messages How the health books are presented may affect how much interest their advice can arouse. Best selling health books found to be using a narrative that present health advice like they were ideologies.


Author(s):  
Udo Kuckartz ◽  
Stefan Rädiker
Keyword(s):  

SAGE Open ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 215824401983962
Author(s):  
Slavica Kozina ◽  
Martin Kowalski ◽  
Mirela Vlastelica ◽  
Tonći Mastelić ◽  
Josip A. Borovac

Our aim was to determine (a) how parents deal with experiences like having a son missing in war, and (b) what expectations they have in terms of outcomes. This qualitative study included 29 parents of 21 sons gone missing in war. We used content analysis singling out narrative patterns and coded these. We assessed intercoder reliability using Krippendorff’s alpha coefficient. Items passing the Krippendorff’s alpha threshold of ≥.50 were verified using Cronbach’s alpha. Three of five coders showed acceptable intercoder agreement on 23 of the 173 identified topics (13.3%; Krippendorff’s alpha: .50-.82). Cronbach’s alpha coefficient confirmed intercoder reliability of .7903. Fathers’ narratives differ from mothers’. Statistics are a valuable tool for identifying specific motifs in grieving narratives of parents who have lost their child. Content analysis can provide insights without interfering with authentic personal experience sparing interviewees from reliving the traumatizing experience.


Author(s):  
Brandon Richard Ro ◽  
Julio Bermudez

This study a) identifies how people describe, characterize, and communicate in written form Extraordinary Architectural Experiences (EAE), and b) expands the traditional qualitative approach to architectural phenomenology by demonstrating a quantitative method to analyze written narratives. Specifically, this study reports on the content analysis of 718 personal accounts of EAEs. Using a deductive, ‘theory-driven’ approach, these narratives were read, coded, and statistically analyzed to identify storyline structure, convincing power, and the relationship between subjective and objective experiential qualities used in the story-telling process. Statistical intercoder agreement tests were conducted to verify the reliability of the interpretations to approach the hard problem of “extraordinary aesthetics” in architecture empirically. The results of this study confirm the aesthetic nature of EAE narratives (and of told experiences) by showing their higher dependence on external objective content (e.g., a building’s features and location) rather than its internal subjective counterpart (e.g., emotions and sensations), which makes them more outwardly focused. The strong interrelationships and intercoder agreement between the thematic realms provide a unique aesthetic construct revealing EAE narratives as memorable, embodied, emotional events mapped by the externally focused content of place, social setting, time, and building features. A majority of EAE narratives were found to possess plot-structure along with significant relationships to objective-subjective content that further grounded their storylines. This study concludes that content analysis provides not only a valid method to understand written narratives about extraordinary architectural experiences quantitatively, but also a view as to how to map the unique nature of aesthetic phenomenology empirically.


Sign in / Sign up

Export Citation Format

Share Document