scholarly journals Establishing Agreement between Parent-reported and Directly-measured Behaviours

2017 ◽  
Vol 42 (1) ◽  
pp. 105-115 ◽  
Author(s):  
Shannon K. Bennetts ◽  
Fiona K. Mensah ◽  
Elizabeth M. Westrupp ◽  
Naomi J. Hackworth ◽  
Jan M. Nicholson ◽  
...  
Keyword(s):  
Early Childhood ◽  
Quantitative Measurement ◽  
Measurement Methods ◽  
Small Sample ◽  
Statistical Techniques ◽  
Policy Makers ◽  
Bland Altman Method ◽  
Research Findings ◽  
Statistical Approaches ◽  
Small Sample Sizes

THE QUALITY AND ACCURACY OF research findings relies on the use of appropriate and sensitive research methods. To date, few studies have directly compared quantitative measurement methods in the early childhood field and the extent to which parent-reported and directly-measured behaviours agree is unclear. Existing studies are hampered by small sample sizes and the use of statistical techniques which quantify the magnitude of association between measures (e.g. correlations), but not agreement. Here we review the limitations of existing method comparisons and suggest how alternative statistical approaches such as the Bland-Altman Method and ordinary least products regression can be readily applied in the early childhood context. Understanding agreement (and disagreement) between measurement methods has potential to reduce research costs and improve data quality, with important implications for researchers, clinicians and policy-makers.

scholarly journals A Review Focused on the Psychological Effectiveness of Tai Chi on Different Populations

2012 ◽  
Vol 2012 ◽  
pp. 1-9 ◽  
Author(s):  
Long Zhang ◽  
Charles Layne ◽  
Thomas Lowder ◽  
Jian Liu
Keyword(s):  
Tai Chi ◽  
Healthy Lifestyle ◽  
Small Sample ◽  
Statistical Techniques ◽  
Psychological Benefits ◽  
Scientific Process ◽  
Control Groups ◽  
Lack Of Control ◽  
Different Populations ◽  
Small Sample Sizes

As a popular exercise form, Tai Chi (TC) has been investigated to determine its contributions to an active and healthy lifestyle. There are an increasing number of researchers who focus on exploring the potential physiological and psychological benefits of TC but only a few systematic reviews of these benefits to a variety of populations. The purpose of this paper is to comprehensively evaluate the reported psychological benefits associated with practicing TC. Although many investigators have reported possible psychological benefits of TC for children, young adults, older healthy adults, and for a variety of patient populations, many of the reports suffer one or more methodological flaws. These flaws include inadequate study design, including lack of control groups, small sample sizes, unsophisticated statistical techniques, or publication without rigorous peer review. After reviewing the results of the existing literature regarding the potential psychological benefits of TC, we recommend that future investigations be conducted with additional adherence to the traditional scientific process.

Use of proper statistical techniques for research studies with small samples

2017 ◽  
Vol 313 (5) ◽  
pp. L873-L877 ◽  
Author(s):  
Charity J. Morgan
Keyword(s):  
Statistical Methods ◽  
Statistical Tests ◽  
Small Sample ◽  
Small Samples ◽  
Statistical Techniques ◽  
Sample Sizes ◽  
Small Sample Sizes ◽  
Research Studies

In this review I discuss the appropriateness of various statistical methods for use with small sample sizes. I review the assumptions and limitations of these methods and provide recommendations for figures and statistical tests.

scholarly journals The principles and application of qualitative research

2004 ◽  
Vol 63 (4) ◽  
pp. 641-646 ◽  
Author(s):  
Alizon K. Draper
Keyword(s):  
Qualitative Research ◽  
Quantitative Research ◽  
Research Strategy ◽  
Small Sample ◽  
Theoretical Perspectives ◽  
Research Findings ◽  
Methodological Principles ◽  
Small Sample Sizes ◽  
Quality Of Research

The present paper provides an overview of the methodological principles that underpinqualitative research and how these principles differ from those of quantitative research. It is intended to set the scene for the following papers that outline two specific approaches to the analysis of qualitative data. Within the tradition of qualitative research there are many different theoretical perspectives, of which these approaches are only two examples, but they need to be set within this broader tradition in order to highlight their specific features. Qualitative and quantitative research differ from each other in far more than their methods and data. They are each based on very different premises about both the nature of the world and the nature of our knowledge of it and how this information is generated. These approaches have implications for all aspects of research strategy, including the assessment of the quality of research findings and their wider utility or application. In relation to the latter, lack of detail in the reporting of qualitative research and small sample sizes has tended to create the impression that the findings of qualitative research have little application outside the particular research setting. While there is need for more rigor in reporting, it needs to be recognized that qualitative research can offer insights and understandings with wider relevance, althoughthese outcomes are of a different type from those provided by quantitative research.

scholarly journals How to prove that your therapy is effective, even when it is not: a guideline

2015 ◽  
Vol 25 (5) ◽  
pp. 428-435 ◽  
Author(s):  
P. Cuijpers ◽  
I. A. Cristea
Keyword(s):  
Gold Standard ◽  
Treatment Guidelines ◽  
Randomised Trial ◽  
Small Sample ◽  
Risk Of Bias ◽  
Randomised Trials ◽  
Control Groups ◽  
Policy Makers ◽  
Small Sample Sizes ◽  
Positive Effect

Aims.Suppose you are the developer of a new therapy for a mental health problem or you have several years of experience working with such a therapy, and you would like to prove that it is effective. Randomised trials have become the gold standard to prove that interventions are effective, and they are used by treatment guidelines and policy makers to decide whether or not to adopt, implement or fund a therapy.Methods.You would want to do such a randomised trial to get your therapy disseminated, but in reality your clinical experience already showed you that the therapy works. How could you do a trial in order to optimise the chance of finding a positive effect?Results.Methods that can help include a strong allegiance towards the therapy, anything that increases expectations and hope in participants, making use of the weak spots of randomised trials (risk of bias), small sample sizes and waiting list control groups (but not comparisons with existing interventions). And if all that fails one can always not publish the outcomes and wait for positive trials.Conclusions.Several methods are available to help you show that your therapy is effective, even when it is not.

The Role of Nonprofits in Designing and Implementing Evidence-Based Programs

2018 ◽  
Vol 678 (1) ◽  
pp. 155-163
Author(s):  
James X. Sullivan
Keyword(s):  
Social Services ◽  
Human Service ◽  
National Level ◽  
Small Sample ◽  
Policy Makers ◽  
Small Sample Sizes ◽  
Access To Data ◽  
Evidence Based Programs ◽  
Effective Programs

Human service nonprofits are a major provider of social services in this country, spending billions of dollars each year implementing programs to improve outcomes for their clients. Unfortunately, these programs are typically not rigorously evaluated to determine whether they are having their intended effect. Many obstacles make it challenging to rigorously evaluate services provided by these nonprofits, including evaluation costs, limited access to data, and small sample sizes, but these obstacles are surmountable. Policy-makers could accelerate the pace and quality of evidence building by providing more resources for impact evaluations, streamlining and standardizing access to key administrative data, and expanding support for the replication of effective programs. Better evidence of what works for human service nonprofits will ultimately mean more effective programs at the national level.

Materialism and Green Purchase Intention: A Study of Urban Vietnamese Consumers

2017 ◽  
pp. 89-106 ◽  
Author(s):  
Mai Nguyen Thi Tuyet ◽  
Hung Nguyen Vu ◽  
Linh Nguyen Hoang ◽  
Minh Nguyen Hoang
Keyword(s):  
Conceptual Framework ◽  
Survey Data ◽  
Purchase Intention ◽  
Behavioral Control ◽  
Subjective Norm ◽  
Perceived Behavioral Control ◽  
Policy Makers ◽  
Tpb Model ◽  
Research Findings ◽  
The Impact

This study focuses on examining the impact of three components of materialism on green purchase intention for urban consumers in Vietnam, an emerging economy. An extended Theory of Planned Behavior (TPB) is applied as the conceptual framework for this study. The hypotheses are empirically tested using survey data obtained from consumers in Hanoi, the capital of Vietnam. The regression results show support for most of our hypotheses. The findings indicate that two out of three facets of materialism are significant predictors of green purchase intention. Specifically, success is found to be negatively related to purchase intention, while happiness is related positively to the intention. All three antecedents in the TPB model, including attitude towards green purchase, subjective norm, and perceived behavioral control are also found to have positive impacts on purchase intention. The research findings are discussed and implications for managers and policy makers are provided.

Integrating Visual and Bayesian Statistical Analyses in Single Case Experimental Research to Evaluate the Effectiveness and Magnitude of a Comprehensive Behavioral Intervention

2018 ◽  
Author(s):  
Prathiba Natesan ◽  
Smita Mehta
Keyword(s):  
Behavioral Intervention ◽  
Effect Size ◽  
Rate Ratio ◽  
Visual Analysis ◽  
Single Case ◽  
Small Sample ◽  
Statistical Analyses ◽  
Data Types ◽  
Ratio Effect ◽  
Small Sample Sizes

Single case experimental designs (SCEDs) have become an indispensable methodology where randomized control trials may be impossible or even inappropriate. However, the nature of SCED data presents challenges for both visual and statistical analyses. Small sample sizes, autocorrelations, data types, and design types render many parametric statistical analyses and maximum likelihood approaches ineffective. The presence of autocorrelation decreases interrater reliability in visual analysis. The purpose of the present study is to demonstrate a newly developed model called the Bayesian unknown change-point (BUCP) model which overcomes all the above-mentioned data analytic challenges. This is the first study to formulate and demonstrate rate ratio effect size for autocorrelated data, which has remained an open question in SCED research until now. This expository study also compares and contrasts the results from BUCP model with visual analysis, and rate ratio effect size with nonoverlap of all pairs (NAP) effect size. Data from a comprehensive behavioral intervention are used for the demonstration.

No Evidence that Experiencing Physical Warmth Promotes Interpersonal Warmth: Two Failures to Replicate Williams and Bargh (2008)

2018 ◽  
Author(s):  
Christopher Chabris ◽  
Patrick Ryan Heck ◽  
Jaclyn Mandart ◽  
Daniel Jacob Benjamin ◽  
Daniel J. Simons
Keyword(s):  
Null Hypothesis ◽  
Small Sample ◽  
Sample Sizes ◽  
Double Blind ◽  
Bayesian Analyses ◽  
Physical Warmth ◽  
Small Sample Sizes ◽  
Interpersonal Warmth

Williams and Bargh (2008) reported that holding a hot cup of coffee caused participants to judge a person’s personality as warmer, and that holding a therapeutic heat pad caused participants to choose rewards for other people rather than for themselves. These experiments featured large effects (r = .28 and .31), small sample sizes (41 and 53 participants), and barely statistically significant results. We attempted to replicate both experiments in field settings with more than triple the sample sizes (128 and 177) and double-blind procedures, but found near-zero effects (r = –.03 and .02). In both cases, Bayesian analyses suggest there is substantially more evidence for the null hypothesis of no effect than for the original physical warmth priming hypothesis.

Sign in / Sign up

Export Citation Format

Share Document