JaConTeBe: A Benchmark Suite of Real-World Java Concurrency Bugs (T)

2015 ◽  
Author(s):  
Ziyi Lin ◽  
Darko Marinov ◽  
Hao Zhong ◽  
Yuting Chen ◽  
Jianjun Zhao
Keyword(s):  
Real World ◽  
Concurrency Bugs ◽  
Benchmark Suite

scholarly journals Debugging Nondeterministic Failures in Linux Programs through Replay Analysis

2018 ◽  
Vol 2018 ◽  
pp. 1-11
Author(s):  
Shakaiba Majeed ◽  
Minsoo Ryu
Keyword(s):  
Real World ◽  
Production Systems ◽  
Memory Access ◽  
Analysis Method ◽  
Concurrency Bugs ◽  
Real World Applications ◽  
Record And Replay ◽  
Access Patterns ◽  
Event Based ◽  
Concurrency Bug

Reproducing a failure is the first and most important step in debugging because it enables us to understand the failure and track down its source. However, many programs are susceptible to nondeterministic failures that are hard to reproduce, which makes debugging extremely difficult. We first address the reproducibility problem by proposing an OS-level replay system for a uniprocessor environment that can capture and replay nondeterministic events needed to reproduce a failure in Linux interactive and event-based programs. We then present an analysis method, called replay analysis, based on the proposed record and replay system to diagnose concurrency bugs in such programs. The replay analysis method uses a combination of static analysis, dynamic tracing during replay, and delta debugging to identify failure-inducing memory access patterns that lead to concurrency failure. The experimental results show that the presented record and replay system has low-recording overhead and hence can be safely used in production systems to catch rarely occurring bugs. We also present few concurrency bug case studies from real-world applications to prove the effectiveness of the proposed bug diagnosis framework.

scholarly journals TaintBench: Automatic real-world malware benchmarking of Android taint analyses

2021 ◽  
Vol 27 (1) ◽  
Author(s):  
Linghui Luo ◽  
Felix Pauck ◽  
Goran Piskachev ◽  
Manuel Benz ◽  
Ivan Pashchenko ◽  
...  
Keyword(s):  
Real World ◽  
Ground Truth ◽  
Complex Structures ◽  
Taint Analysis ◽  
Specific Domain ◽  
Sources And Sinks ◽  
Usability Test ◽  
Android Applications ◽  
Benchmark Suite ◽  
Perceived Usability

AbstractDue to the lack of established real-world benchmark suites for static taint analyses of Android applications, evaluations of these analyses are often restricted and hard to compare. Even in evaluations that do use real-world apps, details about the ground truth in those apps are rarely documented, which makes it difficult to compare and reproduce the results. To push Android taint analysis research forward, this paper thus recommends criteria for constructing real-world benchmark suites for this specific domain, and presents TaintBench, the first real-world malware benchmark suite with documented taint flows. TaintBench benchmark apps include taint flows with complex structures, and addresses static challenges that are commonly agreed on by the community. Together with the TaintBench suite, we introduce the TaintBench framework, whose goal is to simplify real-world benchmarking of Android taint analyses. First, a usability test shows that the framework improves experts’ performance and perceived usability when documenting and inspecting taint flows. Second, experiments using TaintBench reveal new insights for the taint analysis tools Amandroid and FlowDroid: (i) They are less effective on real-world malware apps than on synthetic benchmark apps. (ii) Predefined lists of sources and sinks heavily impact the tools’ accuracy. (iii) Surprisingly, up-to-date versions of both tools are less accurate than their predecessors.

A Benchmark-Suite of Real-World Constrained Multi-Objective Optimization Problems and some Baseline Results

2021 ◽  
pp. 100961
Author(s):  
Abhishek Kumar ◽  
Guohua Wu ◽  
Mostafa Z. Ali ◽  
Qizhang Luo ◽  
Rammohan Mallipeddi ◽  
...  
Keyword(s):  
Real World ◽  
Optimization Problems ◽  
Multi Objective Optimization ◽  
Multi Objective ◽  
Benchmark Suite

Replications can cause distorted belief in scientific progress

2018 ◽  
Vol 41 ◽  
Author(s):  
Michał Białek
Keyword(s):  
Real World ◽  
Scientific Progress ◽  
The Public ◽  
Psychological Science

AbstractIf we want psychological science to have a meaningful real-world impact, it has to be trusted by the public. Scientific progress is noisy; accordingly, replications sometimes fail even for true findings. We need to communicate the acceptability of uncertainty to the public and our peers, to prevent psychology from being perceived as having nothing to say about reality.

Current Issues: Evidence-Based Practice for the Real World: Thoughts on Clinical Education in Communication Disorders

2010 ◽  
Vol 20 (3) ◽  
pp. 100-105 ◽  
Author(s):  
Anne K. Bothe
Keyword(s):  
Clinical Education ◽  
Real World ◽  
Evidence Based Practice ◽  
Communication Disorders ◽  
University Faculty ◽  
Evidence Based ◽  
Speech Language Pathology ◽  
Basic Principles ◽  
The Real ◽  
Language Pathology

This article presents some streamlined and intentionally oversimplified ideas about educating future communication disorders professionals to use some of the most basic principles of evidence-based practice. Working from a popular five-step approach, modifications are suggested that may make the ideas more accessible, and therefore more useful, for university faculty, other supervisors, and future professionals in speech-language pathology, audiology, and related fields.

Qualitative Case Study Research Design

2015 ◽  
Vol 25 (1) ◽  
pp. 39-45 ◽  
Author(s):  
Jennifer Tetnowski
Keyword(s):  
Research Design ◽  
Real World ◽  
Qualitative Case Study ◽  
Case Study Research ◽  
Study Research

Qualitative case study research can be a valuable tool for answering complex, real-world questions. This method is often misunderstood or neglected due to a lack of understanding by researchers and reviewers. This tutorial defines the characteristics of qualitative case study research and its application to a broader understanding of stuttering that cannot be defined through other methodologies. This article will describe ways that data can be collected and analyzed.

Sign in / Sign up

Export Citation Format

Share Document