On quality of test sets: relating fault coverage to defect coverage

Author(s):  
A.L. D'souzat ◽  
M.S. Hsiao
2022 ◽  
pp. 096703352110572
Author(s):  
Nicholas T Anderson ◽  
Kerry B Walsh

Short wave near infrared (NIR) spectroscopy operated in a partial or full transmission geometry and a point spectroscopy mode has been increasingly adopted for evaluation of quality of intact fruit, both on-tree and on-packing lines. The evolution in hardware has been paralleled by an evolution in the modelling techniques employed. This review documents the range of spectral pre-treatments and modelling techniques employed for this application. Over the last three decades, there has been a shift from use of multiple linear regression to partial least squares regression. Attention to model robustness across seasons and instruments has driven a shift to machine learning methods such as artificial neural networks and deep learning in recent years, with this shift enabled by the availability of large and diverse training and test sets.


2020 ◽  
Vol 9 (2) ◽  
pp. 364 ◽  
Author(s):  
Kyeong Hwa Ryu ◽  
Hye Jin Baek ◽  
Sung-Min Gho ◽  
Kanghyun Ryu ◽  
Dong-Hyun Kim ◽  
...  

We investigated the capability of a trained deep learning (DL) model with a convolutional neural network (CNN) in a different scanning environment in terms of ameliorating the quality of synthetic fluid-attenuated inversion recovery (FLAIR) images. The acquired data of 319 patients obtained from the retrospective review were used as test sets for the already trained DL model to correct the synthetic FLAIR images. Quantitative analyses were performed for native synthetic FLAIR and DL-FLAIR images against conventional FLAIR images. Two neuroradiologists assessed the quality and artifact degree of the native synthetic FLAIR and DL-FLAIR images. The quantitative parameters showed significant improvement on DL-FLAIR in all individual tissue segments and total intracranial tissues than on the native synthetic FLAIR (p < 0.0001). DL-FLAIR images showed improved image quality with fewer artifacts than the native synthetic FLAIR images (p < 0.0001). There was no significant difference in the preservation of the periventricular white matter hyperintensities and lesion conspicuity between the two FLAIR image sets (p = 0.217). The quality of synthetic FLAIR images was improved through artifact correction using the trained DL model on a different scan environment. DL-based correction can be a promising solution for ameliorating the quality of synthetic FLAIR images to broaden the clinical use of synthetic magnetic resonance imaging (MRI).


2020 ◽  
Vol 75 (10) ◽  
pp. 794.e1-794.e6
Author(s):  
B.A. Qenam ◽  
T. Li ◽  
K. Tapia ◽  
P.C. Brennan

2021 ◽  
pp. 43-57
Author(s):  
Sergey Makarenko ◽  

Relevance. Security issues of information systems in critical infrastructure objects become important now. However, current tasks of information security audit of critical infrastructure objects are mainly limited to checking them for compliance with requirements of standards and documents. With this approach to the audit, security of these objects from real attacks by hackers remains unclear. Therefore, objects are subjected to a testing procedure, namely, penetration testing, in order to objectively verify their security. An analysis of publications in this area shows that there is not mathematical approaches to selection of tests, as well as parameters and criteria for evaluating the effectiveness of penetration testing. The goals of the paper is to form specific parameters of completeness, efficiency, reliability and cost of testing, as well as, in a generalized form, a group of criteria “efficiency/cost”, allowing to estimate the quality of test sets, as well as to compare different penetration testing scenarios with each other. Research methods. Methods of probability theory and mathematical statistics, methods of processing experimental data, as well as the results of other studies in the field of software security testing are used in the paper to achieve the research goals. Results. The general form of the “efficiency/cost” criteria for estimating the quality of penetration testing, as well as formal particular parameters for evaluating separate parameters in the proposed criteria – the parameters of completeness, efficiency, reliability and cost are presented in the paper. The results of the paper can be used by auditors and testers to objectively justify test sets and compare different penetration testing scenarios with each other. The material of the paper can be useful for specialists who make research is such an area as penetration testing. Keywords: penetration testing, information technology impact, testing quality criterion, testing quality, testing completeness, testing efficiency, testing reliability, testing cost.


Author(s):  
BYOUNGJU CHOI

The traditional method of assessing software quality is through software testing. In the past two decades, numerous test criteria have been proposed. Although the generation and evaluation of a test set is important, the ultimate goal is to ensure the quality of the software under test. It is risky to validate software by using test sets with respect to an arbitrarily selected test adequacy criterion as it can lead to incorrect conclusions on the quality of the software. In this paper we examine how different test criteria can be combined into one measurement to assess the adequacy of test sets. Based on the subsumption relation between these criteria, a multi-criterion decision making method, Analytic Hierarchy Process (AHP), is used to determine the weight of each test adequacy criterion. A case study reported here suggests that the combined criterion so generated provides a more objective and precise measurement of the fault detection capability of test sets than does a single-member test criterion.


1997 ◽  
Vol 2 (3) ◽  
pp. 281-305 ◽  
Author(s):  
Paul Thadikaran ◽  
Sreejit Chakravarty ◽  
Janak Patel

2013 ◽  
Vol 84 (6) ◽  
pp. 768-775 ◽  
Author(s):  
Dhelfeson Willya Douglas de Oliveira ◽  
Daniel Pedro Marques ◽  
Ivan Cândido Aguiar-Cantuária ◽  
Olga Dumont Flecha ◽  
Patricia Furtado Gonçalves

Sign in / Sign up

Export Citation Format

Share Document