scholarly journals Open Data Quality Evaluation: A Comparative Analysis of Open Data in Latvia

2018 ◽  
Vol 6 (4) ◽  
Author(s):  
Anastasija Nikiforova
Keyword(s):  
Comparative Analysis ◽  
Data Quality ◽  
Quality Evaluation ◽  
Open Data

scholarly journals User-Oriented Approach to Data Quality Evaluation

2020 ◽  
Vol 26 (1) ◽  
pp. 107-126
Author(s):  
Anastasija Nikiforova ◽  
Janis Bicevskis ◽  
Zane Bicevska ◽  
Ivo Oditis
Keyword(s):  
Data Quality ◽  
Quality Evaluation ◽  
Open Data ◽  
Evaluation Process ◽  
Specific Model ◽  
Third Party ◽  
Quality Model ◽  
Levels Of Abstraction ◽  
Quality Requirements ◽  
Data Object

The paper proposes a new data object-driven approach to data quality evaluation. It consists of three main components: (1) a data object, (2) data quality requirements, and (3) data quality evaluation process. As data quality is of relative nature, the data object and quality requirements are (a) use-case dependent and (b) defined by the user in accordance with his needs. All three components of the presented data quality model are described using graphical Domain Specific Languages (DSLs). In accordance with Model-Driven Architecture (MDA), the data quality model is built in two steps: (1) creating a platform-independent model (PIM), and (2) converting the created PIM into a platform-specific model (PSM). The PIM comprises informal specifications of data quality. The PSM describes the implementation of a data quality model, thus making it executable, enabling data object scanning and detecting data quality defects and anomalies. The proposed approach was applied to open data sets, analysing their quality. At least 3 advantages were highlighted: (1) a graphical data quality model allows the definition of data quality by non-IT and non-data quality experts as the presented diagrams are easy to read, create and modify, (2) the data quality model allows an analysis of "third-party" data without deeper knowledge on how the data were accrued and processed, (3) the quality of the data can be described at least at two levels of abstraction - informally using natural language or formally by including executable artefacts such as SQL statements.

Methods for detecting and correcting contextual data quality problems

2021 ◽  
Vol 25 (4) ◽  
pp. 763-787
Author(s):  
Alladoumbaye Ngueilbaye ◽  
Hongzhi Wang ◽  
Daouda Ahmat Mahamat ◽  
Ibrahim A. Elgendy ◽  
Sahalu B. Junaidu
Keyword(s):  
Data Quality ◽  
Quality Evaluation ◽  
Web Applications ◽  
Support Vector ◽  
Similarity Metrics ◽  
Distributed Data ◽  
Contextual Data ◽  
Formal Taxonomy ◽  
E Learning ◽  
High Scalability

Knowledge extraction, data mining, e-learning or web applications platforms use heterogeneous and distributed data. The proliferation of these multifaceted platforms faces many challenges such as high scalability, the coexistence of complex similarity metrics, and the requirement of data quality evaluation. In this study, an extended complete formal taxonomy and some algorithms that utilize in achieving the detection and correction of contextual data quality anomalies were developed and implemented on structured data. Our methods were effective in detecting and correcting more data anomalies than existing taxonomy techniques, and also highlighted the demerit of Support Vector Machine (SVM). These proposed techniques, therefore, will be of relevance in detection and correction of errors in large contextual data (Big data).

Comparative analysis of data quality and applications in vegetation of HJ-1A CCD images

2014 ◽  
Author(s):  
Hongwei Wei ◽  
Qingjiu Tian ◽  
Yan Huang ◽  
Yan Wang
Keyword(s):  
Comparative Analysis ◽  
Data Quality

Acceleration data quality assessment for bridge structural health monitoring via statistical and deep-learning approach

2021 ◽  
Author(s):  
Huaqiang Zhong ◽  
Limin Sun ◽  
José Turmo ◽  
Ye Xia
Keyword(s):  
Structural Health Monitoring ◽  
Data Quality ◽  
Health Monitoring ◽  
Structural Damage ◽  
Quality Evaluation ◽  
Evaluation Method ◽  
Operating Conditions ◽  
Monitoring Data ◽  
Statistical Characteristics ◽  
Structural Health

<p>In recent years, the safety and comfort problems of bridges are not uncommon, and the operating conditions of in-service bridges have received widespread attention. Many large-span key bridges have installed structural health monitoring systems and collected massive amounts of data. Monitoring data is the basis of structural damage identification and performance evaluation, and it is of great significance to analyze and evaluate its quality. This paper takes the acceleration monitoring data of the main girder and arch rib of a long-span arch bridge as the research object, analyzes and summarizes the statistical characteristics of the data, summarizes 6 abnormal data conditions, and proposes a data quality evaluation method of convolutional neural network. This paper conducts frequency statistics on the acceleration vibration amplitude of the bridge in December 2018 in hours. In order to highlight the end effect of frequency statistics, the whole is amplified and used as network input for training and data quality evaluation. The results are good. It provides another new method for structural monitoring data quality evaluation and abnormal data elimination.</p>

Sign in / Sign up

Export Citation Format

Share Document