scholarly journals A Classification Method for the Cellular Images Based on Active Learning and Cross-Modal Transfer Learning

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1469
Author(s):  
Caleb Vununu ◽  
Suk-Hwan Lee ◽  
Ki-Ryong Kwon
Keyword(s):  
Active Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Discrimination Performance ◽  
The State ◽  
Cad Systems ◽  
Learning Techniques ◽  
Parallel Networks

In computer-aided diagnosis (CAD) systems, the automatic classification of the different types of the human epithelial type 2 (HEp-2) cells represents one of the critical steps in the diagnosis procedure of autoimmune diseases. Most of the methods prefer to tackle this task using the supervised learning paradigm. However, the necessity of having thousands of manually annotated examples constitutes a serious concern for the state-of-the-art HEp-2 cells classification methods. We present in this work a method that uses active learning in order to minimize the necessity of annotating the majority of the examples in the dataset. For this purpose, we use cross-modal transfer learning coupled with parallel deep residual networks. First, the parallel networks, which take simultaneously different wavelet coefficients as inputs, are trained in a fully supervised way by using a very small and already annotated dataset. Then, the trained networks are utilized on the targeted dataset, which is quite larger compared to the first one, using active learning techniques in order to only select the images that really need to be annotated among all the examples. The obtained results show that active learning, when mixed with an efficient transfer learning technique, can allow one to achieve a quite pleasant discrimination performance with only a few annotated examples in hands. This will help in building CAD systems by simplifying the burdensome task of labeling images while maintaining a similar performance with the state-of-the-art methods.

scholarly journals Representation Learning for Fine-Grained Change Detection

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4486
Author(s):  
Niall O’Mahony ◽  
Sean Campbell ◽  
Lenka Krpalkova ◽  
Anderson Carvalho ◽  
Joseph Walsh ◽  
...  
Keyword(s):  
Deep Learning ◽  
Change Detection ◽  
Model Calibration ◽  
State Of The Art ◽  
Representation Learning ◽  
Machine Intelligence ◽  
The State ◽  
Sensor Data ◽  
Fine Grained ◽  
Learning Techniques

Fine-grained change detection in sensor data is very challenging for artificial intelligence though it is critically important in practice. It is the process of identifying differences in the state of an object or phenomenon where the differences are class-specific and are difficult to generalise. As a result, many recent technologies that leverage big data and deep learning struggle with this task. This review focuses on the state-of-the-art methods, applications, and challenges of representation learning for fine-grained change detection. Our research focuses on methods of harnessing the latent metric space of representation learning techniques as an interim output for hybrid human-machine intelligence. We review methods for transforming and projecting embedding space such that significant changes can be communicated more effectively and a more comprehensive interpretation of underlying relationships in sensor data is facilitated. We conduct this research in our work towards developing a method for aligning the axes of latent embedding space with meaningful real-world metrics so that the reasoning behind the detection of change in relation to past observations may be revealed and adjusted. This is an important topic in many fields concerned with producing more meaningful and explainable outputs from deep learning and also for providing means for knowledge injection and model calibration in order to maintain user confidence.

Hydrogel-Based Bioinks for Three-Dimensional Bioprinting: Patent Analysis

2021 ◽  
Vol 7 (1) ◽  
pp. 3
Author(s):  
Ahmed Fatimi
Keyword(s):  
Tissue Engineering ◽  
Detailed Analysis ◽  
State Of The Art ◽  
Three Dimensional ◽  
Patent Analysis ◽  
The State ◽  
Driving Factors ◽  
3D Bioprinting ◽  
Preparation Methods

There are a variety of hydrogel-based bioinks commonly used in three-dimensional bioprinting. In this study, in the form of patent analysis, the state of the art has been reviewed by introducing what has been patented in relation to hydrogel-based bioinks. Furthermore, a detailed analysis of the patentability of the used hydrogels, their preparation methods and their formulations, as well as the 3D bioprinting process using hydrogels, have been provided by determining publication years, jurisdictions, inventors, applicants, owners, and classifications. The classification of patents reveals that most inventions intended for hydrogels used as materials for prostheses or for coating prostheses are characterized by their function or properties Knowledge clusters and expert driving factors show that biomaterials, tissue engineering, and biofabrication research is concentrated in the most patents.

scholarly journals State-of-the-art on monolingual lexicography for Croatia (Croatian)

2019 ◽  
Vol 7 (1) ◽  
pp. 65-77
Author(s):  
Kristina Štrkalj Despot ◽  
Lana Hudeček ◽  
Tomislav Stojanov ◽  
Nikola Ljubešić
Keyword(s):  
State Of The Art ◽  
The State ◽  
Writing Systems ◽  
Insight Into

In this minireview, the state of the art of the Croatian monolingual lexicography is presented. A brief overview and classification of all existing lexicographic resources is provided in the firts part of the minireview, followed by somewhat more detailed insight into the existing Croatian monolingual dictionaries and monolingual lexicographic projects, orthography dictionaries, and dictionary writing systems used.

scholarly journals Applying a Deep Q Network for OpenAIs Car Racing Game

2020 ◽  
Author(s):  
Ali Fakhry
Keyword(s):  
Machine Learning ◽  
Reinforcement Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Learning Techniques ◽  
Car Racing ◽  
Custom Made ◽  
Learning Technique ◽  
Reward Threshold

The applications of Deep Q-Networks are seen throughout the field of reinforcement learning, a large subsect of machine learning. Using a classic environment from OpenAI, CarRacing-v0, a 2D car racing environment, alongside a custom based modification of the environment, a DQN, Deep Q-Network, was created to solve both the classic and custom environments. The environments are tested using custom made CNN architectures and applying transfer learning from Resnet18. While DQNs were state of the art years ago, using it for CarRacing-v0 appears somewhat unappealing and not as effective as other reinforcement learning techniques. Overall, while the model did train and the agent learned various parts of the environment, attempting to reach the reward threshold for the environment with this reinforcement learning technique seems problematic and difficult as other techniques would be more useful.

scholarly journals Redundancy Removal Adversarial Active Learning Based on Norm Online Uncertainty Indicator

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Jifeng Guo ◽  
Zhiqi Pang ◽  
Wenbo Sun ◽  
Shi Li ◽  
Yu Chen
Keyword(s):  
Active Learning ◽  
Feature Vector ◽  
State Of The Art ◽  
Representation Learning ◽  
The State ◽  
Feature Representation ◽  
Learning Ability ◽  
Redundancy Removal ◽  
Previous State ◽  
Uncertainty Score

Active learning aims to select the most valuable unlabelled samples for annotation. In this paper, we propose a redundancy removal adversarial active learning (RRAAL) method based on norm online uncertainty indicator, which selects samples based on their distribution, uncertainty, and redundancy. RRAAL includes a representation generator, state discriminator, and redundancy removal module (RRM). The purpose of the representation generator is to learn the feature representation of a sample, and the state discriminator predicts the state of the feature vector after concatenation. We added a sample discriminator to the representation generator to improve the representation learning ability of the generator and designed a norm online uncertainty indicator (Norm-OUI) to provide a more accurate uncertainty score for the state discriminator. In addition, we designed an RRM based on a greedy algorithm to reduce the number of redundant samples in the labelled pool. The experimental results on four datasets show that the state discriminator, Norm-OUI, and RRM can improve the performance of RRAAL, and RRAAL outperforms the previous state-of-the-art active learning methods.

Tomato pest classification using deep convolutional neural network with transfer learning, fine tuning and scratch learning

2021 ◽  
pp. 1-10
Author(s):  
Gayatri Pattnaik ◽  
Vimal K. Shrivastava ◽  
K. Parvathi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Data Augmentation ◽  
State Of The Art ◽  
Deep Convolutional Neural Network ◽  
Fine Tuning ◽  
Tomato Plants ◽  
Random Weights

Pests are major threat to economic growth of a country. Application of pesticide is the easiest way to control the pest infection. However, excessive utilization of pesticide is hazardous to environment. The recent advances in deep learning have paved the way for early detection and improved classification of pest in tomato plants which will benefit the farmers. This paper presents a comprehensive analysis of 11 state-of-the-art deep convolutional neural network (CNN) models with three configurations: transfers learning, fine-tuning and scratch learning. The training in transfer learning and fine tuning initiates from pre-trained weights whereas random weights are used in case of scratch learning. In addition, the concept of data augmentation has been explored to improve the performance. Our dataset consists of 859 tomato pest images from 10 categories. The results demonstrate that the highest classification accuracy of 94.87% has been achieved in the transfer learning approach by DenseNet201 model with data augmentation.

Ontology Learning from Thesauri

2010 ◽  
pp. 247-260
Author(s):  
Javier Nogueras-Iso ◽  
Javier Lacasta ◽  
Jacques Teller ◽  
Gilles Falquet ◽  
Jacques Guyot
Keyword(s):  
State Of The Art ◽  
A Priori ◽  
Automatic Processing ◽  
The State ◽  
Ontology Learning ◽  
Ontology Construction ◽  
Knowledge Resources ◽  
Learning Techniques ◽  
Methods And Techniques ◽  
Domain Ontologies

Ontology learning is the term used to encompass methods and techniques employed for the (semi-)automatic processing of knowledge resources that facilitate the acquisition of knowledge during ontology construction. This chapter focuses on ontology learning techniques using thesauri as input sources. Thesauri are one of the most promising sources for the creation of domain ontologies thanks to the richness of term definitions, the existence of a priori relationships between terms, and the consensus provided by their extensive use in the library context. Apart from reviewing the state of the art, this chapter shows how ontology learning techniques can be applied in the urban domain for the development of domain ontologies.

scholarly journals Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1459 ◽  
Author(s):  
Tamás Czimmermann ◽  
Gastone Ciuti ◽  
Mario Milazzo ◽  
Marcello Chiurazzi ◽  
Stefano Roccella ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Visual Processing ◽  
State Of The Art ◽  
Industrial Applications ◽  
The State ◽  
Shape Error ◽  
Supervised Classifiers ◽  
Processing Techniques

This paper reviews automated visual-based defect detection approaches applicable to various materials, such as metals, ceramics and textiles. In the first part of the paper, we present a general taxonomy of the different defects that fall in two classes: visible (e.g., scratches, shape error, etc.) and palpable (e.g., crack, bump, etc.) defects. Then, we describe artificial visual processing techniques that are aimed at understanding of the captured scenery in a mathematical/logical way. We continue with a survey of textural defect detection based on statistical, structural and other approaches. Finally, we report the state of the art for approaching the detection and classification of defects through supervised and non-supervised classifiers and deep learning.

Sign in / Sign up

Export Citation Format

Share Document