scholarly journals Hierarchical Transfer Learning for Cycle Time Forecasting for Semiconductor Wafer Lot under Different Work in Process Levels

Mathematics ◽  
2021 ◽  
Vol 9 (17) ◽  
pp. 2039
Author(s):  
Junliang Wang ◽  
Pengjie Gao ◽  
Zhe Li ◽  
Wei Bai
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Cycle Time ◽  
Learning Strategy ◽  
System Level ◽  
Hierarchical Optimization ◽  
Learning Approach ◽  
Semiconductor Wafer ◽  
Work In Process ◽  
Optimization Transfer

The accurate cycle time (CT) prediction of the wafer fabrication remains a tough task, as the system level of work in process (WIP) is fluctuant. Aiming to construct one unified CT forecasting model under dynamic WIP levels, this paper proposes a transfer learning method for finetuning the predicted neural network hierarchically. First, a two-dimensional (2D) convolutional neural network was constructed to predict the CT under a primary WIP level with the input of spatial-temporal characteristics by reorganizing the input parameters. Then, to predict the CT under another WIP level, a hierarchical optimization transfer learning strategy was designed to finetune the prediction model so as to improve the accuracy of the CT forecasting. The experimental results demonstrated that the hierarchically transfer learning approach outperforms the compared methods in the CT forecasting with the fluctuation of WIP levels.

scholarly journals Transfer learning-based Fashion Image Classification using Hybrid 2D-CNN and ImageNet Neural Network

2021 ◽  
Vol 9 (11) ◽  
pp. 1537-1545
Author(s):  
Sweety Duseja
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Image Classification ◽  
Transfer Learning ◽  
Learning Strategy ◽  
Learning Transfer ◽  
Learning Approach ◽  
Learning Method ◽  
Product Identification ◽  
Classification Product

Abstract: Many algorithms have been developed as a result of recent advances in machine learning to handle a variety of challenges. In recent years, the most popular transfer learning method has allowed researchers and engineers to run experiments with minimal computing and time resources. To tackle the challenges of classification, product identification, product suggestion, and picture-based search, this research proposed a transfer learning strategy for Fashion image classification based on hybrid 2D-CNN pretrained by VGG-16 and AlexNet. Pre-processing, feature extraction, and classification are the three parts of the proposed system's implementation. We used the Fashion MNIST dataset, which consists of 50,000 fashion photos that have been classified. Training and validation datasets have been separated. In comparison to other conventional methodologies, the suggested transfer learning approach has higher training and validation accuracy and reduced loss. Keywords: Machine Learning, Transfer Learning, Convolutional Neural Network, Image Classification, VGG16, AlexNet, 2D CNN.

Automated detection of pneumonia cases using deep transfer learning with paediatric chest X-ray images

2021 ◽  
pp. 20201263
Author(s):  
Mohammad Salehi ◽  
Reza Mohammadi ◽  
Hamed Ghaffari ◽  
Nahid Sadighi ◽  
Reza Reiazi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Area Under Curve ◽  
Binary Classification ◽  
Classification Performance ◽  
Learning Approach ◽  
Insufficient Data ◽  
X Ray ◽  
Chest X Ray

Objective: Pneumonia is a lung infection and causes the inflammation of the small air sacs (Alveoli) in one or both lungs. Proper and faster diagnosis of pneumonia at an early stage is imperative for optimal patient care. Currently, chest X-ray is considered as the best imaging modality for diagnosing pneumonia. However, the interpretation of chest X-ray images is challenging. To this end, we aimed to use an automated convolutional neural network-based transfer-learning approach to detect pneumonia in paediatric chest radiographs. Methods: Herein, an automated convolutional neural network-based transfer-learning approach using four different pre-trained models (i.e. VGG19, DenseNet121, Xception, and ResNet50) was applied to detect pneumonia in children (1–5 years) chest X-ray images. The performance of different proposed models for testing data set was evaluated using five performances metrics, including accuracy, sensitivity/recall, Precision, area under curve, and F1 score. Results: All proposed models provide accuracy greater than 83.0% for binary classification. The pre-trained DenseNet121 model provides the highest classification performance of automated pneumonia classification with 86.8% accuracy, followed by Xception model with an accuracy of 86.0%. The sensitivity of the proposed models was greater than 91.0%. The Xception and DenseNet121 models achieve the highest classification performance with F1-score greater than 89.0%. The plotted area under curve of receiver operating characteristics of VGG19, Xception, ResNet50, and DenseNet121 models are 0.78, 0.81, 0.81, and 0.86, respectively. Conclusion: Our data showed that the proposed models achieve a high accuracy for binary classification. Transfer learning was used to accelerate training of the proposed models and resolve the problem associated with insufficient data. We hope that these proposed models can help radiologists for a quick diagnosis of pneumonia at radiology departments. Moreover, our proposed models may be useful to detect other chest-related diseases such as novel Coronavirus 2019. Advances in knowledge: Herein, we used transfer learning as a machine learning approach to accelerate training of the proposed models and resolve the problem associated with insufficient data. Our proposed models achieved accuracy greater than 83.0% for binary classification.

Neural Network Based Transfer Learning of Manipulator Inverse Displacement Analysis

2020 ◽  
Author(s):  
Houcheng Tang ◽  
Leila Notash
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Transfer Learning ◽  
Learning Approach ◽  
Training Process ◽  
Displacement Analysis ◽  
Performance Targets ◽  
The Neural Networks ◽  
Random Initialization ◽  
And Performance

Abstract In this paper, a neural network based transfer learning approach of inverse displacement analysis of robot manipulators is studied. Neural networks with different structures are applied utilizing data from different configurations of a manipulator for training purposes. Then the transfer learning was conducted between manipulators with different geometric layouts. The training is performed on both the neural networks with pretrained initial parameters and the neural networks with random initialization. To investigate the rate of convergence of data fitting comprehensively, different values of performance targets are defined. The computing epochs and performance measures are compared. It is presented that, depending on the structure of neural network, the proposed transfer learning can accelerate the training process and achieve higher accuracy. For different datasets, the transfer learning approach improves their performance differently.

scholarly journals Quantifying Seagrass Distribution in Coastal Water with Deep Learning Models

2020 ◽  
Vol 12 (10) ◽  
pp. 1581 ◽  
Author(s):  
Daniel Perez ◽  
Kazi Islam ◽  
Victoria Hill ◽  
Richard Zimmerman ◽  
Blake Schaeffer ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Transfer Learning ◽  
Satellite Images ◽  
Support Vector ◽  
Learning Approach ◽  
Learning Models ◽  
Learning Techniques ◽  
The World ◽  
New Locations

Coastal ecosystems are critically affected by seagrass, both economically and ecologically. However, reliable seagrass distribution information is lacking in nearly all parts of the world because of the excessive costs associated with its assessment. In this paper, we develop two deep learning models for automatic seagrass distribution quantification based on 8-band satellite imagery. Specifically, we implemented a deep capsule network (DCN) and a deep convolutional neural network (CNN) to assess seagrass distribution through regression. The DCN model first determines whether seagrass is presented in the image through classification. Second, if seagrass is presented in the image, it quantifies the seagrass through regression. During training, the regression and classification modules are jointly optimized to achieve end-to-end learning. The CNN model is strictly trained for regression in seagrass and non-seagrass patches. In addition, we propose a transfer learning approach to transfer knowledge in the trained deep models at one location to perform seagrass quantification at a different location. We evaluate the proposed methods in three WorldView-2 satellite images taken from the coastal area in Florida. Experimental results show that the proposed deep DCN and CNN models performed similarly and achieved much better results than a linear regression model and a support vector machine. We also demonstrate that using transfer learning techniques for the quantification of seagrass significantly improved the results as compared to directly applying the deep models to new locations.

scholarly journals Classification of pathological types of lung cancer from CT images by deep residual neural networks with transfer learning strategy

Open Medicine ◽  
2020 ◽  
Vol 15 (1) ◽  
pp. 190-197 ◽  
Author(s):  
Shudong Wang ◽  
Liyuan Dong ◽  
Xun Wang ◽  
Xingguang Wang
Keyword(s):  
Neural Network ◽  
Lung Cancer ◽  
Transfer Learning ◽  
Learning Strategy ◽  
Malignant Tumors ◽  
Histopathological Examination ◽  
Ct Images ◽  
Hospital Data ◽  
Cancer Dataset ◽  
Pathological Type

AbstractLung cancer is one of the most harmful malignant tumors to human health. The accurate judgment of the pathological type of lung cancer is vital for treatment. Traditionally, the pathological type of lung cancer requires a histopathological examination to determine, which is invasive and time consuming. In this work, a novel residual neural network is proposed to identify the pathological type of lung cancer via CT images. Due to the low amount of CT images in practice, we explored a medical-to-medical transfer learning strategy. Specifically, a residual neural network is pre-trained on public medical images dataset luna16, and then fine-tuned on our intellectual property lung cancer dataset collected in Shandong Provincial Hospital. Data experiments show that our method achieves 85.71% accuracy in identifying pathological types of lung cancer from CT images and outperforming other models trained with 2054 labels. Our method performs better than AlexNet, VGG16 and DenseNet, which provides an efficient, non-invasive detection tool for pathological diagnosis.

Sign in / Sign up

Export Citation Format

Share Document