scholarly journals Generalizing Fuzzy SARSA Learning for Real-Time Operation of Irrigation Canals

Water ◽  
2020 ◽  
Vol 12 (9) ◽  
pp. 2407
Author(s):  
Kazem Shahverdi ◽  
J. M. Maestre ◽  
Farinaz Alamiyan-Harandi ◽  
Xin Tian
Keyword(s):  
Performance Indicators ◽  
Action Learning ◽  
Irrigation Canals ◽  
State Action ◽  
Time Operation ◽  
Real Time Operation ◽  
Southwest Of Iran ◽  
Large Irrigation ◽  
Q Function ◽  
Reinforcement Learning Model

Recently, a continuous reinforcement learning model called fuzzy SARSA (state, action, reward, state, action) learning (FSL) was proposed for irrigation canals. The main problem related to FSL is its convergence and generalization in environments with many variables such as large irrigation canals and situations beyond training. Furthermore, due to its architecture, FSL may require high computation demands during its learning process. To deal with these issues, this work proposes a computationally lighter generalizing learned Q-function (GLQ) model, which benefits from the FSL-learned Q-function, to provide operators with a faster and simpler mechanism to obtain operational instructions. The proposed approach is tested for different water requests in the East Aghili Canal, located in the southwest of Iran. Several performance indicators are used for evaluating the GLQ model results, showing convergence in all the investigated cases and the ability to estimate operational instructions (actions) in situations beyond training, delivering water with high accuracy regarding several performance indicators. Hence, the use of the GLQ model is recommended for determining the operational patterns in irrigation canals.

scholarly journals Exploring 3D Human Action Recognition Using STACOG on Multi-View Depth Motion Maps Sequences

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3642
Author(s):  
Mohammad Farhad Bulbul ◽  
Sadiya Tabussum ◽  
Hazrat Ali ◽  
Wenli Zheng ◽  
Mi Young Lee ◽  
...  
Keyword(s):  
Action Recognition ◽  
Depth Map ◽  
Human Action Recognition ◽  
Human Action ◽  
Collaborative Representation ◽  
Auto Correlation ◽  
Time Operation ◽  
Real Time Operation ◽  
Benchmark Datasets ◽  
Depth Motion Maps

This paper proposes an action recognition framework for depth map sequences using the 3D Space-Time Auto-Correlation of Gradients (STACOG) algorithm. First, each depth map sequence is split into two sets of sub-sequences of two different frame lengths individually. Second, a number of Depth Motion Maps (DMMs) sequences from every set are generated and are fed into STACOG to find an auto-correlation feature vector. For two distinct sets of sub-sequences, two auto-correlation feature vectors are obtained and applied gradually to L2-regularized Collaborative Representation Classifier (L2-CRC) for computing a pair of sets of residual values. Next, the Logarithmic Opinion Pool (LOGP) rule is used to combine the two different outcomes of L2-CRC and to allocate an action label of the depth map sequence. Finally, our proposed framework is evaluated on three benchmark datasets named MSR-action 3D dataset, DHA dataset, and UTD-MHAD dataset. We compare the experimental results of our proposed framework with state-of-the-art approaches to prove the effectiveness of the proposed framework. The computational efficiency of the framework is also analyzed for all the datasets to check whether it is suitable for real-time operation or not.

scholarly journals A Comparative Study of AI-Based Intrusion Detection Techniques in Critical Infrastructures

2021 ◽  
Vol 21 (4) ◽  
pp. 1-22
Author(s):  
Safa Otoum ◽  
Burak Kantarci ◽  
Hussein Mouftah
Keyword(s):  
Reinforcement Learning ◽  
Intrusion Detection ◽  
Comparative Study ◽  
Performance Metrics ◽  
Action Learning ◽  
Smart Devices ◽  
Critical Infrastructures ◽  
State Action ◽  
Detection Techniques ◽  
Depth Analysis

Volunteer computing uses Internet-connected devices (laptops, PCs, smart devices, etc.), in which their owners volunteer them as storage and computing power resources, has become an essential mechanism for resource management in numerous applications. The growth of the volume and variety of data traffic on the Internet leads to concerns on the robustness of cyberphysical systems especially for critical infrastructures. Therefore, the implementation of an efficient Intrusion Detection System for gathering such sensory data has gained vital importance. In this article, we present a comparative study of Artificial Intelligence (AI)-driven intrusion detection systems for wirelessly connected sensors that track crucial applications. Specifically, we present an in-depth analysis of the use of machine learning, deep learning and reinforcement learning solutions to recognise intrusive behavior in the collected traffic. We evaluate the proposed mechanisms by using KDD’99 as real attack dataset in our simulations. Results present the performance metrics for three different IDSs, namely the Adaptively Supervised and Clustered Hybrid IDS (ASCH-IDS), Restricted Boltzmann Machine-based Clustered IDS (RBC-IDS), and Q-learning based IDS (Q-IDS), to detect malicious behaviors. We also present the performance of different reinforcement learning techniques such as State-Action-Reward-State-Action Learning (SARSA) and the Temporal Difference learning (TD). Through simulations, we show that Q-IDS performs with detection rate while SARSA-IDS and TD-IDS perform at the order of .

Real-Time Operation and Characterization of a High-Performance Time-Based Accelerometer

2015 ◽  
Vol 24 (6) ◽  
pp. 1703-1711 ◽  
Author(s):  
Rosana Alves Dias ◽  
Filipe Serra Alves ◽  
Margaret Costa ◽  
Helder Fonseca ◽  
Jorge Cabral ◽  
...  
Keyword(s):  
Real Time ◽  
High Performance ◽  
Performance Time ◽  
Time Operation ◽  
Real Time Operation

Cultural Change in ALS Real Time Operation and Optimization in Vaca Muerta Through CWE

2018 ◽  
Author(s):  
J. I. Alvarez Claramunt ◽  
P. E. Bizzotto ◽  
F. Sapag ◽  
E. Ferrigno ◽  
J. L. Barros ◽  
...  
Keyword(s):  
Real Time ◽  
Cultural Change ◽  
Time Operation ◽  
Vaca Muerta ◽  
Real Time Operation

scholarly journals A Novel Computational Approach for Harmonic Mitigation in PV Systems with Single-Phase Five-Level CHBMI

Energies ◽  
2018 ◽  
Vol 11 (8) ◽  
pp. 2100 ◽  
Author(s):  
Rosario Miceli ◽  
Giuseppe Schettino ◽  
Fabio Viola
Keyword(s):  
Single Phase ◽  
Switching Frequency ◽  
Polynomial Equations ◽  
Voltage Waveform ◽  
Pv Systems ◽  
Time Operation ◽  
Novel Approach ◽  
Field Programmable ◽  
Real Time Operation ◽  
Harmonic Mitigation

In this paper, a novel approach to low order harmonic mitigation in fundamental switching frequency modulation is proposed for high power photovoltaic (PV) applications, without trying to solve the cumbersome non-linear transcendental equations. The proposed method allows for mitigation of the first-five harmonics (third, fifth, seventh, ninth, and eleventh harmonics), to reduce the complexity of the required procedure and to allocate few computational resource in the Field Programmable Gate Array (FPGA) based control board. Therefore, the voltage waveform taken into account is different respect traditional voltage waveform. The same concept, known as “voltage cancelation”, used for single-phase cascaded H-bridge inverters, has been applied at a single-phase five-level cascaded H-bridge multilevel inverter (CHBMI). Through a very basic methodology, the polynomial equations that drive the control angles were detected for a single-phase five-level CHBMI. The acquired polynomial equations were implemented in a digital system to real-time operation. The paper presents the preliminary analysis in simulation environment and its experimental validation.

scholarly journals TDOA-based microwave imaging algorithm for real-time microwave ablation monitoring

2017 ◽  
Vol 10 (2) ◽  
pp. 169-178 ◽  
Author(s):  
Shouhei Kidera ◽  
Luz Maria Neira ◽  
Barry D. Van Veen ◽  
Susan C. Hagness
Keyword(s):  
Real Time ◽  
Microwave Ablation ◽  
Microwave Imaging ◽  
Ablation Zone ◽  
Real Time Monitoring ◽  
Imaging Algorithm ◽  
Array Measurements ◽  
Time Operation ◽  
Real Time Operation ◽  
Propagation Media

Microwave ablation is widely recognized as a promising minimally invasive tool for treating cancer. Real-time monitoring of the dimensions of the ablation zone is indispensable for ensuring an effective and safe treatment. In this paper, we propose a microwave imaging algorithm for monitoring the evolution of the ablation zone. Our proposed algorithm determines the boundary of the ablation zone by exploiting the time difference of arrival (TDOA) between signals received before and during the ablation at external antennas surrounding the tissue, using the interstitial ablation antenna as the transmitter. A significant advantage of this method is that it requires few assumptions about the dielectric properties of the propagation media. Also the simplicity of the signal processing, wherein the TDOA is determined from a cross-correlation calculation, allows real-time monitoring and provides robust performance in the presence of noise. We investigate the performance of this approach for the application of breast tumor ablation. We use simulated array measurements obtained from finite-difference time-domain simulations of magnetic resonance imaging-derived numerical breast phantoms. The results demonstrate that our proposed method offers the potential to achieve millimeter-order accuracy and real-time operation in estimating the boundary of the ablation zone in heterogeneous and dispersive breast tissue.

scholarly journals Development of a Low-Cost Data Acquisition System for Very Short-Term Photovoltaic Power Forecasting

Energies ◽  
2021 ◽  
Vol 14 (19) ◽  
pp. 6075
Author(s):  
Guilherme Fonseca Bassous ◽  
Rodrigo Flora Calili ◽  
Carlos Hall Barbosa
Keyword(s):  
Low Cost ◽  
Renewable Energy Sources ◽  
Relevant Information ◽  
Acquisition System ◽  
Time Operation ◽  
Detection Point ◽  
Real Time Operation ◽  
Forecast Models ◽  
Input Variables ◽  
Power Forecasting

The rising adoption of renewable energy sources means we must turn our eyes to limitations in traditional energy systems. Intermittency, if left unaddressed, may lead to several power-quality and energy-efficiency issues. The objective of this work is to develop a working tool to support photovoltaic energy forecast models for real-time operation applications. The current paradigm of intra-hour solar-power forecasting is to use image-based approaches to predict the state of cloud composition for short time horizons. Since the objective of intra-minute forecasting is to address high-frequency intermittency, data must provide information on and surrounding these events. For that purpose, acquisition by exception was chosen as the guiding principle. The system performs power measurements at 1 Hz frequency, and whenever it detects variations over a certain threshold, it saves the data 10 s before and 4 s after the detection point. A multilayer perceptron neural network was used to determine its relevance to the forecasting problem. With a thorough selection of attributes and network structures, the results show very low error with R2 greater than 0.93 for both input variables tested with a time horizon of 60 s. In conclusion, the data provided by the acquisition system yielded relevant information for forecasts up to 60 s ahead.

scholarly journals CONTROLLING AND MONITORING OF AUTOMATION WATER SUPPLY SYSTEM BASED ON IOT WITH THEFT IDENTIFICATION

2017 ◽  
Vol 5 (5) ◽  
pp. 320-325
Author(s):  
Ahmad T. Jaiad ◽  
Hamzah Sabr Ghayyib
Keyword(s):  
Water Supply ◽  
Real Time ◽  
Water Conservation ◽  
Water Distribution ◽  
Network Connectivity ◽  
Raspberry Pi ◽  
Human Beings ◽  
Residential Areas ◽  
Time Operation ◽  
Real Time Operation

Water is the most precious and valuable because it’s a basic need of all the human beings but, now a day water supply department are facing problem in real time operation this is because less amount of water in resources due to less rain fall. With increase in Population, urban residential areas have increased because of this reasons water has become a crucial problem which affects the problem of water distribution, interrupted water supply, water conservation, water consumption and also the water quality so, to overcome water supply related problems and make system efficient there is need of proper monitoring and controlling system. In this project, we are focusing on continuous and real time monitoring of water supply in IOT platform. Water supply with continuous monitoring makes a proper distribution so that, we can have a record of available amount of water in tanks, flow rate, abnormality in distribution line. Internet of things is nothing but the network of physical objects embedded with electronics, sensors, software, and network connectivity. Monitoring can be done from anywhere as central office. Using Adafruit as free sever data continuously pushed on cloud so we can see data in real time operation. Using different sensors with controller and raspberry pi as Mini computer can monitor data and also control operation from cloud with efficient client server communication.

Sign in / Sign up

Export Citation Format

Share Document