Efficient Prototyping of Fault Tolerant Map-Reduce Applications with Docker-Hadoop

Author(s):  
Javier Rey ◽  
Matias Cogorno ◽  
Sergio Nesmachnow ◽  
Luiz Angelo Steffenel
Keyword(s):  
Author(s):  
Alexandros Gazis ◽  
Eleftheria Katsiri

Map-Reduce is a programming model and an associated implementation for processing and generating large data sets. This model has a single point of failure: the master, who coordinates the work in a cluster. On the contrary, wireless sensor networks (WSNs) are distributed systems that scale and feature large numbers of small, computationally limited, low-power, unreliable nodes. In this article, we provide a top-down approach explaining the architecture, implementation and rationale of a distributed fault-tolerant IoT middleware. Specifically, this middleware consists of multiple mini-computing devices (Raspberry Pi) connected in a WSN which implement the Map-Reduce algorithm. First, we explain the tools used to develop this system. Second, we focus on the Map-Reduce algorithm implemented to overcome common network connectivity issues, as well as to enhance operation availability and reliability. Lastly, we provide benchmarks for our middleware as a crowd tracking application for a preserved building in Greece (i.e., M. Hatzidakis’ residence). The results of this study show that IoT middleware with low-power and low-cost components are viable solutions for medium-sized cloud computing distributed and parallel computing centres. Potential uses of this middleware apply for monitoring buildings and indoor structures, in addition to crowd tracking to prevent the spread of COVID-19.


2012 ◽  
Vol 2 (1) ◽  
pp. 57-59
Author(s):  
Balachandra Pattanaik ◽  
◽  
Dr S. Chandrasekaran Dr S. Chandrasekaran

2016 ◽  
Vol 136 (2) ◽  
pp. 143-156 ◽  
Author(s):  
Katsuhiko Fuwa ◽  
Tatsuo Narikiyo ◽  
Tatsushi Ooba

Sign in / Sign up

Export Citation Format

Share Document