Configuration of communication software for distributed applications

2002 ◽  
Author(s):  
O. Drobnik ◽  
M. Feldhoffer ◽  
M. Zimmermann
Keyword(s):  
Distributed Applications ◽  
Communication Software

TUNING MESSAGE AGGREGATION ON HIGH PERFORMANCE CLUSTERS FOR EFFICIENT PARALLEL SIMULATIONS

1999 ◽  
Vol 09 (04) ◽  
pp. 521-532 ◽  
Author(s):  
CONGDUC PHAM ◽  
CARSTEN ALBRECHT
Keyword(s):  
Interconnection Networks ◽  
High Performance ◽  
Network Models ◽  
Distributed Applications ◽  
Parallel Applications ◽  
Communication Overhead ◽  
Parallel Simulations ◽  
Aggregation Techniques ◽  
Communication Software ◽  
Message Aggregation

High performance clusters (HPCs) based on commodity hardware are becoming more and more popular in the parallel computing community. These new platforms offer a hardware capable of very low latency and very high throughput at an unbeatable cost, making them attractive for a large variety of parallel and distributed applications. With adequate communication software, HPCs have the potential to achieve a level of performance similar to massively parallel computers. However, for parallel applications that present a high communication/computation ratio, it is still essential to provide the lowest latency in order to minimize the communication overhead. In this paper, we are investigating message aggregation techniques to improve parallel simulations of fine-grain ATM communication network models. Even if message aggregation is a well-known solution for improving the communication perfomance of high latency interconnection networks, the complex interaction between message aggregation and the underlying communication software is often ignored. We show that message aggregation must carefully take into account the characteristics of the communication software to be efficient on an HPC. This methodology can be applied as a preliminary step to tune a message aggregation algorithm for a given combination of hardware architecture and communication software layer.

A hitchhiker’s guide to microscopy and microanalysis using telecommunications, e-mail, and the Internet

1994 ◽  
Vol 52 ◽  
pp. 390-391 ◽  
Author(s):  
Nestor J. Zaluzec
Keyword(s):  
The Internet ◽  
Information Superhighway ◽  
The World ◽  
Exchange Information ◽  
On Line ◽  
Computer Based ◽  
Software And Hardware ◽  
Communication Software ◽  
Basic Ideas ◽  
E Mail

The Information SuperHighway, Email, The Internet, FTP, BBS, Modems, : all buzz words which are becoming more and more routine in our daily life. Confusing terminology? Hopefully it won't be in a few minutes, all you need is to have a handle on a few basic concepts and terms and you will be on-line with the rest of the "telecommunication experts". These terms all refer to some type or aspect of tools associated with a range of computer-based communication software and hardware. They are in fact far less complex than the instruments we use on a day to day basis as microscopist's and microanalyst's. The key is for each of us to know what each is and how to make use of the wealth of information which they can make available to us for the asking. Basically all of these items relate to mechanisms and protocols by which we as scientists can easily exchange information rapidly and efficiently to colleagues in the office down the hall, or half-way around the world using computers and various communications media. The purpose of this tutorial/paper is to outline and demonstrate the basic ideas of some of the major information systems available to all of us today. For the sake of simplicity we will break this presentation down into two distinct (but as we shall see later connected) areas: telecommunications over conventional phone lines, and telecommunications by computer networks. Live tutorial/demonstrations of both procedures will be presented in the Computer Workshop/Software Exchange during the course of the meeting.

Using events to build large scale distributed applications

1996 ◽  
Author(s):  
Richard Hayton ◽  
Jean Bacon ◽  
John Bates ◽  
Ken Moody
Keyword(s):  
Large Scale ◽  
Distributed Applications

An Analysis of Web-based Document Management and Communication Tools Usage Among Project Managers

2017 ◽  
Vol 8 (1) ◽  
pp. 1-24 ◽  
Author(s):  
Tomislav Rozman ◽  
Tanja Kocjan Stjepanovič ◽  
Andrej Raspor
Keyword(s):  
Project Management ◽  
Management Practice ◽  
Project Managers ◽  
Document Management ◽  
Communication Tools ◽  
Web Based ◽  
Motivation Factors ◽  
Communication Software ◽  
Group Interviews ◽  
Eu Project

The article analyzes modern cloud document management systems and communication tools from the viewpoint of a EU project managers, who lead multidisciplinary, multilingual and international teams. It also explores the types of users who use these tools as well as the motivation factors guiding their choices. The research includes observation within the project group, interviews and semi-structured surveys among 40 EU project managers, who have managed 244 EU projects. The main finding is that a lot of project managers still don't use shared, cloud document system. The biggest obstacle to more efficient usage of existing systems is their un-friendliness, security concerns and lack of skills. Meetings are still perceived as the most efficient channel for distributing and receiving project tasks, but they are closely followed by communication software. Applying the authors' findings to the project management practice can lead to better communication and shared document storage management, which can influence overall effectiveness of project management.

scholarly journals Swarm-Like Distributed Algorithm for Scheduling a Microservice-Based Application to the Cloud Servers

Electronics ◽  
2021 ◽  
Vol 10 (13) ◽  
pp. 1553
Author(s):  
Marian Rusek ◽  
Grzegorz Dwornicki
Keyword(s):  
Distributed Applications ◽  
Practical Implementation ◽  
Live Migration ◽  
Cloud Infrastructure ◽  
Application Development ◽  
Cloud Management ◽  
Cloud Application ◽  
Cloud Servers ◽  
Distributed Cloud ◽  
Better Than

Introduction of virtualization containers and container orchestrators fundamentally changed the landscape of cloud application development. Containers provide an ideal way for practical implementation of microservice-based architecture, which allows for repeatable, generic patterns that make the development of reliable, distributed applications more approachable and efficient. Orchestrators allow for shifting the accidental complexity from inside of an application into the automated cloud infrastructure. Existing container orchestrators are centralized systems that schedule containers to the cloud servers only at their startup. In this paper, we propose a swarm-like distributed cloud management system that uses live migration of containers to dynamically reassign application components to the different servers. It is based on the idea of “pheromone” robots. An additional mobile agent process is placed inside each application container to control the migration process. The number of parallel container migrations needed to reach an optimal state of the cloud is obtained using models, experiments, and simulations. We show that in the most common scenarios the proposed swarm-like algorithm performs better than existing systems, and due to its architecture it is also more scalable and resilient to container death. It also adapts to the influx of containers and addition of new servers to the cloud automatically.

scholarly journals Computational storage: an efficient and scalable platform for big data and HPC applications

2019 ◽  
Vol 6 (1) ◽  
Author(s):  
Mahdi Torabzadehkashi ◽  
Siavash Rezaei ◽  
Ali HeydariGorji ◽  
Hosein Bobarshad ◽  
Vladimir Alves ◽  
...  
Keyword(s):  
Big Data ◽  
High Performance ◽  
Distributed Processing ◽  
Data Access ◽  
Distributed Applications ◽  
Process Data ◽  
Storage Devices ◽  
Hadoop Mapreduce ◽  
Big Data Applications ◽  
Application Processor

AbstractIn the era of big data applications, the demand for more sophisticated data centers and high-performance data processing mechanisms is increasing drastically. Data are originally stored in storage systems. To process data, application servers need to fetch them from storage devices, which imposes the cost of moving data to the system. This cost has a direct relation with the distance of processing engines from the data. This is the key motivation for the emergence of distributed processing platforms such as Hadoop, which move process closer to data. Computational storage devices (CSDs) push the “move process to data” paradigm to its ultimate boundaries by deploying embedded processing engines inside storage devices to process data. In this paper, we introduce Catalina, an efficient and flexible computational storage platform, that provides a seamless environment to process data in-place. Catalina is the first CSD equipped with a dedicated application processor running a full-fledged operating system that provides filesystem-level data access for the applications. Thus, a vast spectrum of applications can be ported for running on Catalina CSDs. Due to these unique features, to the best of our knowledge, Catalina CSD is the only in-storage processing platform that can be seamlessly deployed in clusters to run distributed applications such as Hadoop MapReduce and HPC applications in-place without any modifications on the underlying distributed processing framework. For the proof of concept, we build a fully functional Catalina prototype and a CSD-equipped platform using 16 Catalina CSDs to run Intel HiBench Hadoop and HPC benchmarks to investigate the benefits of deploying Catalina CSDs in the distributed processing environments. The experimental results show up to 2.2× improvement in performance and 4.3× reduction in energy consumption, respectively, for running Hadoop MapReduce benchmarks. Additionally, thanks to the Neon SIMD engines, the performance and energy efficiency of DFT algorithms are improved up to 5.4× and 8.9×, respectively.

Sign in / Sign up

Export Citation Format

Share Document