A Dynamic Scaling Approach in Hadoop YARN

In Cloud based Big Data applications, Hadoop has been widely adopted for distributed processing large scale data sets. However, the wastage of energy consumption of data centers still constitutes an important axis of research due to overuse of resources and extra overhead costs. As a solution to overcome this challenge, a dynamic scaling of resources in Hadoop YARN Cluster is a practical solution. This paper proposes a dynamic scaling approach in Hadoop YARN (DSHYARN) to add or remove nodes automatically based on workload. It is based on two algorithms (scaling up/down) which are implemented to automate the scaling process in the cluster. This article aims to assure energy efficiency and performance of Hadoop YARN’ clusters. To validate the effectiveness of DSHYARN, a case study with sentiment analysis on tweets about covid-19 vaccine is provided. the goal is to analyze tweets of the people posted on Twitter application. The results showed improvement in CPU utilization, RAM utilization and Job Completion time. In addition, the energy has been reduced of 16% under average workload.

Static and dynamic formant scaling conveys body size and aggression

When producing intimidating aggressive vocalizations, humans and other animals often extend their vocal tracts to lower their voice resonance frequencies (formants) and thus sound big. Is acoustic size exaggeration more effective when the vocal tract is extended before, or during, the vocalization, and how do listeners interpret within-call changes in apparent vocal tract length? We compared perceptual effects of static and dynamic formant scaling in aggressive human speech and nonverbal vocalizations. Acoustic manipulations corresponded to elongating or shortening the vocal tract either around (Experiment 1) or from (Experiment 2) its resting position. Gradual formant scaling that preserved average frequencies conveyed the impression of smaller size and greater aggression, regardless of the direction of change. Vocal tract shortening from the original length conveyed smaller size and less aggression, whereas vocal tract elongation conveyed larger size and more aggression, and these effects were stronger for static than for dynamic scaling. Listeners familiarized with the speaker's natural voice were less often ‘fooled’ by formant manipulations when judging speaker size, but paid more attention to formants when judging aggressive intent. Thus, within-call vocal tract scaling conveys emotion, but a better way to sound large and intimidating is to keep the vocal tract consistently extended.

Modeling of probable maximum values in autonomous driving

In this paper, we approximate the probable maximum (very rare, extremal) values of highly autonomous driving sensor signals by reviewing two methods based on dynamic time series scaling and multifractal statistics.The article is a significantly revised and modified version of the conference material ("Determination of extreme values ​​in autonomous driving based on multifractals and dynamic scaling") presented at the conference "2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics, SACI". The method of dynamic scaling is originally derived from statistical physics and approximates the critical interface phenomena. The time series of the vibration signal of the corner radar can be considered as a fractal surface and grow appropriately for a given scale-inverse dynamic equation. In the second method we initiate, that multifractal statistics can be useful in searching for statistical analog time series that have a similar multifractal spectrum as the original sensor time series.

New granular rock-analogue materials for simulation of multi-scale fault and fracture processes

In this study, we present a new granular rock-analogue material (GRAM) with a dynamic scaling suitable for the simulation of fault and fracture processes in analogue experiments. Dynamically scaled experiments allow the direct comparison of geometrical, kinematical and mechanical processes between model and nature. The geometrical scaling factor defines the model resolution, which depends on the density and cohesive strength ratios of model material and natural rocks. Granular materials such as quartz sands are ideal for the simulation of upper crustal deformation processes as a result of similar nonlinear deformation behaviour of granular flow and brittle rock deformation. We compared the geometrical scaling factor of common analogue materials applied in tectonic models, and identified a gap in model resolution corresponding to the outcrop and structural scale (1–100 m). The proposed GRAM is composed of quartz sand and hemihydrate powder and is suitable to form cohesive aggregates capable of deforming by tensile and shear failure under variable stress conditions. Based on dynamical shear tests, GRAM is characterized by a similar stress–strain curve as dry quartz sand, has a cohesive strength of 7.88 kPa and an average density of 1.36 g cm−3. The derived geometrical scaling factor is 1 cm in model = 10.65 m in nature. For a large-scale test, GRAM material was applied in strike-slip analogue experiments. Early results demonstrate the potential of GRAM to simulate fault and fracture processes, and their interaction in fault zones and damage zones during different stages of fault evolution in dynamically scaled analogue experiments.

Understanding future increases in precipitation extremes in global land monsoon regions

This study investigates future changes in daily precipitation extremes and the involved physics over the global land monsoon (GM) region using climate models from the Coupled Model Intercomparison Project Phase 6 (CMIP6). The daily precipitation extreme is identified by the cutoff scale, measuring the extreme tail of the precipitation distribution. Compared to the historical period, multi-model results reveal a continuous increase in precipitation extremes under four scenarios, with a progressively higher fraction of precipitation exceeding the historical cutoff scale when moving into the future. The rise of the cutoff-scale by the end of the century is reduced by 57.8% in the moderate emission scenario relative to the highest scenario, underscoring the social benefit in reducing emissions. The cutoff scale sensitivity, defined by the increasing rates of the cutoff scale over the GM region to the global mean surface temperature increase, is nearly independent of the projected periods and emission scenarios, roughly 8.0% K−1 by averaging all periods and scenarios. To understand the cause of the changes, we applied a physical scaling diagnostic to decompose them into thermodynamic and dynamic contributions. We find that thermodynamics and dynamics have comparable contributions to the intensified precipitation extremes in the GM region. Changes in thermodynamic scaling contribute to a spatially uniform increase pattern, while changes in dynamic scaling dominate the regional differences in the increased precipitation extremes. Furthermore, the large inter-model spread of the projection is primarily attributed to variations of dynamic scaling among models.

An SDN-Based Solution for Horizontal Auto-Scaling and Load Balancing of Transparent VNF Clusters

This paper studies the problem of the dynamic scaling and load balancing of transparent virtualized network functions (VNFs). It analyzes different particularities of this problem, such as loop avoidance when performing scaling-out actions, and bidirectional flow affinity. To address this problem, a software-defined networking (SDN)-based solution is implemented consisting of two SDN controllers and two OpenFlow switches (OFSs). In this approach, the SDN controllers run the solution logic (i.e., monitoring, scaling, and load-balancing modules). According to the SDN controllers instructions, the OFSs are responsible for redirecting traffic to and from the VNF clusters (i.e., load-balancing strategy). Several experiments were conducted to validate the feasibility of this proposed solution on a real testbed. Through connectivity tests, not only could end-to-end (E2E) traffic be successfully achieved through the VNF cluster, but the bidirectional flow affinity strategy was also found to perform well because it could simultaneously create flow rules in both switches. Moreover, the selected CPU-based load-balancing method guaranteed an average imbalance below 10% while ensuring that new incoming traffic was redirected to the least loaded instance without requiring packet modification. Additionally, the designed monitoring function was able to detect failures in the set of active members in near real-time and active new instances in less than a minute. Likewise, the proposed auto-scaling module had a quick response to traffic changes. Our solution showed that the use of SDN controllers along with OFS provides great flexibility to implement different load-balancing, scaling, and monitoring strategies.

Study on a visual coder acceleration algorithm for image classification applying dynamic scaling training techniques

Nowadays, image classification techniques are used in the field of autonomous vehicles, and Convolutional Neural Network (CNN) is used extensively, and Vision Transformer (ViT) networks are used instead of deep convolutional networks in order to compress the network size and improve the model accuracy. The ViT network is used to replace the deep convolutional network. Since training ViT requires a large dataset to have sufficient accuracy, a variant of ViT, Data-Efficient Image Transformers (DEIT), is used in this paper. In addition, in order to greatly reduce the computing memory and shorten the computing time in practical use, the network is flexibly scaled in size and training speed by both adaptive width and adaptive depth. In this paper, we introduce DEIT, width adaptive techniques and depth adaptive techniques and combine them to be applied to image classification examples. Experiments are conducted on the Cifar100 dataset, and the experiments demonstrate the superiority of the algorithm on image classification scenarios.