scholarly journals Overlapping Data Transfers with Computation on GPU with Tiles

Author(s):  
Burak Bastem ◽  
Didem Unat ◽  
Weiqun Zhang ◽  
Ann Almgren ◽  
John Shalf
2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Christian Ariza-Porras ◽  
Valentin Kuznetsov ◽  
Federica Legger

AbstractThe globally distributed computing infrastructure required to cope with the multi-petabyte datasets produced by the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) at CERN comprises several subsystems, such as workload management, data management, data transfers, and submission of users’ and centrally managed production requests. To guarantee the efficient operation of the whole infrastructure, CMS monitors all subsystems according to their performance and status. Moreover, we track key metrics to evaluate and study the system performance over time. The CMS monitoring architecture allows both real-time and historical monitoring of a variety of data sources. It relies on scalable and open source solutions tailored to satisfy the experiment’s monitoring needs. We present the monitoring data flow and software architecture for the CMS distributed computing applications. We discuss the challenges, components, current achievements, and future developments of the CMS monitoring infrastructure.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Carole Lunny ◽  
Dawid Pieper ◽  
Pierre Thabet ◽  
Salmaan Kanji

Abstract Background Overviews often identify and synthesise a large number of systematic reviews on the same topic, which is likely to lead to overlap (i.e. duplication) in primary studies across the reviews. Using a primary study result multiple times in the same analysis overstates its sample size and number of events, falsely leading to greater precision in the analysis. This paper aims to: (a) describe types of overlapping data that arise from the same primary studies reported across multiple reviews, (b) describe methods to identify and explain overlap of primary study data, and (c) present six case studies illustrating different approaches to manage overlap. Methods We first updated the search in PubMed for methods from the MOoR framework relating to overlap of primary studies. One author screened the studies titles and abstracts, and any full-text articles retrieved, extracted methods data relating to overlap of primary studies and mapped it to the overlap methods from the MOoR framework. We also describe six case studies as examples of overviews that use specific overlap methods across the steps in the conduct of an overview. For each case study, we discuss potential methodological implications in terms of limitations, efficiency, usability, and resource use. Results Nine methods studies were found and mapped to the methods identified by the MOoR framework to address overlap. Overlap methods were mapped across four steps in the conduct of an overview – the eligibility criteria step, the data extraction step, the assessment of risk of bias step, and the synthesis step. Our overview case studies used multiple methods to reduce overlap at different steps in the conduct of an overview. Conclusions Our study underlines that there is currently no standard methodological approach to deal with overlap in primary studies across reviews. The level of complexity when dealing with overlap can vary depending on the yield, trends and patterns of the included literature and the scope of the overview question. Choosing a method might be dependent on the number of included reviews and their primary studies. Gaps in evaluation of methods to address overlap were found and further investigation in this area is needed.


2013 ◽  
Vol 54 (62) ◽  
pp. 59-64 ◽  
Author(s):  
K. Shirasawa ◽  
N. Ebuchi ◽  
M. Leppäranta ◽  
T. Takatsuka

AbstractA C-band sea-ice radar (SIR) network system was operated to monitor the sea-ice conditions off the Okhotsk Sea coast of northern Hokkaido, Japan, from 1969 to 2004. The system was based on three radar stations, which were capable of continuously monitoring the sea surface as far as 60 km offshore along a 250 km long coastal section. In 2004 the SIR system was closed down and a sea surface monitoring programme was commenced using high-frequency (HF) radar; this system provides information on surface currents in open-water conditions, while areas with ‘no signal’ can be identified as sea ice. The present study compares HF radar data with SIR data to evaluate their feasibility for sea-ice remote sensing. The period of overlapping data was 1.5 months. The results show that HF radar information can be utilized for ice-edge mapping although it cannot fully compensate for the loss of the SIR system. In particular, HF radar does not provide ice concentration, ice roughness and geometrical structures or ice kinematics. The probability of ice-edge detection by HF radar was 0.9 and the correlation of the ice-edge distance between the radars was 0.7.


Author(s):  
Bin Ren ◽  
Nishkam Ravi ◽  
Yi Yang ◽  
Min Feng ◽  
Gagan Agrawal ◽  
...  
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document