Transferring Data from High-Performance Simulations to Extreme Scale Analysis Applications in Real-Time

Author(s):  
Thomas Marrinan ◽  
Silvio Rizzi ◽  
Joseph Insley ◽  
Brian Toonen ◽  
William Allcock ◽  
...  
Author(s):  
Isabel Schwerdtfeger

This chapter discusses the challenges high-end storage solutions will have with future demands. Due to heavy end-user demands for real-time processing of data access, this need must be addressed by high-end storage solutions. But what type of high-end storage solutions address this need and are suitable to ensure high performance write and retrieval of data in real-time from high- end storage infrastructures, including read and write access from digital archives? For this reason, this chapter reviews a few disk and tape solutions as well as combined disk- and tape storage solutions. The review on the different storage solutions does not focus on compliance of data storage management, but on available commercial high-end systems, addressing scalability and performance requirements both for online storage and archives. High level requirements aid in identifying high-end storage system features and support Extreme Scale infrastructures for the amount of data that high-end storage systems will need to manage in future.


Author(s):  
Muhammad Faris Roslan ◽  
◽  
Afandi Ahmad ◽  
Abbes Amira ◽  
◽  
...  

Author(s):  
Jianglin Feng ◽  
Nathan C Sheffield

Abstract Summary Databases of large-scale genome projects now contain thousands of genomic interval datasets. These data are a critical resource for understanding the function of DNA. However, our ability to examine and integrate interval data of this scale is limited. Here, we introduce the integrated genome database (IGD), a method and tool for searching genome interval datasets more than three orders of magnitude faster than existing approaches, while using only one hundredth of the memory. IGD uses a novel linear binning method that allows us to scale analysis to billions of genomic regions. Availability https://github.com/databio/IGD


Author(s):  
Yuchen Luo ◽  
Yi Zhang ◽  
Ming Liu ◽  
Yihong Lai ◽  
Panpan Liu ◽  
...  

Abstract Background and aims Improving the rate of polyp detection is an important measure to prevent colorectal cancer (CRC). Real-time automatic polyp detection systems, through deep learning methods, can learn and perform specific endoscopic tasks previously performed by endoscopists. The purpose of this study was to explore whether a high-performance, real-time automatic polyp detection system could improve the polyp detection rate (PDR) in the actual clinical environment. Methods The selected patients underwent same-day, back-to-back colonoscopies in a random order, with either traditional colonoscopy or artificial intelligence (AI)-assisted colonoscopy performed first by different experienced endoscopists (> 3000 colonoscopies). The primary outcome was the PDR. It was registered with clinicaltrials.gov. (NCT047126265). Results In this study, we randomized 150 patients. The AI system significantly increased the PDR (34.0% vs 38.7%, p < 0.001). In addition, AI-assisted colonoscopy increased the detection of polyps smaller than 6 mm (69 vs 91, p < 0.001), but no difference was found with regard to larger lesions. Conclusions A real-time automatic polyp detection system can increase the PDR, primarily for diminutive polyps. However, a larger sample size is still needed in the follow-up study to further verify this conclusion. Trial Registration clinicaltrials.gov Identifier: NCT047126265


2001 ◽  
Vol 7 (S2) ◽  
pp. 1050-1051 ◽  
Author(s):  
S.W. Nam ◽  
D.A. Wollman ◽  
Dale E. Newbury ◽  
G.C. Hilton ◽  
K.D. Irwin ◽  
...  

The high performance of single-pixel microcalorimeter EDS (μ,cal EDS) has been shown to be very useful for a variety of microanalysis cases. The primary advantage of jxcal EDS over conventional EDS is the factor of 25 improvement in energy resolution (∽3 eV in real-time). This level of energy resolution is particularly important for applications such as nanoscale contaminant analysis where it is necessary to resolve peak overlaps at low x-ray energies. Because μcal EDS offers practical solutions to many microanalysis problems, several companies are proceeding with commercialization of single-pixel μal EDS technology. Two drawbacks limiting the application of uxal EDS are its low count rate (∽500 s−1) and small area (∽0.04 mm for a bare single pixel, ∽5 mm2 with a polycapillary optic). We are developing a 32x32 pixel array with a total area of 40 mm2 and with a total count rate between 105 s−1 and 106 s−1.


Author(s):  
Jop Vermeer ◽  
Leonardo Scandolo ◽  
Elmar Eisemann

Ambient occlusion (AO) is a popular rendering technique that enhances depth perception and realism by darkening locations that are less exposed to ambient light (e.g., corners and creases). In real-time applications, screen-space variants, relying on the depth buffer, are used due to their high performance and good visual quality. However, these only take visible surfaces into account, resulting in inconsistencies, especially during motion. Stochastic-Depth Ambient Occlusion is a novel AO algorithm that accounts for occluded geometry by relying on a stochastic depth map, capturing multiple scene layers per pixel at random. Hereby, we efficiently gather missing information in order to improve upon the accuracy and spatial stability of conventional screen-space approximations, while maintaining real-time performance. Our approach integrates well into existing rendering pipelines and improves the robustness of many different AO techniques, including multi-view solutions.


Electronics ◽  
2021 ◽  
Vol 10 (5) ◽  
pp. 627
Author(s):  
David Marquez-Viloria ◽  
Luis Castano-Londono ◽  
Neil Guerrero-Gonzalez

A methodology for scalable and concurrent real-time implementation of highly recurrent algorithms is presented and experimentally validated using the AWS-FPGA. This paper presents a parallel implementation of a KNN algorithm focused on the m-QAM demodulators using high-level synthesis for fast prototyping, parameterization, and scalability of the design. The proposed design shows the successful implementation of the KNN algorithm for interchannel interference mitigation in a 3 × 16 Gbaud 16-QAM Nyquist WDM system. Additionally, we present a modified version of the KNN algorithm in which comparisons among data symbols are reduced by identifying the closest neighbor using the rule of the 8-connected clusters used for image processing. Real-time implementation of the modified KNN on a Xilinx Virtex UltraScale+ VU9P AWS-FPGA board was compared with the results obtained in previous work using the same data from the same experimental setup but offline DSP using Matlab. The results show that the difference is negligible below FEC limit. Additionally, the modified KNN shows a reduction of operations from 43 percent to 75 percent, depending on the symbol’s position in the constellation, achieving a reduction 47.25% reduction in total computational time for 100 K input symbols processed on 20 parallel cores compared to the KNN algorithm.


2020 ◽  
Vol 8 (39) ◽  
pp. 13762-13769
Author(s):  
Jing-Wei Kang ◽  
Chao Zhang ◽  
Kai-Jun Cao ◽  
Yu Lu ◽  
Chun-Yan Wu ◽  
...  

A high-performance γ-In2Se3/GaAs heterostructure-based photodetector linear array shows potential in optoelectronic applications such as real-time light trajectory tracking and image sensing.


Sign in / Sign up

Export Citation Format

Share Document