DrMP: Mixed Precision-Aware DRAM for High Performance Approximate and Precise Computing

2017 ◽  
Author(s):  
Xianwei Zhang ◽  
Youtao Zhang ◽  
Bruce R. Childers ◽  
Jun Yang
Keyword(s):  
High Performance ◽  
Mixed Precision

Adaptive Precision Block-Jacobi for High Performance Preconditioning in the Ginkgo Linear Algebra Software

2021 ◽  
Vol 47 (2) ◽  
pp. 1-28
Author(s):  
Goran Flegar ◽  
Hartwig Anzt ◽  
Terry Cojean ◽  
Enrique S. Quintana-Ortí
Keyword(s):  
Linear Algebra ◽  
Graphics Processing Units ◽  
High Performance ◽  
Numerical Algorithms ◽  
Mixed Precision ◽  
Before And After ◽  
Memory Accesses ◽  
Specialized Hardware ◽  
The Individual ◽  
Graphics Processing

The use of mixed precision in numerical algorithms is a promising strategy for accelerating scientific applications. In particular, the adoption of specialized hardware and data formats for low-precision arithmetic in high-end GPUs (graphics processing units) has motivated numerous efforts aiming at carefully reducing the working precision in order to speed up the computations. For algorithms whose performance is bound by the memory bandwidth, the idea of compressing its data before (and after) memory accesses has received considerable attention. One idea is to store an approximate operator–like a preconditioner–in lower than working precision hopefully without impacting the algorithm output. We realize the first high-performance implementation of an adaptive precision block-Jacobi preconditioner which selects the precision format used to store the preconditioner data on-the-fly, taking into account the numerical properties of the individual preconditioner blocks. We implement the adaptive block-Jacobi preconditioner as production-ready functionality in the Ginkgo linear algebra library, considering not only the precision formats that are part of the IEEE standard, but also customized formats which optimize the length of the exponent and significand to the characteristics of the preconditioner blocks. Experiments run on a state-of-the-art GPU accelerator show that our implementation offers attractive runtime savings.

BISWSRBS: A Winograd-based CNN Accelerator with a Fine-grained Regular Sparsity Pattern and Mixed Precision Quantization

2021 ◽  
Vol 14 (4) ◽  
pp. 1-28
Author(s):  
Tao Yang ◽  
Zhezhi He ◽  
Tengchuan Kou ◽  
Qingzheng Li ◽  
Qi Han ◽  
...  
Keyword(s):  
High Performance ◽  
State Of The Art ◽  
The State ◽  
Optimization Approach ◽  
Quantization Scheme ◽  
Model Accuracy ◽  
Sparsity Pattern ◽  
Computing Platform ◽  
Energy Efficiency Improvement ◽  
Mixed Precision

Field-programmable Gate Array (FPGA) is a high-performance computing platform for Convolution Neural Networks (CNNs) inference. Winograd algorithm, weight pruning, and quantization are widely adopted to reduce the storage and arithmetic overhead of CNNs on FPGAs. Recent studies strive to prune the weights in the Winograd domain, however, resulting in irregular sparse patterns and leading to low parallelism and reduced utilization of resources. Besides, there are few works to discuss a suitable quantization scheme for Winograd. In this article, we propose a regular sparse pruning pattern in the Winograd-based CNN, namely, Sub-row-balanced Sparsity (SRBS) pattern, to overcome the challenge of the irregular sparse pattern. Then, we develop a two-step hardware co-optimization approach to improve the model accuracy using the SRBS pattern. Based on the pruned model, we implement a mixed precision quantization to further reduce the computational complexity of bit operations. Finally, we design an FPGA accelerator that takes both the advantage of the SRBS pattern to eliminate low-parallelism computation and the irregular memory accesses, as well as the mixed precision quantization to get a layer-wise bit width. Experimental results on VGG16/VGG-nagadomi with CIFAR-10 and ResNet-18/34/50 with ImageNet show up to 11.8×/8.67× and 8.17×/8.31×/10.6× speedup, 12.74×/9.19× and 8.75×/8.81×/11.1× energy efficiency improvement, respectively, compared with the state-of-the-art dense Winograd accelerator [20] with negligible loss of model accuracy. We also show that our design has 4.11× speedup compared with the state-of-the-art sparse Winograd accelerator [19] on VGG16.

Fast reconstruction tools for ptychography at Sirius, the fourth-generation Brazilian synchrotron

2020 ◽  
Vol 53 (6) ◽  
pp. 1550-1558
Author(s):  
Giovanni L. Baraldi ◽  
Carlos S. B. Dias ◽  
Francisco M. C. Silva ◽  
Hélio C. N. Tolentino ◽  
Eduardo X. Miqueles
Keyword(s):  
High Speed ◽  
High Performance ◽  
Phase Retrieval ◽  
Scattering Data ◽  
Fourth Generation ◽  
Acquisition Time ◽  
Optimization Strategy ◽  
X Ray ◽  
Mixed Precision ◽  
Synchrotron Light

Described here are image reconstruction optimizations for ptychographic coherent X-ray scattering data and X-ray fluorescence, which have been developed for the new fourth-generation synchrotron light source, Sirius, at the Brazilian Synchrotron Light Laboratory. The optimization strategy has been applied to the standard experimental strategy for ptychographic and fluorescence experiments on the Carnaúba beamline which involves the use of high-speed continuous scans (fly scans) for a fast acquisition time over large areas through the use of a newly proposed trajectory named the alternating linear trajectory. The scientific computing developments presented here target an efficient use of graphical processing units (GPUs) to the point where large fly-scan acquisitions can be processed in real time on a local high-performance computer. Some optimizations involving a custom fast Fourier transform implementation and use of mixed precision can be applied to other algorithms and phase-retrieval techniques, and therefore this work provides a general optimization scheme. Finally, the optimization strategy presented here has improved performance by a factor of ∼2.5 times faster when compared with non-optimized GPU implementations.

Supporting Mixed-domain Mixed-precision Matrix Multiplication within the BLIS Framework

2021 ◽  
Vol 47 (2) ◽  
pp. 1-26
Author(s):  
Field G. Van Zee ◽  
Devangi N. Parikh ◽  
Robert A. Van De Geijn
Keyword(s):  
High Performance ◽  
Matrix Multiplication ◽  
Software Framework ◽  
Matrix Product ◽  
Double Precision ◽  
Precision Matrix ◽  
Implementation Approach ◽  
Mixed Precision ◽  
The Matrix ◽  
Performance Results

We approach the problem of implementing mixed-datatype support within the general matrix multiplication ( gemm ) operation of the BLAS-like Library Instantiation Software framework, whereby each matrix operand A , B , and C may be stored as single- or double-precision real or complex values. Another factor of complexity, whereby the matrix product and accumulation are allowed to take place in a precision different from the storage precisions of either A or B , is also discussed. We first break the problem into orthogonal dimensions, considering the mixing of domains separately from mixing precisions. Support for all combinations of matrix operands stored in either the real or complex domain is mapped out by enumerating the cases and describing an implementation approach for each. Supporting all combinations of storage and computation precisions is handled by typecasting the matrices at key stages of the computation—during packing and/or accumulation, as needed. Several optional optimizations are also documented. Performance results gathered on a 56-core Marvell ThunderX2 and a 52-core Intel Xeon Platinum demonstrate that high performance is mostly preserved, with modest slowdowns incurred from unavoidable typecast instructions. The mixed-datatype implementation confirms that combinatorial intractability is avoided, with the framework relying on only two assembly microkernels to implement 128 datatype combinations.

High-Performance Mixed-Precision Linear Solver for FPGAs

2008 ◽  
Vol 57 (12) ◽  
pp. 1614-1623 ◽  
Author(s):  
Junqing Sun ◽  
G.D. Peterson ◽  
O.O. Storaasli
Keyword(s):  
High Performance ◽  
Linear Solver ◽  
Mixed Precision

Fine-grained floating-point precision analysis

2016 ◽  
Vol 32 (2) ◽  
pp. 231-245 ◽  
Author(s):  
Michael O Lam ◽  
Jeffrey K Hollingsworth
Keyword(s):  
High Performance ◽  
Floating Point ◽  
Data Sets ◽  
Double Precision ◽  
Precision Analysis ◽  
Memory Space ◽  
Incremental Search ◽  
Fine Grained ◽  
Mixed Precision ◽  
Application Developers

Floating-point computation is ubiquitous in high-performance scientific computing, but rounding error can compromise the results of extended calculations, especially at large scales. In this paper, we present new techniques that use binary instrumentation and modification to do fine-grained floating-point precision analysis, simulating any level of precision less than or equal to the precision of the original program. These techniques have an average of 40–70% lower overhead and provide more fine-grained insights into a program’s sensitivity than previous mixed-precision analyses. We also present a novel histogram-based visualization of a program’s floating-point precision sensitivity, as well as an incremental search technique that allows developers to incrementally trade off analysis time for detail, including the ability to restart analyses from where they left off. We present results from several case studies and experiments that show the efficacy of these techniques. Using our tool and its novel visualization, application developers can more quickly determine for specific data sets whether their application could be run using fewer double precision variables, saving both time and memory space.

scholarly journals Mixed-precision iterative refinement using tensor cores on GPUs to accelerate solution of linear systems

2020 ◽  
Vol 476 (2243) ◽  
pp. 20200110
Author(s):  
Azzam Haidar ◽  
Harun Bayraktar ◽  
Stanimire Tomov ◽  
Jack Dongarra ◽  
Nicholas J. Higham
Keyword(s):  
Linear Systems ◽  
Numerical Stability ◽  
High Performance ◽  
Iterative Refinement ◽  
Floating Point ◽  
Double Precision ◽  
Floating Point Arithmetic ◽  
Mixed Precision ◽  
Scientific Simulations ◽  
Point Arithmetic

Double-precision floating-point arithmetic (FP64) has been the de facto standard for engineering and scientific simulations for several decades. Problem complexity and the sheer volume of data coming from various instruments and sensors motivate researchers to mix and match various approaches to optimize compute resources, including different levels of floating-point precision. In recent years, machine learning has motivated hardware support for half-precision floating-point arithmetic. A primary challenge in high-performance computing is to leverage reduced-precision and mixed-precision hardware. We show how the FP16/FP32 Tensor Cores on NVIDIA GPUs can be exploited to accelerate the solution of linear systems of equations Ax  =  b without sacrificing numerical stability. The techniques we employ include multiprecision LU factorization, the preconditioned generalized minimal residual algorithm (GMRES), and scaling and auto-adaptive rounding to avoid overflow. We also show how to efficiently handle systems with multiple right-hand sides. On the NVIDIA Quadro GV100 (Volta) GPU, we achieve a 4 × − 5 × performance increase and 5× better energy efficiency versus the standard FP64 implementation while maintaining an FP64 level of numerical stability.

Linear algebra software for large-scale accelerated multicore computing

Acta Numerica ◽  
2016 ◽  
Vol 25 ◽  
pp. 1-160 ◽  
Author(s):  
A. Abdelfattah ◽  
H. Anzt ◽  
J. Dongarra ◽  
M. Gates ◽  
A. Haidar ◽  
...  
Keyword(s):  
Linear Algebra ◽  
High Performance ◽  
Large Scale ◽  
Runtime Systems ◽  
Development Effort ◽  
Light Weight ◽  
Multicore Systems ◽  
Static Scheduling ◽  
Mixed Precision ◽  
Value Decomposition

Many crucial scientific computing applications, ranging from national security to medical advances, rely on high-performance linear algebra algorithms and technologies, underscoring their importance and broad impact. Here we present the state-of-the-art design and implementation practices for the acceleration of the predominant linear algebra algorithms on large-scale accelerated multicore systems. Examples are given with fundamental dense linear algebra algorithms – from the LU, QR, Cholesky, and LDLT factorizations needed for solving linear systems of equations, to eigenvalue and singular value decomposition (SVD) problems. The implementations presented are readily available via the open-source PLASMA and MAGMA libraries, which represent the next generation modernization of the popular LAPACK library for accelerated multicore systems.To generate the extreme level of parallelism needed for the efficient use of these systems, algorithms of interest are redesigned and then split into well-chosen computational tasks. The task execution is scheduled over the computational components of a hybrid system of multicore CPUs with GPU accelerators and/or Xeon Phi coprocessors, using either static scheduling or light-weight runtime systems. The use of light-weight runtime systems keeps scheduling overheads low, similar to static scheduling, while enabling the expression of parallelism through sequential-like code. This simplifies the development effort and allows exploration of the unique strengths of the various hardware components. Finally, we emphasize the development of innovative linear algebra algorithms using three technologies – mixed precision arithmetic, batched operations, and asynchronous iterations – that are currently of high interest for accelerated multicore systems.

A High Performance Energy Analyzer for Use in Electron Scanning Microscopy

1969 ◽  
Vol 27 ◽  
pp. 14-15
Author(s):  
A. V. Crewe ◽  
M. Isaacson ◽  
D. Johnson
Keyword(s):  
High Performance ◽  
Vertical Plane ◽  
Median Plane ◽  
Electron Gun ◽  
Uniform Field ◽  
Loss Mechanism ◽  
Electron Scanning Microscopy ◽  
Sector Type ◽  
Double Focusing ◽  
Electron Energy Loss

A double focusing magnetic spectrometer has been constructed for use with a field emission electron gun scanning microscope in order to study the electron energy loss mechanism in thin specimens. It is of the uniform field sector type with curved pole pieces. The shape of the pole pieces is determined by requiring that all particles be focused to a point at the image slit (point 1). The resultant shape gives perfect focusing in the median plane (Fig. 1) and first order focusing in the vertical plane (Fig. 2).

Vacuum System to Minimize the Specimen Contamination of High-Performance EM

1977 ◽  
Vol 35 ◽  
pp. 68-69
Author(s):  
N. Yoshimura ◽  
K. Shirota ◽  
T. Etoh
Keyword(s):  
Electron Microscope ◽  
High Speed ◽  
High Performance ◽  
High Vacuum ◽  
Vacuum System ◽  
Pump System ◽  
Pumping System ◽  
Diffusion Pump ◽  
Almost All ◽  
Cascade Type

One of the most important requirements for a high-performance EM, especially an analytical EM using a fine beam probe, is to prevent specimen contamination by providing a clean high vacuum in the vicinity of the specimen. However, in almost all commercial EMs, the pressure in the vicinity of the specimen under observation is usually more than ten times higher than the pressure measured at the punping line. The EM column inevitably requires the use of greased Viton O-rings for fine movement, and specimens and films need to be exchanged frequently and several attachments may also be exchanged. For these reasons, a high speed pumping system, as well as a clean vacuum system, is now required. A newly developed electron microscope, the JEM-100CX features clean high vacuum in the vicinity of the specimen, realized by the use of a CASCADE type diffusion pump system which has been essentially improved over its predeces- sorD employed on the JEM-100C.

Sign in / Sign up

Export Citation Format

Share Document