Efficient Image Resolution Enhancement Using Edge-Directed Unsharp Masking Sharpening for Real-Time ASIC Applications

Author(s):  
Kuo-Shiuan Peng
Author(s):  
Parastoo Soleimani ◽  
David W. Capson ◽  
Kin Fun Li

AbstractThe first step in a scale invariant image matching system is scale space generation. Nonlinear scale space generation algorithms such as AKAZE, reduce noise and distortion in different scales while retaining the borders and key-points of the image. An FPGA-based hardware architecture for AKAZE nonlinear scale space generation is proposed to speed up this algorithm for real-time applications. The three contributions of this work are (1) mapping the two passes of the AKAZE algorithm onto a hardware architecture that realizes parallel processing of multiple sections, (2) multi-scale line buffers which can be used for different scales, and (3) a time-sharing mechanism in the memory management unit to process multiple sections of the image in parallel. We propose a time-sharing mechanism for memory management to prevent artifacts as a result of separating the process of image partitioning. We also use approximations in the algorithm to make hardware implementation more efficient while maintaining the repeatability of the detection. A frame rate of 304 frames per second for a $$1280 \times 768$$ 1280 × 768 image resolution is achieved which is favorably faster in comparison with other work.


2021 ◽  
Vol 13 (9) ◽  
pp. 1854
Author(s):  
Syed Muhammad Arsalan Bashir ◽  
Yi Wang

This paper deals with detecting small objects in remote sensing images from satellites or any aerial vehicle by utilizing the concept of image super-resolution for image resolution enhancement using a deep-learning-based detection method. This paper provides a rationale for image super-resolution for small objects by improving the current super-resolution (SR) framework by incorporating a cyclic generative adversarial network (GAN) and residual feature aggregation (RFA) to improve detection performance. The novelty of the method is threefold: first, a framework is proposed, independent of the final object detector used in research, i.e., YOLOv3 could be replaced with Faster R-CNN or any object detector to perform object detection; second, a residual feature aggregation network was used in the generator, which significantly improved the detection performance as the RFA network detected complex features; and third, the whole network was transformed into a cyclic GAN. The image super-resolution cyclic GAN with RFA and YOLO as the detection network is termed as SRCGAN-RFA-YOLO, which is compared with the detection accuracies of other methods. Rigorous experiments on both satellite images and aerial images (ISPRS Potsdam, VAID, and Draper Satellite Image Chronology datasets) were performed, and the results showed that the detection performance increased by using super-resolution methods for spatial resolution enhancement; for an IoU of 0.10, AP of 0.7867 was achieved for a scale factor of 16.


2021 ◽  
Author(s):  
Tianhua Zhang ◽  
Shiduo Yang ◽  
Chandramani Shrivastava ◽  
Adrian A ◽  
Nadege Bize-Forest

Abstract With the advancement of LWD (Logging While Drilling) hardware and acquisition, the imaging technology becomes not only an indispensable part of the drilling tool string, but also the image resolution increases to map layers and heterogeneity features down to less than 5mm scale. This shortens the geological interpretation turn-around time from wireline logging time (hours to days after drilling) to semi-real time (drilling time or hours after drilling). At the same time, drilling motion is complex. The depth tracking is on the surface referenced to the surface block movement. The imaging sensor located downhole can be thousands of feet away from the surface. Mechanical torque and drag, wellbore friction, wellbore temperature and weight on bit can make the downhole sensor movement motion not synchronized with surface pipe depth. This will cause time- depth conversion step generate image artifacts that either stop real-time interpretation of geological features or mis-interpret features on high resolution images. In this paper, we present several LWD images featuring distortion mechanism during the drilling process using synthetic data. We investigated how heave, depth reset and downhole sensor stick/slip caused image distortions. We provide solutions based on downhole sensor pseudo velocity computation to minimize the image distortion. The best practice in using Savitsky-Golay filter are presented in the discussion sections. Finally, some high-resolution LWD images distorted with drilling-related artifacts and processed ones are shown to demonstrate the importance of image post-processing. With the proper processed images, we can minimize interpretation risks and make drilling decisions with more confidence.


Sign in / Sign up

Export Citation Format

Share Document