Real-time 8K/4K video coding system with super-resolution inter-layer prediction

2016 ◽  
Author(s):  
Toshie Misu ◽  
Shunsuke Iwamura ◽  
Yasutaka Matsuo ◽  
Kikufumi Kanda ◽  
Shinichi Sakaida
Keyword(s):  
Video Coding ◽  
Real Time ◽  
Super Resolution ◽  
Coding System

Practical considerations for real-time super-resolution implementation techniques over video coding platforms (Keynote Address)

2005 ◽  
Author(s):  
Gustavo M. Callico ◽  
Sebastian Lopez ◽  
Rafael Peset Llopis ◽  
Ramanathan Sethuraman ◽  
Antonio Nunez ◽  
...  
Keyword(s):  
Video Coding ◽  
Real Time ◽  
Super Resolution ◽  
Keynote Address ◽  
Implementation Techniques

A real-time atmospheric turbulence mitigation and super-resolution solution for infrared imaging systems

2012 ◽  
Author(s):  
Douglas R. Droege ◽  
Russell C. Hardie ◽  
Brian S. Allen ◽  
Alexander J. Dapore ◽  
Jon C. Blevins
Keyword(s):  
Real Time ◽  
Atmospheric Turbulence ◽  
Infrared Imaging ◽  
Super Resolution ◽  
Imaging Systems

scholarly journals Real-Time Environment Monitoring Using a Lightweight Image Super-Resolution Network

2021 ◽  
Vol 18 (11) ◽  
pp. 5890
Author(s):  
Qiang Yu ◽  
Feiqiang Liu ◽  
Long Xiao ◽  
Zitao Liu ◽  
Xiaomin Yang
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Super Resolution ◽  
Model Complexity ◽  
Practical Application ◽  
Single Image ◽  
Feature Maps ◽  
Benchmark Datasets ◽  
Image Super Resolution ◽  
Single Image Super Resolution

Deep-learning (DL)-based methods are of growing importance in the field of single image super-resolution (SISR). The practical application of these DL-based models is a remaining problem due to the requirement of heavy computation and huge storage resources. The powerful feature maps of hidden layers in convolutional neural networks (CNN) help the model learn useful information. However, there exists redundancy among feature maps, which can be further exploited. To address these issues, this paper proposes a lightweight efficient feature generating network (EFGN) for SISR by constructing the efficient feature generating block (EFGB). Specifically, the EFGB can conduct plain operations on the original features to produce more feature maps with parameters slightly increasing. With the help of these extra feature maps, the network can extract more useful information from low resolution (LR) images to reconstruct the desired high resolution (HR) images. Experiments conducted on the benchmark datasets demonstrate that the proposed EFGN can outperform other deep-learning based methods in most cases and possess relatively lower model complexity. Additionally, the running time measurement indicates the feasibility of real-time monitoring.

scholarly journals A Residual Network and FPGA Based Real-Time Depth Map Enhancement System

Entropy ◽  
2021 ◽  
Vol 23 (5) ◽  
pp. 546
Author(s):  
Zhenni Li ◽  
Haoyi Sun ◽  
Yuliang Gao ◽  
Jiao Wang
Keyword(s):  
Real Time ◽  
Super Resolution ◽  
Depth Map ◽  
Acquisition System ◽  
Depth Image ◽  
Fpga Design ◽  
Depth Sensing ◽  
Residual Network ◽  
Real Time Processing ◽  
Depth Maps

Depth maps obtained through sensors are often unsatisfactory because of their low-resolution and noise interference. In this paper, we propose a real-time depth map enhancement system based on a residual network which uses dual channels to process depth maps and intensity maps respectively and cancels the preprocessing process, and the algorithm proposed can achieve real-time processing speed at more than 30 fps. Furthermore, the FPGA design and implementation for depth sensing is also introduced. In this FPGA design, intensity image and depth image are captured by the dual-camera synchronous acquisition system as the input of neural network. Experiments on various depth map restoration shows our algorithms has better performance than existing LRMC, DE-CNN and DDTF algorithms on standard datasets and has a better depth map super-resolution, and our FPGA completed the test of the system to ensure that the data throughput of the USB 3.0 interface of the acquisition system is stable at 226 Mbps, and support dual-camera to work at full speed, that is, 54 fps@ (1280 × 960 + 328 × 248 × 3).

Sign in / Sign up

Export Citation Format

Share Document