Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/25919
Title: A Real-Time High-Quality Complete System for Depth Image-Based Rendering on FPGA
Authors: LI, Yanzhe 
CLAESEN, Luc 
Huang, Kai
Zhao, Menglian
Issue Date: 2018
Source: IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 29 (4), p. 1179-1193
Abstract: Depth image-based rendering (DIBR) techniques have drawn more attention in various three dimensional (3D) applications nowadays. In this paper, a real-time high-quality DIBR system which consists of disparity estimation and view synthesis is proposed. For disparity estimation, a local approach that focuses on depth discontinuities and disparity smoothness is presented to improve the disparity accuracy. For view synthesis, a method that contains view interpolation and extrapolation is proposed to render high-quality virtual views. Moreover, the system is designed with an optimized parallelism scheme to achieve a high throughput, and can be scaled up easily. It is implemented on an Altera Stratix IV FPGA at a processing speed of 45 frames per second (fps) for 1080p resolution. Evaluated on selected image sets of the Middlebury benchmark, the average error rate of the disparity maps is 6.02%; the average peak signal to noise ratio (PSNR) and structural similarity (SSIM) values of the virtual views are 30.07 dB and 0.9303, respectively. The experimental results indicate that the proposed DIBR system has the topperforming processing speed and its accuracy performance is among the best of state-of-the-art hardware implementations.
Notes: Huang, K (reprint author), Zhejiang Univ, Inst VLSI Design, Hangzhou 310058, Zhejiang, Peoples R China. liyz@vlsi.zju.edu.cn; luc.claesen@uhasselt.be; huangk@vlsi.zju.edu.cn; zhaoml@vlsi.zju.edu.cn
Keywords: multi-camera systems; FPGA; VLSI; System-on-Chip; SoC; 3D-TV; Stereo Vision; Image Processing; DIBR; disparity calculation
Document URI: http://hdl.handle.net/1942/25919
ISSN: 1051-8215
e-ISSN: 1558-2205
DOI: 10.1109/TCSVT.2018.2825022
ISI #: 000464149700020
Rights: IEEE copyright
Category: A1
Type: Journal Contribution
Validations: ecoom 2020
Appears in Collections:Phd Theses
Research publications

Files in This Item:
File Description SizeFormat 
A_Real-Time_High-Quality_Complete_System_for_Depth_Image-Based_Rendering_on_FPGA.pdf
  Restricted Access
Published version6.22 MBAdobe PDFView/Open    Request a copy
Show full item record

SCOPUSTM   
Citations

5
checked on Sep 2, 2020

WEB OF SCIENCETM
Citations

15
checked on Mar 23, 2024

Page view(s)

116
checked on Sep 7, 2022

Download(s)

92
checked on Sep 7, 2022

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.