Abstract:

 View synthesis is an important building block in three dimension (3D) video processing and communications. Based on one or several views, view synthesis creates other views for the purpose of view prediction (for compression) or view rendering (for multi-view-display). The quality of view synthesis depends on how one fills the occlusion area as well as how the pixels are created. Consequently, luminance adjustment and hole filling are two key issues in view synthesis. In this paper, two views are used to produce an arbitrary virtual synthesized view. One view is merged into another view using a local luminance adjustment method, based on local neighborhood region for the calculation of adjustment coefficient. Moreover, a maximum neighborhood spreading strength hole filling method is presented to deal with the micro texture structure when the hole is being filled. For each pixel at the hole boundary, its neighborhood pixels with the maximum spreading strength direction are selected as candidates; and among them, the pixel with the maximum spreading strength is used to fill the hole from boundary to center. If there still exist disocclusion pixels after once scan, the filling process is repeated until all hole pixels are filled. Simulation results show that the proposed method is efficient, robust and achieves high performance in subjection and objection.