Multi-View Motion Synthesis via Applying Rotated Dual-Pixel Blur Kernels
TL
TL;DR
This work follows the trend of rendering the NIMAT effect by introducing a modification on the blur synthesis procedure in portrait mode that enables a high-quality synthesis of multi-view bokeh from a single image by applying rotated blurring kernels.
Abstract
Portrait mode is widely available on smartphone cameras to provide an enhanced photographic experience. One of the primary effects applied to images captured in portrait mode is a synthetic shallow depth of field (DoF). The synthetic DoF (or bokeh effect) selectively blurs regions in the image to emulate the effect of using a large lens with a wide aperture. In addition, many applications now incorporate a new image motion attribute (NIMAT) to emulate background motion, where the motion is correlated with estimated depth at each pixel. In this work, we follow the trend of rendering the NIMAT effect by introducing a modification on the blur synthesis procedure in portrait mode. In particular, our modification enables a high-quality synthesis of multi-view bokeh from a single image by applying rotated blurring kernels. Given the synthesized multiple views, we can generate aesthetically realistic image motion similar to the NIMAT effect. We validate our approach qualitatively compared to the original NIMAT effect and other similar image motions, like Facebook 3D image. Our image motion demonstrates a smooth image view transition with fewer artifacts around the object boundary.
References30 items
1
Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning
2
NTIRE 2021 Challenge for Defocus Deblurring Using Dual-pixel Images: Methods and Results
3
Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data
4
Rendering Natural Camera Bokeh Effect with Deep Learning
5