Rich360: Optimized Spherical Representation from Structured Panoramic Camera Arrays

Jungjin Lee, Bumki Kim, Kyehyun Kim, Younghui Kim, Junyong Noh

Journal: ACM Transaction on Graphics, Volume 35, Issue 4, p.63:1-63:11, July 2016
Conference : ACM SIGGRAPH, 2016

Paper (25.6M PDF) / Slides (786.3MB) / Videos / Datasets

Abstract

This paper presents Rich360, a novel system for creating and viewing a 360 panoramic video obtained from multiple cameras placed on a structured rig. Rich360 provides an as-rich-as-possible 360 viewing experience by effectively resolving two issues that occur in the existing pipeline. First, a deformable spherical projection surface is utilized to minimize the parallax from multiple cameras. The surface is deformed spatio-temporally according to the depth constraints estimated from the overlapping video regions. This enables fast and efficient parallax-free stitching independent of the number of views. Next, a non-uniform spherical ray sampling is performed. The density of the sampling varies depending on the importance of the image region. Finally, for interactive viewing, the nonuniformly sampled video is mapped onto a uniform viewing sphere using a UV map. This approach can preserve the richness of the input videos when the resolution of the final 360 panoramic video is smaller than the overall resolution of the input videos, which is the case for most 360 panoramic videos. We show various results from Rich360 to demonstrate the richness of the output video and the advancement in the stitching results.

Dataset consisting of input/output data and camera parameters used for stitching results in Rich360: Optimized Spherical Representation from Structured Panoramic Camera Arrays

• Input: set of input images for each camera (JPG sequence)
• Output: stitching results from Rich360 (the equirectangular projection with linear blending, non-uniform ray sampling was not applied.)
• CamParams.txt: 3D calibration data of all cameras.

	Carillon Input images (ZIP, 4.92 GB) — 301×6(2704×2028) images Output images (ZIP, 879.8 MB) — 301(2048×1024) images Calibration data (TXT, 2.99 KB) — 6(GoPro) cameras
	StoneTower Input images (ZIP, 6.33 GB) — 450×6(2704×2028) images Output images (ZIP, 1.15 GB) — 450(2048×1024) images Calibration data (TXT, 2.99 KB) — 6(GoPro) cameras
	GolfCenter Input images (ZIP, 4.46 GB) — 301×6(2704×2028) images Output images (ZIP, 811.1 MB) — 301(2048×1024) images Calibration data (TXT, 2.99 KB) — 6(GoPro) cameras

Citation

Rich360: Optimized Spherical Representation from Structured Panoramic Camera Arrays, Jungjin Lee, Bumki Kim, Kyehyun Kim, Younghui Kim, Junyong Noh, ACM Transaction on Graphics (Proc. of ACM SIGGRAPH 2016), Volume 35, Issue 4, p.63:1-63:11, July 2016 [ BibTeX ]

License