Free-view Pixels of Elemental image Rearrangement Technique

In a conventional free-view reconstruction, the visual quality of the reconstructed 3D images is insufficient to provide 3D information to applications because of the shift and sum process. In addition, its processing speed is slow. To solve these problems, our proposed method uses a pixel rearrangement technique (PERT) with locally selective elemental images. In general, PERT can reconstruct 3D images with a high visual quality at a fast processing speed. However, PERT can not provide a free-view reconstruction. Therefore, using our proposed method , free-view reconstructed 3D images with high visual qualities can be generated when low-resolution elemental images are used. to show the feasibility of our proposed method, we applied it to optical experiments.

Conventional Method PERT (Pixels of Elemental image Rearrangement Technique)

Concept of PERT
Arrangement of x-axis pixels of PERT
Result of conventional PERT

Conventional method has plenty data of different perspective data but it can not generate free-view perspective images. It always produce center fixed image. So, in proposed method, we can generate the different perspectives view point image by using the elemental images data where we want to see.

Proposed Method FPERT (Free-view Pixels of Elemental image Rearrangement Technique)

With the proposed method, we can choose pixels of the elemental image locally, and the pixels are projected onto the reconstruction plane through a virtual pinhole. After we choose the pixels of the elemental image, we calculate the position of each pixel and implement the same pixel rearrangement process used by PERT. In the pixel rearrangement, pixels have their own position numbers on the reconstruction plane. Using this pixel arrangement process, we can cluster the local elemental image pixels according to the viewing points.

Concept of FPERT
Arrangement of x-axis pixels of FPERT

Result images of FPERT