Advanced three-dimensional visualization system for an integral imaging microscope using a fully convolutional depth estimation network

KC Kwon, KH Kwon, MU Erdenebat¡¦ - IEEE Photonics ¡¦, 2020 - ieeexplore.ieee.org
KC Kwon, KH Kwon, MU Erdenebat, YL Piao, YT Lim, Y Zhao, MY Kim, N Kim
IEEE Photonics Journal, 2020ieeexplore.ieee.org
In this paper, we propose an advanced three-dimensional visualization method for an
integral imaging microscope system to simultaneously improve the resolution and quality of
the reconstructed image. The main advance of the proposed method is that it generates a
high-quality three-dimensional model without limitation of resolution by combining the high-
resolution two-dimensional color image with depth data obtained through a fully
convolutional neural network. First, the high-resolution two-dimensional image and an ¡¦
In this paper, we propose an advanced three-dimensional visualization method for an integral imaging microscope system to simultaneously improve the resolution and quality of the reconstructed image. The main advance of the proposed method is that it generates a high-quality three-dimensional model without limitation of resolution by combining the high-resolution two-dimensional color image with depth data obtained through a fully convolutional neural network. First, the high-resolution two-dimensional image and an elemental image array for a specimen are captured, and the orthographic-view image is reconstructed from the elemental image array. Then, via a convolutional neural network-based depth estimation after the brightness of input images are uniformed, a more accurate and improved depth image is generated; and the noise of result depth image is filtered. Subsequently, the estimated depth data is combined with the high-resolution two-dimensional image and transformed into a high-quality three-dimensional model. In the experiment, it was confirmed that the displayed high-quality three-dimensional model could be visualized very similarly to the original image.
ieeexplore.ieee.org
ÀÌ °Ë»ö¾î¿¡ ´ëÇÑ ÃÖ»óÀÇ °Ë»ö°á°ú Ç¥½Ã ¸ðµç °Ë»ö°á°ú Ç¥½Ã