Embedded Files
In this project, we modified a Nikon D700 DSLR camera into a hand-held Light Field Camera (LFC) by placing a pinhole-array mask on the sensor. The LFC can be used to capture 4-D light field data in a single shot, so that many more camera functions, such as digital refocusing, depth estimation, HDR imaging, can be available. In addition to the design of the LFC, we also proposed different hardware-compatible light field data processing algorithms, and implemented special processors based on these algorithms to reduce the total execution time.
LFC Design
[1-1] C. W. Chang, M. H. Chen, K. C. Chen, C. M. Yeh, and Y. C. Lu, "Mask design for pinhole-array-based hand-held flight field cameras with applications in depth estimation," in 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2016, pp. 1-4.
Digital Refocusing
[2-1] C. C. Chen, Y. C. Lu, and M. S. Su, "Light field based digital refocusing using a DSLR camera with a pinhole array mask," in 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, 2010, pp. 754-757.[2-2] C. W. Chang, M. R. Chen, P. H. Hsu, and Y. C. Lu, "A pixel-based depth estimation algorithm and its hardware implementation for 4-D light field data," in 2014 IEEE International Symposium on Circuits and Systems, 2014, pp. 786-789.[2-3] M. R. Chen, H. W. Liu, Y. H. Lin, and Y. C. Lu, "A special-purpose processor for FFT-based digital refocusing using 4-D light field data," in 2019 IEEE International Symposium on Circuits and Systems, 2019. (To appear)
HDR Imaging
[3-1] P. H. Hsu, Y. M. Yeh, C. M. Yeh, and Y. C. Lu, "A high dynamic range light field camera and its built-in data processor design," in 2018 IEEE International Symposium on Circuits and Systems, 2018, pp. 1-5.
Depth Estimation
[4-1] C. C. Chen, S. C. F. Chiang, X. X. Huang, M. S. Su, and Y. C. Lu, "Depth estimation of light field data from pinhole-masked DSLR cameras," in 2010 IEEE International Conference on Image Processing, 2010, pp. 1769-1772.[4-2] S. C. F. Chiang, P. H. Hsu, and Y. C. Lu, "Light field data processor design for depth estimation using confidence-assisted disparities," in 2013 IEEE International SOC Conference, 2013, pp. 129-133.[4-3] See [2-2] above[4-4] M. H. Chen, C. F. Chiang, and Y. C. Lu, "Depth estimation for hand-held light field cameras under low light conditions," in 2014 International Conference on 3D Imaging, 2014, pp. 1-4.[4-5] Y. H. Chen, N. C. Chen, Y. H. Kao, Y. C. Li, and Y. C. Lu, "Queue-based segmentation algorithm for refining depth maps in light field camera applications," in 2016 IEEE 5th Global Conference on Consumer Electronics, 2016, pp. 1-2.
Light Field Data Compression
[5-1] C. L. Kuo, Y. Y. Lin, and Y. C. Lu, "Analysis and implementation of Discrete Wavelet Transform for compressing four-dimensional light field data," in 2013 IEEE International SOC Conference, 2013, pp. 134-138.[5-2] Y. M. Yeh, C. M. Yeh, Y. Y. Tseng, and Y. C. Lu, "An orthogonal matching pursuit processor for sparse-representation-based light field data compression," in 2016 IEEE 5th Global Conference on Consumer Electronics, 2016, pp. 1-2.
Google Sites
Report abuse