1
|
Hossain MB, Shinde RK, Imtiaz SM, Hossain FMF, Jeon SH, Kwon KC, Kim N. Swin Transformer and the Unet Architecture to Correct Motion Artifacts in Magnetic Resonance Image Reconstruction. Int J Biomed Imaging 2024; 2024:8972980. [PMID: 38725808 PMCID: PMC11081754 DOI: 10.1155/2024/8972980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Revised: 04/08/2024] [Accepted: 04/23/2024] [Indexed: 05/12/2024] Open
Abstract
We present a deep learning-based method that corrects motion artifacts and thus accelerates data acquisition and reconstruction of magnetic resonance images. The novel model, the Motion Artifact Correction by Swin Network (MACS-Net), uses a Swin transformer layer as the fundamental block and the Unet architecture as the neural network backbone. We employ a hierarchical transformer with shifted windows to extract multiscale contextual features during encoding. A new dual upsampling technique is employed to enhance the spatial resolutions of feature maps in the Swin transformer-based decoder layer. A raw magnetic resonance imaging dataset is used for network training and testing; the data contain various motion artifacts with ground truth images of the same subjects. The results were compared to six state-of-the-art MRI image motion correction methods using two types of motions. When motions were brief (within 5 s), the method reduced the average normalized root mean square error (NRMSE) from 45.25% to 17.51%, increased the mean structural similarity index measure (SSIM) from 79.43% to 91.72%, and increased the peak signal-to-noise ratio (PSNR) from 18.24 to 26.57 dB. Similarly, when motions were extended from 5 to 10 s, our approach decreased the average NRMSE from 60.30% to 21.04%, improved the mean SSIM from 33.86% to 90.33%, and increased the PSNR from 15.64 to 24.99 dB. The anatomical structures of the corrected images and the motion-free brain data were similar.
Collapse
Affiliation(s)
- Md. Biddut Hossain
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Rupali Kiran Shinde
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Shariar Md Imtiaz
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - F. M. Fahmid Hossain
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Seok-Hee Jeon
- Department of Electronics Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon 22012, Republic of Korea
| | - Ki-Chul Kwon
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Nam Kim
- Department of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| |
Collapse
|
2
|
Hossain MB, Shinde RK, Oh S, Kwon KC, Kim N. A Systematic Review and Identification of the Challenges of Deep Learning Techniques for Undersampled Magnetic Resonance Image Reconstruction. Sensors (Basel) 2024; 24:753. [PMID: 38339469 PMCID: PMC10856856 DOI: 10.3390/s24030753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 01/05/2024] [Accepted: 01/22/2024] [Indexed: 02/12/2024]
Abstract
Deep learning (DL) in magnetic resonance imaging (MRI) shows excellent performance in image reconstruction from undersampled k-space data. Artifact-free and high-quality MRI reconstruction is essential for ensuring accurate diagnosis, supporting clinical decision-making, enhancing patient safety, facilitating efficient workflows, and contributing to the validity of research studies and clinical trials. Recently, deep learning has demonstrated several advantages over conventional MRI reconstruction methods. Conventional methods rely on manual feature engineering to capture complex patterns and are usually computationally demanding due to their iterative nature. Conversely, DL methods use neural networks with hundreds of thousands of parameters and automatically learn relevant features and representations directly from the data. Nevertheless, there are some limitations to DL-based techniques concerning MRI reconstruction tasks, such as the need for large, labeled datasets, the possibility of overfitting, and the complexity of model training. Researchers are striving to develop DL models that are more efficient, adaptable, and capable of providing valuable information for medical practitioners. We provide a comprehensive overview of the current developments and clinical uses by focusing on state-of-the-art DL architectures and tools used in MRI reconstruction. This study has three objectives. Our main objective is to describe how various DL designs have changed over time and talk about cutting-edge tactics, including their advantages and disadvantages. Hence, data pre- and post-processing approaches are assessed using publicly available MRI datasets and source codes. Secondly, this work aims to provide an extensive overview of the ongoing research on transformers and deep convolutional neural networks for rapid MRI reconstruction. Thirdly, we discuss several network training strategies, like supervised, unsupervised, transfer learning, and federated learning for rapid and efficient MRI reconstruction. Consequently, this article provides significant resources for future improvement of MRI data pre-processing and fast image reconstruction.
Collapse
Affiliation(s)
- Md. Biddut Hossain
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Rupali Kiran Shinde
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Sukhoon Oh
- Research Equipment Operation Department, Korea Basic Science Institute, Cheongju-si 28119, Chungcheongbuk-do, Republic of Korea;
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| |
Collapse
|
3
|
Erdenebat MU, Amgalan T, Khuderchuluun A, Nam OS, Jeon SH, Kwon KC, Kim N. Comprehensive High-Quality Three-Dimensional Display System Based on a Simplified Light-Field Image Acquisition Method and a Full-Connected Deep Neural Network. Sensors (Basel) 2023; 23:6245. [PMID: 37514540 PMCID: PMC10386739 DOI: 10.3390/s23146245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 07/30/2023]
Abstract
We propose a high-quality, three-dimensional display system based on a simplified light field image acquisition method, and a custom-trained full-connected deep neural network is proposed. The ultimate goal of the proposed system is to acquire and reconstruct the light field images with possibly the most elevated quality from the real-world objects in a general environment. A simplified light field image acquisition method acquires the three-dimensional information of natural objects in a simple way, with high-resolution/high-quality like multicamera-based methods. We trained a full-connected deep neural network model to output desired viewpoints of the object with the same quality. The custom-trained instant neural graphics primitives model with hash encoding output the overall desired viewpoints of the object within the acquired viewing angle in the same quality, based on the input perspectives, according to the pixel density of a display device and lens array specifications within the significantly short processing time. Finally, the elemental image array was rendered through the pixel re-arrangement from the entire viewpoints to visualize the entire field-of-view and re-constructed as a high-quality three-dimensional visualization on the integral imaging display. The system was implemented successfully, and the displayed visualizations and corresponding evaluated results confirmed that the proposed system offers a simple and effective way to acquire light field images from real objects with high-resolution and present high-quality three-dimensional visualization on the integral imaging display system.
Collapse
Affiliation(s)
- Munkh-Uchral Erdenebat
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| | - Tuvshinjargal Amgalan
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| | - Anar Khuderchuluun
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| | - Oh-Seung Nam
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| | - Seok-Hee Jeon
- Department of Electronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea
| |
Collapse
|
4
|
Hossain MB, Kwon KC, Shinde RK, Imtiaz SM, Kim N. A Hybrid Residual Attention Convolutional Neural Network for Compressed Sensing Magnetic Resonance Image Reconstruction. Diagnostics (Basel) 2023; 13:diagnostics13071306. [PMID: 37046524 PMCID: PMC10093476 DOI: 10.3390/diagnostics13071306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 03/20/2023] [Accepted: 03/29/2023] [Indexed: 04/03/2023] Open
Abstract
We propose a dual-domain deep learning technique for accelerating compressed sensing magnetic resonance image reconstruction. An advanced convolutional neural network with residual connectivity and an attention mechanism was developed for frequency and image domains. First, the sensor domain subnetwork estimates the unmeasured frequencies of k-space to reduce aliasing artifacts. Second, the image domain subnetwork performs a pixel-wise operation to remove blur and noisy artifacts. The skip connections efficiently concatenate the feature maps to alleviate the vanishing gradient problem. An attention gate in each decoder layer enhances network generalizability and speeds up image reconstruction by eliminating irrelevant activations. The proposed technique reconstructs real-valued clinical images from sparsely sampled k-spaces that are identical to the reference images. The performance of this novel approach was compared with state-of-the-art direct mapping, single-domain, and multi-domain methods. With acceleration factors (AFs) of 4 and 5, our method improved the mean peak signal-to-noise ratio (PSNR) to 8.67 and 9.23, respectively, compared with the single-domain Unet model; similarly, our approach increased the average PSNR to 3.72 and 4.61, respectively, compared with the multi-domain W-net. Remarkably, using an AF of 6, it enhanced the PSNR by 9.87 ± 1.55 and 6.60 ± 0.38 compared with Unet and W-net, respectively.
Collapse
|
5
|
Kwon KH, Erdenebat MU, Kim N, Khuderchuluun A, Imtiaz SM, Kim MY, Kwon KC. High-Quality 3D Visualization System for Light-Field Microscopy with Fine-Scale Shape Measurement through Accurate 3D Surface Data. Sensors (Basel) 2023; 23:2173. [PMID: 36850772 PMCID: PMC9967073 DOI: 10.3390/s23042173] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 02/10/2023] [Accepted: 02/11/2023] [Indexed: 06/18/2023]
Abstract
We propose a light-field microscopy display system that provides improved image quality and realistic three-dimensional (3D) measurement information. Our approach acquires both high-resolution two-dimensional (2D) and light-field images of the specimen sequentially. We put forward a matting Laplacian-based depth estimation algorithm to obtain nearly realistic 3D surface data, allowing the calculation of depth data, which is relatively close to the actual surface, and measurement information from the light-field images of specimens. High-reliability area data of the focus measure map and spatial affinity information of the matting Laplacian are used to estimate nearly realistic depths. This process represents a reference value for the light-field microscopy depth range that was not previously available. A 3D model is regenerated by combining the depth data and the high-resolution 2D image. The element image array is rendered through a simplified direction-reversal calculation method, which depends on user interaction from the 3D model and is displayed on the 3D display device. We confirm that the proposed system increases the accuracy of depth estimation and measurement and improves the quality of visualization and 3D display images.
Collapse
Affiliation(s)
- Ki Hoon Kwon
- School of Electronic and Electrical Engineering, Kyungpook National University, Daegu 41566, Republic of Korea
| | - Munkh-Uchral Erdenebat
- School of Information and Communication Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea
| | - Anar Khuderchuluun
- School of Information and Communication Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea
| | - Shariar Md Imtiaz
- School of Information and Communication Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea
| | - Min Young Kim
- School of Electronic and Electrical Engineering, Kyungpook National University, Daegu 41566, Republic of Korea
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea
| |
Collapse
|
6
|
Hossain MB, Kwon KC, Imtiaz SM, Nam OS, Jeon SH, Kim N. De-Aliasing and Accelerated Sparse Magnetic Resonance Image Reconstruction Using Fully Dense CNN with Attention Gates. Bioengineering (Basel) 2022; 10:bioengineering10010022. [PMID: 36671594 PMCID: PMC9854709 DOI: 10.3390/bioengineering10010022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 12/19/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022]
Abstract
When sparsely sampled data are used to accelerate magnetic resonance imaging (MRI), conventional reconstruction approaches produce significant artifacts that obscure the content of the image. To remove aliasing artifacts, we propose an advanced convolutional neural network (CNN) called fully dense attention CNN (FDA-CNN). We updated the Unet model with the fully dense connectivity and attention mechanism for MRI reconstruction. The main benefit of FDA-CNN is that an attention gate in each decoder layer increases the learning process by focusing on the relevant image features and provides a better generalization of the network by reducing irrelevant activations. Moreover, densely interconnected convolutional layers reuse the feature maps and prevent the vanishing gradient problem. Additionally, we also implement a new, proficient under-sampling pattern in the phase direction that takes low and high frequencies from the k-space both randomly and non-randomly. The performance of FDA-CNN was evaluated quantitatively and qualitatively with three different sub-sampling masks and datasets. Compared with five current deep learning-based and two compressed sensing MRI reconstruction techniques, the proposed method performed better as it reconstructed smoother and brighter images. Furthermore, FDA-CNN improved the mean PSNR by 2 dB, SSIM by 0.35, and VIFP by 0.37 compared with Unet for the acceleration factor of 5.
Collapse
Affiliation(s)
- Md. Biddut Hossain
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Shariar Md Imtiaz
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Oh-Seung Nam
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
| | - Seok-Hee Jeon
- Department of Electronics Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon 22012, Gyeonggi-do, Republic of Korea
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea
- Correspondence: ; Tel.: +82-043-261-2482
| |
Collapse
|
7
|
Imtiaz SM, Kwon KC, Hossain MB, Alam MS, Jeon SH, Kim N. Depth Estimation for Integral Imaging Microscopy Using a 3D-2D CNN with a Weighted Median Filter. Sensors (Basel) 2022; 22:s22145288. [PMID: 35890968 PMCID: PMC9316143 DOI: 10.3390/s22145288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 07/07/2022] [Accepted: 07/13/2022] [Indexed: 11/16/2022]
Abstract
This study proposes a robust depth map framework based on a convolutional neural network (CNN) to calculate disparities using multi-direction epipolar plane images (EPIs). A combination of three-dimensional (3D) and two-dimensional (2D) CNN-based deep learning networks is used to extract the features from each input stream separately. The 3D convolutional blocks are adapted according to the disparity of different directions of epipolar images, and 2D-CNNs are employed to minimize data loss. Finally, the multi-stream networks are merged to restore the depth information. A fully convolutional approach is scalable, which can handle any size of input and is less prone to overfitting. However, there is some noise in the direction of the edge. A weighted median filtering (WMF) is used to acquire the boundary information and improve the accuracy of the results to overcome this issue. Experimental results indicate that the suggested deep learning network architecture outperforms other architectures in terms of depth estimation accuracy.
Collapse
Affiliation(s)
- Shariar Md Imtiaz
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Korea; (S.M.I.); (K.-C.K.); (M.B.H.)
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Korea; (S.M.I.); (K.-C.K.); (M.B.H.)
| | - Md. Biddut Hossain
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Korea; (S.M.I.); (K.-C.K.); (M.B.H.)
| | - Md. Shahinur Alam
- VL2 Center, Gallaudet University, 800 Florida Avenue NE, Washington, DC 20002, USA;
| | - Seok-Hee Jeon
- Department of Electronics Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon-si 22012, Gyeonggi-do, Korea;
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Korea; (S.M.I.); (K.-C.K.); (M.B.H.)
- Correspondence: ; Tel.: +82-043-261-2482
| |
Collapse
|
8
|
Kwon KC, Erdenebat MU, Khuderchuluun A, Kwon KH, Kim MY, Kim N. High-quality 3D display system for an integral imaging microscope using a simplified direction-inversed computation based on user interaction. Opt Lett 2021; 46:5079-5082. [PMID: 34653119 DOI: 10.1364/ol.436201] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 09/13/2021] [Indexed: 06/13/2023]
Abstract
We propose and implement a high-quality three-dimensional (3D) display system for an integral imaging microscope using a simplified direction-inversed computation method based on user interaction. A model of the specimen is generated from the estimated depth information (via the convolutional neural network-based algorithm), the quality of the model is defined by the high-resolution two-dimensional image. The new elemental image arrays are generated from the models via a simplified direction-inversed computation method according to the user interaction and directly displayed on the display device. A high-quality 3D visualization of the specimen is reconstructed and displayed while the lens array is placed in front of the display device. The user interaction enables more viewpoints of the specimen to be reconstructed by the proposed system, within the basic viewing zone. Remarkable quality improvement is confirmed through quantitative evaluations of the experimental results.
Collapse
|
9
|
Darkhanbaatar N, Erdenebat MU, Shin CW, Kwon KC, Lee KY, Baasantseren G, Kim N. Three-dimensional see-through augmented-reality display system using a holographic micromirror array. Appl Opt 2021; 60:7545-7551. [PMID: 34613220 DOI: 10.1364/ao.428364] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 07/09/2021] [Indexed: 06/13/2023]
Abstract
It is difficult to find the micromirror array with desired specifications for augmented-reality displays, and the custom fabricating methods are complicated and unstable. We propose a novel, to our knowledge, three-dimensional see-through augmented-reality display system using the holographic micromirror array. Unlike the conventional holographic waveguide-type augmented-reality displays, the proposed system utilizes the holographic micromirror array as an in-coupler, without any additional elements. The holographic micromirror array is fabricated through the simple, effective, and stable method of applying the total internal reflection-based hologram recording using a dual-prism. The optical mirror and microlens array are set as references, and the specifications can be customized. It reconstructs a three-dimensional image from a displayed elemental image set without using any additional device, and the user can observe a three-dimensional virtual image while viewing the real-world objects. Thus, the principal advantages of the existing holographic waveguide-type augmented-reality system are retained. An optical experiment confirmed that the proposed system displays three-dimensional images exploiting the augmented-reality system simply and effectively.
Collapse
|
10
|
Shin CW, Wu HY, Kwon KC, Piao YL, Lee KY, Gil SK, Kim N. Diffraction efficiency enhancement and optimization in full-color HOE using the inhibition characteristics of the photopolymer. Opt Express 2021; 29:1175-1187. [PMID: 33726338 DOI: 10.1364/oe.413370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 12/18/2020] [Indexed: 06/12/2023]
Abstract
A novel and effective simultaneous recording method, to the best of our knowledge, is proposed for improving the diffraction efficiency and uniformity of full-color holographic optical elements (HOE) using the Bayfol HX102 photopolymer. To improve the diffraction efficiency of a full-color HOE, it is important to find the optimal recording beam intensity taking into account the initial and late responses of the medium. The range of optimal beam intensity for recording full-color HOE can be found experimentally by analyzing the inhibition period and response characteristics of the recording medium for three wavelengths. Through this method, a full-color HOE with an average diffraction efficiency of about 56.81% and a standard deviation of about 1.7% was implemented in a single layer photopolymer.
Collapse
|
11
|
Piao YL, Erdenebat MU, Zhao Y, Kwon KC, Piao ML, Kang H, Kim N. Improving the quality of full-color holographic three-dimensional displays using depth-related multiple wavefront recording planes with uniform active areas. Appl Opt 2020; 59:5179-5188. [PMID: 32543538 DOI: 10.1364/ao.387377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Accepted: 04/08/2020] [Indexed: 06/11/2023]
Abstract
In this paper, a depth-related uniform multiple wavefront recording plane (UM-WRP) method is proposed for enhancing the image quality of point cloud-based holograms. Conventional multiple WRP methods, based on full-color computer-generated holograms, experience a color uniformity problem caused by intensity distributions. To solve this problem, the proposed method generates depth-related WRPs to enhance color uniformity, thereby accelerating hologram generation using a uniform active area. The aim is to calculate depth-related WRPs with designed active area sizes that then propagate to the hologram. Compared with conventional multiple WRP methods, reconstructed images have significantly improved quality, as confirmed by numerical simulations and optical experiments.
Collapse
|
12
|
Sifatul Islam M, Piao YL, Zhao Y, Kwon KC, Cho E, Kim N. Max-depth-range technique for faster full-color hologram generation. Appl Opt 2020; 59:3156-3164. [PMID: 32400598 DOI: 10.1364/ao.383946] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Accepted: 02/16/2020] [Indexed: 06/11/2023]
Abstract
In this paper, a max-depth-range method is proposed to determine the optimum length of depth range for faster generation of full-color holograms. For each color channel, objects are divided by a fixed length to create a temporary depth range, and the wavefront recording plane (WRP) is placed in the middle of all layers within the temporary depth range. The proposed method is used to calculate full-color holograms significantly faster than a conventional multiple-WRP method but with almost the same reconstructed image quality. The feasibility of the proposed method was confirmed using numerical and optical experiments for various scenes containing multiple real objects.
Collapse
|
13
|
Zhao Y, Kwon KC, Erdenebat MU, Jeon SH, Piao ML, Kim N. Implementation of full-color holographic system using non-uniformly sampled 2D images and compressed point cloud gridding. Opt Express 2019; 27:29746-29758. [PMID: 31684232 DOI: 10.1364/oe.27.029746] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Accepted: 09/14/2019] [Indexed: 06/10/2023]
Abstract
A multiple-camera holographic system using non-uniformly sampled 2D images and compressed point cloud gridding (C-PCG) is suggested. High-quality, digital single-lens reflex cameras are used to acquire the depth and color information from real scenes; these are then virtually reconstructed by the uniform point cloud using a non-uniform sampling method. The C-PCG method is proposed to generate efficient depth grids by classifying groups of object points with the same depth values in the red, green, and blue channels. Holograms are obtained by applying fast Fourier transform diffraction calculations to the grids. Compared to wave-front recording plane methods, the quality of the reconstructed images is substantially better, and the computational complexity is dramatically reduced. The feasibility of our method is confirmed both numerically and optically.
Collapse
|
14
|
Piao YL, Erdenebat MU, Kwon KC, Gil SK, Kim N. Chromatic-dispersion-corrected full-color holographic display using directional-view image scaling method. Appl Opt 2019; 58:A120-A127. [PMID: 30873968 DOI: 10.1364/ao.58.00a120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Accepted: 11/19/2018] [Indexed: 06/09/2023]
Abstract
A novel directional-view image scaling method that corrects chromatic dispersion and enhances the quality of three-dimensional (3D) images reconstructed by a full-color holographic display system is proposed. When the 3D information of the real scene is acquired through the integral imaging pickup method, the orthographic projection image is reconstructed. Then, each directional-view image is separated and synthesized onto the computer-generated hologram. To correct the chromatic dispersion of the full-color holographic 3D display, each directional-view image is scaled depending on the relation between the different wavelengths of single-channel holograms and resolutions of the sub-holograms. According to the optical experimental results, it can be concluded that the proposed method is an effective way of producing full-color holographic images from an orthographic projection image through a simple process.
Collapse
|
15
|
Zhao Y, Kwon KC, Erdenebat MU, Islam MS, Jeon SH, Kim N. Quality enhancement and GPU acceleration for a full-color holographic system using a relocated point cloud gridding method. Appl Opt 2018; 57:4253-4262. [PMID: 29791403 DOI: 10.1364/ao.57.004253] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2018] [Accepted: 04/22/2018] [Indexed: 06/08/2023]
Abstract
The calculation of realistic full-color holographic displays is hindered by the high computational cost. Previously, we suggested a point cloud gridding (PCG) method to calculate monochrome holograms of real objects. In this research, a relocated point cloud gridding (R-PCG) method is proposed to enhance the reconstruction quality and accelerate the calculation speed in GPU for a full-color holographic system. We use a depth camera to acquire depth and color information from the real scene then reconstruct the point cloud model virtually. The R-PCG method allows us to classify groups of object points with the same depth values into grids in the red, green, and blue (RGB) channels. Computer-generated holograms (CGHs) are obtained by applying a fast Fourier transform (FFT) diffraction calculation to the grids. The feasibility of the R-PCG method is confirmed by numerical and optical reconstruction.
Collapse
|
16
|
Kwon KC, Im CY, Seo KY, Nam SM, Erdenebat MU, Shim YB, Han YG, Kim N. Three-dimensional visualization system for ophthalmic microscopes using visible light and near-infrared illumination. J Biophotonics 2018; 11:e201600268. [PMID: 28700122 DOI: 10.1002/jbio.201600268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2016] [Revised: 06/19/2017] [Accepted: 06/20/2017] [Indexed: 06/07/2023]
Abstract
In this paper, we describe a three-dimensional visualization system for ophthalmic microscopes that is aimed at microsurgery without the eyepieces. A three-dimensional visualization system for ophthalmic microscopes using the mixed illumination, which consists of visible light and near-infrared illumination, is established in order to acquire more exact information of object and reduce the amount of light irradiated to the patients, and its usage in microsurgery without eyepieces is herein described. A custom-designed stereoscopic three-dimensional display which is manufactured for the convenience of the surgeons during the long-time surgery, is connected directly to the camera of the ophthalmic microscope in order to eliminate the discomfort of eyepieces to the surgeon and signal delay between the camera, mounted on the microscope, and display device for surgeon. The main features of the established system are the signal delay-free for surgeon and the low level of illumination for patient. In particular, it could significantly reduce the amount of light irradiated on a patient's eye via NIR illumination. Upon comparison with the conventional system during clinical ophthalmology trials, this system is confirmed to require almost the same operation time and reduced discomfort and eyestrain during long periods of observation.
Collapse
Affiliation(s)
- Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju, South Korea
| | | | - Kyoung Yul Seo
- College of Medicine, Yonsei University, Seoul, South Korea
| | - Sang Min Nam
- Department of Ophthalmology, Bundang Cha Medical Center, Cha University, Seongnam, South Korea
| | - Munkh-Uchral Erdenebat
- School of Information and Communication Engineering, Chungbuk National University, Cheongju, South Korea
| | - Young Bo Shim
- Department of Physics and the Research Institute for Convergence of Basic Science, Hanyang University, Seoul, South Korea
| | - Young-Geun Han
- Department of Physics and the Research Institute for Convergence of Basic Science, Hanyang University, Seoul, South Korea
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju, South Korea
| |
Collapse
|
17
|
Kwon KC, Erdenebat MU, Lim YT, Joo KI, Park MK, Park H, Jeong JR, Kim HR, Kim N. Enhancement of the depth-of-field of integral imaging microscope by using switchable bifocal liquid-crystalline polymer micro lens array. Opt Express 2017; 25:30503-30512. [PMID: 29221078 DOI: 10.1364/oe.25.030503] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2017] [Accepted: 11/15/2017] [Indexed: 06/07/2023]
Abstract
An integral imaging microscopy (IIM) system with improved depth-of-field (DoF) using a custom-designed bifocal polarization-dependent liquid-crystalline polymer micro lens array (LCP-MLA) is proposed. The implemented MLA has improved electro-optical properties such as a small focal ratio, high fill factor, low driving voltage, and fast switching speed, utilizing a well-aligned reactive mesogen on the imprinted reverse shape of the lens and a polarization switching layer. A bifocal MLA switches its focal length according to the polarization angle and acquires different DoF information of the specimen. After two elemental image arrays are captured, the depth-slices are reconstructed and combined to provide a widened DoF. The fabricated bifocal MLA consists of two identical polarization-dependent LCP-MLAs with 1.6 mm and f/16 focal ratio. Our experimental results confirmed that the proposed system improves the DoF of IIM without the need for mechanical manipulation.
Collapse
|
18
|
Erdenebat MU, Kim BJ, Piao YL, Park SY, Kwon KC, Piao ML, Yoo KH, Kim N. Three-dimensional image acquisition and reconstruction system on a mobile device based on computer-generated integral imaging. Appl Opt 2017; 56:7796-7802. [PMID: 29047770 DOI: 10.1364/ao.56.007796] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Accepted: 08/09/2017] [Indexed: 06/07/2023]
Abstract
A mobile three-dimensional image acquisition and reconstruction system using a computer-generated integral imaging technique is proposed. A depth camera connected to the mobile device acquires the color and depth data of a real object simultaneously, and an elemental image array is generated based on the original three-dimensional information for the object, with lens array specifications input into the mobile device. The three-dimensional visualization of the real object is reconstructed on the mobile display through optical or digital reconstruction methods. The proposed system is implemented successfully and the experimental results certify that the system is an effective and interesting method of displaying real three-dimensional content on a mobile device.
Collapse
|
19
|
Kwon KC, Lim YT, Shin CW, Erdenebat MU, Hwang JM, Kim N. Enhanced depth-of-field of an integral imaging microscope using a bifocal holographic optical element-micro lens array. Opt Lett 2017; 42:3209-3212. [PMID: 28809910 DOI: 10.1364/ol.42.003209] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2017] [Accepted: 07/16/2017] [Indexed: 06/07/2023]
Abstract
We propose and implement an integral imaging microscope with extended depth-of-field (DoF) using a bifocal holographic micro lens array (MLA). The properties of the two MLAs are switched via peristrophic multiplexing, where different properties of the MLA are recorded onto the single holographic optical element (HOE). The recorded MLA properties are perpendicular to each other: after the first mode is recorded, the HOE is rotated by 90° clockwise, and the second mode is recorded. The experimental results confirm that the DoF of the integral imaging microscopy system is extended successfully by using the bifocal MLA.
Collapse
|
20
|
Zhao Y, Kwon KC, Piao YL, Jeon SH, Kim N. Depth-layer weighted prediction method for a full-color polygon-based holographic system with real objects. Opt Lett 2017; 42:2599-2602. [PMID: 28957294 DOI: 10.1364/ol.42.002599] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2017] [Accepted: 05/28/2017] [Indexed: 06/07/2023]
Abstract
We propose a full-color polygon-based holographic system for real three-dimensional (3D) objects using a depth-layer weighted prediction method. The proposed system is composed of four main stages: acquisition, preprocessing, hologram generation, and reconstruction. In the preprocessing stage, the point cloud model is separated into red, green, and blue channels with depth-layer weighted prediction. The color component values are characterized based on the depth information of the real object, then color prediction is derived from the measurement data. The computer-generated holograms reconstruct 3D full-color images with a strong sensation of depth resulting from the polygon approach. The feasibility of the proposed method was confirmed by numerical and optical reconstruction.
Collapse
|
21
|
Song MH, Jeong JS, Erdenebat MU, Kwon KC, Kim N, Yoo KH. Integral imaging system using an adaptive lens array. Appl Opt 2016; 55:6399-6403. [PMID: 27534485 DOI: 10.1364/ao.55.006399] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We produced an adaptive lens array composed of multiple flat lens arrays arranged in a curved shape with an adjustable radius of curvature, in order to overcome the hardware problem of the conventional flat or curved lens array-based systems. The manufactured adaptive lens array is applied to an integral imaging system. The gap mismatch that occurs when using a curved lens array is resolved by computing the exact display mapping position of element images through each lens. The results of the experiment demonstrate that the adaptive lens array-based integral imaging system successfully generated elemental images according to the curvature transformation of the adaptive lens array, and they were reconstructed as 3D images.
Collapse
|
22
|
Kwon KC, Erdenebat MU, Alam MA, Lim YT, Kim KG, Kim N. Integral imaging microscopy with enhanced depth-of-field using a spatial multiplexing. Opt Express 2016; 24:2072-2083. [PMID: 26906782 DOI: 10.1364/oe.24.002072] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
A depth-of-field enhancement method for integral imaging microscopy system using a spatial multiplexing structure consisting of a beamsplitter with dual video channels and micro lens arrays is proposed. A computational integral imaging reconstruction algorithm generates two sets of depth-sliced images for the acquired depth information of the captured elemental image arrays and the well-focused depth-slices of both image sets are combined where each is focused on a different depth plane of the specimen. A prototype is implemented, and the experimental results demonstrate that the depth-of-field of the reconstructed images in the proposed integral imaging microscopy is significantly increased compared with conventional integral imaging microscopy systems.
Collapse
|
23
|
Piao ML, Kwon KC, Kang HJ, Lee KY, Kim N. Full-color holographic diffuser using time-scheduled iterative exposure. Appl Opt 2015; 54:5252-5259. [PMID: 26192691 DOI: 10.1364/ao.54.005252] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
A compact wavelength multiplexing technique is proposed and experimentally investigated to improve the efficiency of a full-color holographic diffuser using photopolymer. The exposure responses of a monochromatic hologram and a three wavelength multiplexed hologram recorded in photopolymer film are presented. The time-scheduled exposure energies at wavelengths of 633, 532, and 473 nm were chosen to optimize the uniform diffraction efficiency of the wavelength multiplexed hologram. These three wavelength iterative sequences of exposures are applied to achieve a specific color balance for a multicolor holographic diffuser. The experimental results confirm that the fabrication method is well suited to the manufacture of holographic diffusers for full-color display applications.
Collapse
|
24
|
Kwon KC, Jeong JS, Erdenebat MU, Piao YL, Yoo KH, Kim N. Resolution-enhancement for an orthographic-view image display in an integral imaging microscope system. Biomed Opt Express 2015; 6:736-46. [PMID: 25798299 PMCID: PMC4361429 DOI: 10.1364/boe.6.000736] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2014] [Revised: 01/12/2015] [Accepted: 02/03/2015] [Indexed: 05/09/2023]
Abstract
Due to the limitations of micro lens arrays and camera sensors, images on display devices through the integral imaging microscope systems have been suffering for a low-resolution. In this paper, a resolution-enhanced orthographic-view image display method for integral imaging microscopy is proposed and demonstrated. Iterative intermediate-view reconstructions are performed based on bilinear interpolation using neighborhood elemental image information, and a graphics processing unit parallel processing algorithm is applied for fast image processing. The proposed method is verified experimentally and the effective results are presented in this paper.
Collapse
Affiliation(s)
- Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| | - Ji-Seong Jeong
- Department of Digital Informatics and Convergence, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| | - Munkh-Uchral Erdenebat
- School of Information and Communication Engineering, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| | - Yan-Ling Piao
- School of Information and Communication Engineering, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| | - Kwan-Hee Yoo
- Department of Digital Informatics and Convergence, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 362-763,
South Korea
| |
Collapse
|
25
|
Erdenebat MU, Kwon KC, Dashdavaa E, Piao YL, Yoo KH, Baasantseren G, Kim Y, Kim N. Advanced 360-Degree Integral-Floating Display Using a Hidden Point Removal Operator and a Hexagonal Lens Array. ACTA ACUST UNITED AC 2014. [DOI: 10.3807/josk.2014.18.6.706] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
26
|
Kwon KC, Jeong JS, Erdenebat MU, Lim YT, Yoo KH, Kim N. Real-time interactive display for integral imaging microscopy. Appl Opt 2014; 53:4450-9. [PMID: 25090064 DOI: 10.1364/ao.53.004450] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2014] [Accepted: 05/29/2014] [Indexed: 05/24/2023]
Abstract
A real-time interactive orthographic-view image display of integral imaging (II) microscopy that includes the generation of intermediate-view elemental images (IVEIs) for resolution enhancement is proposed. Unlike the conventional II microscopes, parallel processing through a graphics processing unit is required for real-time display that generates the IVEIs and interactive orthographic-view images in high speed, according to the user interactive input. The real-time directional-view display for the specimen for which 3D information is acquired through II microscopy is successfully demonstrated by using resolution-enhanced elemental image arrays. A user interactive feature is also satisfied in the proposed real-time interactive display for II microscopy.
Collapse
|
27
|
Erdenebat MU, Kwon KC, Yoo KH, Baasantseren G, Park JH, Kim ES, Kim N. Vertical viewing angle enhancement for the 360 degree integral-floating display using an anamorphic optic system. Opt Lett 2014; 39:2326-2329. [PMID: 24978984 DOI: 10.1364/ol.39.002326] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We propose a 360 degree integral-floating display with an enhanced vertical viewing angle. The system projects two-dimensional elemental image arrays via a high-speed digital micromirror device projector and reconstructs them into 3D perspectives with a lens array. Double floating lenses relate initial 3D perspectives to the center of a vertically curved convex mirror. The anamorphic optic system tailors the initial 3D perspectives horizontally and vertically disperse light rays more widely. By the proposed method, the entire 3D image provides both monocular and binocular depth cues, a full-parallax demonstration with high-angular ray density and an enhanced vertical viewing angle.
Collapse
|
28
|
Kim DH, Erdenebat MU, Kwon KC, Jeong JS, Lee JW, Kim KA, Kim N, Yoo KH. Real-time 3D display system based on computer-generated integral imaging technique using enhanced ISPP for hexagonal lens array. Appl Opt 2013; 52:8411-8. [PMID: 24513846 DOI: 10.1364/ao.52.008411] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2013] [Accepted: 11/04/2013] [Indexed: 05/24/2023]
Abstract
This paper proposes an open computer language (OpenCL) parallel processing method to generate the elemental image arrays (EIAs) for hexagonal lens array from a three-dimensional (3D) object such as a volume data. Hexagonal lens array has a higher fill factor compared to the rectangular lens array case; however, each pixel of an elemental image should be determined to belong to the single hexagonal lens. Therefore, generation for the entire EIA requires very large computations. The proposed method reduces processing time for the EIAs for a given hexagonal lens array. By using the proposed image space parallel processing (ISPP) method, it can enhance the processing speed that generates the 3D display of real-time interactive integral imaging for hexagonal lens array. In our experiment, we implemented the EIAs for hexagonal lens array in real-time and obtained a good processing time for a large of volume data for multiple cases of lens arrays.
Collapse
|
29
|
Li G, Kwon KC, Shin GH, Jeong JS, Yoo KH, Kim N. Simplified Integral Imaging Pickup Method for Real Objects Using a Depth Camera. ACTA ACUST UNITED AC 2012. [DOI: 10.3807/josk.2012.16.4.381] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
30
|
Erdenebat MU, Baasantseren G, Kim N, Kwon KC, Byeon J, Yoo KH, Park JH. Integral-floating Display with 360 Degree Horizontal Viewing Angle. ACTA ACUST UNITED AC 2012. [DOI: 10.3807/josk.2012.16.4.365] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
31
|
Kwon KC, Park C, Erdenebat MU, Jeong JS, Choi JH, Kim N, Park JH, Lim YT, Yoo KH. High speed image space parallel processing for computer-generated integral imaging system. Opt Express 2012; 20:732-40. [PMID: 22274418 DOI: 10.1364/oe.20.000732] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
In an integral imaging display, the computer-generated integral imaging method has been widely used to create the elemental images from a given three-dimensional object data. Long processing time, however, has been problematic especially when the three-dimensional object data set or the number of the elemental lenses are large. In this paper, we propose an image space parallel processing method, which is implemented by using Open Computer Language (OpenCL) for rapid generation of the elemental images sets from large three-dimensional volume data. Using the proposed technique, it is possible to realize a real-time interactive integral imaging display system for 3D volume data constructed from computational tomography (CT) or magnetic resonance imaging (MRI) data.
Collapse
Affiliation(s)
- Ki-Chul Kwon
- College of Electrical and Computer Engineering, Chungbuk National University, Cheongju, Chungbuk, South Korea
| | | | | | | | | | | | | | | | | |
Collapse
|
32
|
Kwon KC, Lim YT, Kim CH, Kim N, Park C, Yoo KH, Son SH, Jeon SI. Microwave tomography analysis system for breast tumor detection. J Med Syst 2011; 36:1757-67. [PMID: 21210189 DOI: 10.1007/s10916-010-9635-4] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2010] [Accepted: 12/05/2010] [Indexed: 11/26/2022]
Abstract
In the breast-cancer image detection device field, remarkable advancements have been made in the breast cancer detection method using microwave radiation that satisfies the conditions required by Institute of Medicine (IOM). This paper is for embodying the microwave analysis breast tumor detection system that can analyze the permittivity and the conductivity of the breast inside, discover breast tumors, and easily check the various analytical information of the scatter and size of tumors inside breasts. The microwave breast tumor detection system is composed of an antenna array and the RF transceiver for the acquiring of microwave exposure information; the inverse scattering algorithm for searching the permitivity, conductivity and position of a material, and graphic user interface software that includes the visualization and various analyses of acquired data. The embodied system has shown the same-level function of tumor detection even in the type of heterogeneously dense material that is difficult to detect through mammography by experimentations with four kinds of classifications according to the distribution of lactiferous duct inside the breast.
Collapse
Affiliation(s)
- Ki-Chul Kwon
- College of Electrical and Computer Engineering, Chungbuk National University, Chungbuk, South Korea
| | | | | | | | | | | | | | | |
Collapse
|
33
|
Pham DQ, Kim N, Kwon KC, Jung JH, Hong K, Lee B, Park JH. Depth enhancement of integral imaging by using polymer-dispersed liquid-crystal films and a dual-depth configuration. Opt Lett 2010; 35:3135-3137. [PMID: 20847803 DOI: 10.1364/ol.35.003135] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
In spite of their many advantages, limited image depth still remains as an obstacle to three-dimensional displays based on integral imaging. In this Letter, by combining multiple polymer-dispersed liquid-crystal films and a dual-depth configuration, we propose a method to enhance the depth range of the integral imaging display system.
Collapse
Affiliation(s)
- Duc-Quang Pham
- School of Electrical & Computer Engineering, Chungbuk National University, 410 SungBong-Ro, Heungduk-Gu, Cheongju-Si, Chungbuk 361-763, South Korea
| | | | | | | | | | | | | |
Collapse
|
34
|
Abstract
A resolution-enhanced integral imaging microscope that uses lens array shifting is proposed in this study. The lens shift method maintains the same field of view of the reconstructed orthographic view images with increased spatial density. In this study, multiple sets of the elemental images were captured with horizontal and vertical shifts of the micro lens array and combined together to form a single set of the elemental images. From the combined elemental images, orthographic view images and depth slice images of the microscopic specimen were generated with enhanced resolution.
Collapse
Affiliation(s)
- Young-Tae Lim
- College of Electrical and Computer Engineering, Chungbuk National University,410 SungBong-Ro, Heungduk-Gu, Cheongju-Si, Chungbuk 361-763, Korea
| | | | | | | |
Collapse
|
35
|
Abstract
A viewing angle enhanced integral imaging display using two elemental image masks is proposed. In our new method, rays emitted from the elemental images are directed by two masks into corresponding lenses. Due to the elemental image guiding of the masks, the number of elemental images for each integrated image point is increased, enhancing the viewing angle. The experimental result shows that the proposed method exhibits two times larger viewing angle than the conventional method with the same lens array.
Collapse
Affiliation(s)
- Ganbat Baasantseren
- College of Electrical & Computer Engineering, Chungbuk National University, Heungduk-Gu, Cheongju-Si, Chungbuk 361-763, Korea
| | | | | | | |
Collapse
|
36
|
Cho IJ, Kook DH, Kwon KC, Lee EP, Choung WM, You GS. Design and verification of shielding for the advanced spent fuel conditioning process facility. Health Phys 2008; 94:S65-S71. [PMID: 18403959 DOI: 10.1097/01.hp.0000305821.17893.94] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
An Advanced spent fuel Conditioning Process Facility (ACPF) has recently been constructed by a modification of previously unused cells. ACPF is a hot cell with two rooms located in the basement of the Irradiated Materials Experiment Facility (IMEF) at the Korea Atomic Energy Research Institute. This is for demonstrating the advanced spent fuel conditioning process being proposed in Korea, which is an electrolytic reduction process of spent oxide fuels into a metallic form. The ACPF was designed with a more than 90 cm thick high density concrete shield wall to handle 1.38 PBq (37,430 Ci) of radioactive materials with dose rates lower than 10 muSv h in the operational areas (7,000 zone) and 150 muSv h in the service areas (8,000 zone). In Monte Carlo calculations with a design basis source inventory, the results for the bounding wall showed a maximum of 3 muSv h dose rate at an exterior surface of the ACPF for gamma radiation and 0.76 muSv h for neutrons. All the bounding structures of the ACPF were investigated to check on the shielding performance of the facility to ensure the radiation safety of the facility. A test was performed with a 2.96 TBq (80 Ci) 60Co source unit and the test results were compared with the calculation results. A few failure points were discovered and carefully fixed to meet the design criteria. After fixing the problems, the failure points were rechecked and the safety of the shielding structures was confirmed. In conclusion, it was confirmed that all the investigated parts of the ACPF passed the shielding safety limits by using this program and the ACPF is ready to fulfill its tasks for the advanced spent fuel conditioning process.
Collapse
|
37
|
Abstract
3 alpha-Hydroxy-23,24-bisnorcholane spermidine and spermine carbamates 2-7 have been synthesized and their antimicrobial and hemolytic activities were evaluated. They exhibited excellent in vitro activities especially against methicillin-resistant Staphylococcus aureus.
Collapse
Affiliation(s)
- H S Kim
- Department of Industrial Chemistry, Kyungpook National University, Taegu 702-701, South Korea.
| | | | | | | |
Collapse
|
38
|
Koo SH, Ihm CH, Kwon KC, Park JW, Kim JM, Kong G. Genetic alterations in hepatocellular carcinoma and intrahepatic cholangiocarcinoma. Cancer Genet Cytogenet 2001; 130:22-8. [PMID: 11672769 DOI: 10.1016/s0165-4608(01)00460-5] [Citation(s) in RCA: 41] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
In the following study, we used comparative genomic hybridization (CGH) to screen and compare for genetic alterations of hepatocellular carcinoma (HCC) and intrahepatic choalgiocarcinoma (ICC). The studies showed distinctive features of genetic alterations between the two tumors. Characteristic abnormal changes for HCC were 1q gain and loss of 4q, 10q and 13q regions. In contrast, gains of 5p, 7p, 13q and 20q were more predominant in ICC. Losses of 16q, 17p, and 18q, and gain of 8q region showed a similar high frequency of incidence in both tumors. The most striking and different findings were 1q amplification in HCC and 20q gain in ICC. Our data indicate that ICC shows the pattern of genetic alterations similar to pancreatic and colorectal cancers. This suggests that the genetic alterations in tumorigenesis show a similar pattern depending on the origin of cells, not the organ.
Collapse
Affiliation(s)
- S H Koo
- Department of Clinical Pathology, Chungnam National University Hospital, Daesadong 640, 301-040, Taejon, South Korea.
| | | | | | | | | | | |
Collapse
|
39
|
Abstract
Synthesis and antimicrobial activity of squalamine analogue 2 are reported. The synthesis of 2 was accomplished from bisnoralcohol 3. The spermidine moiety was introduced via reductive amination of an appropriately functionalized 3beta-aminosterol with spermidinyl aldehyde 17 utilizing sodium triacetoxyborohydride as the reducing agent. Compound 2 shows weaker antimicrobial activity than squalamine.
Collapse
Affiliation(s)
- H S Kim
- Department of Industrial Chemistry, Kyungpook National University, Taegu, South Korea.
| | | | | | | | | | | |
Collapse
|
40
|
Koo SH, Kwon KC, Park JW, Lee YE, Kim JW. Characterization of chromosomal breakpoints in an ALL patient using cross-species color banding. Cancer Genet Cytogenet 2000; 119:118-20. [PMID: 10867146 DOI: 10.1016/s0165-4608(99)00231-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Cross-species color-banded karyotype (Rx-FISH) results were compared with those of conventional G-banded metaphases from the same sample. Breakpoints and karyotype were confirmed as 46,XX,t(8;22)(q24;q11), der(9)t(1;9)(q21;p13) through the novel technology of cross-species color banding in an acute leukemic patient (ALL, L3); the karyotype was 46,XX,t(8;22)(q24;q11),der(9)t(1;9)(q25;p24) by conventional G-banding.
Collapse
MESH Headings
- Adult
- Chromosome Banding/methods
- Chromosomes, Human, Pair 1/ultrastructure
- Chromosomes, Human, Pair 22/ultrastructure
- Chromosomes, Human, Pair 8/ultrastructure
- Chromosomes, Human, Pair 9/ultrastructure
- Fatal Outcome
- Humans
- In Situ Hybridization, Fluorescence
- Karyotyping
- Male
- Precursor Cell Lymphoblastic Leukemia-Lymphoma/genetics
- Precursor Cell Lymphoblastic Leukemia-Lymphoma/pathology
- Translocation, Genetic
Collapse
Affiliation(s)
- S H Koo
- Department of Clinical Pathology, Chungnam National University Hospital, Taejon, South Korea
| | | | | | | | | |
Collapse
|
41
|
Koo SH, Kwon KC, Shin SY, Jeon YM, Park JW, Kim SH, Noh SM. Genetic alterations of gastric cancer: comparative genomic hybridization and fluorescence In situ hybridization studies. Cancer Genet Cytogenet 2000; 117:97-103. [PMID: 10704677 DOI: 10.1016/s0165-4608(99)00152-1] [Citation(s) in RCA: 52] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Genetic changes leading to the development of gastric cancers are still in dispute. In the following study, we used comparative genomic hybridization (CGH) to screen for DNA copy number changes along all chromosomes in 37 gastric carcinomas, and fluorescence in situ hybridization (FISH) with the C-MYC and TP53 probes in 14 cases for comparison. The aim of this study was to identify those chromosome regions that contain genes important for the development of gastric carcinomas and to identify genetic markers associated with tumor progression. The most often involved gains were 2q, 7pq, 8pq, 13q, 17q, 18q, and 20pq. The most commonly deleted regions were 17p. The pattern of genetic changes was different depending on the existence of nodal metastasis and histologic types. Gains in 8q and losses in 17p were the most common features of the CGH changes. However, only 3 among the available 10 cases (30%) showed an amplification of the C-MYC gene by FISH. Allelic loss of TP53 was found in 2 of 4 cases (50%). This difference might be due to another rearrangement of these 2 genes which cannot be detected by FISH, or other possible genes in that area may be involved in the tumorigenesis and nodal metastasis of gastric carcinomas.
Collapse
Affiliation(s)
- S H Koo
- Department of Clinical Pathology, Chungnam National University Hospital, Taejon, South Korea
| | | | | | | | | | | | | |
Collapse
|
42
|
Koo SH, Kwon KC, Ihm CH, Jeon YM, Park JW, Sul CK. Detection of genetic alterations in bladder tumors by comparative genomic hybridization and cytogenetic analysis. Cancer Genet Cytogenet 1999; 110:87-93. [PMID: 10214355 DOI: 10.1016/s0165-4608(98)00193-9] [Citation(s) in RCA: 53] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Comparative genomic hybridization (CGH) and conventional cytogenetic karyotyping were used to screen for losses and gains of DNA sequences along all chromosome arms in 16 bladder tumors. Cytogenetic results were highly complex. The most frequently affected chromosomes were 5, 8, 9, 21, and Y as determined by karyotyping. There was close correlation between the CGH data and cytogenetic results in near-diploid tumors with simple karyotypes. However, some unexpected results were observed by CGH in tumors with several composite clones. Common amplification of copy numbers of DNA sequences by CGH were seen at 1q, 3q, 4q, 5p, 6p/q, 7p, 8q, 11q, 12q, 13q, 17q, 18q, and 20p/q (more than 20% of cases). High level amplification was noted at 1p32, 3p21, 3q24, 4q26, 8q21-qter, 11q14-22, 12q15-21, 12q21-24, 13q21-31, 17q22, and 18q22. Deletions were noted at 2q21-qter. 4q13-23, 5q, 8p12-22, 9p/q, and 11p13-15 (more than 20% of cases). Although most amplifications and deletions have been previously described in the literature, our study showed some intriguing and uncommon regions, different from those found in past studies. These were the amplification of 7p, 8q, 11q14-qter 12q24-24, 13q21-31, and 18q22, and deletion on 4q13-23, even though loss of heterozygosity was not detected at this locus. In spite of the very complex pattern of genetic changes in bladder tumors, most of these uncommon aberrations have to be implicated in bladder tumors, and further molecular genetic methods are necessary to establish whether the chromosomal regions contain candidate genes which contributed to the initiation and progression of bladder tumors.
Collapse
Affiliation(s)
- S H Koo
- Department of Clinical Pathology and Urology, Chungnam National University Hospital, Taejon, South Korea
| | | | | | | | | | | |
Collapse
|