1
|
Kitrungrotsakul T, Han XH, Iwamoto Y, Takemoto S, Yokota H, Ipponjima S, Nemoto T, Xiong W, Chen YW. A Cascade of 2.5D CNN and Bidirectional CLSTM Network for Mitotic Cell Detection in 4D Microscopy Image. IEEE/ACM Trans Comput Biol Bioinform 2021; 18:396-404. [PMID: 31144644 DOI: 10.1109/tcbb.2019.2919015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Mitosis detection is one of the challenging steps in biomedical imaging research, which can be used to observe the cell behavior. Most of the already existing methods that are applied in detecting mitosis usually contain many nonmitotic events (normal cell and background) in the result (false positives, FPs). In order to address such a problem, in this study, we propose to apply 2.5-dimensional (2.5D) networks called CasDetNet_CLSTM, which can accurately detect mitotic events in 4D microscopic images. This CasDetNet_CLSTM involves a 2.5D faster region-based convolutional neural network (Faster R-CNN) as the first network, and a convolutional long short-term memory (CLSTM) network as the second network. The first network is used to select candidate cells using the information from nearby slices, whereas the second network uses temporal information to eliminate FPs and refine the result of the first network. Our experiment shows that the precision and recall of our networks yield better results than those of other state-of-the-art methods.
Collapse
|
2
|
Kitrungrotsakul T, Iwamoto Y, Takemoto S, Yokota H, Ipponjima S, Nemoto T, Lin L, Tong R, Li J, Chen YW. Accurate and fast mitotic detection using an anchor-free method based on full-scale connection with recurrent deep layer aggregation in 4D microscopy images. BMC Bioinformatics 2021; 22:91. [PMID: 33637042 PMCID: PMC7908657 DOI: 10.1186/s12859-021-04014-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2020] [Accepted: 02/10/2021] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND To effectively detect and investigate various cell-related diseases, it is essential to understand cell behaviour. The ability to detection mitotic cells is a fundamental step in diagnosing cell-related diseases. Convolutional neural networks (CNNs) have been successfully applied to object detection tasks, however, when applied to mitotic cell detection, most existing methods generate high false-positive rates due to the complex characteristics that differentiate normal cells from mitotic cells. Cell size and orientation variations in each stage make detecting mitotic cells difficult in 2D approaches. Therefore, effective extraction of the spatial and temporal features from mitotic data is an important and challenging task. The computational time required for detection is another major concern for mitotic detection in 4D microscopic images. RESULTS In this paper, we propose a backbone feature extraction network named full scale connected recurrent deep layer aggregation (RDLA++) for anchor-free mitotic detection. We utilize a 2.5D method that includes 3D spatial information extracted from several 2D images from neighbouring slices that form a multi-stream input. CONCLUSIONS Our proposed technique addresses the scale variation problem and can efficiently extract spatial and temporal features from 4D microscopic images, resulting in improved detection accuracy and reduced computation time compared with those of other state-of-the-art methods.
Collapse
Affiliation(s)
- Titinunt Kitrungrotsakul
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, China.,Graduate School of Information Science and Engineering, Ritsumeikan University, Kusatsu, Shiga, Japan
| | - Yutaro Iwamoto
- Graduate School of Information Science and Engineering, Ritsumeikan University, Kusatsu, Shiga, Japan
| | | | - Hideo Yokota
- Center for Advanced Photonics, RIKEN, Wako, Saitama, Japan
| | - Sari Ipponjima
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Tomomi Nemoto
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Lanfen Lin
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Ruofeng Tong
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, China.,College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Jingsong Li
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, China.,College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
| | - Yen-Wei Chen
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, China. .,Graduate School of Information Science and Engineering, Ritsumeikan University, Kusatsu, Shiga, Japan. .,College of Computer Science and Technology, Zhejiang University, Hangzhou, China.
| |
Collapse
|
3
|
Umino Y, Ipponjima S, Denda M. Polyoxyethylene/polyoxypropylene dimethyl ether (EPDME) random copolymer improves lipid structural ordering in stratum corneum of an epidermal-equivalent model as seen by two-photon microscopy. Skin Res Technol 2021; 27:632-638. [PMID: 33410546 DOI: 10.1111/srt.12996] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2020] [Revised: 11/11/2020] [Accepted: 12/05/2020] [Indexed: 11/27/2022]
Abstract
BACKGROUND/PURPOSE Topical application of polyoxyethylene/polyoxypropylene dimethyl ether (EPDME) random copolymer improves the barrier function of skin, whereas polyethylene glycol (PEG) and polypropylene glycol (PPG) are ineffective. The aim of this work was to examine the interaction between these polymers and lipid molecules in the stratum corneum in order to establish whether EPDME-specific changes in the structural ordering of lipids might account for the improvement of barrier function. METHODS We used two-photon microscopy to evaluate the effects of EPDME, PEG, and PPG on the structural ordering of lipids in an epidermal-equivalent model in terms of the fluorescence changes of Laurdan, a fluorescent dye that responds to changes of membrane fluidity. The generalized polarization (GP) value, a parameter that reflects lipid ordering, was measured at various depths from the surface of the stratum corneum. RESULTS EPDME increased the GP value to a depth of about 3 µm from the surface, indicating that lipid ordering was increased in this region, while PEG and PPG of the same molecular weight had no effect. Diffusion of Lucifer yellow into the epidermis was reduced after application of EPDME, indicating that the barrier function was improved. CONCLUSION These results support the view that EPDME improves barrier function by increasing the ordering of lipid structures in the stratum corneum. The methodology described here could be useful for screening new compounds that would improve the structural ordering of lipids.
Collapse
Affiliation(s)
- Yuki Umino
- Shiseido Global Innovation Center, Yokohama, Japan
| | - Sari Ipponjima
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan
| | | |
Collapse
|
4
|
Ipponjima S, Umino Y, Nagayama M, Denda M. Live imaging of alterations in cellular morphology and organelles during cornification using an epidermal equivalent model. Sci Rep 2020; 10:5515. [PMID: 32218450 PMCID: PMC7099034 DOI: 10.1038/s41598-020-62240-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Accepted: 03/09/2020] [Indexed: 11/30/2022] Open
Abstract
The stratum corneum plays a crucial role in epidermal barrier function. Various changes occur in granular cells at the uppermost stratum granulosum during cornification. To understand the temporal details of this process, we visualized the cell shape and organelles of cornifying keratinocytes in a living human epidermal equivalent model. Three-dimensional time-lapse imaging with a two-photon microscope revealed that the granular cells did not simply flatten but first temporarily expanded in thickness just before flattening during cornification. Moreover, before expansion, intracellular vesicles abruptly stopped moving, and mitochondria were depolarized. When mitochondrial morphology and quantity were assessed, granular cells with fewer, mostly punctate mitochondria tended to transition to corneocytes. Several minutes after flattening, DNA leakage from the nucleus was visualized. We also observed extension of the cell-flattening time induced by the suppression of filaggrin expression. Overall, we successfully visualized the time-course of cornification, which describes temporal relationships between alterations in the transition from granular cells to corneocytes.
Collapse
Affiliation(s)
- Sari Ipponjima
- Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan.
| | - Yuki Umino
- Shiseido Global Innovation Center, Yokohama, Japan
| | - Masaharu Nagayama
- Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan
| | | |
Collapse
|
5
|
Inoue Y, Hasegawa S, Miyachi K, Yamada T, Nakata S, Ipponjima S, Hibi T, Nemoto T, Tanaka M, Suzuki R, Hirashima N. Development of 3D imaging technique of reconstructed human epidermis with immortalized human epidermal cell line. Exp Dermatol 2019; 27:563-570. [PMID: 29700854 DOI: 10.1111/exd.13672] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/16/2018] [Indexed: 11/29/2022]
Abstract
The epidermis, the outermost layer of the skin, retains moisture and functions as a physical barrier against the external environment. Epidermal cells are continuously replaced by turnover, and thus to understand in detail the dynamic cellular events in the epidermis, techniques to observe live tissues in 3D are required. Here, we established a live 3D imaging technique for epidermis models. We first obtained immortalized human epidermal cell lines which have a normal differentiation capacity and fluorescence-labelled cytoplasm or nuclei. The reconstituted 3D epidermis was prepared with these lines. Using this culture system, we were able to observe the structure of the reconstituted epidermis live in 3D, which was similar to an in vivo epidermis, and evaluate the effect of a skin irritant. This technique may be useful for dermatological science and drug development.
Collapse
Affiliation(s)
- Yu Inoue
- Department of Cellular Biophysics, Graduate School of Pharmaceutical Sciences, Nagoya City University, Nagoya, Aichi, Japan.,Research Laboratories, Nippon Menard Cosmetic Co., Ltd., Nagoya, Aichi, Japan.,Nagoya University-MENARD Collaborative Research Chairs, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Seiji Hasegawa
- Research Laboratories, Nippon Menard Cosmetic Co., Ltd., Nagoya, Aichi, Japan.,Nagoya University-MENARD Collaborative Research Chairs, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Katsuma Miyachi
- Research Laboratories, Nippon Menard Cosmetic Co., Ltd., Nagoya, Aichi, Japan
| | - Takaaki Yamada
- Research Laboratories, Nippon Menard Cosmetic Co., Ltd., Nagoya, Aichi, Japan
| | - Satoru Nakata
- Research Laboratories, Nippon Menard Cosmetic Co., Ltd., Nagoya, Aichi, Japan
| | - Sari Ipponjima
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan.,Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Terumasa Hibi
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Tomomi Nemoto
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan.,Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Masahiko Tanaka
- Department of Cellular Biophysics, Graduate School of Pharmaceutical Sciences, Nagoya City University, Nagoya, Aichi, Japan
| | - Ryo Suzuki
- Department of Cellular Biophysics, Graduate School of Pharmaceutical Sciences, Nagoya City University, Nagoya, Aichi, Japan
| | - Naohide Hirashima
- Department of Cellular Biophysics, Graduate School of Pharmaceutical Sciences, Nagoya City University, Nagoya, Aichi, Japan.,Institute of Drug Discovery Science, Nagoya City University, Nagoya, Aichi, Japan
| |
Collapse
|
6
|
Umino Y, Ipponjima S, Denda M. 626 Effects of polyols on lipid in an epidermal-equivalent model. J Invest Dermatol 2018. [DOI: 10.1016/j.jid.2018.03.635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
7
|
Ipponjima S, Umino Y, Nagayama M, Denda M. 628 Live imaging of granular cells during cornification in the epidermal equivalent model. J Invest Dermatol 2018. [DOI: 10.1016/j.jid.2018.03.637] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
8
|
Tanabe A, Hibi T, Ipponjima S, Matsumoto K, Yokoyama M, Kurihara M, Hashimoto N, Nemoto T. Transmissive liquid-crystal device for correcting primary coma aberration and astigmatism in biospecimen in two-photon excitation laser scanning microscopy. J Biomed Opt 2016; 21:121503. [PMID: 27624000 DOI: 10.1117/1.jbo.21.12.121503] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2016] [Accepted: 08/15/2016] [Indexed: 05/24/2023]
Abstract
All aberrations produced inside a biospecimen can degrade the quality of a three-dimensional image in two-photon excitation laser scanning microscopy. Previously, we developed a transmissive liquid-crystal device to correct spherical aberrations that improved the image quality of a fixed-mouse-brain slice treated with an optical clearing reagent. In this study, we developed a transmissive device that corrects primary coma aberration and astigmatism. The motivation for this study is that asymmetric aberration can be induced by the shape of a biospecimen and/or by a complicated refractive-index distribution in a sample; this can considerably degrade optical performance even near the sample surface. The device’s performance was evaluated by observing fluorescence beads. The device was inserted between the objective lens and microscope revolver and succeeded in improving the spatial resolution and fluorescence signal of a bead image that was originally degraded by asymmetric aberration. Finally, we implemented the device for observing a fixed whole mouse brain with a sloping surface shape and complicated internal refractive-index distribution. The correction with the device improved the spatial resolution and increased the fluorescence signal by ?2.4×. The device can provide a simple approach to acquiring higher-quality images of biospecimens.
Collapse
Affiliation(s)
- Ayano Tanabe
- Hokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, JapanbHokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, JapancCitizen Holdings Co., Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Terumasa Hibi
- Hokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, Japan
| | - Sari Ipponjima
- Hokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, JapanbHokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, Japan
| | - Kenji Matsumoto
- Citizen Holdings Co., Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Masafumi Yokoyama
- Citizen Holdings Co., Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Makoto Kurihara
- Citizen Holdings Co., Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Nobuyuki Hashimoto
- Citizen Holdings Co., Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Tomomi Nemoto
- Hokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, JapanbHokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, Japan
| |
Collapse
|
9
|
Ipponjima S, Hibi T, Nemoto T. Three-Dimensional Analysis of Cell Division Orientation in Epidermal Basal Layer Using Intravital Two-Photon Microscopy. PLoS One 2016; 11:e0163199. [PMID: 27657513 PMCID: PMC5033459 DOI: 10.1371/journal.pone.0163199] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2016] [Accepted: 09/06/2016] [Indexed: 01/06/2023] Open
Abstract
Epidermal structures are different among body sites, and proliferative keratinocytes in the epidermis play an important role in the maintenance of the epidermal structures. In recent years, intravital skin imaging has been used in mammalian skin research for the investigation of cell behaviors, but most of these experiments were performed with rodent ears. Here, we established a non-invasive intravital imaging approach for dorsal, ear, hind paw, or tail skin using R26H2BEGFP hairless mice. Using four-dimensional (x, y, z, and time) imaging, we successfully visualized mitotic cell division in epidermal basal cells. A comparison of cell division orientation relative to the basement membrane in each body site revealed that most divisions in dorsal and ear epidermis occurred in parallel, whereas the cell divisions in hind paw and tail epidermis occurred both in parallel and oblique orientations. Based on the quantitative analysis of the four-dimensional images, we showed that the epidermal thickness correlated with the basal cell density and the rate of the oblique divisions.
Collapse
Affiliation(s)
- Sari Ipponjima
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Terumasa Hibi
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Tomomi Nemoto
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Hokkaido, Japan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Hokkaido, Japan
- * E-mail:
| |
Collapse
|
10
|
Tanabe A, Hibi T, Ipponjima S, Matsumoto K, Yokoyama M, Kurihara M, Hashimoto N, Nemoto T. Correcting spherical aberrations in a biospecimen using a transmissive liquid crystal device in two-photon excitation laser scanning microscopy. J Biomed Opt 2015; 20:101204. [PMID: 26244766 DOI: 10.1117/1.jbo.20.10.101204] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2015] [Accepted: 05/18/2015] [Indexed: 05/24/2023]
Abstract
Two-photon excitation laser scanning microscopy has enabled the visualization of deep regions in a biospecimen. However, refractive-index mismatches in the optical path cause spherical aberrations that degrade spatial resolution and the fluorescence signal, especially during observation at deeper regions. Recently, we developed transmissive liquid-crystal devices for correcting spherical aberration without changing the basic design of the optical path in a conventional laser scanning microscope. In this study, the device was inserted in front of the objective lens and supplied with the appropriate voltage according to the observation depth. First, we evaluated the device by observing fluorescent beads in single- and two-photon excitation laser scanning microscopes. Using a 25× water-immersion objective lens with a numerical aperture of 1.1 and a sample with a refractive index of 1.38, the device recovered the spatial resolution and the fluorescence signal degraded within a depth of 0.6 mm. Finally, we implemented the device for observation of a mouse brain slice in a two-photon excitation laser scanning microscope. An optical clearing reagent with a refractive index of 1.42 rendered the fixed mouse brain transparent. The device improved the spatial resolution and the yellow fluorescent protein signal within a depth of 0-0.54 mm.
Collapse
Affiliation(s)
- Ayano Tanabe
- Hokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, JapanbHokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, JapancCitizen Ho
| | - Terumasa Hibi
- Hokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, JapanbHokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, Japan
| | - Sari Ipponjima
- Hokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, JapanbHokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, Japan
| | - Kenji Matsumoto
- Citizen Holdings Co. Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Masafumi Yokoyama
- Citizen Holdings Co. Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Makoto Kurihara
- Citizen Holdings Co. Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Nobuyuki Hashimoto
- Citizen Holdings Co. Ltd., 840, Shimotomi, Tokorozawa, Saitama 359-8511, Japan
| | - Tomomi Nemoto
- Hokkaido University, Research Institute for Electronic Science, N20W10, Kita-Ward, Sapporo, Hokkaido 001-0020, JapanbHokkaido University, Graduate School of Information Science and Technology, N14W9, Kita-Ward, Sapporo, Hokkaido 060-0814, Japan
| |
Collapse
|