1
|
Kim H, Kwak TY, Chang H, Kim SW, Kim I. RCKD: Response-Based Cross-Task Knowledge Distillation for Pathological Image Analysis. Bioengineering (Basel) 2023; 10:1279. [PMID: 38002403 PMCID: PMC10669242 DOI: 10.3390/bioengineering10111279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 10/19/2023] [Accepted: 10/29/2023] [Indexed: 11/26/2023] Open
Abstract
We propose a novel transfer learning framework for pathological image analysis, the Response-based Cross-task Knowledge Distillation (RCKD), which improves the performance of the model by pretraining it on a large unlabeled dataset guided by a high-performance teacher model. RCKD first pretrains a student model to predict the nuclei segmentation results of the teacher model for unlabeled pathological images, and then fine-tunes the pretrained model for the downstream tasks, such as organ cancer sub-type classification and cancer region segmentation, using relatively small target datasets. Unlike conventional knowledge distillation, RCKD does not require that the target tasks of the teacher and student models be the same. Moreover, unlike conventional transfer learning, RCKD can transfer knowledge between models with different architectures. In addition, we propose a lightweight architecture, the Convolutional neural network with Spatial Attention by Transformers (CSAT), for processing high-resolution pathological images with limited memory and computation. CSAT exhibited a top-1 accuracy of 78.6% on ImageNet with only 3M parameters and 1.08 G multiply-accumulate (MAC) operations. When pretrained by RCKD, CSAT exhibited average classification and segmentation accuracies of 94.2% and 0.673 mIoU on six pathological image datasets, which is 4% and 0.043 mIoU higher than EfficientNet-B0, and 7.4% and 0.006 mIoU higher than ConvNextV2-Atto pretrained on ImageNet, respectively.
Collapse
Affiliation(s)
- Hyunil Kim
- Deep Bio Inc., Seoul 08380, Republic of Korea; (H.K.); (T.-Y.K.); (H.C.); (S.W.K.)
| | - Tae-Yeong Kwak
- Deep Bio Inc., Seoul 08380, Republic of Korea; (H.K.); (T.-Y.K.); (H.C.); (S.W.K.)
| | - Hyeyoon Chang
- Deep Bio Inc., Seoul 08380, Republic of Korea; (H.K.); (T.-Y.K.); (H.C.); (S.W.K.)
| | - Sun Woo Kim
- Deep Bio Inc., Seoul 08380, Republic of Korea; (H.K.); (T.-Y.K.); (H.C.); (S.W.K.)
| | - Injung Kim
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang 37554, Republic of Korea
| |
Collapse
|
2
|
Cha Y, Chung JY, Jung CH, Kim JW, Lee J, Yoo JI, Kim JT, Jeon Y. Pre-sliding of femoral neck system improves fixation stability in pauwels type III femoral neck fracture: a finite element analysis. BMC Musculoskelet Disord 2023; 24:506. [PMID: 37344858 PMCID: PMC10286416 DOI: 10.1186/s12891-023-06631-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 06/13/2023] [Indexed: 06/23/2023] Open
Abstract
BACKGROUND Femoral neck fractures are a common injury in older adults and their management presents a significant challenge for orthopedic surgeons. The Femoral Neck System (FNS) was recently introduced for the fixation of femur neck fractures. Although neck shortening was reduced with the FNS, the complication rates were not reduced. Thus, improvements to enhance fixation stability should be made for the FNS. We hypothesized that (1) the pre-sliding technique and (2) the use of longer anti-rotation screw would increase fracture stability. This study aimed to determine the change in fracture stability using the pre-sliding technique and long anti-rotation screw in the FNS for fixation of Pauwels type III femoral neck fractures. METHODS Finite element models of Pauwels type III femoral neck fracture fixed with pre-sliding FNS and 5-mm longer anti-rotation screw were established. The models were subjected to normal walking load. The material properties of the elements belonging to the bone were mapped by assigning the formulation with the computed tomography Hounsfield unit. RESULTS Pauwels type III femoral neck fractures fixed with pre-slided FNS showed better fracture stability, decreasing fracture gap and sliding by 14% and 12%, respectively, under normal walking load. No element of cortical bone in any of the models had an absolute value of principal strain that exceeded 1%. The peak von Mises stress (VMS) of the implants ranged from 260 to 289 MPa, and the highest peak VMS value was 50% lower than the yield strength of the titanium alloy (800 MPa). The longer anti-rotation screw did not affect fracture stability. CONCLUSIONS The pre-sliding technique using the FNS showed higher fracture stability than the standard fixation technique for a Pauwels type III femoral neck fracture. The longer anti-rotation screw did not contribute significantly to fixation stability. As this finite element analysis considered the inhomogeneous mechanical property of the bone, it offered equivalent mechanical conditions to investigate the components of interest.
Collapse
Grants
- HI22C0494 the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- HI22C0494 the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- HI22C0494 the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- HI20C2140 the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- 2022R1G1A1003299 the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT)
- the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
Collapse
Affiliation(s)
- Yonghan Cha
- Department of Orthopaedic Surgery, Eulji university hospital, Daejeon, Korea
| | - Jun Young Chung
- Department of Orthopedic Surgery, Ajou University School of Medicine, Ajou Medical Center, 164, World cup-ro, Yeongtong-gu, 16499, Suwon, Suwon-si, Gyeonggi-do, Korea
| | - Chang-Ho Jung
- Department of Mechanical Engineering, Ajou University, Suwon, Korea
| | - Jin-Woo Kim
- Department of Orthopaedic Surgery, Nowon Eulji Medical Center, Eulji University, Seoul, Korea
| | - Jeyoon Lee
- Department of Orthopedic Surgery, Ajou University School of Medicine, Ajou Medical Center, 164, World cup-ro, Yeongtong-gu, 16499, Suwon, Suwon-si, Gyeonggi-do, Korea
| | - Jun-Il Yoo
- Department of Orthopedic Surgery, Inha University Hospital, Incheon, Korea
| | - Jung-Taek Kim
- Department of Orthopedic Surgery, Ajou University School of Medicine, Ajou Medical Center, 164, World cup-ro, Yeongtong-gu, 16499, Suwon, Suwon-si, Gyeonggi-do, Korea.
| | - Yongho Jeon
- Department of Mechanical Engineering, Ajou University, Suwon, Korea
| |
Collapse
|
3
|
Park BY, Cho HA, Shin H. Disparity in access for people with disabilities to outpatient dental care services: a retrospective cohort study. BMC Oral Health 2023; 23:213. [PMID: 37060034 PMCID: PMC10102694 DOI: 10.1186/s12903-023-02948-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 04/06/2023] [Indexed: 04/16/2023] Open
Abstract
BACKGROUND People with disabilities face difficulties in oral health management and gaining access to dental care. The availability of a regular source of dental care (RSDC) is an important factor that influences the access to health services and care management. The purpose of this study was to determine the effect of the availability of RSDC on the number of annual dental visits and dental expenses per visit among people with disabilities. METHODS Data of 7,896,251 patients with dental problems in South Korea were analyzed using the 2002-2018 National Health Insurance claims data. A generalized estimating equation was applied to analyze the repeated-measurement data, and the interaction effect between RSDC and the disability severity was evaluated. RESULTS The number of annual dental visits was higher among people with (2.62) than among those without (2.23) disabilities. Despite their increased dental needs, both annual dental visits and dental expenses per visit were low among older individuals (p < 0.001). The proportion and frequency of annual dental visits was lower among women than among men with disabilities. RSDC had differential effects on the severity of disability. Compared to people without disabilities, RSDC increased the number of annual dental visits (p = 0.067) and the dental expenses per visit (p < 0.05) among those with severe disabilities, but the effect on the number of annual dental visits was not significant among those with mild disabilities (p = 0.698). CONCLUSIONS Our results suggest a need for a special dental care system for people with disabilities, to ensure an RSDC, particularly for women and for older people with disabilities.
Collapse
Affiliation(s)
- Bo-Young Park
- Department of Dental Hygiene, Shinhan University, Uijeongbu-Si, Republic of Korea
| | - Han-A Cho
- Department of Dental Hygiene, Shinhan University, Uijeongbu-Si, Republic of Korea
| | - Hosung Shin
- Department of Social and Humanity in Dentistry, Wonkwang University School of Dentistry, 460 Iksan Dearo, Iksan, 54538, North Jula, Korea.
| |
Collapse
|
4
|
Kim YG, Lee Y, Kim JH, Chang SY, Jung JW, Chung WJ, Jin HE. Self-Assembled Multi-Epitope Peptide Amphiphiles Enhance the Immune Response against Enterovirus 71. Nanomaterials (Basel) 2020; 10:E2342. [PMID: 33255791 PMCID: PMC7760352 DOI: 10.3390/nano10122342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Revised: 11/18/2020] [Accepted: 11/23/2020] [Indexed: 11/17/2022]
Abstract
Subunit vaccines consist of non-genetic material, such as peptides or proteins. They are considered safe because they have fewer side effects; however, they have low immunogenicity when used alone. We aimed to enhance the immune response of peptide-based vaccines by using self-assembled multimeric peptide amphiphiles (PAs). We designed two epitope PAs by conjugating epitope peptides from Enterovirus 71 (EV71) virus particle (VP) 1 and VP3 capsid proteins with different fatty acid chain lengths (VP1PA and VP3PA). These PAs self-assembled into supramolecular structures at a physiological pH, and the resulting structures were characterized using atomic force microscopy. Multi-epitope PAs (m-PAs) consisted of a 1:1 mixture of VP1PA and VP3PA solutions. To evaluate immunogenicity, m-PA constructs were injected with adjuvant subcutaneously into female Balb/c mice. Levels of antigen-specific immunoglobulin G (IgG) and IgG1 in m-PA-injected mice serum samples were analyzed using ELISA and Western blotting. Additionally, cytokine production stimulated by each antigen was measured in splenocytes cultured from immunized mice groups. We found that m-PA showed improved humoral and cellular immune responses compared to the control and peptide groups. The sera from m-PA immunized mice group could neutralize EV71 infection and protect host cells. Thus, self-assembled m-PAs can promote a protective immune response and can be developed as a potential platform technology to produce peptide vaccines against infectious viral diseases.
Collapse
Affiliation(s)
- Yu-Gyeong Kim
- College of Pharmacy, Ajou University, Suwon 16499, Korea; (Y.-G.K.); (Y.L.); (J.H.K.); (S.-Y.C.)
| | - Yunsu Lee
- College of Pharmacy, Ajou University, Suwon 16499, Korea; (Y.-G.K.); (Y.L.); (J.H.K.); (S.-Y.C.)
| | - Joo Hee Kim
- College of Pharmacy, Ajou University, Suwon 16499, Korea; (Y.-G.K.); (Y.L.); (J.H.K.); (S.-Y.C.)
| | - Sun-Young Chang
- College of Pharmacy, Ajou University, Suwon 16499, Korea; (Y.-G.K.); (Y.L.); (J.H.K.); (S.-Y.C.)
| | - Jong-Wha Jung
- Research Institute of Pharmaceutical Sciences, College of Pharmacy, Kyungpook National University, Daegu 41566, Korea;
| | - Woo-Jae Chung
- Department of Integrative Biotechnology, Sungkyunkwan University, Suwon 16419, Korea
| | - Hyo-Eon Jin
- College of Pharmacy, Ajou University, Suwon 16499, Korea; (Y.-G.K.); (Y.L.); (J.H.K.); (S.-Y.C.)
- Research Institute of Pharmaceutical Science and Technology, Ajou University, Suwon 16499, Korea
| |
Collapse
|
5
|
Kim YE, Sung SI, Chang YS, Ahn SY, Sung DK, Park WS. Thrombin Preconditioning Enhances Therapeutic Efficacy of Human Wharton's Jelly-Derived Mesenchymal Stem Cells in Severe Neonatal Hypoxic Ischemic Encephalopathy. Int J Mol Sci 2019; 20:E2477. [PMID: 31137455 PMCID: PMC6566845 DOI: 10.3390/ijms20102477] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2019] [Revised: 05/10/2019] [Accepted: 05/17/2019] [Indexed: 02/08/2023] Open
Abstract
We investigated whether thrombin preconditioning of human Wharton's jelly-derived mesenchymal stem cells (MSCs) improves paracrine potency and thus the therapeutic efficacy of naïve MSCs against severe hypoxic ischemic encephalopathy (HIE). Thrombin preconditioning significantly enhances the neuroprotective anti-oxidative, anti-apoptotic, and anti-cytotoxic effects of naïve MSCs against oxygen-glucose deprivation (OGD) of cortical neurons in vitro. Severe HIE was induced in vivo using unilateral carotid artery ligation and hypoxia for 2 h and confirmed using brain magnetic resonance imaging (MRI) involving >40% of ipsilateral hemisphere at postnatal day (P) 7 in newborn rats. Delayed intraventricular transplantation of 1 × 105 thrombin preconditioned but not naïve MSCs at 24 h after hypothermia significantly enhanced observed anti-inflammatory, anti-astroglial, and anti-apoptotic effects and the ensuing brain infarction; behavioral tests, such as cylinder rearing and negative geotaxis tests, were conducted at P42. In summary, thrombin preconditioning of human Wharton's jelly-derived MSCs significantly boosted the neuroprotective effects of naïve MSCs against OGD in vitro by enhancing their anti-oxidative, anti-apoptotic, and anti-cytotoxic effects, and significantly attenuated the severe HIE-induced brain infarction and improved behavioral function tests in vivo by maximizing their paracrine anti-inflammatory, anti-astroglial, and anti-apoptotic effects.
Collapse
Affiliation(s)
- Young Eun Kim
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
| | - Se In Sung
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
| | - Yun Sil Chang
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
- Stem Cell and Regenerative Medicine Institute, Samsung Medical Center, Seoul 06351, Korea.
- Department of Health Sciences and Technology, SAIHST, Sungkyunkwan University, Seoul 06351, Korea.
| | - So Yoon Ahn
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
| | - Dong Kyung Sung
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
- Stem Cell and Regenerative Medicine Institute, Samsung Medical Center, Seoul 06351, Korea.
| | - Won Soon Park
- Department of Pediatrics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.
- Stem Cell and Regenerative Medicine Institute, Samsung Medical Center, Seoul 06351, Korea.
| |
Collapse
|