1
|
Wisuthiphaet N, Zhang H, Liu X, Nitin N. Detection of Escherichia coli Using Bacteriophage T7 and Analysis of Excitation‑Emission Matrix Fluorescence Spectroscopy. J Food Prot 2024; 87:100396. [PMID: 39521134 DOI: 10.1016/j.jfp.2024.100396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Revised: 10/11/2024] [Accepted: 10/29/2024] [Indexed: 11/16/2024]
Abstract
Conventional detection methods require the isolation and enrichment of bacteria, followed by molecular, biochemical, or culture-based analysis. To address some of the limitations of conventional methods, this study develops a machine learning (ML) approach to analyze the excitation-emission matrix (EEM) fluorescence data generated based on bacteriophage T7 and Escherichia coli interactions for in-situ detection of live bacteria in the presence of fresh produce homogenate. We trained classification models using various ML algorithms based on the 3-D EEM data generated with bacteria and their interactions with a T7 phage. These ML algorithms, including linear Support Vector Classifier (SVC) and Random Forest (RF), demonstrate high accuracy (>0.85) for detecting E. coli at 102 CFU/ml concentration within 6 h. Additionally, these ML models can differentiate among different E. coli concentration levels. For example, the Gaussian Process model achieved an accuracy of 92% in detecting different concentration levels of live E. coli. Application of these ML methods to detect E. coli in spinach homogenate yielded an accuracy of 89% using the linear-SVC model. Furthermore, feature selection techniques were employed to reduce the dimensionality of the data, revealing that only six features were necessary for achieving classification accuracy (>0.85) of spinach homogenate samples containing 102 CFU/ml of E. coli. These findings highlight the potential of this novel bacterial detection methodology, offering rapid, specific, and efficient solutions for applications in food safety and environmental monitoring.
Collapse
Affiliation(s)
- Nicharee Wisuthiphaet
- Department of Biotechnology, Faculty of Applied Science, King Mongkut's University of Technology North Bangkok, Bangkok, Thailand
| | - Huanle Zhang
- School of Computer Science and Technology, Shandong University, Shandong, China
| | - Xin Liu
- Department of Computer Science, University of California, Davis, Davis, California, United States
| | - Nitin Nitin
- Department of Food Science & Technology, University of California, Davis, Davis, California, United States; Department of Biological & Agricultural Engineering, University of California, Davis, Davis, California, United States.
| |
Collapse
|
2
|
Ryzhkova E, Morgunova T, Potapova E, Ryzhkov I, Fadeyev V. Fluorescence Spectroscopy With Temperature Functional Tests in the Assessment of Markers of Intracellular Energy Metabolism: Spatial Heterogeneity and Reproducibility of Measurements. JOURNAL OF BIOPHOTONICS 2024; 17:e202400294. [PMID: 39198025 DOI: 10.1002/jbio.202400294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 08/09/2024] [Accepted: 08/13/2024] [Indexed: 09/01/2024]
Abstract
The fluorescence intensities of the cellular respiratory cofactors NADH (reduced nicotinamide adenine dinucleotide) and FAD++ (oxidized flavin adenine dinucleotide) reflect energy metabolism in skin and other tissues and can be quantified in vivo by fluorescence spectroscopy (FS). However, the variability of physiological parameters largely determines the reproducibility of measurement results and the reliability of the diagnostic test. In this prospective study, we evaluated the interday reproducibility of NADH and FAD++ fluorescence intensity measurements in the skin of 51 healthy volunteers assessed by the FS at baseline, after local cooling (10°C) and heating of the skin (35°C). Results showed that the fluorescence amplitude of NADH (AFNADH) in forearm skin was the most reproducible of the FS parameters studied. Assessment of AFNADH in the dorsal forearm in combination with a thermal functional test is the most promising method for clinical use for assessing energy metabolism in the skin.
Collapse
Affiliation(s)
- Ekaterina Ryzhkova
- Department of Endocrinology No.1, Institute of Clinical Medicine N.V. Sklifosovsky, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| | - Tatyana Morgunova
- Department of Endocrinology No.1, Institute of Clinical Medicine N.V. Sklifosovsky, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| | - Elena Potapova
- Research and Development Center of Biomedical Photonics, Orel State University, Orel, Russia
| | - Ivan Ryzhkov
- V. A. Negovsky Research Institute of General Reanimatology, Federal Research and Clinical Center of Intensive Care Medicine and Rehabilitology, Moscow, Russia
| | - Valentin Fadeyev
- Department of Endocrinology No.1, Institute of Clinical Medicine N.V. Sklifosovsky, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| |
Collapse
|
3
|
Leiloglou M, Kedrzycki MS, Chalau V, Chiarini N, Thiruchelvam PTR, Hadjiminas DJ, Hogben KR, Rashid F, Ramakrishnan R, Darzi AW, Leff DR, Elson DS. Indocyanine green fluorescence image processing techniques for breast cancer macroscopic demarcation. Sci Rep 2022; 12:8607. [PMID: 35597783 PMCID: PMC9124184 DOI: 10.1038/s41598-022-12504-x] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 05/05/2022] [Indexed: 12/13/2022] Open
Abstract
Re-operation due to disease being inadvertently close to the resection margin is a major challenge in breast conserving surgery (BCS). Indocyanine green (ICG) fluorescence imaging could be used to visualize the tumor boundaries and help surgeons resect disease more efficiently. In this work, ICG fluorescence and color images were acquired with a custom-built camera system from 40 patients treated with BCS. Images were acquired from the tumor in-situ, surgical cavity post-excision, freshly excised tumor and histopathology tumour grossing. Fluorescence image intensity and texture were used as individual or combined predictors in both logistic regression (LR) and support vector machine models to predict the tumor extent. ICG fluorescence spectra in formalin-fixed histopathology grossing tumor were acquired and analyzed. Our results showed that ICG remains in the tissue after formalin fixation. Therefore, tissue imaging could be validated in freshly excised and in formalin-fixed grossing tumor. The trained LR model with combined fluorescence intensity (pixel values) and texture (slope of power spectral density curve) identified the tumor's extent in the grossing images with pixel-level resolution and sensitivity, specificity of 0.75 ± 0.3, 0.89 ± 0.2.This model was applied on tumor in-situ and surgical cavity (post-excision) images to predict tumor presence.
Collapse
Affiliation(s)
- Maria Leiloglou
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK. .,Department of Surgery and Cancer, Imperial College London, London, UK.
| | - Martha S Kedrzycki
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK.,Department of Surgery and Cancer, Imperial College London, London, UK.,Department of Breast Surgery, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Vadzim Chalau
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK.,Department of Surgery and Cancer, Imperial College London, London, UK
| | - Nicolas Chiarini
- Department of Surgery and Cancer, Imperial College London, London, UK
| | - Paul T R Thiruchelvam
- Department of Surgery and Cancer, Imperial College London, London, UK.,Department of Breast Surgery, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Dimitri J Hadjiminas
- Department of Breast Surgery, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Katy R Hogben
- Department of Breast Surgery, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Faiza Rashid
- Department of Histopathology, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Rathi Ramakrishnan
- Department of Histopathology, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Ara W Darzi
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK.,Department of Surgery and Cancer, Imperial College London, London, UK
| | - Daniel R Leff
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK.,Department of Surgery and Cancer, Imperial College London, London, UK.,Department of Breast Surgery, Charing Cross Hospital, Imperial College Healthcare NHS Trust, London, UK
| | - Daniel S Elson
- Hamlyn Centre, Institute of Global Health Innovation, Imperial College London, London, UK.,Department of Surgery and Cancer, Imperial College London, London, UK
| |
Collapse
|
4
|
Głowacz K, Skorupska S, Grabowska-Jadach I, Ciosek-Skibińska P. Excitation–emission matrix fluorescence spectroscopy for cell viability testing in UV-treated cell culture. RSC Adv 2022; 12:7652-7660. [PMID: 35424724 PMCID: PMC8982211 DOI: 10.1039/d1ra09021f] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 02/25/2022] [Indexed: 02/02/2023] Open
Abstract
Monitoring of cells viability is essential in a number of biomedical applications, including cell-based sensors, cell-based microsystems, and cell-based assays. The use of spectroscopic techniques for such purposes is especially advantageous since they are non-invasive, label-free, and non-destructive. However, such an approach must include chemometric analysis of the data to assess the information on cells viability. In the presented article we demonstrate, that excitation–emission matrix (EEM) fluorescence spectroscopy can be applied for reliable determination of cells viability due to the high correlation of EEM fluorescence data with the MTT test data. A375 cells (malignant melanoma) were exposed to UV radiation as a physical stress factor, resulting in a decrease of viability up to ca. 20%, confirmed by the standard MTT test. They were also characterized by means of EEM fluorescence spectroscopy coupled with unfolded partial least squares (UPLS) regression. Statistical evaluation revealed high accordance of the two methods of viability testing in terms of accuracy, precision, and correlation. The presented results are very promising for the development of spectroscopic soft sensors that can be applied for drug screening, biocompatibility testing, tissue engineering, and pharmacodynamic studies. Excitation-emission matrix fluorescence spectroscopy can be applied for label-free and non-destructive determination of cells viability, which is promising methodology for drug screening, biocompatibility testing, or pharmacodynamic studies.![]()
Collapse
Affiliation(s)
- Klaudia Głowacz
- Chair of Medical Biotechnology, Faculty of Chemistry, Warsaw University of Technology, Noakowskiego 3, 00-664 Warsaw, Poland
| | - Sandra Skorupska
- Chair of Medical Biotechnology, Faculty of Chemistry, Warsaw University of Technology, Noakowskiego 3, 00-664 Warsaw, Poland
| | - Ilona Grabowska-Jadach
- Chair of Medical Biotechnology, Faculty of Chemistry, Warsaw University of Technology, Noakowskiego 3, 00-664 Warsaw, Poland
| | - Patrycja Ciosek-Skibińska
- Chair of Medical Biotechnology, Faculty of Chemistry, Warsaw University of Technology, Noakowskiego 3, 00-664 Warsaw, Poland
| |
Collapse
|
5
|
Borisova E, Genova T, Bratashov D, Lomova M, Terziev I, Vladimirov B, Avramov L, Semyachkina-Glushkovskaya O. Macroscopic and microscopic fluorescence spectroscopy of colorectal benign and malignant lesions - diagnostically important features. BIOMEDICAL OPTICS EXPRESS 2019; 10:3009-3017. [PMID: 31259070 PMCID: PMC6583348 DOI: 10.1364/boe.10.003009] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2019] [Revised: 05/18/2019] [Accepted: 05/18/2019] [Indexed: 06/09/2023]
Abstract
Fluorescence spectroscopy is a sensitive, fast and non-invasive tool for a diagnostics of cancerous gastrointestinal lesions. It could be applied for in situ detection of tumours during primary endoscopic observations or as add-on measurement modality during microscopic observations of tissue histology slides for their initial or retrospective diagnosis. Therefore, we are looking for diagnostically important features of normal and cancerous tissue areas in a broad spectral range for gastrointestinal tissues ex vivo using two steady-state macroscopic fluorescent spectroscopic modalities and by confocal fluorescent microscopic detection. Results obtained from autofluorescence spectroscopy of benign and malignant lower part gastrointestinal tract (GIT) lesions from freshly excised tissues during surgical removal of the lesions in 18 patients (22 lesions), were compared with the spectral measurements obtained during confocal fluorescent microscopy observations of unstained tissue slides using 405 nm excitation. Excitation-emission matrices (EEMs) were used for ex vivo measurements with applied excitation in 280-440 nm spectral region and emission observed between 300 and 700 nm. Synchronous fluorescence spectroscopy (SFS) approach was also applied to improve the spectral resolution of the observed complex emission spectra. Specific fluorescent features observed, related to presence of structural proteins, co-enzymes and endogenous porphyrins in the tissues investigated, allow discriminating normal mucosa from benign polyps and malignant carcinoma lesions with diagnostic accuracy up to 94.4%.
Collapse
Affiliation(s)
- E. Borisova
- Institute of Electronics, Bulgarian Academy of Sciences, 72 Tsarigradsko Chaussee Blvd., Sofia, 1784, Bulgaria
- Saratov State University, 83 Astrakhanskaya Str., Saratov, 410012, Russia
| | - T. Genova
- Institute of Electronics, Bulgarian Academy of Sciences, 72 Tsarigradsko Chaussee Blvd., Sofia, 1784, Bulgaria
| | - D. Bratashov
- Saratov State University, 83 Astrakhanskaya Str., Saratov, 410012, Russia
| | - M. Lomova
- Saratov State University, 83 Astrakhanskaya Str., Saratov, 410012, Russia
| | - I. Terziev
- University Hospital “Tzaritza Yoanna – ISUL”, 8, “Byalo more” str., Sofia, 1527, Bulgaria
| | - B. Vladimirov
- University Hospital “Tzaritza Yoanna – ISUL”, 8, “Byalo more” str., Sofia, 1527, Bulgaria
| | - L. Avramov
- Institute of Electronics, Bulgarian Academy of Sciences, 72 Tsarigradsko Chaussee Blvd., Sofia, 1784, Bulgaria
| | | |
Collapse
|
6
|
Nindrea RD, Aryandono T, Lazuardi L, Dwiprahasto I. Diagnostic Accuracy of Different Machine Learning Algorithms for Breast Cancer Risk Calculation: a Meta-Analysis. Asian Pac J Cancer Prev 2018; 19:1747-1752. [PMID: 30049182 PMCID: PMC6165638 DOI: 10.22034/apjcp.2018.19.7.1747] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 07/03/2018] [Indexed: 12/12/2022] Open
Abstract
Objective: The aim of this study was to determine the diagnostic accuracy of different machine learning algorithms for breast cancer risk calculation. Methods: A meta-analysis was conducted of published research articles on diagnostic test accuracy of different machine learning algorithms for breast cancer risk calculation published between January 2000 and May 2018 in the online article databases of PubMed, ProQuest and EBSCO. Paired forest plots were employed for the analysis. Numerical values for sensitivity and specificity were obtained from false negative (FN), false positive (FP), true negative (TN) and true positive (TP) rates, presented alongside graphical representations with boxes marking the values and horizontal lines showing the confidence intervals (CIs). Summary receiver operating characteristic (SROC) curves were applied to assess the performance of diagnostic tests. Data were processed using Review Manager 5.3 (RevMan 5.3). Results: A total of 1,879 articles were reviewed, of which 11 were selected for systematic review and meta-analysis. Fve algorithms for machine learning able to predict breast cancer risk were identified: Super Vector Machine (SVM); Artificial Neural Networks (ANN); Decision Tree (DT); Naive Bayes (NB); and K-Nearest Neighbor (KNN). With the SVM, the Area Under Curve (AUC) from the SROC was > 90%, therefore classified into the excellent category. Conclusion: The meta-analysis confirmed that the SVM algorithm is able to calculate breast cancer risk with better accuracy value than other machine learning algorithms.
Collapse
Affiliation(s)
- Ricvan Dana Nindrea
- Doctoral Program, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta City, Indonesia
- Department of Public Health, Faculty of Medicine, Universitas Andalas, Padang City, Indonesia.
| | | | | | | |
Collapse
|
7
|
Kumar K, Tarai M, Mishra AK. Unconventional steady-state fluorescence spectroscopy as an analytical technique for analyses of complex-multifluorophoric mixtures. Trends Analyt Chem 2017. [DOI: 10.1016/j.trac.2017.09.004] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
8
|
Siraj N, El-Zahab B, Hamdan S, Karam TE, Haber LH, Li M, Fakayode SO, Das S, Valle B, Strongin RM, Patonay G, Sintim HO, Baker GA, Powe A, Lowry M, Karolin JO, Geddes CD, Warner IM. Fluorescence, Phosphorescence, and Chemiluminescence. Anal Chem 2015; 88:170-202. [PMID: 26575092 DOI: 10.1021/acs.analchem.5b04109] [Citation(s) in RCA: 71] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Affiliation(s)
- Noureen Siraj
- Department of Chemistry, Louisiana State University , Baton Rouge, Louisiana 70803, United States
| | - Bilal El-Zahab
- Department of Mechanical and Materials Engineering, Florida International University , Miami, Florida 33174, United States
| | - Suzana Hamdan
- Department of Chemistry, Louisiana State University , Baton Rouge, Louisiana 70803, United States
| | - Tony E Karam
- Department of Chemistry, Louisiana State University , Baton Rouge, Louisiana 70803, United States
| | - Louis H Haber
- Department of Chemistry, Louisiana State University , Baton Rouge, Louisiana 70803, United States
| | - Min Li
- Process Development Center, Albemarle Corporation , Baton Rouge, Louisiana 70805, United States
| | - Sayo O Fakayode
- Department of Chemistry, Winston-Salem State University , Winston-Salem, North Carolina 27110, United States
| | - Susmita Das
- Department of Civil Engineering, Adamas Institute of Technology , Barasat, Kolkata 700126, West Bengal India
| | - Bertha Valle
- Department of Chemistry, Texas Southern University , Houston, Texas 77004, United States
| | - Robert M Strongin
- Department of Chemistry, Portland State University , Portland, Oregon 97207, United States
| | - Gabor Patonay
- Department of Chemistry, Georgia State University , Atlanta, Georgia 30302-4098, United States
| | - Herman O Sintim
- Department of Chemistry and Biochemistry, University of Maryland , College Park, Maryland 20742, United States
| | - Gary A Baker
- Department of Chemistry, University of Missouri Columbia , Columbia, Missouri 65211-7600, United States
| | - Aleeta Powe
- Department of Chemistry, University of Louisville , Louisville, Kentucky 40208, United States
| | - Mark Lowry
- Department of Chemistry, Portland State University , Portland, Oregon 97207, United States
| | - Jan O Karolin
- Institute of Fluorescence, University of Maryland Baltimore County , Baltimore, Maryland 21202, United States
| | - Chris D Geddes
- Institute of Fluorescence, University of Maryland Baltimore County , Baltimore, Maryland 21202, United States
| | - Isiah M Warner
- Department of Chemistry, Louisiana State University , Baton Rouge, Louisiana 70803, United States
| |
Collapse
|
9
|
Kumar K, Mishra AK. Analysis of dilute aqueous multifluorophoric mixtures using excitation-emission matrix fluorescence (EEMF) and total synchronous fluorescence (TSF) spectroscopy: a comparative evaluation. Talanta 2013; 117:209-20. [PMID: 24209332 DOI: 10.1016/j.talanta.2013.09.002] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2013] [Revised: 08/31/2013] [Accepted: 09/02/2013] [Indexed: 10/26/2022]
Abstract
Excitation-emission matrix fluorescence (EEMF) and total synchronous fluorescence (TSF) spectroscopy are two conceptually different fluorescence techniques that have been used to map the fluorescence responses of the fluorophores present in a multifluorophoric mixture. EEMF was introduced four decades back and most of the fluorimeters have the suitable computer program which allows the acquisition EEMF spectra. Recently introduced TSF spectroscopy has been shown to possess good application potential in analytical fluorimetry and has started attracting the attention of analytical chemists. TSF data structure, however, is intrinsically different from EEMF data structure and a better understanding of TSF data structure is crucial to utilising its application potential. In the present work, a comprehensive comparative study between EEMF and TSF spectroscopic data set was performed by taking aqueous mixtures containing low concentrations of benzo[a]pyrene, chrysene, and pyrene as test case. The EEMF and TSF data structures were clearly explained by taking pyrene as an example. The effects of Rayleigh and Raman scattering on the quality of EEMF and TSF data sets were studied. EEMF and TSF data sets of dilute aqueous mixtures of benzo[a]pyrene, chrysene, and pyrene were subjected to three chemometric techniques PARAFAC, N-PLS, and MCR-ALS analysis. TSF data set in particular was found to be highly attuned to MCR-ALS analysis. Obtained results of chemometric analyses on EEMF and TSF data sets show that TSF data of dilute aqueous mixtures provides more accurate spectral and concentration information than EEMF data sets. Therefore, TSF spectroscopy could be considered as an alternate to the EEMF for the analyses of dilute multifluorophoric mixtures.
Collapse
Affiliation(s)
- Keshav Kumar
- Department of Chemistry, Indian Institute of Technology-Madras, Chennai-600036, India
| | | |
Collapse
|
10
|
Kumar K, Mishra AK. Application of parallel factor analysis to total synchronous fluorescence spectrum of dilute multifluorophoric solutions: addressing the issue of lack of trilinearity in total synchronous fluorescence data set. Anal Chim Acta 2012; 755:37-45. [PMID: 23146392 DOI: 10.1016/j.aca.2012.10.024] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2012] [Revised: 09/25/2012] [Accepted: 10/16/2012] [Indexed: 10/27/2022]
Abstract
In recent years, total synchronous fluorescence (TSF) spectroscopy has become popular for the analysis of multifluorophoric systems. Application of PARAFAC, a popular deconvolution tool, requires trilinear structure in the three-way data array. The present work shows that TSF based three-way array data set of dimension sample × wavelength × Δλ does not have trilinear structure and hence it should not be subjected to PARAFAC analysis. This work also proposes that a TSF data set can be converted to an excitation-emission matrix fluorescence (EEMF) like data set which has trilinear structure, so that PARAFAC analysis can be performed on it. This also enables the retrieval of PARAFAC-separated component TSF spectra.
Collapse
Affiliation(s)
- Keshav Kumar
- Department of Chemistry, Indian Institute of Technology-Madras, Chennai, India.
| | | |
Collapse
|