1
|
Knight B, Otwell T, Coryell MP, Stone J, Davis P, Necciai B, Carlson PE, Sozhamannan S, Schubert AM, Yan YH. Using machine learning models to predict the impact of template mismatches on polymerase chain reaction assay performance. Sci Rep 2025; 15:16184. [PMID: 40346302 PMCID: PMC12064694 DOI: 10.1038/s41598-025-98444-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Accepted: 04/11/2025] [Indexed: 05/11/2025] Open
Abstract
Molecular assays are critical tools for the diagnosis of infectious diseases. These assays have been extremely valuable during the COVID pandemic, used to guide both patient management and infection control strategies. Sustained transmission and unhindered proliferation of the virus during the pandemic resulted in many variants with unique mutations. Some of these mutations could lead to signature erosion, where tests developed using the genetic sequence of an earlier version of the pathogen may produce false negative results when used to detect novel variants. In this study, we assessed the performance changes of 15 molecular assay designs when challenged with a variety of mutations that fall within the targeted region. Using data generated from this study, we trained and assessed the performance of seven different machine learning models to predict whether a specific set of mutations will result in significant change in the performance for a specific test design. The best performing model demonstrated acceptable performance with sensitivity of 82% and specificity of 87% when assessed using tenfold cross validation. Our findings highlighted the potential of using machine learning models to predict the impact of emerging mutations on the performance of specific molecular test designs.
Collapse
Affiliation(s)
- Brittany Knight
- MRIGlobal, 425 Dr. Martin Luther King Jr. Boulevard, Kansas City, MO, 64110, USA
| | - Taylor Otwell
- MRIGlobal, 425 Dr. Martin Luther King Jr. Boulevard, Kansas City, MO, 64110, USA
| | - Michael P Coryell
- Laboratory of Mucosal Pathogens and Cellular Immunology, Division of Bacterial, Parasitic and Allergenic Products, Office of Vaccines Research and Review, Biologics Evaluation and Research, U.S. Food and Drug Administration, Silver Spring, MD, 20993, USA
| | - Jennifer Stone
- MRIGlobal, 425 Dr. Martin Luther King Jr. Boulevard, Kansas City, MO, 64110, USA
| | - Phillip Davis
- MRIGlobal, 425 Dr. Martin Luther King Jr. Boulevard, Kansas City, MO, 64110, USA
| | - Bryan Necciai
- Defense Biological Product Assurance Office (DBPAO), Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND), Joint Project Lead, Enabling Biotechnologies JPL-EB, Frederick, MD, 21702, USA
| | - Paul E Carlson
- Laboratory of Mucosal Pathogens and Cellular Immunology, Division of Bacterial, Parasitic and Allergenic Products, Office of Vaccines Research and Review, Biologics Evaluation and Research, U.S. Food and Drug Administration, Silver Spring, MD, 20993, USA
| | - Shanmuga Sozhamannan
- Defense Biological Product Assurance Office (DBPAO), Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND), Joint Project Lead, Enabling Biotechnologies JPL-EB, Frederick, MD, 21702, USA
- Joint Research and Development, Inc., Stafford, VA, 22556, USA
| | - Alyxandria M Schubert
- Division of Microbiology, Office of In Vitro Diagnostics, Office of Product Evaluation and Quality, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD, 20993, USA
| | - Yi H Yan
- Division of Microbiology, Office of In Vitro Diagnostics, Office of Product Evaluation and Quality, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD, 20993, USA.
| |
Collapse
|
2
|
Negrón DA, Trivedi S, Tolli N, Ashford D, Melton G, Guertin S, Jennings K, Necciai BD, Sozhamannan S, Abramson BW. Loop-mediated isothermal amplification assays for the detection of antimicrobial resistance elements in Vibrio cholera. BMC Bioinformatics 2024; 25:384. [PMID: 39695927 DOI: 10.1186/s12859-024-06001-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2024] [Accepted: 11/26/2024] [Indexed: 12/20/2024] Open
Abstract
BACKGROUND The bacterium Vibrio cholerae causes diarrheal illness and can acquire genetic material leading to multiple drug resistance (MDR). Rapid detection of resistance-conferring mobile genetic elements helps avoid the prescription of ineffective antibiotics for specific strains. Colorimetric loop-mediated isothermal amplification (LAMP) assays provide a rapid and cost-effective means for detection at point-of-care since they do not require specialized equipment, require limited expertise to perform, and can take less than 30 min to perform in resource limited regions. LAMP output is a color change that can be viewed by eye, but it can be difficult to design primer sets, determine target specificity, and interpret subjective color changes. METHODS We developed an algorithm for the in silico design and evaluation of LAMP assays within the open-source PCR Signature Erosion Tool (PSET) and a computer vision application for the quantitative analysis of colorimetric outputs. First, Primer3 calculates LAMP primer sequence candidates with settings based on GC-content optimization. Next, PSET aligns the primer sequences of each assay against large sequence databases to calculate sufficient sequence similarity, coverage, and primer arrangement to the intended taxa, ultimately generating a confusion matrix. Finally, we tested assay candidates in the laboratory against synthetic constructs. RESULTS As an example, we generated new LAMP assays targeting drug resistance in V. cholerae and evaluated existing ones from the literature based on in silico target specificity and in vitro testing. Improvements in the design and testing of LAMP assays, with heightened target specificity and a simple analysis platform, increase utility for in-field applications. Overall, 9 of the 16 tested LAMP assays had positive signal through visual and computer vision-based detection methods developed here. Here we show LAMP assays tested on synthetic AMR gene targets for aph(6), varG, floR, qnrVC5, and almG, which allow for resistance to aminoglycosides, penicillins, carbapenems, phenicols, fluoroquinolones, and polymyxins respectively.
Collapse
Grants
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
- W911SR-22-C-0049 Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND)
Collapse
Affiliation(s)
| | - Shipra Trivedi
- Noblis, Inc., 2002 Edmund Halley Dr, Reston, VA, 20191, USA
| | | | - David Ashford
- Noblis ESI, 14425 Penrose Pl, Chantilly, VA, 20151, USA
| | | | | | | | - Bryan D Necciai
- Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND), Joint Project Lead for CBRND Enabling Biotechnologies (JPL CBRND EB), Frederick, MD, 21702, USA
| | - Shanmuga Sozhamannan
- Joint Program Executive Office for Chemical, Biological, Radiological and Nuclear Defense (JPEO-CBRND), Joint Project Lead for CBRND Enabling Biotechnologies (JPL CBRND EB), Frederick, MD, 21702, USA
- Joint Research and Development, Inc., Stafford, VA, 22556, USA
| | | |
Collapse
|
3
|
Han G, Deng W, Lyu Q, Ma Q, Qiao L. Multiplexed discrimination of SARS-CoV-2 variants via duplex-specific nuclease combined MALDI-TOF MS. Anal Bioanal Chem 2024; 416:1833-1842. [PMID: 38367041 DOI: 10.1007/s00216-024-05202-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 02/02/2024] [Accepted: 02/06/2024] [Indexed: 02/19/2024]
Abstract
The frequent mutations in SARS-CoV-2 significantly increase the virus's pathogenicity and transmissibility while also diminishing the effectiveness of vaccines. Consequently, assays capable of rapidly and simultaneously identifying multiple SARS-CoV-2 variants are essential for large-scale applications that aim to monitor the evolution of the virus. In this work, we propose a method combining duplex-specific nuclease (DSN)-assisted cyclic amplification with matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS) detection, enabling the simultaneous identification of multiple SARS-CoV-2 variants at high-throughput. Due to the high specificity of DSN, single-base mutations can be resolved by the method. With ultra-sensitive detection by MALDI-TOF MS, a limit of detection of 100 pM viral RNA fragment was demonstrated. The assay was used for simultaneous identification and typing of SARS-CoV-2 Alpha, Beta, and Delta variants. The whole assay can be accomplished within 3 h, and the amplification is performed under constant temperature, making the technique simple in operation and efficient. It is also feasible to extend the technique to the detection of many other variants of the virus. We expect that the method can add value to the rapid screening of viral variants and can play an important role in pandemic control.
Collapse
Affiliation(s)
- Guobin Han
- Department of Chemistry, and Shanghai Stomatological Hospital, Fudan University, Shanghai, 200000, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, 310022, Zhejiang, China
| | - Wenchan Deng
- College of Pharmaceutical Sciences, Zhejiang University, Hangzhou, 310058, Zhejiang, China
| | - Qian Lyu
- Bioyong Technologics Inc, Beijing, 100176, China
| | - Qingwei Ma
- Bioyong Technologics Inc, Beijing, 100176, China
| | - Liang Qiao
- Department of Chemistry, and Shanghai Stomatological Hospital, Fudan University, Shanghai, 200000, China.
| |
Collapse
|