1
|
Tan ZC, Murphy MC, Alpay HS, Taylor SD, Meyer AS. Tensor-structured decomposition improves systems serology analysis. Mol Syst Biol 2021; 17:e10243. [PMID: 34487431 PMCID: PMC8420856 DOI: 10.15252/msb.202110243] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 08/12/2021] [Accepted: 08/16/2021] [Indexed: 01/04/2023] Open
Abstract
Systems serology provides a broad view of humoral immunity by profiling both the antigen-binding and Fc properties of antibodies. These studies contain structured biophysical profiling across disease-relevant antigen targets, alongside additional measurements made for single antigens or in an antigen-generic manner. Identifying patterns in these measurements helps guide vaccine and therapeutic antibody development, improve our understanding of diseases, and discover conserved regulatory mechanisms. Here, we report that coupled matrix-tensor factorization (CMTF) can reduce these data into consistent patterns by recognizing the intrinsic structure of these data. We use measurements from two previous studies of HIV- and SARS-CoV-2-infected subjects as examples. CMTF outperforms standard methods like principal components analysis in the extent of data reduction while maintaining equivalent prediction of immune functional responses and disease status. Under CMTF, model interpretation improves through effective data reduction, separation of the Fc and antigen-binding effects, and recognition of consistent patterns across individual measurements. Data reduction also helps make prediction models more replicable. Therefore, we propose that CMTF is an effective general strategy for data exploration in systems serology.
Collapse
Affiliation(s)
- Zhixin Cyrillus Tan
- Bioinformatics Interdepartmental ProgramUniversity of California, Los AngelesLos AngelesCAUSA
| | - Madeleine C Murphy
- Computational and Systems BiologyUniversity of California, Los AngelesLos AngelesCAUSA
| | - Hakan S Alpay
- Department of Computer ScienceUniversity of California, Los AngelesLos AngelesCAUSA
| | - Scott D Taylor
- Department of BioengineeringUniversity of California, Los AngelesLos AngelesCAUSA
| | - Aaron S Meyer
- Bioinformatics Interdepartmental ProgramUniversity of California, Los AngelesLos AngelesCAUSA
- Department of BioengineeringUniversity of California, Los AngelesLos AngelesCAUSA
- Jonsson Comprehensive Cancer CenterUniversity of California, Los AngelesLos AngelesCAUSA
- Eli and Edythe Broad Center of Regenerative Medicine and Stem Cell ResearchUniversity of California, Los AngelesLos AngelesCAUSA
| |
Collapse
|
2
|
Ultrasensitive Detection of p24 in Plasma Samples from People with Primary and Chronic HIV-1 Infection. J Virol 2021; 95:e0001621. [PMID: 33952636 DOI: 10.1128/jvi.00016-21] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
HIV-1 Gag p24 has long been identified as an informative biomarker of HIV replication, disease progression, and therapeutic efficacy, but the lower sensitivity of immunoassays in comparison to molecular tests and the interference with antibodies in chronic HIV infection limit its application for clinical monitoring. The development of ultrasensitive protein detection technologies may help in overcoming these limitations. Here, we evaluated whether immune complex dissociation combined with ultrasensitive digital enzyme-linked immunosorbent assay (ELISA) single-molecule array (Simoa) technology could be used to quantify p24 in plasma samples from people with HIV-1 infection. We found that, among different immune complex dissociation methods, only acid-mediated dissociation was compatible with ultrasensitive p24 quantification by digital ELISA, strongly enhancing p24 detection at different stages of HIV-1 infection. We show that ultrasensitive p24 levels correlated positively with plasma HIV RNA and HIV DNA and negatively with CD4-positive (CD4+) T cells in the samples from people with primary and chronic HIV-1 infection. In addition, p24 levels also correlated with plasma D-dimers and interferon alpha (IFN-α) levels. p24 levels sharply decreased to undetectable levels after initiation of combined antiretroviral treatment (cART). However, we identified a group of people who, 48 weeks after cART initiation, had detectable p24 levels despite most having undetectable viral loads. These people had different virological and immunological baseline characteristics compared with people who had undetectable p24 after cART. These results demonstrate that ultrasensitive p24 analysis provides an efficient and robust means to monitor p24 antigen in plasma samples from people with HIV-1 infection, including during antiretroviral treatment, and may provide complementary information to other commonly used biomarkers. IMPORTANCE The introduction of combined antiretroviral treatment has transformed HIV-1 infection into a manageable condition. In this context, there is a need for additional biomarkers to monitor HIV-1 residual disease or the outcome of new interventions, such as in the case of HIV cure strategies. The p24 antigen has a long half-life outside viral particles, and it is, therefore, a very promising marker to monitor episodes of viral replication or transient activation of the viral reservoir. However, the formation of immune complexes with anti-p24 antibodies makes its quantification difficult beyond acute HIV-1 infection. We show here that, upon immune complex dissociation, new technologies allow the ultrasensitive p24 quantification in plasma samples throughout HIV-1 infection at levels close to those of viral RNA and DNA determinations. Our results further indicate that ultrasensitive p24 quantification may have added value when used in combination with other classic clinical biomarkers.
Collapse
|
3
|
Charvet B, Pierquin J, Brunel J, Gorter R, Quétard C, Horvat B, Amor S, Portoukalian J, Perron H. Human Endogenous Retrovirus Type W Envelope from Multiple Sclerosis Demyelinating Lesions Shows Unique Solubility and Antigenic Characteristics. Virol Sin 2021; 36:1006-1026. [PMID: 33770381 PMCID: PMC8558138 DOI: 10.1007/s12250-021-00372-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Accepted: 02/08/2021] [Indexed: 12/15/2022] Open
Abstract
In multiple sclerosis (MS), human endogenous retrovirus W family (HERV-W) envelope protein, pHERV-W ENV, limits remyelination and induces microglia-mediated neurodegeneration. To better understand its role, we examined the soluble pHERV-W antigen from MS brain lesions detected by specific antibodies. Physico-chemical and antigenic characteristics confirmed differences between pHERV-W ENV and syncytin-1. pHERV-W ENV monomers and trimers remained associated with membranes, while hexamers self-assembled from monomers into a soluble macrostructure involving sulfatides in MS brain. Extracellular hexamers are stabilized by internal hydrophobic bonds and external hydrophilic moieties. HERV-W studies in MS also suggest that this diffusible antigen may correspond to a previously described high-molecular-weight neurotoxic factor secreted by MS B-cells and thus represents a major agonist in MS pathogenesis. Adapted methods are now needed to identify encoding HERV provirus(es) in affected cells DNA. The properties and origin of MS brain pHERV-W ENV soluble antigen will allow a better understanding of the role of HERVs in MS pathogenesis. The present results anyhow pave the way to an accurate detection of the different forms of pHERV-W ENV antigen with appropriate conditions that remained unseen until now.
Collapse
Affiliation(s)
- Benjamin Charvet
- GeNeuro Innovation, Lyon, 69008, France. .,CIRI, International Center for Infectiology Research, INSERM U1111, CNRS UMR5308, University of Lyon, ENS Lyon, France. .,Université Claude Bernard Lyon 1, Lyon, 69000, France.
| | | | - Joanna Brunel
- GeNeuro Innovation, Lyon, 69008, France.,CIRI, International Center for Infectiology Research, INSERM U1111, CNRS UMR5308, University of Lyon, ENS Lyon, France.,Université Claude Bernard Lyon 1, Lyon, 69000, France
| | - Rianne Gorter
- Department of Pathology, Amsterdam UMC, Location VUMC, 1007 MB, Amsterdam, The Netherlands
| | | | - Branka Horvat
- CIRI, International Center for Infectiology Research, INSERM U1111, CNRS UMR5308, University of Lyon, ENS Lyon, France.,Université Claude Bernard Lyon 1, Lyon, 69000, France
| | - Sandra Amor
- Department of Pathology, Amsterdam UMC, Location VUMC, 1007 MB, Amsterdam, The Netherlands.,Centre for Neuroscience and Trauma, Blizard Institute, Barts and London School of Medicine and Dentistry, Queen Mary University of London, London, E1 2AT, UK
| | | | - Hervé Perron
- GeNeuro Innovation, Lyon, 69008, France. .,Université Claude Bernard Lyon 1, Lyon, 69000, France.
| |
Collapse
|
4
|
Lu X, Zhang M, Liu W, Sheng N, Du Q, Zhang M, Guo X, Wang G, Wang Q. A method to alleviate false-positive results of the Elecsys HIV combi PT assay. Sci Rep 2021; 11:1033. [PMID: 33441741 PMCID: PMC7807026 DOI: 10.1038/s41598-020-80047-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Accepted: 12/16/2020] [Indexed: 11/09/2022] Open
Abstract
To explore the effects of urea dissociation on reducing false-positive results of the Elecsys HIV combi PT assay. A retrospective analysis was used to evaluate the false-positive rate of the Elecsys HIV combi PT assay. Six false-positive sera, six positive sera and six sera from patients with early HIV infection were collected. Dissociation was performed using 1 mol/L, 2 mol/L, 4 mol/L, 6 mol/L, or 8 mol/L urea, and HIV screening assay were then detected to select the appropriate concentration of urea dissociation. Next, 55 false-positive sera and 15 sera from early HIV infection were used to verify the best concentration of urea to achieve dissociation. Retrospective analysis showed that the COI of the Elecsys HIV combi PT assay in false-positive sera ranged from 1.0 to 200.0, and approximately 97.01%(227/234) of false-positive sera were in the range of 1.0-15.0. The avidity index (AI) in positive and false-positive sera decreased as the urea dissociation concentration increased. When the dissociation concentration was 6 mol/L, the AI of false-positive serum was between 0.0234 and 0.2567, and the AI of early HIV infection sera was between 0.4325 and 0.5017. The difference in AI between false-positive and positive samples was significant. When negativity was defined as an AI of less than 0.3970, the sensitivity and specificity were 100.0% and 100.0%, respectively. Urea-mediated dissociation could significantly reduce the false-positive rate of the Elecsys HIV combi PT assay with a low COI. Our findings provided a reference for distinguishing positive and false-positive of the Elecsys HIV combi PT assay.
Collapse
Affiliation(s)
- Xiaolan Lu
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China
| | - Minghong Zhang
- Nanchong Center for Disease Control and Prevention, Nanchong, Sichuan, People's Republic of China
| | - Wen Liu
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China
| | - Nan Sheng
- Nanchong Center for Disease Control and Prevention, Nanchong, Sichuan, People's Republic of China
| | - Qin Du
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China
| | - Maoxin Zhang
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China
| | - Xiaolan Guo
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China
| | - Guangrong Wang
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China. .,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China. .,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.
| | - Qiang Wang
- Department of Laboratory Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China. .,College of Laboratory Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China. .,Faculty of Laboratory Medicine, Center for Translational Medicine, North Sichuan Medical College, Nanchong, Sichuan, People's Republic of China.
| |
Collapse
|
5
|
Bystryak S, Ossina N. A rapid ultrasound particle agglutination method for HIV antibody detection: Comparison with conventional rapid HIV tests. J Virol Methods 2017; 249:38-47. [PMID: 28843787 DOI: 10.1016/j.jviromet.2017.08.015] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2017] [Revised: 08/15/2017] [Accepted: 08/18/2017] [Indexed: 01/05/2023]
Abstract
We present the results of the feasibility and preliminary studies on analytical performance of a rapid test for detection of human immunodeficiency virus (HIV) antibodies in human serum or plasma that is an important advance in detecting HIV infection. Current methods for rapid testing of antibodies against HIV are qualitative and exhibit poor sensitivity (limit of detection). In this paper, we describe an ultrasound particle agglutination (UPA) method that leads to a significant increase of the sensitivity of conventional latex agglutination tests for HIV antibody detection in human serum or plasma. The UPA method is based on the use of: 1) a dual mode ultrasound, wherein a first single-frequency mode is used to accelerate the latex agglutination process, and then a second swept-frequency mode of sonication is used to disintegrate non-specifically bound aggregates; and 2) a numerical assessment of results of the agglutination process. The numerical assessment is carried out by optical detection and analysis of moving patterns in the resonator cell during the swept-frequency mode. The single-step UPA method is rapid and more sensitive than the three commercial rapid HIV test kits analyzed in the study: analytical sensitivity of the new UPA method was found to be 510-, 115-, and 80-fold higher than that for Capillus™, Multispot™ and Uni-Gold™ Recombigen HIV antibody rapid test kits, respectively. The newly developed UPA method opens up additional possibilities for detection of a number of clinically significant markers in point-of-care settings.
Collapse
Affiliation(s)
- Simon Bystryak
- Allied Innovative Systems, 13 Watchung Ave., ste 102, Chatham, NJ 07928, USA.
| | - Natalya Ossina
- Allied Innovative Systems, 13 Watchung Ave., ste 102, Chatham, NJ 07928, USA
| |
Collapse
|
6
|
Bystryak S, Acharya C. Detection of HIV-1 p24 antigen in patients with varying degrees of viremia using an ELISA with a photochemical signal amplification system. Clin Chim Acta 2016; 456:128-136. [PMID: 26940950 DOI: 10.1016/j.cca.2016.02.022] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2015] [Revised: 02/25/2016] [Accepted: 02/26/2016] [Indexed: 11/28/2022]
Abstract
BACKGROUND We describe a photochemical signal amplification method (PSAM) for increasing the sensitivity of enzyme-linked immunosorbent assays (ELISAs) for the detection of HIV-1 p24 antigen, and present a preliminary validation study on ELISA+PSAM technology for detection of HIV-1 p24 antigen in clinical samples. METHODS ELISA+PSAM is compatible with commercially available microtiter plate readers, employs an inexpensive illumination device and the amplification takes around 10 min. RESULTS The PSAM technology not only increases the analytical sensitivity for detection of HIV-1 p24 antigen by approximately 40 times, but also significantly increases the clinical sensitivity of the ELISA: in instances where viral RNA load is <3000 copies/ml, conventional heat mediated immune complex disruption ELISA (HM-ELISA) cannot detect any HIV positive samples whereas HM-ELISA+PSAM can detect HIV infection in approximately half of the samples (clinical sensitivity is 52.63%). For viral RNA loads between 3000 and 30,000 copies/ml, the clinical sensitivities of the HM-ELISA and HM-ELISA+PSAM are 32.6% and 91.3%, and for that >30,000 copies/ml, clinical sensitivities of HM-ELISA and HM-ELISA+PSAM are 52.3% and 100%, respectively. CONCLUSIONS The HM-ELISA+PSAM represents an advancement in monitoring HIV-1 disease progression and treatment in the global healthcare setting.
Collapse
Affiliation(s)
- Simon Bystryak
- Allied Innovative Systems, 1 Jill Court, Bldg. 16, Unit 2, Hillsborough, NJ 08844, United States.
| | - Chitrangada Acharya
- Allied Innovative Systems, 1 Jill Court, Bldg. 16, Unit 2, Hillsborough, NJ 08844, United States
| |
Collapse
|
7
|
Gu WG, Zhang X, Ip DTM, Yang LM, Zheng YT, Wan DCC. Discovery of a novel HIV-1 integrase inhibitor from natural compounds through structure based virtual screening and cell imaging. FEBS Lett 2014; 588:3461-8. [DOI: 10.1016/j.febslet.2014.08.004] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2014] [Revised: 07/26/2014] [Accepted: 08/04/2014] [Indexed: 01/06/2023]
|
8
|
Wejse C, Furtado A, Camara C, Lüneborg-Nielsen M, Sodemann M, Gerstoft J, Katzenstein TL. Impact of tuberculosis treatment on CD4 cell count, HIV RNA, and p24 antigen in patients with HIV and tuberculosis. Int J Infect Dis 2013; 17:e907-12. [PMID: 23816410 DOI: 10.1016/j.ijid.2013.05.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2013] [Revised: 05/08/2013] [Accepted: 05/09/2013] [Indexed: 11/29/2022] Open
Abstract
OBJECTIVES To describe HIV RNA levels during tuberculosis (TB) infection in patients co-infected with TB and HIV. Moreover, to examine the p24 antigen profile during TB treatment. METHODS We examined the changes in CD4 cell count, HIV RNA, and p24 levels during anti-tuberculous therapy in a group of TB/HIV-1 co-infected and HIV-untreated patients from Guinea-Bissau. RESULTS A total of 365 TB patients were enrolled, of whom 76 were co-infected with HIV-1 and 19 were dually infected with HIV-1 + HIV-2. No significant changes in CD4, HIV RNA, or p24 levels were found during 8 months of TB treatment. HIV RNA levels correlated well with p24 (Spearman's R(2)=0.52, p<0.00001) and both markers were strong predictors of mortality. Initial HIV RNA levels correlated with a clinical TB severity index--the TBscore (Spearman's R(2)=0.23, p=0.02)--and the TBscore decreased dramatically during TB treatment although HIV RNA levels remained unchanged. CONCLUSION We found no significant changes in CD4, HIV RNA, or p24 antigen levels during 8 months of TB treatment among TB/HIV co-infected individuals, who did not receive antiretroviral treatment. The markers were unaffected by a strong improvement in TBscore and all three markers showed predictive capacity for mortality risk.
Collapse
Affiliation(s)
- C Wejse
- Department of Infectious Diseases, Aarhus University Hospital, Brendstrupgaardsvej, 8200 Aarhus N, Denmark; GloHAU, Center for Global Health, School of Public Health, Aarhus University, Aarhus, Denmark.
| | | | | | | | | | | | | |
Collapse
|
9
|
Wessman MJ, Theilgaard Z, Katzenstein TL. Determination of HIV status of infants born to HIV-infected mothers: A review of the diagnostic methods with special focus on the applicability of p24 antigen testing in developing countries. ACTA ACUST UNITED AC 2011; 44:209-15. [DOI: 10.3109/00365548.2011.627569] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
10
|
Malou N, Raoult D. Immuno-PCR: a promising ultrasensitive diagnostic method to detect antigens and antibodies. Trends Microbiol 2011; 19:295-302. [DOI: 10.1016/j.tim.2011.03.004] [Citation(s) in RCA: 85] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2010] [Revised: 02/09/2011] [Accepted: 03/08/2011] [Indexed: 11/30/2022]
|
11
|
Abstract
Currently, the majority of HIV-infected infants are found within limited-resource settings, where inadequate screening for HIV due to the lack of access to simple and affordable point-of-care tests impedes implementation of antiretroviral therapy. Here we report development of a low-cost dipstick p24 antigen assay using a visual readout format that can facilitate the diagnosis of HIV for infants in resource-poor conditions. A heat shock methodology was developed to optimize disruption of immune complexes present in the plasma of infected infants. The analytical sensitivity of the assay using recombinant p24 antigen is 50 pg/mL (2 pM) with whole virus detection as low as 42.5k RNA copies per milliliter plasma. In a blinded study comprising 51 archived infant samples from the Women and Infants Transmission Study, our assay demonstrated an overall sensitivity and specificity of 90% and 100%, respectively. In field evaluations of 389 fresh samples from South African infants, a sensitivity of 95% and specificity of 99% was achieved. The assay is simple to perform, requires minimal plasma volume (25 μL), and yields a result in less than 40 minutes making it ideal for implementation in resource-limited settings.
Collapse
|
12
|
Research needs and challenges in the development of HIV diagnostic and treatment monitoring tests for use in resource-limited settings. Curr Opin HIV AIDS 2009; 3:495-503. [PMID: 19373011 DOI: 10.1097/coh.0b013e328303e5f9] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
PURPOSE OF REVIEW The aim of this article is to review research priorities for current and new technologies to diagnose HIV and to monitor treatment response, including technologies to enumerate CD4 cell counts and quantify plasma viral load, in resource-limited settings. RECENT FINDINGS Numerous challenges remain before HIV diagnostic and treatment monitoring technologies can be broadly implemented, especially in rural areas. New technologies that are less costly and complex to use are in development and may be better suited than current technologies for use in resource-limited settings. Investment into research activities is needed for development, evaluation and validation of new technologies. The lack of clarity in the process for evaluation and validation for these technologies affects country and program-level decisions on the appropriateness of technologies for individual settings. Implementation research is needed to assess how best to use CD4 and viral load to guide initiation and management of antiretroviral treatment, as well as how best to scale up diagnosis of HIV serostatus in infants. Studies also need to be conducted to determine if the same CD4 cutoffs can be used in resource-limited settings for initiating antiretroviral therapy and prophylaxis against opportunistic infections due to potential regional differences and the impact of other common co-morbidities on CD4 cell counts. SUMMARY Increased availability of antiretroviral therapy in resource-limited settings increases the need for reliable, less costly and simpler to use HIV diagnostic and treatment monitoring technologies. Global leadership is needed to coordinate the research and development necessary to ensure that HIV diagnostic and treatment monitoring technologies are properly evaluated in the setting where they will be used.
Collapse
|
13
|
p24 as a predictor of mortality in a cohort of HIV-1-infected adults in rural Africa. J Acquir Immune Defic Syndr 2008; 48:345-9. [PMID: 18545150 DOI: 10.1097/qai.0b013e31817dc3d1] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND Implementation of antiretroviral treatment in sub-Saharan Africa requires efficient tools to monitor HIV patients. p24 measurements have been proposed as an alternative to HIV-RNA because of the low cost of reagents and equipment needed. Here, we evaluate p24 as a prognostic marker in a cohort of HIV-1-infected individuals in Zimbabwe. METHODS Treatment-naive HIV-1-infected individuals (n=198) from the Mupfure Schistosomiasis and HIV Cohort were followed until death or censoring (3-4.3 years). At baseline, p24, HIV-RNA, CD4 cell counts, and clinical staging (Centers for Disease Control and Prevention classification) were assessed. RESULTS p24 correlated with HIV-RNA (P<0.0001, R: 0.44). Ten percent of p24 but only 1% of HIV-RNA measurements was undetectable. p24 predicted Centers for Disease Control and Prevention category (P<0.001) stronger than CD4 count (P=0.34) in multivariate logistic regression. p24 predicted mortality in univariate Cox analysis (P<0.0001) and in multivariate analysis, but it was inferior to HIV-RNA and CD4 count. CONCLUSIONS This is the first study to evaluate the prognostic strength of p24 in an area with a predominance of HIV subtype C infections. p24 correlated with HIV-RNA and predicted clinical stage better than CD4 count. It predicted mortality in both univariate and multivariate analysis, but in multivariate analysis, it was inferior to HIV-RNA and CD4 count.
Collapse
|
14
|
Kajiwara K, Kodama E, Matsuoka M. A novel colorimetric assay for CXCR4 and CCR5 tropic human immunodeficiency viruses. Antivir Chem Chemother 2006; 17:215-23. [PMID: 17066899 DOI: 10.1177/095632020601700405] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
The majority of HIV isolated from infected patients uses CCR5 as a coreceptor (R5-HIV). Although R5-HIV fails to replicate efficiently in human transformed T-cell lines, HIV using CXCR4 (X4-HIV) can replicate well in such cell lines. Therefore, most of screening systems using the T-cell lines detect only X4-HIV replication. Here we report a new assay to monitor the replication of R5- as well as X4-HIV. An MTT assay using CD4-, CXCR4-, and CCR5-transduced human glioma NP-2 cells (NCK45 cells) was established and then compared with the representative assays including multinuclear activation of a galactosidase indicator assay (MAGI assay). The antiviral activities of not only an adsorption inhibitor and reverse transcriptase inhibitors but also a Tat antagonist in the NCK45 cells, were comparable to those obtained from the MTT assay using MT-4 cells or the MAGI assay. However, the activity of protease inhibitors (PIs) was underestimated, even though expressions of major multidrug resistant genes involved in efflux of PIs were comparable in MT-2, NP-2, and NCK45 cells. After cultivation of more than 6 months, NCK45 cells remained susceptible to HIV infection since NCK45 cells consistently expressed CD4, CXCR4, and CCR5. On the other hand, MAGI cells lost the CD4 expression during culture. Thus, this assay system can stably detect the replication of both X4- and R5-HIV, indicating that it should be useful for the evaluation of HIV replication and drug susceptibility.
Collapse
Affiliation(s)
- Keiko Kajiwara
- Laboratory of Virus Immunology, Institute for Virus Research, Kyoto University, Shogoin, Sakyo-ku, Kyoto, Japan
| | | | | |
Collapse
|
15
|
Patton JC, Sherman GG, Coovadia AH, Stevens WS, Meyers TM. Ultrasensitive human immunodeficiency virus type 1 p24 antigen assay modified for use on dried whole-blood spots as a reliable, affordable test for infant diagnosis. CLINICAL AND VACCINE IMMUNOLOGY : CVI 2006; 13:152-5. [PMID: 16426014 PMCID: PMC1356617 DOI: 10.1128/cvi.13.1.152-155.2006] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
The ultrasensitive human immunodeficiency virus (HIV) p24 antigen assay was modified for use on pediatric dried whole-blood spots on Whatman no. 1 filter paper. The modified assay was found to be reliable and accurate, making it an affordable tool for pediatric HIV diagnosis in developing countries.
Collapse
Affiliation(s)
- Janet C Patton
- Wits Paediatric HIV Unit, Wits Health Consortium, University of the Witwatersrand, 7 York Rd., Parktown 2193, Johannesburg, South Africa.
| | | | | | | | | |
Collapse
|
16
|
Jennings C, Fiscus SA, Crowe SM, Danilovic AD, Morack RJ, Scianna S, Cachafeiro A, Brambilla DJ, Schupbach J, Stevens W, Respess R, Varnier OE, Corrigan GE, Gronowitz JS, Ussery MA, Bremer JW. Comparison of two human immunodeficiency virus (HIV) RNA surrogate assays to the standard HIV RNA assay. J Clin Microbiol 2006; 43:5950-6. [PMID: 16333081 PMCID: PMC1317157 DOI: 10.1128/jcm.43.12.5950-5956.2005] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Human immunodeficiency virus (HIV) RNA testing is the gold standard for monitoring antiretroviral therapy in HIV-infected patients. However, equipment and reagent costs preclude widespread use of the assay in resource-limited settings. The Perkin-Elmer Ultrasensitive p24 assay and the Cavidi Exavir Load assay both offer potentially simpler, less costly technologies for monitoring viral load. These assays were compared to the Roche Amplicor HIV-1 Monitor Test, v1.5, using panels of clinical samples (subtype B) from HIV-positive subjects and HIV-spiked samples (subtypes A, C, D, CRF_01AE, CRF_02AG, and F). The Ultrasensitive p24 assay detected 100% of the spiked samples with virus loads of >250,000 copies/ml and 61% of the clinical samples with virus loads of 219 to 288,850 copies/ml. Detection rates were improved substantially if an external lysis buffer was added to the procedure. The Cavidi assay detected 54 to 100% of spiked samples with virus loads >10,000 copies/ml and 68% of the clinical samples. These detection rates were also greatly improved with a newly implemented version of this kit. Coefficients of variation demonstrate good reproducibility for each of these kits. The results from the Cavidi v1.0, Cavidi v2.0, and Perkin-Elmer, and the Perkin-Elmer Plus external buffers all correlated well with the results from the Roche Monitor Test (r = 0.83 to 0.96, r = 0.84 to 0.99, r = 0.58 to 0.67, and r = 0.59 to 0.95, respectively). Thus, the use of these two assays for monitoring patients, together with less-frequent confirmation testing, offers a feasible alternative to frequent HIV RNA testing in resource-limited settings.
Collapse
Affiliation(s)
- Cheryl Jennings
- Rush Medical College, Department of Immunology/Microbiology, 1653 W. Congress Parkway, Chicago, IL 60612, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
17
|
Li CC, Seidel KD, Coombs RW, Frenkel LM. Detection and quantification of human immunodeficiency virus type 1 p24 antigen in dried whole blood and plasma on filter paper stored under various conditions. J Clin Microbiol 2005; 43:3901-5. [PMID: 16081929 PMCID: PMC1233947 DOI: 10.1128/jcm.43.8.3901-3905.2005] [Citation(s) in RCA: 35] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
The quantification of human immunodeficiency virus type 1 (HIV-1) by an assay measuring heat-dissociated (HD) p24 antigen (Ag) in specimens of whole blood and plasma stored on filter paper, and of plasma stored in tubes, was compared to HIV-1 RNA plasma levels determined by real-time reverse transcription (RT)-PCR. The stability of p24 Ag on filter paper under conditions simulating specimen transport was also evaluated. The HD p24 Ag in both plasma and whole-blood specimens stored on filter paper correlated with plasma HIV-1 RNA levels (Spearman rank rho = 0.74 [P < 0.0001] and rho = 0.56 [P = 0.0001], respectively). The sensitivity of the HD p24 Ag assay was similar when plasma and whole blood on filter paper were contrasted to the real-time RT-PCR assay (80% versus 82.5% and 78.6% versus 83.3%, respectively). However, while the specificity of the HD p24 Ag assay of plasma on filter paper was 100%, the specificity was diminished in whole-blood specimens. The storage of specimens on filter paper for 2 weeks at 37 degrees C, 24 degrees C, or 0 degrees C did not alter the detection or quantification of HD p24 Ag. These results suggest that transport and storage of plasma on filter paper and quantification of HD p24 Ag may be a reliable method for HIV-1 load monitoring.
Collapse
Affiliation(s)
- Chung-Chen Li
- Departments of Pediatrics, Laboratory Medicine, Medicine, University of Washington, Department of Biostatistics, Children's Hospital and Regional Medical Center, Seattle, Washington, Departments of Pediatrics, Chang-Gang Children's Hospital, Kaohsiung, Taiwan
| | - Kristy D. Seidel
- Departments of Pediatrics, Laboratory Medicine, Medicine, University of Washington, Department of Biostatistics, Children's Hospital and Regional Medical Center, Seattle, Washington, Departments of Pediatrics, Chang-Gang Children's Hospital, Kaohsiung, Taiwan
| | - Robert W. Coombs
- Departments of Pediatrics, Laboratory Medicine, Medicine, University of Washington, Department of Biostatistics, Children's Hospital and Regional Medical Center, Seattle, Washington, Departments of Pediatrics, Chang-Gang Children's Hospital, Kaohsiung, Taiwan
| | - Lisa M. Frenkel
- Departments of Pediatrics, Laboratory Medicine, Medicine, University of Washington, Department of Biostatistics, Children's Hospital and Regional Medical Center, Seattle, Washington, Departments of Pediatrics, Chang-Gang Children's Hospital, Kaohsiung, Taiwan
- Corresponding author. Mailing address: 307 Westlake Avenue North, Suite 300, Room 330, Seattle, WA 98105. Phone: (206) 987-5140. Fax: (206) 987-7311. E-mail:
| |
Collapse
|
18
|
Respess RA, Cachafeiro A, Withum D, Fiscus SA, Newman D, Branson B, Varnier OE, Lewis K, Dondero TJ. Evaluation of an ultrasensitive p24 antigen assay as a potential alternative to human immunodeficiency virus type 1 RNA viral load assay in resource-limited settings. J Clin Microbiol 2005; 43:506-8. [PMID: 15635029 PMCID: PMC540096 DOI: 10.1128/jcm.43.1.506-508.2005] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
An inexpensive enzyme-linked immunosorbent assay method for human immunodeficiency virus type 1 quantitation, ultrasensitive p24 antigen assay (Up24), was compared with RNA viral load assay (VL). Up24 had 100% sensitivity of detection at a viral load of >/=30,000, with sensitivity of 46.4% at a viral load of <30,000 (232 specimens from 65 seropositive subjects). The assay was highly reproducible, with excellent correlation between duplicates and among three laboratories.
Collapse
Affiliation(s)
- Richard A Respess
- Global AIDS Program, National Center for HIV, STD and TB Prevention, Centers for Disease Control and Prevention, 1600 Clifton Rd., Mail Stop A-12, Atlanta, GA 30333, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
19
|
Prado JG, Shintani A, Bofill M, Clotet B, Ruiz L, Martinez-Picado J. Lack of longitudinal intrapatient correlation between p24 antigenemia and levels of human immunodeficiency virus (HIV) type 1 RNA in patients with chronic hiv infection during structured treatment interruptions. J Clin Microbiol 2004; 42:1620-5. [PMID: 15071015 PMCID: PMC387543 DOI: 10.1128/jcm.42.4.1620-1625.2004] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Structured treatment interruptions (STIs) have been proposed as a potential treatment strategy during human immunodeficiency virus type 1 (HIV-1) antiretroviral therapy. This still-experimental intervention requires a close monitoring of patients' plasma viremia and CD4(+)-T-cell counts during the treatment interruption phase. By using signal amplification of a heat-dissociated p24 antigen (p24Ag) assay, we compared p24Ag levels with levels of HIV RNA in plasma. One hundred seventy-four plasma samples were obtained from 51 chronically HIV-infected patients: 117 from patients who underwent STIs and 57 from patients who did not. Partial immune complex dissociation and clearance of those complexes by the erythrocytes were also investigated. A significant association between the two assays was observed (beta = 0.23, 95% confidence interval = 0.18, 0.28; P < 0.0001), but the association was smaller in the subset of samples from patients undergoing STIs. Moreover, discordant results and lack of longitudinal intrapatient correlation between levels of p24Ag and HIV-1 RNA were higher in this group. Incomplete immune complex dissociation and binding of those complexes to erythrocytes could be contributing factors involved in the diminished detection of p24Ag. Therefore, signal amplification of a heat-dissociated p24Ag had a positive association with current HIV RNA assays in a population-based analysis. However, it might not be sensitive enough to monitor longitudinal intrapatient viremia during STIs in patients with high CD4(+)-T-cell counts potentially due to the production of high-affinity anti-p24 antibodies and clearance of immune complexes by erythrocytes.
Collapse
Affiliation(s)
- Julia G Prado
- IrsiCaixa Foundation, Hospital Germans Trias i Pujol, Universitat Autonoma de Barcelona, Badalona, Spain
| | | | | | | | | | | |
Collapse
|
20
|
Affiliation(s)
- N Kumarasamy
- YRG Centre for AIDS Research and Education, VHS, Chennai-600113, India.
| |
Collapse
|
21
|
Sherman GG, Stevens G, Stevens WS. Affordable diagnosis of human immunodeficiency virus infection in infants by p24 antigen detection. Pediatr Infect Dis J 2004; 23:173-6. [PMID: 14872188 DOI: 10.1097/01.inf.0000109332.83246.1a] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
The expense of PCR testing limits diagnosis of HIV infection in infancy in low resource settings. The ultrasensitive p24 antigen assay has been proposed as an accurate substitute; however, its ability to detect different HIV viral subtypes remains to be determined. A sensitivity of 98.1% and specificity of 98.7% was obtained testing 203 samples from 24 HIV-infected and 66 uninfected infants born to HIV subtype C-infected women.
Collapse
Affiliation(s)
- Gayle G Sherman
- Department of Molecular Medicine and Haematology, National Health Laboratory Service, University of the Witwatersrand, Johannesburg, South Africa
| | | | | |
Collapse
|
22
|
Bonard D, Rouet F, Toni TA, Minga A, Huet C, Ekouévi DK, Dabis F, Salamon R, Rouzioux C. Field evaluation of an improved assay using a heat-dissociated p24 antigen for adults mainly infected with HIV-1 CRF02_AG strains in Côte d'Ivoire, West Africa. J Acquir Immune Defic Syndr 2003; 34:267-73. [PMID: 14600570 DOI: 10.1097/00126334-200311010-00002] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
The aim of this study was to evaluate the heat-dissociated p24 antigen (HD p24 Ag) assay as an alternative low-cost tool for diagnosis of HIV-1 infection and quantitation of HIV-1 RNA levels in African adults mainly infected with HIV-1 CRF02_AG strains. One hundred seventeen plasma specimens were obtained from HIV-1-seropositive subjects enrolled in the ANRS 1220 PRIMO-CI cohort (Abidjan, Côte d'Ivoire, West Africa). Results of the HD p24 Ag assay were comparable with those of HIV-1 RNA levels quantified in the same antibody-positive plasma samples by the Amplicor HIV-1 Monitor assay (1.5 version; Roche Diagnostics, Indianapolis, IN): sensitivity, 95.7% versus 96.6%, respectively; specificity (evaluated with samples from 75 seronegative subjects), 94.7% versus 100%, respectively. HD p24 Ag and HIV-1 RNA assays were weakly correlated (Spearman coefficient correlation, r = 0.33; P < 0.001) except for HIV-1 RNA levels of >/=5 log10 copies/mL (r = 0.62; P < 0.001). Quantitation of HD p24 antigenemia in 76 plasma specimens from 14 patients treated with highly active antiretroviral therapy demonstrated weaker changes during treatment than those observed with the HIV-1 RNA assay. Follow-up of infected patients using both markers showed different results. The reliability of the HD p24 Ag assay is questionable for clinical and biologic management as a surrogate tool for measurement of HIV-1 RNA levels in Africa.
Collapse
Affiliation(s)
- D Bonard
- Centre de Diagnostic et de Recherches sur le SIDA, CHU de Treichville, BP V3 Abidjan, Côte d'Ivoire, West Africa.
| | | | | | | | | | | | | | | | | |
Collapse
|
23
|
Schüpbach J. Viral RNA and p24 Antigen as Markers of HIV Disease and Antiretroviral Treatment Success. Int Arch Allergy Immunol 2003; 132:196-209. [PMID: 14646380 DOI: 10.1159/000074552] [Citation(s) in RCA: 38] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
HIV-1 RNA has become the standard for monitoring antiretroviral therapies. Dogma predicts, however, that a viral protein like p24 should be at least as good a marker of HIV disease activity, provided that it is measured with sufficient sensitivity and accuracy. Simple modifications including use of a more efficient virus lysis buffer, heat-mediated destruction of antibodies interfering with antigen detection, and tyramide signal amplification for increased sensitivity have highly improved the HIV-1 p24 antigen assay. The p24 antigen assay is inferior to RT-PCR in detecting viral particles, but the presence of extraviral p24 antigen in most samples makes largely up for this. p24 antigen testing is similarly sensitive and specific in diagnosing pediatric HIV infection, in predicting CD4+ T cell decline and clinical progression at early and late stage of infection, and suitable for antiretroviral treatment monitoring in both adults and children. Notably, p24 antigen was measurable even in patients with stably suppressed viremia, and its concentrations were correlated negatively with the concentrations of CD4+ T cells and positively with the concentrations of activated CD8+ T cell subsets. p24 antigen is an excellent marker of HIV expression and disease activity and can be used in the same fields of application as HIV RNA is used. The test is validated for subtype B, but requires further studies for non-B subtypes.
Collapse
Affiliation(s)
- Jörg Schüpbach
- Swiss National Center for Retroviruses, University of Zürich, Zürich, Switzerland.
| |
Collapse
|
24
|
Perrin A, Duracher D, Perret M, Cleuziat P, Mandrand B. A combined oligonucleotide and protein microarray for the codetection of nucleic acids and antibodies associated with human immunodeficiency virus, hepatitis B virus, and hepatitis C virus infections. Anal Biochem 2003; 322:148-55. [PMID: 14596821 DOI: 10.1016/j.ab.2003.08.002] [Citation(s) in RCA: 35] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
A multiplexed assay based on the codetection of nucleic acids and antibodies in human serum infected by human immunodeficiency virus (HIV), hepatitis B virus (HBV) or hepatitis C virus was proposed. The combined immuno- and oligosorbent array (CombOLISA) microarray is prepared in 96-well standard microplates by spotting (1). nucleic probes specific for a virus genome, (2). viral proteins for the capture of serum antibodies, and (3). nonspecific proteins for verifying specificity. Experimental assay conditions were optimized so that both DNA hybridization and immunological reactions can be achieved simultaneously in the same well and buffer and all at the same temperature. A generic detection system based on the precipitation of an insoluble colorimetric substrate in the presence of enzyme-labeled antibodies or streptavidin was proposed. The optical density of each spot was correlated to the corresponding analyte concentration. The influence of critical parameters on CombOLISA performance such as serum concentration was studied. Calibration curves and sensitivity thresholds were established for each parameter. Serial dilutions of serum were correlated to results obtained with validated immunoassay platforms such as a microplate enzyme-linked immunosorbent assay or the VIDAS automat. Also, several HIV- and HBV-infected serum samples were tested independently by CombOLISA and VIDAS. Coefficients of variation for genomic and proteomic parameters vs spot density were below 15%.
Collapse
Affiliation(s)
- Agnès Perrin
- UMR 2142 CNRS-bioMérieux, 46 allée d'Italie, 69364 Lyon Cedex 07, France.
| | | | | | | | | |
Collapse
|
25
|
Pascual A, Cachafeiro A, Funk ML, Fiscus SA. Comparison of an assay using signal amplification of the heat-dissociated p24 antigen with the Roche Monitor human immunodeficiency virus RNA assay. J Clin Microbiol 2002; 40:2472-5. [PMID: 12089264 PMCID: PMC120606 DOI: 10.1128/jcm.40.7.2472-2475.2002] [Citation(s) in RCA: 35] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
We compared an assay using signal amplification of a heat-dissociated p24 antigen (HDAg) with the Roche Monitor human immunodeficiency virus (HIV) RNA assay. The two assays gave comparable results when 130 specimens from 130 patients were tested (r = 0.60, P < 0.0001). The HDAg assay was almost as sensitive (85%) as the Roche HIV RNA kit (95%), just as specific (25 negative results from 25 HIV seronegative volunteers [100%]), less variable (mean log standard deviation of 0.07 compared to 0.11 when eight specimens were tested three or four times), and less expensive (reagent and labor costs, $8 versus $75). The assay appeared to be useful for monitoring established patients (n = 17) and identifying seroconverters (n = 4). HIV subtypes A to F were all recognized. This assay should be useful for monitoring patients in resource-poor countries and for monitoring vaccine recipients.
Collapse
Affiliation(s)
- Alvaro Pascual
- Department of Microbiology, Universidad de Sevilla, Seville, Spain
| | | | | | | |
Collapse
|