1
|
Colonetti T, Rodrigues Uggioni ML, Meller Dos Santos AL, Michels Uggioni N, Uggioni Elibio L, Balbinot EL, Grande AJ, Rosa MI. Self-sampling for HPV testing in cervical cancer screening: A scoping review. Eur J Obstet Gynecol Reprod Biol 2024; 296:20-51. [PMID: 38394715 DOI: 10.1016/j.ejogrb.2024.02.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 02/14/2024] [Accepted: 02/18/2024] [Indexed: 02/25/2024]
Abstract
Cervical cancer is the third most common gynecological cancer worldwide. Its origin is linked to intraepithelial lesions caused by high-risk Human Papillomavirus (HPV) types, detected in 99.7% of cases. Early screening is essential to prevent cancer development from these lesions. Molecular methods are more specific and offer the possibility of being performed through a self-collected sample by the patient, thus contributing to increasing screening coverage for this pathology. This study aim was to map the medical-scientific literature on existing protocols for self-sampling for HPV testing in cervical cancer screening. A search strategy was developed using the following keywords and their synonyms: "self-sampling," "professional sampling," and "HPV", on the databases: MEDLINE, Cochrane Library, Virtual Health Library - BVS, Scopus, National Institute for Health Research NHS EED, Web of Science, and EMBASE. The search strategy was formulated to identify relevant studies and describe their main characteristics, such as patient acceptance of self-sampling, cost differences between the tests used, and the accuracy of self-sampling compared to the gold standard test. A total of 876 studies were found, and 33 of those studies were included in this review. Out of these, 10 studies were domized clinical trials involving 46,751 patients, and 23 observational studies included 142,795 patients. Regarding acceptance, most studies reported a preference for self-sampling. Sensitivity analyses from various studies also showed that the low cost of self-sampling kits generally increased cost-effectiveness. The study concluded that using HPV testing on self-collected samples is a viable strategy for monitoring women with HPV.
Collapse
Affiliation(s)
- Tamy Colonetti
- Laboratory of Translational Biomedicine, University of Extremo Sul Catarinense (UNESC), Criciúma, SC, Brazil
| | | | | | | | - Laura Uggioni Elibio
- Laboratory of Translational Biomedicine, University of Extremo Sul Catarinense (UNESC), Criciúma, SC, Brazil
| | - Eduarda Letícia Balbinot
- Laboratory of Translational Biomedicine, University of Extremo Sul Catarinense (UNESC), Criciúma, SC, Brazil
| | - Antonio José Grande
- Laboratory of Evidence-Based Practice, State University of Mato Grosso do Sul, Av. Dom Antonio Barbosa (MS-080), 4155 - CEP 79115-898, Campo Grande, MS, Brazil
| | - Maria Inês Rosa
- Laboratory of Translational Biomedicine, University of Extremo Sul Catarinense (UNESC), Criciúma, SC, Brazil.
| |
Collapse
|
2
|
Beaverson S, Cyrus JW, Huffstetler AN. Concordance of Primary Human Papillomavirus Testing Among Clinicians and Patients: A Systematic Review. J Womens Health (Larchmt) 2023; 32:1062-1072. [PMID: 37582276 PMCID: PMC10623466 DOI: 10.1089/jwh.2023.0125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2023] Open
Abstract
Objective: Primary high risk human papilloma virus (hrHPV) testing is recommended as first-line screening for cervical cancer. Testing involves either a clinician-collected or a self-collected cervicovaginal swab. This study examines concordance between methods of collection of primary HPV testing. Methods: Ovid MEDLINE, Ovid Embase, and Cochrane were searched for relevant studies on self-collected and clinician-collected primary HPV testing published before December 31, 2022. English-language studies for primary HPV testing of average-risk patients were included. Studies conducted in screening settings rather than colposcopy clinics, that used standard devices for HPV collection, and that directly compared methods of collection were included. Outcomes were concordance and kappa between paired samples, and rate of HPV detection in self-collected and clinician-collected samples. Results: A total of 2381 studies were screened, of which 228 were included for full-text evaluation. Thirty-six studies, including 23,328 individuals screened, met the inclusion criteria. The rate of HPV detection ranged from 4.7% to 63% for self-collection and from 3.7% to 62% for clinician-collection. The concordance ranged from 78.2% to 96.9%, and kappa had substantial agreement for 26 of the 36 studies and moderate agreement for 7 of the 36 studies. Conclusions: This study directly compares clinician-collected and self-collected primary HPV screening rates. Studies were conducted in methods which are widely reproducible in the primary care setting. Primary HPV self-collection is a reliable and accurate method for cervical cancer screening.
Collapse
Affiliation(s)
- Sarah Beaverson
- School of Medicine, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA
| | - John W. Cyrus
- Health Sciences Library, Virginia Commonwealth University, Richmond, Virginia, USA
| | - Alison N. Huffstetler
- Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, Virginia, USA
| |
Collapse
|
3
|
Di Gennaro G, Licata F, Trovato A, Bianco A. Does self-sampling for human papilloma virus testing have the potential to increase cervical cancer screening? An updated meta-analysis of observational studies and randomized clinical trials. Front Public Health 2022; 10:1003461. [PMID: 36568753 PMCID: PMC9773849 DOI: 10.3389/fpubh.2022.1003461] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/15/2022] [Indexed: 12/13/2022] Open
Abstract
Objectives A meta-analysis was conducted to examine the effectiveness of HPV self-sampling proposal on cervical cancer screening (CCS) uptake when compared with an invitation to have a clinician to collect the sample. Secondary outcomes were acceptability and preference of self-sampling compared to clinician-collected samples. Methods The present systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Studies examining the CCS uptake comparing self-sampling over invitation to be sampled by an healthcare professional and examining the proportion of women accepting or preferring self-sampling vs. clinician-collected sampling were included. The CCS uptake was also explored according to strategy of self-samplers' distribution, collection device type and screening status. Peters' test and Funnel Plot inspection were used to assess the publication bias. Quality of the studies was assessed through Cochrane Risk of Bias and NIH Quality Assessment tools. Results One hundred fifty-four studies were globally identified, and 482,271 women were involved. Self-sampling procedures nearly doubled the probability (RR: 1.8; 95% CI: 1.7-2.0) of CCS uptake when compared with clinician-collected samples. The opt-out (RR: 2.1; 95% CI: 1.9-2.4) and the door-to-door (RR: 1.8; 95% CI: 1.6-2.0) did not statistically significant differ (p = 1.177) in improving the CCS uptake. A higher relative uptake was shown for brushes (RR: 1.6; 95% CI: 1.5-1.7) and swabs (RR: 2.5; 95% CI: 1.9-3.1) over clinician-collected samples. A high between-studies variability in characteristics of sampled women was shown. In all meta-analyses the level of heterogeneity was consistently high (I 2 > 95%). Publication bias was unlikely. Conclusions Self-sampling has the potential to increase participation of under-screened women in the CCS, in addition to the standard invitation to have a clinician to collect the sample. For small communities door-to-door distribution could be preferred to distribute the self-sampler while; for large communities opt-out strategies should be preferred over opt-in. Since no significant difference in acceptability and preference of device type was demonstrated among women, and swabs and brushes exhibited a potential stronger effect in improving CCS, these devices could be adopted.
Collapse
Affiliation(s)
| | - Francesca Licata
- Department of Health Sciences, School of Medicine, University of Catanzaro “Magna Græcia”, Catanzaro, Italy
| | | | | |
Collapse
|
4
|
Letter to the Editor. J Low Genit Tract Dis 2020; 24:423. [PMID: 32986388 DOI: 10.1097/lgt.0000000000000554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Acceptability of Women Self-Sampling versus Clinician-Collected Samples for HPV DNA Testing: A Systematic Review. J Low Genit Tract Dis 2019; 23:193-199. [PMID: 30933030 DOI: 10.1097/lgt.0000000000000476] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVES Female self-sampling for human papillomavirus (HPV) DNA testing is an alternative screening method that can potentially increase cervical cancer screening coverage. This review addresses the acceptability of HPV DNA testing using self-sampling compared with conventional clinician-collected sampling. Barriers to and others factors associated with acceptability of either method were also examined. METHODS The following electronic resources were searched: Medline @EBSCOHOST(Medline), Embase, PubMed, and CINAHL databases. Manual searches were also conducted. The main outcome of interest was the acceptability of HPV DNA testing by self-sampling in comparison with clinician-collected sampling. RESULTS In total, 23 articles were included in this systematic review. The majority (19 studies) were quantitative intervention studies and 4 studies were qualitative observational studies. Eleven studies reported a preference for self-sampling by women compared with clinician-collected sampling (64.7%-93%). The remaining studies found that women preferred clinician-collected sampling because mainly of respondents' lack of confidence in their ability to complete self-sampling correctly. In most articles reviewed, the studied associated factors, such as demographic factors (age, marital status, and ethnicity), socioeconomic factors (income, education level), reproductive factors (condom use, number of children, current use of contraception, and number of partners), and habits (smoking status) were not found to be significantly associated with preference. CONCLUSIONS Both methods of sampling were found to be acceptable to women. Self-sampling is cost-effective and could increase the screening coverage among underscreened populations. However, more information about the quality, reliability, and accuracy of self-sampling is needed to increase women's confidence about using to this method.
Collapse
|
6
|
Chatzistamatiou K, Chatzaki Ε, Constantinidis Τ, Nena E, Tsertanidou A, Agorastos T. Self-collected cervicovaginal sampling for site-of-care primary HPV-based cervical cancer screening: a pilot study in a rural underserved Greek population. J OBSTET GYNAECOL 2017. [PMID: 28631511 DOI: 10.1080/01443615.2017.1323197] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
In the present pilot study, the feasibility of a site-of-care cervicovaginal self-sampling methodology for HPV-based screening was tested in 346 women residing in underserved rural areas of Northern Greece. These women provided self-collected cervicovaginal sample along with a study questionnaire. Following molecular testing, using the cobas® HPV Test, Roche®, HPV positive women, were referred to colposcopy and upon abnormal findings, to biopsy and treatment. Participation rate was 100%. Regular pap-test examination was reported for 17.1%. Among hrHPV testing, 11.9% were positive and colposcopy/biopsy revealed 2 CIN3 cases. Non-compliance was the most prevalent reason for no previous attendance. Most women reported non-difficulty and non-discomfort in self-sampling (77.6% and 82.4%, respectively). They would choose self-sampling over clinician-sampling (86.2%), and should self-sampling being available, they would test themselves more regularly (92.3%). In conclusion, self-sampling is feasible and well-accepted for HPV-based screening, and could increase population coverage in underserved areas, helping towards successful prevention.
Collapse
Affiliation(s)
- Kimon Chatzistamatiou
- a 4th Department of Obstetrics and Gynecology , Hippokratio Hospital of Thessaloniki , Thessaloniki , Greece
| | - Εkaterini Chatzaki
- b Laboratory of Pharmacology , Medical School, Democritus University of Thrace , Alexandroupolis , Greece
| | - Τheocharis Constantinidis
- c Peripheral Laboratory of Public Health , Hellenic Center for Disease Control and Prevention, Ministry of Health , Alexandroupolis , Greece
| | - Evangelia Nena
- d Laboratory of Hygiene and Environmental Protection , Medical School, Democritus University of Thrace , Alexandroupolis , Greece
| | - Athena Tsertanidou
- a 4th Department of Obstetrics and Gynecology , Hippokratio Hospital of Thessaloniki , Thessaloniki , Greece
| | - Theodoros Agorastos
- a 4th Department of Obstetrics and Gynecology , Hippokratio Hospital of Thessaloniki , Thessaloniki , Greece
| |
Collapse
|
7
|
Waller J, McCaffery K, Forrest S, Szarewski A, Cadman L, Austin J, Wardle J. Acceptability of unsupervised HPV self-sampling using written instructions. J Med Screen 2016; 13:208-13. [PMID: 17217611 DOI: 10.1177/096914130601300409] [Citation(s) in RCA: 89] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Objectives The study measured the acceptability of self-sampling for human papillomavirus (HPV) testing in the context of cervical cancer screening. Women carried out self-sampling unsupervised, using a written instruction sheet. Setting Participants were women attending either a family planning clinic or a primary care trust for routine cervical screening. Methods Women (n = 902) carried out self-sampling for HPV testing and then a clinician did a routine cervical smear and HPV test. Immediately after having the two tests, participants completed a measure of acceptability for both tests, and answered questions about ease of using the instruction sheet and willingness to use self-sampling in the future. Results The majority of women found self-sampling more acceptable than the clinician-administered test, but there was a lack of confidence that the test had been done correctly. Significant demographic differences in attitudes were found, with married women having more favourable attitudes towards self-sampling than single women, and Asian women having more negative attitudes than women in other ethnic groups. Intention to use self-sampling in the future was very high across all demographic groups. Conclusion Self-sampling for HPV testing was highly acceptable in this large and demographically diverse sample, and women were able to carry out the test alone, using simple written instructions. Consistent with previous studies, women were concerned about doing the test properly and this issue will need to be addressed if self-sampling is introduced. More work is needed to see whether the demographic differences we found are robust and to identify reasons for lower acceptability among single women and those from Asian background.
Collapse
Affiliation(s)
- J Waller
- Cancer Research UK Health Behaviour Unit, Department of Epidemiology and Public Health, UCL, London, UK.
| | | | | | | | | | | | | |
Collapse
|
8
|
da Silva Rocha A, Guilherme Schaefer P, Isabel Albano Edelweiss M. Cervical cytological screening: Assessment of the Fournier ® self-sampling device in a cervical pathology outpatient clinic. Diagn Cytopathol 2015. [PMID: 26223029 DOI: 10.1002/dc.23307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
BACKGROUND The objective of this study was to investigate the performance of the Fournier(®) self-sampled device in the cytological diagnosis of cervical precursor or neoplastic lesions. The colposcopy and cervical biopsy were used as the gold standard evaluation. METHOD This was a case-control study performed at a cervical pathology outpatient clinic from January 2008 to October 2009. Samples were obtained through physician-collected mode before a colposcopic evaluation. Liquid-based cytology slides obtained with the device in question were stained using the Papanicolaou method and anti-p16 immunocytochemistry and were analyzed by two pathologists blind to the histological and colposcopic diagnoses. RESULTS Diagnostic performance for Fournier device using Papanicolaou technique was sensitivity 41.1% (Pathologist 1-P1) and 52.9% (Pathologist 2-P2) for diagnosing low-grade intraepithelial lesions; for high-grade lesions and cervical cancer, sensitivity was 68.7% (P1) and 75.0% (P2) and specificity was 81.8% (P1) and 73.8% (P2). When using the anti-p16 immunocytochemistry, the sensitivity for diagnosing low-grade intraepithelial lesions was 57.1% (P1) and 62.9% (P2), and the sensitivity was 87.5% (P1) and 93.8% (P2) for high-grade lesions and cancer. The specificity was 75.0% (P1) and 54.4% (P2). CONCLUSIONS These results show that when used with "blind" physician-collected cytology in an outpatient setting, the Fournier(®) device achieved a sensitivity and specificity comparable to those obtained by the Pap test traditionally collected during a speculum examination.
Collapse
Affiliation(s)
- Alexandre da Silva Rocha
- Medical Sciences Post-Graduation Program, Universidade Federal Do Rio Grande Do Sul/Brasil, Porto Alegre/RS, Brazil
| | | | | |
Collapse
|
9
|
Papagiannis D, Rachiotis G, Symvoulakis EK, Daponte A, Grivea IN, Syrogiannopoulos GA, Hadjichristodoulou C. Vaccination against human papillomavirus among 865 female students from the health professions in central Greece: a questionnaire-based cross-sectional study. J Multidiscip Healthc 2013; 6:435-9. [PMID: 24324338 PMCID: PMC3855014 DOI: 10.2147/jmdh.s49558] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND There are still sparse data on vaccination coverage against human papillomavirus (HPV) among students in the health professions. The aim of this study was to investigate HPV vaccination coverage in female students from the health professions in Greece. METHODS A self-administered, anonymous questionnaire was distributed to second-year and third-year female students pursuing degrees in medicine, nursing, and paramedical health disciplines in central Greece. RESULTS Overall vaccination coverage was 44.3%. The major reason for lack of vaccination was fear about safety of the vaccine. Participants who had received information about safety of the vaccine from the mass media and paramedical students had lower vaccination coverage in comparison with students who had received information about vaccine safety from alternative sources. CONCLUSION Further quantitative and qualitative research is needed to design educational activities targeting female students in the health professions in order to create a positive domino effect and improve HPV vaccination coverage levels in Greece.
Collapse
Affiliation(s)
- Dimitrios Papagiannis
- Department of Hygiene and Epidemiology, Faculty of Medicine, School of Health Sciences, University of Thessaly, Thessalia, Greece
| | - George Rachiotis
- Department of Hygiene and Epidemiology, Faculty of Medicine, School of Health Sciences, University of Thessaly, Thessalia, Greece
| | | | - Alexandros Daponte
- Department of Obstetrics and Gynaecology, University of Thessalia Medical School, Thessalia, Greece
| | - Ioanna N Grivea
- Department of Paediatrics, University of Thessaly, School of Medicine, General University Hospital of Larissa, Thessalia, Greece
| | - George A Syrogiannopoulos
- Department of Paediatrics, University of Thessaly, School of Medicine, General University Hospital of Larissa, Thessalia, Greece
| | - Christos Hadjichristodoulou
- Department of Hygiene and Epidemiology, Faculty of Medicine, School of Health Sciences, University of Thessaly, Thessalia, Greece
| |
Collapse
|
10
|
Human papillomavirus infection in women in Puerto Rico: agreement between physician-collected and self-collected anogenital specimens. J Low Genit Tract Dis 2013; 17:210-7. [PMID: 23422638 DOI: 10.1097/lgt.0b013e318260e312] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
OBJECTIVE This study aimed to describe the prevalence and concordance between cervical and anal human papillomavirus (HPV) infection and compare cervicovaginal and anal self-collection methods for HPV testing between physician and self-collected specimens in women in Puerto Rico. MATERIALS AND METHODS Specimens for HPV-DNA testing were obtained from 100 women aged 18 to 34 years attending a general gynecology clinic for a routine Pap smear. Human papillomavirus testing was performed using polymerase chain reaction MY09/MY11 primers. Positive samples were typed for 39 genotypes. Agreement between sampling methods was determined by percent agreement and the κ statistic. RESULTS For the 39 genotypes evaluated, 38.4% (38/99) of cervicovaginal and 33.7% (30/89) of anal physician-collected samples were HPV+, whereas 35.1% (34/97) of cervicovaginal and 32.0% (31/97) of anal self-collected samples were positive. Human papillomavirus type 16 was the most common type identified in the cervix (8.3%, 8/97) and the anus (5.6%, 5/89) of physician-collected samples, with similar prevalence in self-collected samples. Concordance between cervical and anal HPV infection was high (>90%) for all types evaluated. There was a strong percent agreement between physician- and self-collected cervicovaginal and anal samples (>95% for all HPV types) and good to excellent agreement (κ > 0.60) for most HPV types. CONCLUSIONS The clinic-based prevalence of anal and cervicovaginal HPV infection was high, with a strong concordance between cervical and anal infection and good to excellent agreement between physician- and self-collected samples. This study supports the feasibility of using cervical and anal self-sampling methods in future population-based studies of HPV infection in Puerto Rico and as an HPV screening method in women.
Collapse
|
11
|
Adler DH, Laher F, Lazarus E, Grzesik K, Gray GE, Allan B, Williamson AL. A Viable and Simple Self-Sampling Method for Human Papillomavirus Detection among South African Adolescents. ACTA ACUST UNITED AC 2013; 2. [PMID: 24324979 DOI: 10.4172/2329-9541.1000113] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
BACKGROUND Self-sampling for Human Papillomavirus (HPV) testing may offer improved patient acceptability, decreased cost, and greater practicality than clinician collection of specimens. HPV testing among adolescents is necessary to conduct vaccine surveillance and may play a role in cervical cancer screening among some populations. METHODS A cross-sectional prevalence study was conducted to compare the results of self-collected and clinician-collected specimens for Human papillomavirus (HPV) testing among South African adolescent females. All participants provided self-sampled vaginal swabs and underwent clinician-collection of cervical swabs for HPV DNA analysis. The level of agreement between HPV DNA results from the two specimen collection methods was measured. RESULTS The level of agreement between HPV DNA results from self-collected and clinician-collected specimens was high (κ=86.7; p<0.001). A high prevalence of HPV overall was found by both specimen collection methods (57%; 95% CI 0.37-0.75). Low-risk HPV (LR-HPV) types were found slightly more frequently in self-collected specimens. CONCLUSION There is a high level of agreement between the HPV DNA results from self-collected and clinician-collected specimens. Self-collection of specimens for HPV testing is a viable alternative among adolescents.
Collapse
Affiliation(s)
- David H Adler
- Department of Emergency Medicine, University of Rochester, 601 Elmwood Avenue, Rochester, NY 14642, USA
| | | | | | | | | | | | | |
Collapse
|
12
|
Wolfrum SG, Koutsky LA, Hughes JP, Feng Q, Xi LF, Shen Z, Winer RL. Evaluation of dry and wet transport of at-home self-collected vaginal swabs for human papillomavirus testing. J Med Microbiol 2012; 61:1538-1545. [PMID: 22899778 DOI: 10.1099/jmm.0.046110-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Our objective was to compare human papillomavirus (HPV) detection in paired self-collected vaginal samples transported by overnight mail in liquid specimen transport medium (STM) (wet) or in dry tubes (dry). Women aged 18-24 years were recruited online to self-collect vaginal swab samples at home for HPV testing and 159 women returned paired wet and dry samples. Dry samples were rehydrated with STM upon arrival at the laboratory. HPV was detected by the Roche Linear Array HPV genotyping test (37 genotypes) and Kappa and McNemar statistics were used to compare wet versus dry samples for detecting HPV. Of the subjects tested in this study, 51 % were HPV-positive (in either sample) and 40 % were positive for high-risk HPV. A total of 216 type-specific infections were detected among the 80 HPV-positive women. Almost perfect agreement was observed between paired samples for detecting any HPV (subject-level positive agreement: 91.9 %, κ: 0.85) or type-specific HPV (positive agreement across types: 90.1 %, κ: 0.90). Similar agreement between sample types was seen when testing for high-risk types and 81.9 % of all type-specific infections were detected in both samples. Among discordant pairs, wet samples were 3.3 times more likely to be positive for type-specific HPV than dry samples (P = 0.02). However, in 63.6 % of wet-positive/dry-negative discordant pairs analysed for viral load, type-specific HPV was either undetectable or detected at a low level (<100 copies) in the wet samples, suggesting that the majority of infections missed by using dry samples are less likely to be clinically relevant. Our results indicate that dry transport is a feasible option for transporting at-home self-collected vaginal samples for HPV DNA testing.
Collapse
Affiliation(s)
| | - Laura A Koutsky
- Department of Epidemiology, School of Public Health, University of Washington, Seattle, WA, USA
| | - James P Hughes
- Department of Biostatistics, School of Public Health, University of Washington, Seattle, WA, USA
| | - Qinghua Feng
- Department of Pathology, School of Medicine, University of Washington, Seattle, WA, USA
| | - Long Fu Xi
- Department of Pathology, School of Medicine, University of Washington, Seattle, WA, USA.,Department of Epidemiology, School of Public Health, University of Washington, Seattle, WA, USA
| | - Zhenping Shen
- Department of Pathology, School of Medicine, University of Washington, Seattle, WA, USA
| | - Rachel L Winer
- Department of Epidemiology, School of Public Health, University of Washington, Seattle, WA, USA
| |
Collapse
|
13
|
Lazcano-Ponce E, Lorincz AT, Cruz-Valdez A, Salmerón J, Uribe P, Velasco-Mondragón E, Nevarez PH, Acosta RD, Hernández-Avila M. Self-collection of vaginal specimens for human papillomavirus testing in cervical cancer prevention (MARCH): a community-based randomised controlled trial. Lancet 2011; 378:1868-73. [PMID: 22051739 DOI: 10.1016/s0140-6736(11)61522-5] [Citation(s) in RCA: 155] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
BACKGROUND Vaginal self-sampling for human papillomavirus (HPV) DNA testing could increase rates of screening participation. In clinic-based settings, vaginal HPV testing is at least as sensitive as cytology for detecting cervical intraepithelial neoplasia (CIN) grade 2 or worse; however, effectiveness in home settings is unknown. We aimed to establish the relative sensitivity and positive predictive value for HPV screening of vaginal samples self-collected at home as compared with clinic-based cervical cytology. METHODS We did a community-based, randomised equivalence trial in Mexican women of low socioeconomic status aged 25-65 years. Participants came from 540 medically underserved, predominantly rural communities in Morelos, Guerrero, and the state of Mexico. Our primary endpoint was CIN 2 or worse, detected by colposcopy. We used a computer-generated randomisation sequence to randomly allocate patients to HPV screening or cervical cytology. Eight community nurses who were masked to patient allocation received daily lists of the women's names and addresses, and did the assigned home visits. We referred women with positive results in either test to colposcopy. We did per-protocol and intention-to-screen analyses. This trial was registered with the Instituto Nacional de Salud Pública, Mexico, INSP number 590. FINDINGS 12,330 women were randomly allocated to HPV screening and 12,731 to cervical cytology; 9202 women in the HPV screening group adhered to the protocol, as did 11,054 in the cervical cytology group. HPV prevalence was 9·8% (95% CI 9·1-10·4) and abnormal cytology rate was 0·38% (0·23-0·45). HPV testing identified 117·4 women with CIN 2 or worse per 10,000 (95·2-139·5) compared with 34·4 women with CIN 2 or worse per 10,000 (23·4-45·3) identified by cytology; the relative sensitivity of HPV testing was 3·4 times greater (2·4-4·9). Similarly, HPV testing detected 4·2 times (1·9-9·2) more invasive cancers than did cytology (30·4 per 10,000 [19·1-41·7] vs 7·2 per 10,000 [2·2-12·3]). The positive predictive value of HPV testing for CIN 2 or worse was 12·2% (9·9-14·5) compared with 90·5% (61·7-100) for cytology. INTERPRETATION Despite the much lower positive predictive value for HPV testing of self-collected vaginal specimens compared with cytology, such testing might be preferred for detecting CIN 2 or worse in low-resource settings where restricted infrastructure reduces the effectiveness of cytology screening programmes. Because women at these sites will be screened only a few times in their lives, the high sensitivity of a HPV screen is of paramount importance. FUNDING Instituto Nacional de Salud Pública, the Health Ministry of Mexico, QiAGEN Corp.
Collapse
Affiliation(s)
- Eduardo Lazcano-Ponce
- Centro de Investigación en Salud Poblacional, Instituto Nacional de Salud Pública, Cuernavaca, Morelos, Mexico
| | | | | | | | | | | | | | | | | |
Collapse
|
14
|
Gustavsson I, Sanner K, Lindell M, Strand A, Olovsson M, Wikström I, Wilander E, Gyllensten U. Type-specific detection of high-risk human papillomavirus (HPV) in self-sampled cervicovaginal cells applied to FTA elute cartridge. J Clin Virol 2011; 51:255-8. [DOI: 10.1016/j.jcv.2011.05.006] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2011] [Revised: 04/18/2011] [Accepted: 05/03/2011] [Indexed: 11/29/2022]
|
15
|
Schmeink CE, Bekkers RLM, Massuger LFAG, Melchers WJG. The potential role of self-sampling for high-risk human papillomavirus detection in cervical cancer screening. Rev Med Virol 2011; 21:139-53. [DOI: 10.1002/rmv.686] [Citation(s) in RCA: 66] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Affiliation(s)
- Channa E. Schmeink
- Department of Obstetrics and Gynaecology; Radboud University Nijmegen Medical Centre; Nijmegen; The Netherlands
| | - Ruud L. M. Bekkers
- Department of Obstetrics and Gynaecology; Radboud University Nijmegen Medical Centre; Nijmegen; The Netherlands
| | - Leon F. A. G. Massuger
- Department of Obstetrics and Gynaecology; Radboud University Nijmegen Medical Centre; Nijmegen; The Netherlands
| | - Willem J. G. Melchers
- Department of Medical Microbiology; Radboud University Nijmegen Medical Centre; Nijmegen; The Netherlands
| |
Collapse
|
16
|
Cost-effectiveness analysis of human papillomavirus DNA testing and Pap smear for cervical cancer screening in a publicly financed health-care system. Br J Cancer 2010; 103:1773-82. [PMID: 21102588 PMCID: PMC3008604 DOI: 10.1038/sj.bjc.6605974] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Objective: To evaluate the long-term cost-effectiveness of different strategies for human papillomavirus (HPV) DNA testing combined with Pap smear for cervical cancer screening in Taiwan. Methods: This study adopts a perspective of Department of Health in cost-effectiveness analysis to compare a no-screening strategy with nine different screening strategies. These strategies comprise three screening tools (Pap smear alone, HPV DNA testing followed by Pap smear triage, and HPV DNA testing combined with Pap smear), and three screening intervals (annually, every 3 years, and every 5 years). Outcomes are life expectancy, quality-adjusted life years (QALYs), lifetime costs, and incremental cost-effectiveness ratios (ICERs). Probabilistic sensitivity analyses (PSAs) were conducted to assess parameter uncertainty. Results: When three times gross domestic product per capita is used as the decision threshold, all nine screening strategies were cost-effective compared with the no-screening strategy. Compared with the current screening strategy (an annual Pap smear), HPV DNA testing followed by Pap smear triage every 5 years and every 3 years were cost-effective. Results of PSA also indicated that a HPV DNA testing followed by Pap smear triage every 5 or every 3 years achieved the highest expected net benefits. Conclusions: Possible economic advantages are associated with extending the cervical cancer screening interval from one Pap smear annually to HPV DNA testing followed by Pap smear triage every 5 years with an ICER $1 247 000 per QALY gained, especially in a country with a publicly financed health-care system.
Collapse
|
17
|
Moscicki AB, Widdice L, Ma Y, Farhat S, Miller-Benningfield S, Jonte J, Jay J, de Medina CG, Hanson E, Clayton L, Shiboski S. Comparison of natural histories of human papillomavirus detected by clinician- and self-sampling. Int J Cancer 2010; 127:1882-92. [PMID: 20104517 DOI: 10.1002/ijc.25199] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
New strategies for cervical cancer screening include human papillomavirus (HPV) DNA testing. Using self-testing methods would increase access to testing in both developed and developing countries. The purpose of this study was to compare time-to-clearance of specific HPV types between clinician-collected-lavage (CC-L) and self-collected (SC) sampling in a single cohort. CC-L and SC samples were obtained every 4 months at alternate 2-month windows from 537 women. Eighteen high-risk (HR) HPV and 4 low-risk (LR) HPV were examined. Proportional hazards model was used to compare time-to-clearance between methods for combined HR and for 13 specific HPV types. Prentice-Wilcoxon test was used for within-subject paired comparison. In the independent analysis for combined HR and LR types, no differences were found. For specific types, time-to-clearance for all HPV types examined between CC-L and SC samples was similar except for HPV 66 which showed a trend to clear slower by SC (p = 0.09). When comparing methods in the same woman, time-to-clearance was similar for all types except for HPV 16 which showed a trend to clear slower by CC-L means (p = 0.08). When we examined pattern of clearance among the CC-L samples, the fastest types to clear were HPV 6, 18, 66, 84 and 39 and the slowest were HPV 62, 68, 59 and 16. These patterns of fast and slow were similar for SC samples. Our findings suggest using SC vaginal swabs would observe similar natural histories of HPV compared to studies using CC-L specimens making self-testing feasible for repeated HPV DNA detection.
Collapse
Affiliation(s)
- Anna-Barbara Moscicki
- Department of Pediatrics, Division of Adolescent Medicine, University of California, San Francisco, CA 94118, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Balasubramanian A, Kulasingam SL, Baer A, Hughes JP, Myers ER, Mao C, Kiviat NB, Koutsky LA. Accuracy and cost-effectiveness of cervical cancer screening by high-risk human papillomavirus DNA testing of self-collected vaginal samples. J Low Genit Tract Dis 2010; 14:185-95. [PMID: 20592553 PMCID: PMC2898894 DOI: 10.1097/lgt.0b013e3181cd6d36] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVE Estimate the accuracy and cost-effectiveness of cervical cancer screening strategies based on high-risk human papillomavirus (HPV) DNA testing of self-collected vaginal samples. MATERIALS AND METHODS A subset of 1,665 women (age range, 18-50 y) participating in a cervical cancer screening study were screened by liquid-based cytology and by high-risk HPV DNA testing of both self-collected vaginal swab samples and clinician-collected cervical samples. Women with positive/abnormal screening test results and a subset of women with negative screening test results were triaged to colposcopy. On the basis of individual and combined test results, 5 screening strategies were defined. Estimates of sensitivity and specificity for cervical intraepithelial neoplasia grade 2 or worse were calculated, and a Markov model was used to estimate the incremental cost-effectiveness ratios for each strategy. RESULTS Compared with cytology-based screening, high-risk HPV DNA testing of self-collected vaginal samples was more sensitive (68%, 95% CI = 58%-78% vs 85%, 95% CI = 76%-94%) but less specific (89%, 95% CI = 86%-91% vs 73%, 95% CI = 67%-79%). A strategy of high-risk HPV DNA testing of self-collected vaginal samples followed by cytology triage of HPV-positive women was comparably sensitive (75%, 95% CI = 64%-86%) and specific (88%, 95% CI = 85%-92%) to cytology-based screening. In-home self-collection for high-risk HPV DNA detection followed by in-clinic cytology triage had a slightly lower lifetime cost and a slightly higher quality-adjusted life year (QALY) expectancy than did cytology-based screening (incremental cost-effectiveness ratio of triennial screening compared with no screening was $9,871/QALY and $12,878/QALY, respectively). CONCLUSIONS Triennial screening by high-risk HPV DNA testing of in-home, self-collected vaginal samples followed by in-clinic cytology triage was cost-effective.
Collapse
|
19
|
Dinas K, Zepiridis L, Arvanitidou O, Mavromatidis G, Nasioutziki M, Loufopoulos P, Daniilidis A, Mamopoulos A, Pantazis K, Dovas D, Theodoridis T, Loufopoulos A. Level of knowledge about genital chlamydial infection among Greek midwives and midwifery students. ACTA ACUST UNITED AC 2010; 42:249-53. [DOI: 10.3109/00365540903489994] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
20
|
Barbee L, Kobetz E, Menard J, Cook N, Blanco J, Barton B, Auguste P, McKenzie N. Assessing the acceptability of self-sampling for HPV among Haitian immigrant women: CBPR in action. Cancer Causes Control 2009; 21:421-31. [DOI: 10.1007/s10552-009-9474-0] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2008] [Accepted: 11/10/2009] [Indexed: 12/24/2022]
|
21
|
Smith JS, Melendy A, Rana RK, Pimenta JM. Age-specific prevalence of infection with human papillomavirus in females: a global review. J Adolesc Health 2008; 43:S5-25, S25.e1-41. [PMID: 18809145 DOI: 10.1016/j.jadohealth.2008.07.009] [Citation(s) in RCA: 194] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2008] [Revised: 06/27/2008] [Accepted: 07/03/2008] [Indexed: 01/08/2023]
Abstract
PURPOSE Global data on age-specific prevalence of human papillomavirus (HPV) infection overall, and for high-risk HPV types 16 and 18, are essential for the future implementation of HPV prophylactic vaccines for cervical cancer prevention. METHODS A systematic review of peer-reviewed publications was conducted to summarize worldwide data on genital HPV-DNA prevalence in women. Studies with clear descriptions of polymerase chain reaction or hybrid capture detection assays were included. RESULTS A total of 346,160 women were included in 375 studies. Of 134 studies with age-stratified HPV prevalence data (116 low sexual risk populations, 18 high sexual risk populations), over 50% were from Europe and the Middle East (38%) and North America (19%), with smaller proportions from Asia and Australia (21%), Central and South America (11%), and Africa (10%). Across all geographical regions, data on HPV prevalence were generally limited to women over 18 years of age. Consistently across studies, HPV infection prevalence decreased with increasing age from a peak prevalence in younger women (< or =25 years of age). In middle-aged women (35-50 years), maximum HPV prevalence differed across geographical regions: Africa (approximately 20%), Asia/Australia (approximately 15%), Central and South America (approximately 20%), North America (approximately 20%), Southern Europe/Middle East (approximately 15%), and Northern Europe (approximately 15%). Inconsistent trends in HPV prevalence by age were noted in older women, with a decrease or plateau of HPV prevalence in older ages in most studies, whereas others showed an increase of HPV prevalence in older ages. Similar trends of HPV 16 and/or 18 prevalence by age were noted among 12 populations with available data. DISCUSSION Genital HPV infection in women is predominantly acquired in adolescence, and peak prevalence in middle-aged women appears to differ across geographical regions. Worldwide variations in HPV prevalence across age appear to largely reflect differences in sexual behavior across geographical regions. Further studies of HPV prevalence in adolescents are needed for all geographic regions.
Collapse
Affiliation(s)
- Jennifer S Smith
- Department of Epidemiology, University of North Carolina, Chapel Hill, North Carolina 27599, USA.
| | | | | | | |
Collapse
|
22
|
Feng Q, Hawes SE, Stern JE, Dem A, Sow PS, Dembele B, Toure P, Sova P, Laird PW, Kiviat NB. Promoter hypermethylation of tumor suppressor genes in urine from patients with cervical neoplasia. Cancer Epidemiol Biomarkers Prev 2007; 16:1178-84. [PMID: 17548682 DOI: 10.1158/1055-9965.epi-06-0694] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
We examined the feasibility of using detection of high-risk human papillomavirus (HPV) DNA in combination with the presence of aberrantly methylated genes (DAPK1, RARB, TWIST1, and CDH13) for urine-based cervical cancer screening. Urine samples from 129 Senegalese women, aged 35 years or older, 110 with (same day) biopsy-proven cervical neoplasia [cervical intraepithelial neoplasia grade 1 (CIN-1): n = 9; CIN-2-3/carcinoma in situ (CIS): n = 29; invasive cervical cancer (ICC): n = 72], and 19 without cervical neoplasia on biopsy were examined. Hypermethylation of at least one of the four genes identified 62% of ICC and 28% of CIN-2-3/CIS and was present in only 4% of CIN-1 or normal urines. High-risk HPV DNA was detected in urine in 70% of those with biopsy-proven ICC, 59% of those with CIN-2-3/CIS on biopsy, 44% of those with CIN-1 on biopsy, and only 11% of women negative for cervical neoplasia on biopsy. Urine-based detection of either high-risk HPV or hypermethylation of any of the four genes identified 84% of ICC, 64% of CIN-2-3/CIS, 44% of CIN-1, but only 19% of women negative for cervical neoplasia. The sensitivity for detection of CIN-2-3/CIS/ICC by high-risk HPV DNA or aberrant DNA methylation of four genes seems to be comparable to that of an exfoliated cervical cytology. This study shows the potential feasibility of using molecular markers detected in urine for cervical cancer screening.
Collapse
Affiliation(s)
- Qinghua Feng
- Department of Pathology, School of Medicine, University of Washington, Seattle, WA 98109, USA.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
23
|
Winer RL, Feng Q, Hughes JP, Yu M, Kiviat NB, O'Reilly S, Koutsky LA. Concordance of self-collected and clinician-collected swab samples for detecting human papillomavirus DNA in women 18 to 32 years of age. Sex Transm Dis 2007; 34:371-7. [PMID: 17065848 DOI: 10.1097/01.olq.0000240315.19652.59] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE The objective of this study was to determine whether self- and clinician-collected samples are comparable for human papillomavirus (HPV) detection. STUDY DESIGN Three hundred seventy-four women aged 23 to 32 (population 1) and 211 women aged 18 to 25 (population 2) contributed self-collected vaginal and clinician-collected cervical and vulvovaginal samples for HPV DNA testing. Eighty-six women mailed in self-collected samples. RESULTS Agreement between self-collected vaginal and clinician-collected combined cervical/vulvovaginal samples was excellent (population 1:92.0%, kappa = 0.81; population 2: 96.4%, kappa = 0.88), but self-collected samples were more concordant with clinician-collected cervical samples in population 2 (kappa = 0.84) than population 1 (kappa = 0.65) (P = 0.01). Age-adjusted HPV prevalence was slightly lower in mailed-in (21.5%) than in-clinic self-collected samples (26.8%). CONCLUSIONS The combined clinician-collected cervical/vulvovaginal sample is most sensitive for detecting all female genital tract HPV infections. HPV concordance between cervical and vaginal samples may be better for newer infections. Larger studies are needed to determine whether mailed-in self-samples are as effective as those collected in a clinical setting.
Collapse
Affiliation(s)
- Rachel L Winer
- Department of Epidemiology, University of Washington, Seattle, Washington, USA.
| | | | | | | | | | | | | |
Collapse
|
24
|
Petignat P, Faltin DL, Bruchim I, Tramèr MR, Franco EL, Coutlée F. Are self-collected samples comparable to physician-collected cervical specimens for human papillomavirus DNA testing? A systematic review and meta-analysis. Gynecol Oncol 2007; 105:530-5. [PMID: 17335880 DOI: 10.1016/j.ygyno.2007.01.023] [Citation(s) in RCA: 202] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2006] [Revised: 01/10/2007] [Accepted: 01/16/2007] [Indexed: 12/16/2022]
Abstract
OBJECTIVE To compare the detection rate of genital human papillomavirus (HPV) infection in self- and physician-obtained samples. DESIGN Systematic review and meta-analysis. DATA SOURCES Studies published between 1966 and November 2005 identified through Medline and Embase that compared both sampling methods. MAIN OUTCOME MEASURES We calculated the concordance and kappa statistic between physician- and self-sampling and the difference between proportions of HPV positive samples. Weighted averages were reported with 95% confidence intervals (CI) using a random-effects model. RESULTS Eighteen studies (5441 participants) were included that evaluated broad HPV type categories, 10 (3688 patients) that of high-risk (HR) HPV and three (530) that of low-risk (LR) HPV. A high level of concordance of 0.87 (95%CI, 0.82 to 0.91) between self- and physician-sampling was obtained for detection of HPV DNA (kappa 0.66, 95%CI, 0.56 to 0.76). The prevalence difference of HPV DNA between sampling methods was -0.5 (95%CI, -2.8 to 1.8). Results were similar when restricting the analysis to HR-HPV but the prevalence of LR-HPV types was higher in self-collected samples. CONCLUSION Self-sampling was as sensitive as physician-obtained sampling to detect HR-HPV or HPV DNA. Self-sampling may be a suitable alternative method for studies on HPV transmission and vaccine trials.
Collapse
Affiliation(s)
- Patrick Petignat
- Senology and Gynaecologic Oncology Unit, Geneva University Hospitals, 1211 Geneva 14, Switzerland.
| | | | | | | | | | | |
Collapse
|
25
|
Panotopoulou E, Tserkezoglou A, Kouvousi M, Tsiaousi I, Chatzieleftheriou G, Daskalopoulou D, Magiakos G. Prevalence of human papillomavirus types 6, 11, 16, 18, 31, and 33 in a cohort of Greek women. J Med Virol 2007; 79:1898-905. [DOI: 10.1002/jmv.21025] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|