1
|
McMaster C, Liew DFL, Lester S, Rischin A, Black RJ, Chand V, Fletcher A, Lassere MN, March L, Robinson PC, Buchbinder R, Hill CL. COVID-19 vaccine hesitancy in inflammatory arthritis patients: serial surveys from a large longitudinal national Australian cohort. Rheumatology (Oxford) 2023; 62:1460-1466. [PMID: 36069664 PMCID: PMC9494403 DOI: 10.1093/rheumatology/keac503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 08/08/2022] [Accepted: 08/20/2022] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVES To determine COVID-19 vaccine hesitancy rates in inflammatory arthritis patients and identify factors associated with changing vaccine hesitancy over time. METHODS This investigation was a prospective cohort study of inflammatory arthritis patients from community and public hospital outpatient rheumatology clinics enrolled in the Australian Rheumatology Association Database (ARAD). Two surveys were conducted, one immediately prior to (pre-pandemic) and another approximately 1 year after the start of the pandemic (follow-up). Coronavirus disease 2019 (COVID-19) vaccine hesitancy was measured at follow-up, and general vaccine hesitancy was inferred pre-pandemic; these were used to identify factors associated with fixed and changing vaccine beliefs, including sources of information and broader beliefs about medication. RESULTS Of the 594 participants who completed both surveys, 74 (12%) were COVID-19 vaccine hesitant. This was associated with pre-pandemic beliefs about medications being harmful (P < 0.001) and overused (P = 0.002), with stronger beliefs resulting in vaccine hesitancy persistent over two time points (P = 0.008, P = 0.005). For those not vaccine hesitant pre-pandemic, the development of COVID-19 vaccine hesitancy was associated with a lower likelihood of seeking out vaccine information from health-care professionals (P < 0.001). COVID-19 vaccine hesitancy was not associated with new influenza vaccine hesitancy (P = 0.138). CONCLUSION In this study of vaccine beliefs before and during the COVID-19 pandemic, factors associated with COVID-19 vaccine hesitancy in inflammatory arthritis patients varied, depending on vaccine attitudes immediately prior to the start of the pandemic. Fixed beliefs reflected broader views about medications, while fluid beliefs were highly influenced by whether they sought out information from health-care professionals, including rheumatologists.
Collapse
Affiliation(s)
- Christopher McMaster
- Department of Rheumatology, Austin Health, Heidelberg, VIC, 3084
- Department of Clinical Pharmacology and Therapeutics, Austin Health, Heidelberg, VIC, 3084
- The Centre for Digital Transformation of Health, University of Melbourne, Parkville, VIC, 3052
| | - David F L Liew
- Department of Rheumatology, Austin Health, Heidelberg, VIC, 3084
- Department of Clinical Pharmacology and Therapeutics, Austin Health, Heidelberg, VIC, 3084
- Department of Medicine, University of Melbourne, Parkville, VIC, 3052
| | - Susan Lester
- Rheumatology Unit, The Queen Elizabeth Hospital, Woodville South, SA, 5011
- Adelaide Medical School, The University of Adelaide, Adelaide, SA, 5000
| | - Adam Rischin
- Department of Rheumatology, The Alfred Hospital, Melbourne, VIC, 3004
| | - Rachel J Black
- Rheumatology Unit, The Queen Elizabeth Hospital, Woodville South, SA, 5011
- Adelaide Medical School, The University of Adelaide, Adelaide, SA, 5000
| | - Vibhasha Chand
- Department of Epidemiology and Preventive Medicine, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, 3004
- Monash-Cabrini Department of Musculoskeletal Health and Clinical Epidemiology, Cabrini Health, Malvern, VIC, 3144
| | - Ashley Fletcher
- Department of Epidemiology and Preventive Medicine, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, 3004
- Monash-Cabrini Department of Musculoskeletal Health and Clinical Epidemiology, Cabrini Health, Malvern, VIC, 3144
| | - Marissa N Lassere
- School of Population Health, UNSW Medicine, Sydney, New South Wales, Australia
- Department of Rheumatology, St George Hospital, Sydney, New South Wales, Australia
| | - Lyn March
- Florance and Cope Professorial Department of Rheumatology, Royal North Shore Hospital, Sydney, New South Wales, Australia
- Institute of Bone and Joint Research, University of Sydney, Sydney, New South Wales, Australia
| | - Philip C Robinson
- Faculty of Medicine, University of Queensland School of Clinical Medicine, Herston, Queensland, Australia
- Royal Brisbane & Women’s Hospital, Metro North Hospital & Health Service, Herston, Queensland, Australia
| | - Rachelle Buchbinder
- Department of Epidemiology and Preventive Medicine, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, 3004
- Monash-Cabrini Department of Musculoskeletal Health and Clinical Epidemiology, Cabrini Health, Malvern, VIC, 3144
| | - Catherine L Hill
- Rheumatology Unit, The Queen Elizabeth Hospital, Woodville South, SA, 5011
- Adelaide Medical School, The University of Adelaide, Adelaide, SA, 5000
| |
Collapse
|
2
|
Lassere MN, Rappo J, Portek IJ, Sturgess A, Edmonds JP. How many life years are lost in patients with rheumatoid arthritis? Secular cause-specific and all-cause mortality in rheumatoid arthritis, and their predictors in a long-term Australian cohort study. Intern Med J 2013; 43:66-72. [PMID: 22289054 DOI: 10.1111/j.1445-5994.2012.02727.x] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2011] [Accepted: 01/16/2012] [Indexed: 11/29/2022]
Abstract
BACKGROUND There is an excess of mortality in patients with rheumatoid arthritis (RA) but no long-term Australian cohort data. AIMS To determine median life years lost, all-cause standardised mortality ratio (SMR) and cause-specific SMR, their predictors and secular change in Australian patients with RA. METHODS Study population was all patients seen by a rheumatologist between 1990 and 1994. Record linkage with Australian National Death Index was performed to determine fact and cause of death up to 2004. All-cause and cause-specific SMR, and median life years lost were determined. RESULTS There were 35 (31%) deaths in the early 1990s cohort (n = 113), SMR 1.31 (95% 0.93, 1.80). There were 216 (44%) deaths in the pre-1990s established cohort (n = 495), SMR 1.73 (1.49, 1.95). Median life years lost in the early cohort was 6 years for males and 7 years for females compared with 8 and 10 years, respectively, in the established cohort. Patients with low disease activity score at baseline (DAS < 3.2), SMR was 0.8 (0.3, 2.2) and 1.5 (1.1, 2.2) for the early and established cohorts, and if DAS ≥3.2, SMR was 1.4 (1.02, 1.98) and 1.8 (1.5, 2.1) respectively. Primary cause of death was cardiovascular disease (SMR 1.43 (1.17, 1.74). Patients at most risk were those age 45-54 years. RA was listed as a comorbid condition on the death certificate in only 16% of patients. CONCLUSIONS Within a period of 14 years, median life expectancy of patients with RA with disease onset in the early 1990s is reduced by 6-7 years. However, our results also suggest a secular reduction in excess mortality.
Collapse
Affiliation(s)
- M N Lassere
- Faculty of Medicine, University of NSW, Sydney, New South Wales, Australia.
| | | | | | | | | |
Collapse
|
3
|
Lassere MN, Johnson KR, Schiff M, Rees D. Is blood pressure reduction a valid surrogate endpoint for stroke prevention? An analysis incorporating a systematic review of randomised controlled trials, a by-trial weighted errors-in-variables regression, the surrogate threshold effect (STE) and the Biomarker-Surrogacy (BioSurrogate) Evaluation Schema (BSES). BMC Med Res Methodol 2012; 12:27. [PMID: 22409774 PMCID: PMC3388460 DOI: 10.1186/1471-2288-12-27] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2011] [Accepted: 03/12/2012] [Indexed: 11/10/2022] Open
Abstract
Background Blood pressure is considered to be a leading example of a valid surrogate endpoint. The aims of this study were to (i) formally evaluate systolic and diastolic blood pressure reduction as a surrogate endpoint for stroke prevention and (ii) determine what blood pressure reduction would predict a stroke benefit. Methods We identified randomised trials of at least six months duration comparing any pharmacologic anti-hypertensive treatment to placebo or no treatment, and reporting baseline blood pressure, on-trial blood pressure, and fatal and non-fatal stroke. Trials with fewer than five strokes in at least one arm were excluded. Errors-in-variables weighted least squares regression modelled the reduction in stroke as a function of systolic blood pressure reduction and diastolic blood pressure reduction respectively. The lower 95% prediction band was used to determine the minimum systolic blood pressure and diastolic blood pressure difference, the surrogate threshold effect (STE), below which there would be no predicted stroke benefit. The STE was used to generate the surrogate threshold effect proportion (STEP), a surrogacy metric, which with the R-squared trial-level association was used to evaluate blood pressure as a surrogate endpoint for stroke using the Biomarker-Surrogacy Evaluation Schema (BSES3). Results In 18 qualifying trials representing all pharmacologic drug classes of antihypertensives, assuming a reliability coefficient of 0.9, the surrogate threshold effect for a stroke benefit was 7.1 mmHg for systolic blood pressure and 2.4 mmHg for diastolic blood pressure. The trial-level association was 0.41 and 0.64 and the STEP was 66% and 78% for systolic and diastolic blood pressure respectively. The STE and STEP were more robust to measurement error in the independent variable than R-squared trial-level associations. Using the BSES3, assuming a reliability coefficient of 0.9, systolic blood pressure was a B + grade and diastolic blood pressure was an A grade surrogate endpoint for stroke prevention. In comparison, using the same stroke data sets, no STEs could be estimated for cardiovascular (CV) mortality or all-cause mortality reduction, although the STE for CV mortality approached 25 mmHg for systolic blood pressure. Conclusions In this report we provide the first surrogate threshold effect (STE) values for systolic and diastolic blood pressure. We suggest the STEs have face and content validity, evidenced by the inclusivity of trial populations, subject populations and pharmacologic intervention populations in their calculation. We propose that the STE and STEP metrics offer another method of evaluating the evidence supporting surrogate endpoints. We demonstrate how surrogacy evaluations are strengthened if formally evaluated within specific-context evaluation frameworks using the Biomarker- Surrogate Evaluation Schema (BSES3), and we discuss the implications of our evaluation of blood pressure on other biomarkers and patient-reported instruments in relation to surrogacy metrics and trial design.
Collapse
Affiliation(s)
- Marissa N Lassere
- School of Public Health and Community Medicine, Faculty of Medicine, University of New South Wales, Sydney 2052, NSW, Australia.
| | | | | | | |
Collapse
|
4
|
Chapman NH, Lazar SP, Fry M, Lassere MN, Chong BH. Clinicians adopting evidence based guidelines: a case study with thromboprophylaxis. BMC Health Serv Res 2011; 11:240. [PMID: 21951830 PMCID: PMC3200175 DOI: 10.1186/1472-6963-11-240] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2010] [Accepted: 09/28/2011] [Indexed: 11/10/2022] Open
Abstract
Background Venous Thromboembolism (VTE) is a cause of hospital mortality and managing its morbidity is associated with significant expenditure. Uptake of evidenced based guideline recommendations intended to prevent VTE in hospital settings is sub-optimal. This study was conducted to explore clinicians' attitudes and the clinical environment in which they work to understand their reluctance to adopt VTE prophylaxis guidelines. Methods Between February and November 2009, 40 hospital employed doctors from 2 Australian metropolitan hospitals were interviewed in depth. Qualitative data were analysed according to thematic methodology. Results Analysis of interviews revealed that barriers to evidence based practice include i) the fragmented system of care delivery where multiple members of teams and multiple teams are responsible for each patient's care, and in the case of VTE, where everyone shares responsibility and no-one in particular is responsible; ii) the culture of practice where team practice is tailored to that of the team head, and where medicine is considered an 'art' in which guidelines should be adapted to each patient rather than applied universally. Interviewees recommend clear allocation of responsibility and reminders to counteract VTE risk assessment being overlooked. Conclusions Senior clinicians are the key enablers for practice change. They will need to be convinced that guideline compliance adds value to their patient care. Then with the support of systems in the organisation designed to minimize the effects of care fragmentation, they will drive practice changes in their teams. We believe that evidence based practice is only possible with a coordinated program that addresses individual, cultural and organisational constraints.
Collapse
|
5
|
Hunter DJ, Losina E, Guermazi A, Burstein D, Lassere MN, Kraus V. A pathway and approach to biomarker validation and qualification for osteoarthritis clinical trials. Curr Drug Targets 2010; 11:536-45. [PMID: 20199395 DOI: 10.2174/138945010791011947] [Citation(s) in RCA: 56] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2009] [Accepted: 07/27/2009] [Indexed: 01/12/2023]
Abstract
This narrative review outlines the work done in other fields with regards biomarker validation and qualification and the lessons that we may learn from this experience. Defining a universally agreed upon path for biomarker validation and qualification is urgently needed to circumvent many of the hurdles faced in OA therapeutic development irrespective of whether we are discussing biochemical markers, imaging markers or other measures. This review proposes a path that may be suitable for osteoarthritis and poses some logical next steps that will take us in this direction.
Collapse
Affiliation(s)
- David J Hunter
- Division of Research, New England Baptist Hospital, 125 Parker Hill Ave, Boston MA 02120, USA.
| | | | | | | | | | | |
Collapse
|
6
|
|
7
|
Lassere MN. The Biomarker-Surrogacy Evaluation Schema: a review of the biomarker-surrogate literature and a proposal for a criterion-based, quantitative, multidimensional hierarchical levels of evidence schema for evaluating the status of biomarkers as surrogate endpoints. Stat Methods Med Res 2007; 17:303-40. [DOI: 10.1177/0962280207082719] [Citation(s) in RCA: 104] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Section 2 is a systematic, historical review of the biomarker-surrogate endpoint literature with special reference to the nomenclature, the systems of classification and statistical methods developed for their evaluation. In Section 3 an explicit, criterion-based, quantitative, multidimensional hierarchical levels of evidence schema — Biomarker-Surrogacy Evaluation Schema — is proposed to evaluate and co-ordinate the multiple dimensions (biological, epidemiological, statistical, clinical trial and risk-benefit evidence) of the biomarker clinical endpoint relationships. The schema systematically evaluates and ranks the surrogacy status of biomarkers and surrogate endpoints using defined levels of evidence. The schema incorporates the three independent domains: Study Design, Target Outcome and Statistical Evaluation. Each domain has items ranked from zero to five. An additional category called Penalties incorporates additional considerations of biological plausibility, risk-benefit and generalizability. The total score (0—15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. The term `surrogate' is restricted to markers attaining Levels 1 or 2 only. Surrogacy status of markers can then be directly compared within and across different areas of medicine to guide individual, trial-based or drug-development decisions. This schema would facilitate communication between clinical, researcher, regulatory, industry and consumer participants necessary for evaluation of the biomarker-surrogate-clinical endpoint relationship in their different settings.
Collapse
Affiliation(s)
- Marissa N Lassere
- Department of Rheumatology, St George Hospital, University of New South Wales, Sydney, Australia,
| |
Collapse
|
8
|
Oakley SP, Portek I, Szomor Z, Appleyard RC, Ghosh P, Kirkham BW, Murrell GAC, Lassere MN. Arthroscopic estimation of the extent of chondropathy. Osteoarthritis Cartilage 2007; 15:506-15. [PMID: 17188524 DOI: 10.1016/j.joca.2006.10.013] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/14/2006] [Accepted: 10/23/2006] [Indexed: 02/02/2023]
Abstract
INTRODUCTION Arthroscopy has been used to evaluate articular cartilage (AC) pathology in osteoarthritis (OA) for outcome measurement and validation of non-invasive imaging. However, many fundamental aspects of arthroscopic assessment remain un-validated. OBJECTIVES This study evaluated arthroscopic estimates of extent of chondropathy. METHODS Serial arthroscopic assessments were performed in a group of 15 sheep before and after bilateral stifle medial meniscectomy (MMx). Post-mortem assessments were performed in un-MMx sheep and 4 and 16 weeks post-MMx. Arthroscopic assessments of the extent of each grade of chondropathy were compared with a non-arthroscopic hybrid assessment that incorporated biomechanical, thickness and macroscopic assessments. RESULTS Arthroscopy evaluated only 36% of AC and missed significant pathological changes, softening and chondro-osteophyte, occurring in peripheral regions. The patterns of change in arthroscopic assessments were similar to those of the non-arthroscopic assessment but there was a very strong tendency to over-estimate the extent of softened AC after MMx. In spite of these limitations arthroscopic assessments were responsive to change. Estimates of the extent of normal and softened AC were most responsive to change over time followed by estimates of superficial and deep fibrillation. Arthroscopy was as an excellent discriminator between normal and OA. Assessments of chondro-osteophyte and exposed bone were not responsive to change. CONCLUSIONS Arthroscopic estimates of extent of chondropathy are prone to substantial error. While experience and training may reduce these errors other approaches may more effectively improve performance.
Collapse
Affiliation(s)
- S P Oakley
- Rheumatology Department, Guys & St. Thomas' NHS Foundation Trust, London, United Kingdom.
| | | | | | | | | | | | | | | |
Collapse
|
9
|
Lassere MN, Johnson KR, Boers M, Tugwell P, Brooks P, Simon L, Strand V, Conaghan PG, Ostergaard M, Maksymowych WP, Landewe R, Bresnihan B, Tak PP, Wakefield R, Mease P, Bingham CO, Hughes M, Altman D, Buyse M, Galbraith S, Wells G. Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema. J Rheumatol 2007; 34:607-15. [PMID: 17343307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
OBJECTIVE There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Our objective was to review the literature on biomarkers and surrogates to develop a hierarchical schema that systematically evaluates and ranks the surrogacy status of biomarkers and surrogates; and to obtain feedback from stakeholders. METHODS After a systematic search of Medline and Embase on biomarkers, surrogate (outcomes, endpoints, markers, indicators), intermediate endpoints, and leading indicators, a quantitative surrogate validation schema was developed and subsequently evaluated at a stakeholder workshop. RESULTS The search identified several classification schema and definitions. Components of these were incorporated into a new quantitative surrogate validation level of evidence schema that evaluates biomarkers along 4 domains: Target, Study Design, Statistical Strength, and Penalties. Scores derived from 3 domains the Target that the marker is being substituted for, the Design of the (best) evidence, and the Statistical strength are additive. Penalties are then applied if there is serious counterevidence. A total score (0 to 15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. It was proposed that the term "surrogate" be restricted to markers attaining Levels 1 or 2 only. Most stakeholders agreed that this operationalization of the National Institutes of Health definitions of biomarker, surrogate endpoint, and clinical endpoint was useful. CONCLUSION Further development and application of this schema provides incentives and guidance for effective biomarker and surrogate endpoint research, and more efficient drug discovery, development, and approval.
Collapse
Affiliation(s)
- Marissa N Lassere
- Department of Rheumatology, St. George Hospital, University of New South Wales, Sydney, Australia.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Kirkham BW, Lassere MN, Edmonds JP, Juhasz KM, Bird PA, Lee CS, Shnier R, Portek IJ. Synovial membrane cytokine expression is predictive of joint damage progression in rheumatoid arthritis: a two-year prospective study (the DAMAGE study cohort). ACTA ACUST UNITED AC 2006; 54:1122-31. [PMID: 16572447 DOI: 10.1002/art.21749] [Citation(s) in RCA: 272] [Impact Index Per Article: 15.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
OBJECTIVE The primary aim of this prospective 2-year study was to explain the wide variability in joint damage progression in patients with rheumatoid arthritis (RA) from measures of pathologic changes in the synovial membrane. METHODS Patients underwent clinical measurements and joint damage assessments by magnetic resonance imaging (MRI) and radiography at enrollment and at year 2. Synovial membrane was obtained by knee biopsy and assessed histologically by hematoxylin and eosin staining. Interleukin-1beta (IL-1beta), IL-10, IL-16, IL-17, RANKL, tumor necrosis factor alpha (TNFalpha), and interferon-gamma (IFNgamma) messenger RNA (mRNA) expression was determined by quantitative reverse transcription-polymerase chain reaction. The relationship of synovial measurements to joint damage progression was determined by multivariate analysis. RESULTS Sixty patients were enrolled. Histologic features had no relationship to damage progression. Multivariate analysis by several different methods consistently demonstrated that synovial membrane mRNA levels of IL-1beta, TNFalpha, IL-17, and IL-10 were predictive of damage progression. IL-17 was synergistic with TNFalpha. TNFalpha and IL-17 effects were most pronounced with shorter disease duration, and IL-1beta effects were most pronounced with longer disease duration. IFNgamma was protective. These factors explained 57% of the MRI joint damage progression over 2 years. CONCLUSION We have demonstrated for the first time in a prospective study that synovial membrane cytokine mRNA expression is predictive of joint damage progression in RA. The findings for IL-1beta and TNFalpha are consistent with results of previous clinical research, but the protective role of IFNgamma, the differing effects of disease duration, and IL-17-cytokine interactions had only been demonstrated previously by animal and in vitro research. These findings explain some of the variability of joint damage in RA and identify new targets for therapy.
Collapse
Affiliation(s)
- Bruce W Kirkham
- Department of Rheumatology, Guy's and St. Thomas' Hospital, London, UK.
| | | | | | | | | | | | | | | |
Collapse
|
11
|
Abstract
Measurement is fundamental to science. In medicine measurement underpins most clinical decisions. Outcome measures for rheumatoid arthritis clinical trials (OMERACT) is an informal collaborative group of professionals dedicated to improving outcome measurement in the rheumatic disease. The methodologic hallmark of the OMERACT process is captured in the OMERACT filter--truth, discrimination, and feasibility. Using the key elements of the OMERACT filter a comprehensive checklist for evaluating reported measures is provided. The checklist guides the potential user through a series of questions. The checklist is also an important resource for researchers working in the field of measurement.
Collapse
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St George Hospital, Gray Street, Kogarah, NSW 2217, Australia.
| |
Collapse
|
12
|
Oakley SP, Portek I, Szomor Z, Appleyard RC, Ghosh P, Kirkham BW, Murrell GAC, Lassere MN. Arthroscopy -- a potential "gold standard" for the diagnosis of the chondropathy of early osteoarthritis. Osteoarthritis Cartilage 2005; 13:368-78. [PMID: 15882560 DOI: 10.1016/j.joca.2004.12.005] [Citation(s) in RCA: 45] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/18/2004] [Accepted: 12/24/2004] [Indexed: 02/02/2023]
Abstract
OBJECTIVES The aims of this study were to: 1. Evaluate the performance of arthroscopy for the diagnosis of chondropathy and to compare it to that of direct non-arthroscopic assessments; 2. Determine intra-observer reliability of arthroscopic assessments; 3. Evaluate the effects of the arthroscopic video quality and probing upon diagnostic performance. DESIGN The ovine medial meniscectomy (MMx) model of early osteoarthritis (OA) was used assuming that pre-MMx articular cartilage (AC) was "normal" and post-MMx AC "chondropathic". Video recordings of arthroscopic assessments of each stifle compartment were evaluated. Scores were given for the quality of the video and the amount of probing. The diagnostic performances of dynamic shear modulus (G), light microscopic assessment and superficial zone collagen birefringence assessments were evaluated and compared to that of arthroscopy. Intra-observer reliability of arthroscopic assessments was also evaluated. RESULTS Arthroscopic assessments had high sensitivity (91-100%), specificity (62-88%) and accuracy (75-93%) for the diagnosis of chondropathy 16 weeks after MMx. Arthroscopy compared favourably with the direct non-arthroscopic assessments in the lateral compartment and was found to have extremely high intra-observer reliability (kappa 0.78-1.00). The quality of arthroscopic video recordings and the amount of probing did not significantly influence accuracy or reliability. CONCLUSIONS Arthroscopy performs as well as direct non-arthroscopic assessments of AC for diagnosis of early OA. These results suggest that arthroscopy can be used as a "gold standard" for the validation of non-invasive assessments like magnetic resonance imaging and that arthroscopic diagnosis can be based on small amounts of video footage without AC probing.
Collapse
Affiliation(s)
- S P Oakley
- Department of Rheumatology, St. George Hospital (University of New South Wales), Gray St. Kogarah, NSW 2217, Australia.
| | | | | | | | | | | | | | | |
Collapse
|
13
|
Lassere MN, Johnson KR. Power of the database: an international approach to studying longterm rheumatoid arthritis therapy. J Rheumatol 2004; 31:1877-80. [PMID: 15468346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/30/2023]
|
14
|
Oakley SP, Lassere MN, Portek I, Szomor Z, Ghosh P, Kirkham BW, Murrell GAC, Wulf S, Appleyard RC. Biomechanical, histologic and macroscopic assessment of articular cartilage in a sheep model of osteoarthritis. Osteoarthritis Cartilage 2004; 12:667-79. [PMID: 15262247 DOI: 10.1016/j.joca.2004.05.006] [Citation(s) in RCA: 48] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/24/2003] [Accepted: 05/08/2004] [Indexed: 02/02/2023]
Abstract
OBJECTIVES Our primary objective was to explore the full potential of the ovine medial meniscectomy (MMx) model of early osteoarthritis (OA) for studies to validate non-destructive articular cartilage (AC) assessments and therapeutic interventions. Our secondary objective was to re-evaluate the relationships between the different types of AC assessment after MMx in sheep. METHODS Macroscopic assessments, dynamic shear modulus (G*), phase lag and AC thickness measurements were performed at a total of 5437 reference points on all six articular surfaces in four normal joints and 16 MMx ovine stifle (knee) joints. Comparisons with histologic assessments of gross structural damage, collagen organisation (birefringence) and proteoglycan content were possible at 702 of these points. RESULTS Histologic gross structural damage and proteoglycan loss were seen throughout the joint with greatest severity (fibrillation) in closest proximity to the MMx site. Increases in AC (30-50%) thickness, reductions in G* (30-40%) and collagen birefringence intensity (15-30%) occurred more evenly throughout the joint. Macroscopic softening was evident only when G* declined by 80%. G* correlated with AC thickness (rho=-0.47), collagen organisation rho=0.44), gross structural damage (rho=-0.44) and proteoglycan content (rho=0.42). Multivariate analysis showed that collagen organisation contributed twice as much to dynamic shear modulus (t=6.66 as proteoglycan content (t=3.21). Collagen organisation (rho=0.11) and proteoglycan content (rho=0.09) correlated only weakly to phase lag. CONCLUSIONS Macroscopic assessments were insensitive to AC softening suggesting that arthroscopic assessments of AC status might also perform poorly. Collagen integrity was more important for the maintenance of AC stiffness (G*) than proteoglycan content. The development of major AC softening and thickening throughout the joint following MMx suggested involvement of non-mechanical (e.g., protein and biochemical) chemical and cytokine mediated processes in addition to the disturbance in biomechanical loading. The ovine MMx model provides a setting in which the spectrum of AC changes associated with the initiation and progression of OA may be evaluated.
Collapse
Affiliation(s)
- S P Oakley
- Department of Rheumatology, St. George Hospital, University of New South Wales, Gray St., Kogarah, NSW 2217, Australia.
| | | | | | | | | | | | | | | | | |
Collapse
|
15
|
Abstract
BACKGROUND AND OBJECTIVES To review the performance of arthroscopic assessment of articular cartilage damage in osteoarthritis. METHODS The literature was reviewed for publications containing data regarding validity and reliability of arthroscopic systems of cartilage evaluation in knee osteoarthritis. RESULTS Fifty-two distinct measurement systems were identified in 60 publications. There were 30 simple severity-scoring systems, 3 global visual analogue scale systems, and 19 composite systems. No systems consisted solely of measurements of lesion size or site, although 13 systems used either or both of these for the calculation of composite scores. Only 6 publications (10%) undertook any reliability evaluation and these generally used inappropriate methods of statistical analysis. Thirty-five publications (58%) evaluated validity. Construct validity was tested using several constructs (clinical in 2, magnetic resonance imaging in 10, radiographs in 10, or other arthroscopic assessments in 5 publications). Criterion validity was ascertained by using several methods including cartilage histology, histochemistry, or biomechanics in 10 publications. Responsiveness was determined in 1 publication. DISCUSSION Many publications evaluated composite systems but only a few evaluated fundamental aspects of arthroscopic measurement. Conceptually, composite scoring systems have the best validity; however, at present, there is only enough evidence to support the use of simple chondropathy severity scores and there are little data on the responsiveness of these methods. A proposed program for comprehensive evaluation and development of valid and responsive arthroscopic assessments of articular cartilage is outlined.
Collapse
Affiliation(s)
- Stephen Philip Oakley
- Department of Rheumatology, The St. George Hospital Campus, University of New South Wales, Kogarah, Australia.
| | | |
Collapse
|
16
|
Oakley SP, Portek I, Szomor Z, Turnbull A, Murrell GAC, Kirkham BW, Lassere MN. Accuracy and reliability of arthroscopic estimates of cartilage lesion size in a plastic knee simulation model. Arthroscopy 2003; 19:282-9. [PMID: 12627153 DOI: 10.1053/jars.2003.50039] [Citation(s) in RCA: 18] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
PURPOSE The goal of the study was to determine the accuracy and reliability of arthroscopic percent area estimates in a plastic knee simulation model. A second goal was to determine the effect of lesion location within the knee and lesion size on accuracy and reliability. TYPE OF STUDY Cross-sectional study of arthroscopic estimates of cartilage lesion size. METHODS Three experienced arthroscopists performed 3 sets arthroscopic percent area estimates in 5 different plastic knees. Each knee had lesions drawn on 5 surfaces (patellar, medial and lateral femoral condyle, medial and lateral tibial plateaus). Accuracy and reliability were studied using Bland and Altman limits of agreement (LOA) and intraclass correlation coefficients. RESULTS There was a strong tendency to overestimate lesion size by over 100% on the femoral and patellar surfaces. Intraobserver and interobserver reliabilities were generally poor. The range for the 95% LOA (+/- 1.96 standard deviation [SD] of the difference scores) between repeated measurements was almost 6 times the size of the lesion itself. Reliability of estimates was poorest for the largest lesions and worse at femoral, lateral tibial, and patellar sites. CONCLUSIONS Assessments of arthroscopic measurements using LOA found that accuracy and reliability were generally poor, although results were better at the medial tibial plateau and for smaller lesions. In spite of these problems, arthroscopy remains a promising measurement tool because it permits physical assessment of cartilage integrity. This study sets the foundations for improvement in techniques of arthroscopic measurement of cartilage lesion size.
Collapse
Affiliation(s)
- Stephen P Oakley
- Deptartments of Rheumatology, St. George Hospital Campus, University of New South Wales, New South Wales, Australia.
| | | | | | | | | | | | | |
Collapse
|
17
|
Johnson KR, Lassere MN. Epidemiological modelling (including economic modelling) and its role in preventive drug therapy. Med J Aust 2003; 178:188; author reply 188-9. [PMID: 12580752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2002] [Accepted: 11/07/2002] [Indexed: 02/28/2023]
|
18
|
Oakley SP, Portek I, Szomor Z, Turnbull A, Murrell GAC, Kirkham BW, Lassere MN. Poor accuracy and interobserver reliability of knee arthroscopy measurements are improved by the use of variable angle elongated probes. Ann Rheum Dis 2002; 61:540-3. [PMID: 12006330 PMCID: PMC1754115 DOI: 10.1136/ard.61.6.540] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
OBJECTIVES (a)To determine the accuracy and reliability of arthroscopic measurements of cartilage lesion diameter in an artificial right knee model; (b) to determine whether the use of a set of variable angle elongated probes improves performance; and (c) to identify other sources of variability. METHODS Ovoid "lesions" were drawn on the five cartilage surfaces of four plastic knees models. Two observers assessed these 20 lesions arthroscopically, measuring two diameters in orientations parallel and orthogonal to the probe. Observer 1 (orthopaedic surgeon) and observer 2 (arthroscopic rheumatologist) made two sets of measurements, firstly with the conventional probe and five months later with the variable angle elongated (VAE) probes. The knees were disarticulated to determine true lesion diameter. RESULTS Observer 1 had negligible bias and good accuracy regardless of orientation or probe type. Observer 2 demonstrated both bias and poor accuracy using the conventional probe. Both improved using VAE probes. Poor interobserver reliability with conventional probes also improved using VAE probes. Major sources of variability could be traced to the probe type, the characteristics of the operator, and the orientation of the lesion in relation to the probe; the lesion location itself did not cause variability. CONCLUSIONS Variation in accuracy and poor interobserver reliability of measurements with conventional methods of cartilage lesion diameter measurement improved when specially designed measurement probes were used. Arthroscopic measurements performed as well as most clinical and radiographic measures. These findings have important implications for the use of arthroscopy as an outcome in multicentre trials where arthroscopists have different levels of experience.
Collapse
Affiliation(s)
- S P Oakley
- Department of Rheumatology, St George Hospital, University of New South Wales, Sydney, Australia.
| | | | | | | | | | | | | |
Collapse
|
19
|
|
20
|
Lassere MN, Bird P. Measurements of rheumatoid arthritis disease activity and damage using magnetic resonance imaging. Truth and discrimination: does MRI make the grade? J Rheumatol 2001; 28:1151-7. [PMID: 11361205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/16/2023]
Abstract
Magnetic resonance imaging (MRI) is a tool with unprecedented capabilities. Rheumatoid arthritis (RA) abnormalities that can be measured with MRI include erosions, articular cartilage thickness, synovial membrane volume, and pannus. However, as access to MRI increases, there is a risk that its use will not be evaluated using rigorous scientific measurement principles. We reviewed published MRI measurement methods for RA and investigated whether the methods were systematically evaluated for reliability, validity, and responsiveness to change--components of the OMERACT filter. Medline and Embase databases were searched from 1966 to 1999. Titles and abstracts were scanned to identify publications on MRI methods used to assess either disease activity or damage in RA. A data extraction template was developed and 68 peer reviewed publications from 40 research groups were appraised; 40 addressed RA disease activity, 4 RA damage, and 24 both activity and damage. Joints most frequently assessed were knee (32 publications) and wrist (31 publications). Ninety-one percent of publications evaluated either reliability or validity or responsiveness to change. Thirteen percent evaluated all 3 and only 9% evaluated none of these measurement properties. Validity was evaluated in 85%, responsiveness to change in 37%, and reliability in 35% of publications. Only 12% of publications evaluated both intra and inter-reliability. Few publications of MRI measures of disease activity or damage in RA met the OMERACT filter for all measurement properties. It would be regrettable if MRI measures are developed ad hoc, with little regard to considerations of scaling, reliability, validity, and responsiveness to change, because this will severely limit their ability to confidently assess treatment efficacy and prognostic indicators.
Collapse
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St. Georges Hospital, Sydney, Australia.
| | | |
Collapse
|
21
|
Lassere MN, van der Heijde D, Johnson KR, Boers M, Edmonds J. Reliability of measures of disease activity and disease damage in rheumatoid arthritis: implications for smallest detectable difference, minimal clinically important difference, and analysis of treatment effects in randomized controlled trials. J Rheumatol 2001; 28:892-903. [PMID: 11327273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Abstract
We evaluate measurement properties of common rheumatoid arthritis (RA) assessments. Included are a comprehensive literature review and new data on the reliability and smallest detectable difference (SDD) for different classes of these measures. We found that certain common measures such as joint counts, pain, and patient global all had poor reliability and showed large SDD compared to multi-item measures of physical/psychological function or compared to radiographic measures. We discuss the implications of these findings on the use of composite endpoints such as the ACR20 or the EULAR responder index in RA clinical trials, particularly the introduction of misclassification bias that arises from differential measurement error. Finally, we consider generically how the concept of the SDD might or might not relate to the concept of the minimal clinically important difference.
Collapse
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St George Hospital, Sydney, Australia.
| | | | | | | | | |
Collapse
|
22
|
Lassere MN, van der Heijde D, Johnson KR. Foundations of the minimal clinically important difference for imaging. J Rheumatol 2001; 28:890-1. [PMID: 11327272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Abstract
This article develops a generic conceptual framework for defining and validating the concept of minimal clinically important difference. We propose 3 approaches. The first uses statistical descriptions of the population ("distribution based"), the second relies on experts ("opinion based"), and a third is based on sequential hypothesis formation and testing ("predictive/data driven based"). The first 2 approaches serve as proxies for the third, which is an experimentally driven approach, asking such questions as "What carries the least penalty?" or "What imparts the greatest gain?" As an experimental approach, it has the expected drawbacks, including the need for greater resources, and the need to tolerate trial and error en route, compared to the other 2 models.
Collapse
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St George Hospital, Sydney, Australia.
| | | | | |
Collapse
|
23
|
Lassere MN, van der Heijde D, Johnson K, Bruynesteyn K, Molenaar E, Boonen A, Verhoeven A, Emery P, Boers M. Robustness and generalizability of smallest detectable difference in radiological progression. J Rheumatol 2001; 28:911-3. [PMID: 11327275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Abstract
The smallest detectable difference (SDD) reflects that component of a measure statistically attributable to error from the measurement process itself. As such it is an irreducible component of the inherent variability in measurements in clinical trials and will affect their design, whether randomized or observational. Even though the application of the SDD concept to assaying radiographs in rheumatoid arthritis is relatively new and not well understood, systematic work on the influences of radiographic SDD can be done. This report describes the effects of a number of clinical aspects of the disease and operational aspects of trials on the values of the SDD of radiographic progression data. We show that if conditions affecting SDD are known and kept constant across datasets, the SDD of radiological progression from one study may be generalizable to other studies. However, if any one condition varies, the SDD is distinctly unrobust and cannot be generalized to other studies.
Collapse
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St George Hospital, NSW, Sydney, Australia.
| | | | | | | | | | | | | | | | | |
Collapse
|
24
|
Lassere MN. Longitudinal and observational studies module. J Rheumatol 1999; 26:459-68. [PMID: 9972988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Affiliation(s)
- M N Lassere
- Department of Rheumatology, St George Hospital, Kogarah, NSW, Australia
| |
Collapse
|
25
|
Abstract
In a 3-year period, 94 patients with driving difficulties due to a variety of musculoskeletal disorders were assessed by the occupational therapy department of a rheumatology unit. The individual's ability to carry out each part of the driving process was recorded and the patients were classified into six broad categories. While some parts of the driving process often proved difficult, patterns of disability were found with different musculoskeletal disorders. Almost all of these difficulties could be overcome by simple modifications to vehicle or driving technique. Only one severely disabled individual required referral to a specialized mobility unit, while two individuals were found to be unsafe. Thus, almost all arthritic individuals are able to continue driving with the help of simple modifications. By providing an unsophisticated driving assessment service, a rheumatology unit can enable patients to continue driving and so maintain independence.
Collapse
Affiliation(s)
- J G Jones
- Queen Elizabeth Hospital, Rotorua, New Zealand
| | | | | |
Collapse
|
26
|
Lassere MN, Jones JG. Recurrent calcific periarthritis, erosive osteoarthritis and hypophosphatasia: a family study. J Rheumatol 1990; 17:1244-8. [PMID: 2290172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
We describe a mother and 2 daughters with familial recurrent calcific periarthritis in a family with an inherited tendency to develop generalized osteoarthritis (OA). Low levels of serum alkaline phosphatase were found in 1 of the daughters while the mother developed erosive OA in later life. HLA typing was noncontributory. However, the 3 individuals with periarthritis possessed blood group A+, while the 6 unaffected family members were O+. The experience of this family adds weight to the case that recurrent calcific periarthritis may be due to an inherited abnormality of alkaline phosphatase production and suggest that this may also be responsible for the recently observed association of calcific periarthritis and erosive OA.
Collapse
Affiliation(s)
- M N Lassere
- Queen Elizabeth Hospital for Rheumatic Diseases, Rotorua, New Zealand
| | | |
Collapse
|