51
|
Ramsey I, Corsini N, Hutchinson AD, Marker J, Eckert M. Development of a Core Set of Patient-Reported Outcomes for Population-Based Cancer Survivorship Research: Protocol for an Australian Consensus Study. JMIR Res Protoc 2020; 9:e14544. [PMID: 32012089 PMCID: PMC7013638 DOI: 10.2196/14544] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 10/15/2019] [Accepted: 10/15/2019] [Indexed: 01/29/2023] Open
Abstract
BACKGROUND Core outcome sets seek to improve the consistency and quality of research by providing agreed-upon recommendations regarding what outcomes should be measured as a minimum for a population and setting. The problems arising from a lack of outcome standardization in population-based cancer survivorship research indicate the need for agreement on a core set of patient-reported outcomes (PROs) to enhance data quality, consistency, and comparability. OBJECTIVE This study aims to identify a core set of PROs, representing the most important issues impacting on cancer survivors' long-term health, functioning and quality of life, to inform population-based research on cancer survivorship. METHODS In Phase I, a list of all potentially important outcomes will be generated through focus group discussions with cancer survivors and a review of measures for assessing quality of life in cancer survivorship. The consolidated list will be advanced to Phase II, where a stakeholder consensus process will be conducted with national experts in cancer survivorship to refine and prioritize the outcomes into a core outcome set. The process will consist of a two-round Delphi survey and a consensus meeting. Cancer survivors, oncology health care professionals, and potential end users of the core outcome set with expertise in cancer survivorship research or policy will be invited to participate. In Phase III, recommended measures for assessment of the core outcome set will be selected with advice from experts on the assessment, analysis, and interpretation of PROs. RESULTS As of April 2019, data collection for Phase I is complete and data analysis is underway. These data will inform the list of outcomes to be advanced into Phase II. Recruitment for Phase II will commence in June 2019, and it is anticipated that it will take 6 months to complete the three-step consensus process and identify a provisional core outcome set. The study results are expected to be published in early 2020. CONCLUSIONS Expert consensus-driven recommendations on outcome measurement will facilitate the inclusion of survivorship outcomes considered important by cancer survivors and health professionals in future research. Adoption of the core outcome set will enable comparison and synthesis of evidence across studies and enhance the quality of PRO data collected in cancer survivorship research, particularly when applied to address macro-level questions. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/14544.
Collapse
Affiliation(s)
- Imogen Ramsey
- Rosemary Bryant AO Research Centre, School of Nursing and Midwifery and UniSA Cancer Research Institute, University of South Australia, Adelaide, Australia
| | - Nadia Corsini
- Rosemary Bryant AO Research Centre, School of Nursing and Midwifery and UniSA Cancer Research Institute, University of South Australia, Adelaide, Australia
| | - Amanda D Hutchinson
- School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, Australia
| | - Julie Marker
- Cancer Voices South Australia, Adelaide, Australia
| | - Marion Eckert
- Rosemary Bryant AO Research Centre, School of Nursing and Midwifery and UniSA Cancer Research Institute, University of South Australia, Adelaide, Australia
| |
Collapse
|
52
|
|
53
|
Multidimensional screening for predicting pain problems in adults: a systematic review of screening tools and validation studies. Pain Rep 2019; 4:e775. [PMID: 31875182 PMCID: PMC6882575 DOI: 10.1097/pr9.0000000000000775] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Revised: 06/11/2019] [Accepted: 06/26/2019] [Indexed: 12/14/2022] Open
Abstract
Screening tools allowing to predict poor pain outcomes are widely used. Often these screening tools contain psychosocial risk factors. This review (1) identifies multidimensional screening tools that include psychosocial risk factors for the development or maintenance of pain, pain-related distress, and pain-related disability across pain problems in adults, (2) evaluates the quality of the validation studies using Prediction model Risk Of Bias ASsessment Tool (PROBAST), and (3) synthesizes methodological concerns. We identified 32 articles, across 42 study samples, validating 7 screening tools. All tools were developed in the context of musculoskeletal pain, most often back pain, and aimed to predict the maintenance of pain or pain-related disability, not pain-related distress. Although more recent studies design, conduct, analyze, and report according to best practices in prognosis research, risk of bias was most often moderate. Common methodological concerns were identified, related to participant selection (eg, mixed populations), predictors (eg, predictors were administered differently to predictors in the development study), outcomes (eg, overlap between predictors and outcomes), sample size and participant flow (eg, unknown or inappropriate handling of missing data), and analysis (eg, wide variety of performance measures). Recommendations for future research are provided.
Collapse
|
54
|
Bhagat M, Neelapala YVR, Gangavelli R. Immediate effects of Mulligan's techniques on pain and functional mobility in individuals with knee osteoarthritis: A randomized control trial. PHYSIOTHERAPY RESEARCH INTERNATIONAL 2019; 25:e1812. [PMID: 31502354 DOI: 10.1002/pri.1812] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Revised: 07/24/2019] [Accepted: 08/25/2019] [Indexed: 12/16/2022]
Abstract
BACKGROUND AND PURPOSE Mulligan's mobilization with movement was shown to be effective when implemented in multimodal therapy for knee osteoarthritis. However, no study has evaluated the Mulligan's technique in isolation and compared the relative effectiveness with sham-controlled interventions. Hence, the present study examined the immediate effects of Mulligan's techniques with sham mobilization on the numerical pain rating scale (NPRS) and timed up and go (TUG) test in individuals with knee osteoarthritis. METHODS Thirty participants (mean age: 55.3 ± 8.3 years) with symptoms at the knee and radiographic diagnosis of knee osteoarthritis were randomized into sham (n = 15) and intervention (n = 15) groups. The intervention (I) group received Mulligan's mobilization glides that resulted in relative pain relief for three sets of 10 repetitions. For the sham (S) group, the therapist's hand was placed over the joint surfaces mimicking the pain-relieving glides, without providing the gliding force. The outcome measures NPRS and TUG were recorded by a blinded assessor pre- and post-intervention. RESULTS Statistically significant differences were identified between the groups in post-intervention median (interquartile range) NPRS (I group: 4.00 [2.00-5.00]; S group: 6.00 [4.00-7.00]) and TUG scores (I group: 10.9 [9.43-10.45]; S group: 13.18 [10.38-16.00]) with the intervention group demonstrating better outcomes (p < .05). Within-group, the post-intervention scores of NPRS and TUG were significantly lower (p < .05) compared to the pre-intervention scores in the intervention group. In the sham group, a statistically significant pre-post change was noticed only in the NPRS scores but not in the TUG scores. CONCLUSION Mulligan's techniques were effective in improving pain and functional mobility in individuals with knee osteoarthritis. The underlying mechanisms for observed effects must be examined further, as participants reported pain relief following sham mobilization.
Collapse
Affiliation(s)
- Madhura Bhagat
- Department of Physiotherapy, School of Allied Health Sciences, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Y V Raghava Neelapala
- Department of Physiotherapy, School of Allied Health Sciences, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Ranganath Gangavelli
- Department of Physiotherapy, School of Allied Health Sciences, Manipal Academy of Higher Education, Manipal, Karnataka, India
| |
Collapse
|
55
|
Pulles ANTD, Köke AJA, Strackke RP, Smeets RJEM. The responsiveness and interpretability of psychosocial patient-reported outcome measures in chronic musculoskeletal pain rehabilitation. Eur J Pain 2019; 24:134-144. [PMID: 31408556 DOI: 10.1002/ejp.1470] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 07/31/2019] [Accepted: 08/08/2018] [Indexed: 12/18/2022]
Abstract
BACKGROUND For several widely used patient-reported outcome measures (PROMs) in chronic musculoskeletal pain (CMSP) rehabilitation, it is still not known whether they are responsive to change, and what the smallest detectable change (SDC) and minimal clinically important change (MCIC) are. Knowledge of these values can be used to accurately interpret change scores in research and clinical practice. METHODS In this retrospective cohort study, the responsiveness, the SDC and the MCIC of the mental components of the Research and Development 36-Item Health Survey (RAND-36), the Pain Catastrophizing Scale (PCS) and the Tampa Scale of Kinesiophobia (TSK) were investigated in CMSP patients. Responsiveness, the SDC and MCIC were determined by using both anchor and distribution-based methods. RESULTS For all outcome measures, there was a progression from smallest to largest mean change scores between participants who did not perceive change and those who reported change after treatment. However, correlations of the Global Perceived Effect (GPE) with the change scores on the outcome measures were low. For all outcome measures, the SDC was larger than the MCIC. CONCLUSIONS For this population, the questionnaires were shown not to be responsive. Furthermore, the questionnaires appeared not to be able to distinguish clinically important change from measurement error in individual patients. The finding of large measurement errors of PROMs is in line with previous research in pain rehabilitation. Using generic PROMs only, to examine changes in psychosocial status due to a pain rehabilitation programme, is therefore questionable. SIGNIFICANCE This study shows that widely used generic psychosocial PROMs might not be responsive and not able to distinguish clinically important change from measurement error in individual chronic musculoskeletal pain patients. It therefore seems reasonable to reconsider the (compulsory) use of these PROMs for assessing the quality of pain rehabilitation programmes, and necessary to consider other, more objective, outcome measures for this purpose in this population.
Collapse
Affiliation(s)
- Alexandra N T D Pulles
- Department of Rehabilitation Medicine, CAPHRI, Maastricht University, Maastricht, The Netherlands
| | - Albère J A Köke
- Department of Rehabilitation Medicine, CAPHRI, Maastricht University, Maastricht, The Netherlands.,Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands.,Zuyd University for Applied Sciences, faculty Health and Technology, Heerlen, The Netherlands
| | - Robin P Strackke
- Adelante Centre of Expertise in Rehabilitation and Audiology, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - Rob J E M Smeets
- Department of Rehabilitation Medicine, CAPHRI, Maastricht University, Maastricht, The Netherlands.,CIR Revalidatie, Eindhoven/Zwolle, The Netherlands
| |
Collapse
|
56
|
Elhennawy K, Krois J, Jost-Brinkmann PG, Schwendicke F. Outcome and comparator choice in molar incisor hypomineralisation (MIH) intervention studies: a systematic review and social network analysis. BMJ Open 2019; 9:e028352. [PMID: 31377700 PMCID: PMC6687020 DOI: 10.1136/bmjopen-2018-028352] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVES Outcome and comparator choice strongly determine the validity and implementation of clinical trial results. We aimed to assess outcome and comparator choice in intervention studies on molar incisor hypomineralisation (MIH) using systematic review and social network analysis (SNA). DESIGN AND DATA SOURCES Medline, Embase, Cochrane Central, Google Scholar, opengrey.eu as well as DRKS.de and Clinicaltrials.gov were searched for MIH intervention studies. The search covered the period from 1980 to 2019. ELIGIBILITY CRITERIA Clinical single-arm/multiarm, controlled/uncontrolled studies reporting on the management of MIH were included. Reported outcomes and comparators were extracted and categorised. SNA was used to evaluate comparator choice and the resulting trial networks. DATA EXTRACTION Of the 7979 identified records, 100 were evaluated in full text and 35 studies (17 randomised controlled trials, 14 prospective and 4 retrospective cohort studies) were included. RESULTS In total, 2124 patients with a mean age of 11 years (min/max 6/70 years) were included. Outcomes fell in one of 11 different outcome categories: restoration success, aesthetic improvement, pain/hypersensitivity/discomfort, mineral gain, space management, anaesthesia effectiveness, preventive success, efficiency, quality of life, gingival and periodontal health and patient satisfaction. Comparators were mainly restorative interventions (17 studies), remineralisation (3), treatment of hypersensitivity (10), aesthetic interventions (5) and orthodontic interventions (3). Two highly clustered comparator networks emerged; many interventions were not robustly linked to these networks. CONCLUSIONS MIH intervention studies recorded both clinically centred and patient-centred outcomes. Core outcome set development should consider these and supplement them with outcomes on, for example, applicability. The high number of compared interventions tested in only few studies and our SNA results implicate that the current evidence may not be robust.
Collapse
Affiliation(s)
- Karim Elhennawy
- Department of Orthodontics, Dentofacial Orthopedics and Pedodontics, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Joachim Krois
- Department of Operative and Preventive Dentistry, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Paul-Georg Jost-Brinkmann
- Department of Orthodontics, Dentofacial Orthopedics and Pedodontics, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Falk Schwendicke
- Department of Operative and Preventive Dentistry, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
57
|
Lima POP, Melo WPX, Bezerra MA, Almeida GPL, Nunes ACL, Oliveira RR. Intraexaminer and Interexaminer Reproducibility of the Downing Test for Sacroiliac Joint Evaluation of Symptomatic and Asymptomatic Individuals. J Chiropr Med 2019; 18:163-170. [PMID: 32884497 DOI: 10.1016/j.jcm.2018.11.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2017] [Revised: 11/22/2018] [Accepted: 11/27/2018] [Indexed: 01/15/2023] Open
Abstract
Objective This study aimed to assess the intraexaminer and interexaminer reproducibility of the Downing test in sacroiliac joint evaluation in symptomatic and asymptomatic individuals. Methods A reliability study was conducted with a test-retest design in 54 college students of both sexes. To assess the intraexaminer reproducibility, each participant was evaluated twice by the same examiner with a 7-day interval, and to assess the interexaminer reproducibility, each participant was evaluated by 2 examiners. Results Of the 54 participants included in the study, 18 (33.3%) were asymptomatic and 36 (66.7%) were symptomatic; a total of 108 sacroiliac joints were evaluated. Sacroiliac joint diagnosis based on the Downing test presented low intraexaminer reproducibility in all participants (κ = 0.12, 95% confidence interval [CI] 0.03-0.22), in asymptomatic individuals (κ = 0.18, 95% CI 0.02-0.34), and in symptomatic individuals (κ = 0.28, 95% CI 0.17-0.39). The interexaminer reproducibility also was low in all participants (κ = 0.18, 95% CI 0.09-0.27), in asymptomatic individuals (κ = 0.22, 95% CI 0.15-0.37), and in symptomatic individuals (κ = 0.16, 95% CI 0.05-0.27). The standard error of the measurement values were not lower than smallest detectable change values considering a CI of 95% for all participants. Conclusion For this group of asymptomatic and symptomatic participants, the reproducibility of the Downing test was poor. The clinical utility of this test used in isolation is not supported by the present study.
Collapse
Affiliation(s)
- Pedro O P Lima
- Department of Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil.,League of Sport Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| | - Wenya P X Melo
- League of Sport Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| | - Márcio A Bezerra
- Department of Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil.,League of Sport Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| | - Gabriel P L Almeida
- Department of Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil.,League of Sport Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| | - Ana Carla L Nunes
- Department of Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| | - Rodrigo R Oliveira
- Department of Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil.,League of Sport Physical Therapy, Federal University of Ceará, Fortaleza, Ceará, CE, Brazil
| |
Collapse
|
58
|
Pennings JS, Devin CJ, Khan I, Bydon M, Asher AL, Archer KR. Prediction of Oswestry Disability Index (ODI) using PROMIS-29 in a national sample of lumbar spine surgery patients. Qual Life Res 2019; 28:2839-2850. [PMID: 31190294 DOI: 10.1007/s11136-019-02223-8] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/29/2019] [Indexed: 12/29/2022]
Abstract
PURPOSE The primary purpose was to examine the measurement properties of the PROMIS-29 to better understand its use in patients undergoing spine surgery. A secondary objective was to calculate a predictive equation between PROMIS-29 and ODI, to allow clinicians and researchers to determine a predicted ODI score based on PROMIS short form scores. METHODS 719 patients with PROMIS v2.0 and ODI responses were queried from the quality outcomes database. Validity was assessed using coefficient omega, ceiling/floor effects, and confirmatory factor analysis. Multivariable regression predicting ODI scores from PROMIS-29 domains was used to create a predictive equation. Predicted ODI scores were plotted against ODI scores to determine how well PROMIS-29 domains predicted ODI. RESULTS Results showed good reliability and validity of PROMIS-29 in patients undergoing lumbar spine surgery: convergent and discriminant validity, low floor/ceiling effects, and unidimensional domains. The conversion equation used 6 PROMIS-29 domains (ODI% = 37.847- 1.475*[PFraw] + 1.842*[PAINraw] + 0.557*[SDraw] - 0.642*[SRraw] + 0.478*[PIraw] + 0.295*[DEPraw]). Correlation between the predicted and actual ODI scores was R = 0.88, R2 = 0.78, suggesting that the equation predicted ODI scores that are strongly correlated with actual ODI scores. CONCLUSIONS Good measurement properties support the use of PROMIS-29 in spine surgery patients. Findings suggest accurate ODI scores can be derived from PROMIS-29 domains. Clinicians who want to move from ODI to PROMIS-29 can use this equation to obtain estimated ODI scores when only collecting PROMIS-29. These results support the idea that PROMIS-29 domains have the potential to replace disease-specific traditional PROMs.
Collapse
Affiliation(s)
- Jacquelyn S Pennings
- Department of Orthopaedic Surgery, Vanderbilt University School of Medicine, Nashville, TN, USA.,Vanderbilt Center for Musculoskeletal Research, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Clinton J Devin
- Department of Orthopaedic Surgery, Vanderbilt University School of Medicine, Nashville, TN, USA.,Steamboat Orthopaedic and Spine Institute, Steamboat Springs, CO, USA
| | - Inamullah Khan
- Department of Orthopaedic Surgery, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Mohamad Bydon
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN, USA
| | - Anthony L Asher
- Carolina Neurosurgery & Spine Associates, Carolinas Healthcare System, Charlotte, NC, USA
| | - Kristin R Archer
- Department of Orthopaedic Surgery, Vanderbilt University School of Medicine, Nashville, TN, USA. .,Vanderbilt Center for Musculoskeletal Research, Vanderbilt University Medical Center, Nashville, TN, USA. .,Department of Physical Medicine and Rehabilitation, Vanderbilt University School of Medicine, Nashville, TN, USA.
| |
Collapse
|
59
|
Redshaw M, Martin CR, Savage-McGlynn E, Harrison S. Women's experiences of maternity care in England: preliminary development of a standard measure. BMC Pregnancy Childbirth 2019; 19:167. [PMID: 31088487 PMCID: PMC6518811 DOI: 10.1186/s12884-019-2284-9] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Accepted: 04/10/2019] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND As maternity services evolve and the population of women served also changes, there is a continuing need to effectively document the views of women with recent experience of care. A woman's maternity experience can have a positive or negative effect upon her emotional well-being and health, in the immediate and the long-term, which can also impact the infant and the wider family system. Measuring women's perceptions of maternity services is an important way of monitoring the quality of care provision, as well as providing key indicators to organisations of the services that they are providing. It follows that, without information identifying possible areas in need of improvement, it is not clear what changes should be made to improve the experiences of women during their journey through maternity services from pregnancy to the early weeks at home with a new baby . The objective is to describe the development process and psychometric properties of a measure of women's experience of maternity care covering the three distinctly different phases of maternity - pregnancy, labour and birth, and the early postnatal period. METHODS Data from a national survey of women who had recently given birth (n = 504) were used. Exploratory and confirmatory factor analytic methods were employed. The measure was assessed for underlying latent factor structure, as well as for reliability, internal consistency, and validity (predictive, convergent and discriminant). RESULTS The models developed confirmed the use of three separate, but related scales about experience of maternity care during pregnancy, labour and birth and the postnatal period. Data reduction was effective, resulting in a measure with 36 items (12 per scale). CONCLUSION The need for a psychometrically robust and qualitatively comprehensive measure of women's experience of maternity care has been addressed in the development and validation of this prototype measure. The whole measure can be used at one time point, or the three separate subscales used as individual measures of experience during particular phases of the maternity journey with identified factor structures in their own right.
Collapse
Affiliation(s)
- Maggie Redshaw
- Policy Research Unit in Maternal Health and Care, National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Old Road Campus, Headington, Oxford, OX3 7LF, UK.
| | - Colin R Martin
- Policy Research Unit in Maternal Health and Care, National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Old Road Campus, Headington, Oxford, OX3 7LF, UK
| | - Emily Savage-McGlynn
- Policy Research Unit in Maternal Health and Care, National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Old Road Campus, Headington, Oxford, OX3 7LF, UK
| | - Sian Harrison
- Policy Research Unit in Maternal Health and Care, National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Old Road Campus, Headington, Oxford, OX3 7LF, UK
| |
Collapse
|
60
|
Elshiwi AM, Hamada HA, Mosaad D, Ragab IMA, Koura GM, Alrawaili SM. Effect of pulsed electromagnetic field on nonspecific low back pain patients: a randomized controlled trial. Braz J Phys Ther 2019; 23:244-249. [PMID: 30177406 PMCID: PMC6531640 DOI: 10.1016/j.bjpt.2018.08.004] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2018] [Revised: 07/31/2018] [Accepted: 08/06/2018] [Indexed: 10/28/2022] Open
Abstract
BACKGROUND Further research on pulsed electromagnetic field (PEMF) effects on the different conditions of low back pain was warranted due to lack of studies in this area. OBJECTIVES To investigate the effects of pulsed electromagnetic field therapy with 50Hz frequency, with low intensity of 20Gauss compared to conventional non-invasive treatment modalities in patients with chronic non-specific low back pain. METHODS Design - A prospective, randomized, patient-blinded, controlled trial. Setting - The study was conducted at Outpatient Physiotherapy Clinic in Cairo, Egypt. The study was conducted between May 2015 and September 2016. Participants - Fifty participants with non-specific low back pain enrolled into experimental and control groups. Interventions - The experimental group received the Conventional physical therapy Protocol as well as magnetic field, while the control group received the same Conventional physical therapy and sham electromagnetic field. Both groups received 12 sessions over 4 weeks' period. Outcome measures - Primary outcome measures was pain intensity while the secondary outcome measures were disability and lumbar range of motion - ROM. There were no adverse events occurred during the study. RESULTS Fifty participants with non-specific low back pain (control group n=25; experimental group n=25) were randomized. There were significant between-group differences in pain scores (mean difference - MD 1.52; 95%CI -0.34 to 3.35), function disability (MD 8.14; 95%CI 6.5 to 9.96), Range of Motion (ROM) of lumbar flexion (MD -1.27; 95%CI -1.09 to -1.45), ROM of lumbar extension (MD -1.1; 95%CI -0.97 to -1.23), ROM of lumbar right side bending (MD 8.2; 95%CI 6.56 to 9.84) and ROM of lumbar left side bending (MD 10.4; 95%CI 8.81 to 11.99) in favour of the experimental group. CONCLUSION Adding pulsed electromagnetic field to Conventional physical therapy Protocol yields superior clinical improvement in pain, functional disability, and lumbar ROM in patients with non-specific low back pain than Conventional physical therapy alone.
Collapse
Affiliation(s)
- Ahmed Mohamed Elshiwi
- Department of Physical Therapy for Musculoskeletal Disorders and its Surgery, Faculty of Physical Therapy, Cairo University, Cairo, Egypt
| | - Hamada Ahmed Hamada
- Department of Biomechanics, Faculty of Physical Therapy, Cairo University, Cairo, Egypt.
| | - Dalia Mosaad
- Department of Basic Science, Faculty of Physical Therapy, Cairo University, Cairo, Egypt
| | - Ibrahim Mohammed A Ragab
- Department of Physical Therapy for Musculoskeletal Disorders and its Surgery, Faculty of Physical Therapy, Beni-Suef University, Beni-Suef, Egypt
| | - Ghada Mohamed Koura
- Department of Physical Therapy for Musculoskeletal Disorders and its Surgery, Faculty of Physical Therapy, Cairo University, Cairo, Egypt; Department of Medical Rehabilitation, Faculty of Applied Sciences, King Khalid University, Abha, Saudi Arabia
| | - Saud Mashi Alrawaili
- Department of Physical Therapy and Health Rehabilitation, College of Applied Medical Sciences, Prince Sattam, Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| |
Collapse
|
61
|
Young AE, Davies A, Bland S, Brookes S, Blazeby JM. Systematic review of clinical outcome reporting in randomised controlled trials of burn care. BMJ Open 2019; 9:e025135. [PMID: 30772859 PMCID: PMC6398699 DOI: 10.1136/bmjopen-2018-025135] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
INTRODUCTION Systematic reviews collate trial data to provide evidence to support clinical decision-making. For effective synthesis, there must be consistency in outcome reporting. There is no agreed set of outcomes for reporting the effect of burn care interventions. Issues with outcome reporting have been identified, although not systematically investigated. This study gathers empirical evidence on any variation in outcome reporting and assesses the need for a core outcome set for burn care research. METHODS Electronic searches of four search engines were undertaken from January 2012 to December 2016 for randomised controlled trials (RCTs), using medical subject headings and free text terms including 'burn', 'scald' 'thermal injury' and 'RCT'. Two authors independently screened papers, extracted outcomes verbatim and recorded the timing of outcome measurement. Duplicate outcomes (exact wording ± different spelling), similar outcomes (albumin in blood, serum albumin) and identical outcomes measured at different times were removed. Variation in outcome reporting was determined by assessing the number of unique outcomes reported across all included trials. Outcomes were classified into domains. Bias was reduced using five researchers and a patient working independently and together. RESULTS 147 trials were included, of which 127 (86.4%) were RCTs, 13 (8.8%) pilot studies and 7 (4.8%) RCT protocols. 1494 verbatim clinical outcomes were reported; 955 were unique. 76.8% of outcomes were measured within 6 months of injury. Commonly reported outcomes were defined differently. Numbers of unique outcomes per trial varied from one to 37 (median 9; IQR 5,13). No single outcome was reported across all studies demonstrating inconsistency of reporting. Outcomes were classified into 54 domains. Numbers of outcomes per domain ranged from 1 to 166 (median 11; IQR 3,24). CONCLUSIONS This review has demonstrated heterogeneity in outcome reporting in burn care research which will hinder amalgamation of study data. We recommend the development of a Core Outcome Set. PROSPERO REGISTRATION NUMBER CRD42017060908.
Collapse
Affiliation(s)
- Amber E Young
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Anna Davies
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | | | - Sara Brookes
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Cancer Research UK Clinical Trials Unit (CRCTU), Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham, UK
| | - Jane M Blazeby
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| |
Collapse
|
62
|
Chierrito D, Villas-Boas CB, Tonin FS, Fernandez-Llimos F, Sanches AC, de Mello JC. Using Cell Cultures for the Investigation of Treatments for Attention Deficit Hyperactivity Disorder: A Systematic Review. Curr Neuropharmacol 2019; 17:916-925. [PMID: 31079591 PMCID: PMC7052832 DOI: 10.2174/1570159x17666190409143155] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2018] [Revised: 01/01/2019] [Accepted: 03/29/2019] [Indexed: 12/09/2022] Open
Abstract
BACKGROUND Advances in basic and molecular biology have promoted the use of cell cultures in a wide range of areas, including the evaluation of drug efficacy, safety and toxicity. OBJECTIVE This article aims to provide a general overview of the methodological parameters of cell cultures used to investigate therapeutic options for Attention Deficit Hyperactivity Disorder. METHOD A systematic search was performed in the electronic databases PubMed, Scopus, and DOAJ. In vitro experimental studies using cell cultures were included. RESULTS A total of 328 studies were initially identified, with 16 included for qualitative synthesis. Seven studies used neuronal cells (SH-SY5Y neuroblastoma and PC12 cell line) and nine used nonneuronal cells. All the studies described the culture conditions, but most studies were inconsistent with regard to reporting results and raw data. Only one-third of the studies performed cell viability assays, while a further 30% conducted gene expression analysis. Other additional tests included electrophysiological evaluation and transporter activity. More than 50% of the studies evaluated the effects of drugs such as methylphenidate and atomoxetine, while plant extracts were assessed in four studies and polyunsaturated fatty acids in one. CONCLUSION We suggested a flowchart to guide the planning and execution of studies, and a checklist to be completed by authors to allow the standardized reporting of results. This may guide the elaboration of laboratory protocols and further in vitro studies.
Collapse
Affiliation(s)
| | | | | | | | | | - João C.P. de Mello
- Address correspondence to this author at the Department of Pharmacy, Universidade Estadual de Maringá, Maringá, PR, Brazil; Tel/Fax: +55 44 30114627; E-mail:
| |
Collapse
|
63
|
Almeida CCD, Silva VZMD, Júnior GC, Liebano RE, Durigan JLQ. Transcutaneous electrical nerve stimulation and interferential current demonstrate similar effects in relieving acute and chronic pain: a systematic review with meta-analysis. Braz J Phys Ther 2018; 22:347-354. [PMID: 29426587 PMCID: PMC6157468 DOI: 10.1016/j.bjpt.2017.12.005] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2017] [Revised: 12/12/2017] [Accepted: 12/20/2017] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Transcutaneous electrical nerve stimulation and interferential current have been widely used in clinical practice. However, a systematic review comparing their effects on pain relief has not yet been performed. OBJECTIVES To investigate the effects of transcutaneous electrical nerve stimulation and interferential current on acute and chronic pain. METHODS We use Pubmed, Embase, LILACS, PEDro and Cochrane Central Register of Controlled Trials as data sources. Two independent reviewers that selected studies according to inclusion criteria, extracted information of interest and verified the methodological quality of the studies made study selection. The studies were selected if transcutaneous electrical nerve stimulation and interferential current were used as treatment and they had pain as the main outcome, as evaluated by a visual analog scale. Secondary outcomes were the Western Ontario Macmaster and Rolland Morris Disability questionnaires, which were added after data extraction. RESULTS Eight studies with a pooled sample of 825 patients were included. The methodological quality of the selected studies was moderate, with an average of six on a 0-10 scale (PEDro). In general, both transcutaneous electrical nerve stimulation and interferential current improved pain and functional outcomes without a statistical difference between them. CONCLUSION Transcutaneous electrical nerve stimulation and interferential current have similar effects on pain outcome The low number of studies included in this meta-analysis indicates that new clinical trials are needed.
Collapse
Affiliation(s)
| | - Vinicius Z Maldaner da Silva
- Physical Therapy Division, Instituto Hospital de Base do Distrito federal e Escola Superior de Ciências da Saúde (ESCS), Brasilia, DF, Brazil
| | - Gerson Cipriano Júnior
- Rehabilitation Sciences Program, Physical Therapy Division, Universdade de Brasilia UnB, Brasília, DF, Brazil
| | - Richard Eloin Liebano
- Department of Physical Therapy, Universidade Federal de São Carlos UFSCar, São Carlos, SP, Brazil
| | | |
Collapse
|
64
|
Chiarotto A, Boers M, Deyo RA, Buchbinder R, Corbin TP, Costa LO, Foster NE, Grotle M, Koes BW, Kovacs FM, Lin CWC, Maher CG, Pearson AM, Peul WC, Schoene ML, Turk DC, van Tulder MW, Terwee CB, Ostelo RW. Core outcome measurement instruments for clinical trials in nonspecific low back pain. Pain 2018; 159:481-495. [PMID: 29194127 PMCID: PMC5828378 DOI: 10.1097/j.pain.0000000000001117] [Citation(s) in RCA: 288] [Impact Index Per Article: 41.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2017] [Revised: 11/09/2017] [Accepted: 11/15/2017] [Indexed: 01/09/2023]
Abstract
To standardize outcome reporting in clinical trials of patients with nonspecific low back pain, an international multidisciplinary panel recommended physical functioning, pain intensity, and health-related quality of life (HRQoL) as core outcome domains. Given the lack of a consensus on measurement instruments for these 3 domains in patients with low back pain, this study aimed to generate such consensus. The measurement properties of 17 patient-reported outcome measures for physical functioning, 3 for pain intensity, and 5 for HRQoL were appraised in 3 systematic reviews following the COSMIN methodology. Researchers, clinicians, and patients (n = 207) were invited in a 2-round Delphi survey to generate consensus (≥67% agreement among participants) on which instruments to endorse. Response rates were 44% and 41%, respectively. In round 1, consensus was achieved on the Oswestry Disability Index version 2.1a for physical functioning (78% agreement) and the Numeric Rating Scale (NRS) for pain intensity (75% agreement). No consensus was achieved on any HRQoL instrument, although the Short Form 12 (SF12) approached the consensus threshold (64% agreement). In round 2, a consensus was reached on an NRS version with a 1-week recall period (96% agreement). Various participants requested 1 free-to-use instrument per domain. Considering all issues together, recommendations on core instruments were formulated: Oswestry Disability Index version 2.1a or 24-item Roland-Morris Disability Questionnaire for physical functioning, NRS for pain intensity, and SF12 or 10-item PROMIS Global Health form for HRQoL. Further studies need to fill the evidence gaps on the measurement properties of these and other instruments.
Collapse
Affiliation(s)
- Alessandro Chiarotto
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, the Netherlands
- Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, Vrije Universiteit, Amsterdam, the Netherlands
| | - Maarten Boers
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, the Netherlands
- Amsterdam Rheumatology and Immunology Center, VU University Medical Center, Amsterdam, the Netherlands
| | - Richard A. Deyo
- Department of Family Medicine, Department of Internal Medicine, and Oregon Institute of Occupational Health Sciences, Oregon Health and Science University, Portland, OR, USA
| | - Rachelle Buchbinder
- Department of Epidemiology and Preventive Medicine, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
- Monash Department of Clinical Epidemiology, Cabrini Institute, Malvern, Australia
| | - Terry P. Corbin
- Cochrane Collaboration, Back and Neck Review Group, Maple Grove, MN, USA
| | - Leonardo O.P. Costa
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de Sao Paulo, Sao Paulo, Brazil
| | - Nadine E. Foster
- Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, United Kingdom
| | - Margreth Grotle
- Oslo and Akershus University College, Faculty of Health Science, Oslo, Norway
- Communication and Research Unit for Musculoskeletal Disorders (FORMI), Oslo University Hospital & University of Oslo, Oslo, Norway
| | - Bart W. Koes
- Department of General Practice, Erasmus MC University Medical Center, Rotterdam, the Netherlands
| | - Francisco M. Kovacs
- Spanish Back Pain Research Network, Hospital Universitario HLA-Moncloa, Madrid, Spain
| | - C.-W. Christine Lin
- Sydney School of Public Health, Sydney Medical School, University of Sydney, Sydney, Australia
| | - Chris G. Maher
- Sydney School of Public Health, Sydney Medical School, University of Sydney, Sydney, Australia
| | - Adam M. Pearson
- Department of Orthopaedic Surgery, Dartmouth-Hitchcock Medical Center, Lebanon, PA, USA
| | - Wilco C. Peul
- Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
| | - Mark L. Schoene
- Cochrane Collaboration, Back and Neck Review Group, Newbury, MA, USA
| | - Dennis C. Turk
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, WA, USA
| | - Maurits W. van Tulder
- Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, Vrije Universiteit, Amsterdam, the Netherlands
| | - Caroline B. Terwee
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, the Netherlands
| | - Raymond W. Ostelo
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, the Netherlands
- Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, Vrije Universiteit, Amsterdam, the Netherlands
| |
Collapse
|
65
|
Marquillier T, Doméjean S, Le Clerc J, Chemla F, Gritsch K, Maurin JC, Millet P, Pérard M, Grosgogeat B, Dursun E. The use of FDI criteria in clinical trials on direct dental restorations: A scoping review. J Dent 2018; 68:1-9. [PMID: 29055692 DOI: 10.1016/j.jdent.2017.10.007] [Citation(s) in RCA: 71] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2017] [Revised: 10/14/2017] [Accepted: 10/18/2017] [Indexed: 12/17/2022] Open
Abstract
OBJECTIVES A scoping review was conducted to explore the use of FDI criteria 10 years after their introduction. The first aim was to compare the amount of studies using the FDI and/or the modified USPHS criteria. The second aim was to analyse the use of the FDI criteria in clinical trials evaluating direct dental restorations. DATA Listing of studies using FDI and/or USPHS criteria per year since 2007. Clinical studies related to the assessment of direct restorations using FDI criteria. SOURCE Two systematic searches - regarding the use of FDI and modified USPHS criteria - were carried out on Medline/Pubmed in order to identify the studies published between 2007 and 2017. Authors of the included articles were contacted to clarify their choice of FDI criteria in their studies. ClinicalTrials.gov database was also queried for the on-going studies that use FDI and modified USPHS criteria. STUDY SELECTION In the first review, all the clinical trials (randomized/non-randomized, controlled, prospective/retrospective studies) that used FDI criteria to evaluate direct restorations on primary or permanent teeth were included. CONCLUSIONS 16.3% of the studies used FDI criteria. The percentage of studies using them increased from 4.5% in 2010 to 50.0% in 2016. In average, 8.5 FDI criteria were used. The most employed criteria were: marginal adaptation (96.7%), staining (90.0%), fracture of material and retention (90.0%), recurrence of caries/erosion/abfraction (90.0%), post-operative sensitivity/tooth vitality (86.7%) and surface luster (60.0%). In addition, among the 27 on-going studies from ClinicalTrials.gov database, 51.9% use FDI criteria (including 87.5% with an open recruitment status). CLINICAL SIGNIFICANCE FDI criteria were reported as practical (various and freely selectable), relevant (sensitive as well as appropriate to current restorative materials and clinical studies design), standardized (making comparisons between investigations easier). Investigators should go on using them for a better standardization of their clinical judgment, allowing comparisons with other studies.
Collapse
Affiliation(s)
- Thomas Marquillier
- Univ. Lille, CHRU Lille, UFR Odontologie, Odontologie pédiatrique, 59000 Lille, France; Univ. Paris 13 - Sorbonne Paris Cité, UFR Santé Médecine Biologie Humaine, Laboratoire Educations et Pratiques de Santé (EA 3412), 93017, France
| | - Sophie Doméjean
- Univ Clermont Auvergne, UFR d'Odontologie, CHU Estaing Clermont-Ferrand, Service d'Odontologie, 63001 Clermont-Ferrand, France; Centre de Recherche en Odontologie Clinique EA 4847, 63100 Clermont-Ferrand, France
| | - Justine Le Clerc
- Univ Rennes1, CHU Rennes, UFR Odontologie, 35043 Rennes, France; Univ Rennes1, CNRS, U6226, Institut des Sciences Chimiques de Rennes, 35700 Rennes, France
| | - Florence Chemla
- Univ. Paris Descartes, APHP Hôpital Charles Foix, UFR Odontologie, 92120 Montrouge, France
| | - Kerstin Gritsch
- Univ Lyon, Université Claude Bernard Lyon 1, CNRS, Laboratoire des Multimatériaux et Interfaces, 69622 Villeurbanne, France.; Laboratoire des Multimatériaux et Interfaces, UMR CNRS 5615, 69008 Lyon, France; Hospices Civils de Lyon, Service de Consultations et de Traitements Dentaires, 69007, Lyon, France
| | - Jean-Christophe Maurin
- Univ Lyon, Université Claude Bernard Lyon 1, CNRS, Laboratoire des Multimatériaux et Interfaces, 69622 Villeurbanne, France.; Laboratoire des Multimatériaux et Interfaces, UMR CNRS 5615, 69008 Lyon, France; Hospices Civils de Lyon, Service de Consultations et de Traitements Dentaires, 69007, Lyon, France
| | - Pierre Millet
- Univ. Reims Champagne Ardenne, CHU Reims, Service Odontologie, 51100 Reims, France
| | - Matthieu Pérard
- Univ Rennes1, CHU Rennes, UFR Odontologie, 35043 Rennes, France; Univ Rennes1, CNRS, U6226, Institut des Sciences Chimiques de Rennes, 35700 Rennes, France
| | - Brigitte Grosgogeat
- Univ Lyon, Université Claude Bernard Lyon 1, CNRS, Laboratoire des Multimatériaux et Interfaces, 69622 Villeurbanne, France.; Laboratoire des Multimatériaux et Interfaces, UMR CNRS 5615, 69008 Lyon, France; Hospices Civils de Lyon, Service de Consultations et de Traitements Dentaires, 69007, Lyon, France.
| | - Elisabeth Dursun
- Univ. Paris Descartes, APHP Hôpital Albert Chenevier, UFR Odontologie, 92120 Montrouge, France; Univ. Paris Descartes, UFR Odontologie, Unité de recherche en biomatériaux innovants et interfaces (EA4462), 92120 Montrouge, France
| |
Collapse
|
66
|
Chiarotto A, Terwee CB, Ostelo RW. Choosing the right outcome measurement instruments for patients with low back pain. Best Pract Res Clin Rheumatol 2017; 30:1003-1020. [PMID: 29103546 DOI: 10.1016/j.berh.2017.07.001] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2017] [Revised: 07/01/2017] [Accepted: 07/03/2017] [Indexed: 10/19/2022]
Abstract
Choosing the most fit-for-purpose outcome measurement instruments is fundamental because using inappropriate instruments can lead to detection bias and measurement inconsistency. Recent recommendations, consensus procedures and systematic reviews on existing patient-reported outcome measures (PROMs) informed this manuscript, which provides suggestions on which outcome domains and measurement instruments to use in patients with low back pain (LBP). Six domains are identified as highly relevant: (1) physical functioning, (2) pain intensity, (3) health-related quality of life, (4) work, (5) psychological functioning and (6) pain interference. For each domain, one or more PROMs are suggested for clinical research and practice, selecting among those that are most frequently used and recommended, and that have satisfactory measurement properties in patients with LBP. Further research on the measurement properties of these suggested PROMs is needed while also considering other emerging instruments, such as the PROMIS computerised adaptive testing and short forms.
Collapse
Affiliation(s)
- Alessandro Chiarotto
- Department of Health Sciences, Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, The Netherlands; Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, The Netherlands.
| | - Caroline B Terwee
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, The Netherlands
| | - Raymond W Ostelo
- Department of Health Sciences, Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, The Netherlands; Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, The Netherlands
| |
Collapse
|