Assessing professional competence in optometry - a review of the development and validity of the written component of the competency in optometry examination (COE)

Antimicrobial stewardship and education in optometry

CLINICAL RELEVANCE

Antimicrobial stewardship aims to improve how antibiotics are prescribed by clinicians and used by patients, to ensure safe appropriate use, and to prevent and contain antimicrobial resistance.

BACKGROUND

Australian optometrists can prescribe a range of antimicrobial agents, but to what extent they consider antimicrobial stewardship is not known. This study evaluated what final-year optometry students and optometrists understood about antimicrobial stewardship in eye care and considered relevance to oral prescribing and education.

METHODS

A knowledge, attitude, and practice (KAP) questionnaire was developed comprising four sections: i) demographic questions, ii) 10 multiple choice questions regarding Knowledge about antimicrobial agents and likely pathogens, diagnosis, treatment, and preventing resistance, iii) 10 Likert rating scale questions about thoughts and Attitudes, iv) mix of question types (5× MCQ: course of action, 16 Likert scale: confidence) related to Practice (diagnosis, management, and prescribing). Descriptive analyses were conducted (medians, mean±SD, and distributions).

RESULTS

Thirteen students and 36 optometrists completed the survey. Both groups had a good understanding of microbial resistance and antibiotic prescribing for ocular conditions; average knowledge scores were 9.2 ± 0.7 and 8.7 ± 1.1 for students and practitioners, respectively. Scores were neutral to agree for questions related to the need for more educational programs. The answers of practice-related MCQs had a dichotomy of answers indicating a diversity of opinion, as can be the case in practice. Average total practice confidence scores were approximately 57/80 for students and 68/80 for optometrists. Optometrists and students were very confident in their ability to conduct an appropriate case history and use their knowledge and clinical skills, including slit lamp anterior eye assessment. The lowest confidence scores were for conducting microbial testing, i.e. taking swabs for pathology.

CONCLUSION

Student and optometrist knowledge, attitudes, and practice around antimicrobial stewardship were high and in line with other health professions globally. There is scope for increased stewardship training.

A validity study of COMLEX-USA Level 3 with the new test design

CONTEXT

The National Board of Osteopathic Medical Examiners (NBOME) administers the Comprehensive Osteopathic Medical Licensing Examination of the United States (COMLEX-USA), a three-level examination designed for licensure for the practice of osteopathic medicine. The examination design for COMLEX-USA Level 3 (L3) was changed in September 2018 to a two-day computer-based examination with two components: a multiple-choice question (MCQ) component with single best answer and a clinical decision-making (CDM) case component with extended multiple-choice (EMC) and short answer (SA) questions. Continued validation of the L3 examination, especially with the new design, is essential for the appropriate interpretation and use of the test scores.

OBJECTIVES

The purpose of this study is to gather evidence to support the validity of the L3 examination scores under the new design utilizing sources of evidence based on Kane's validity framework.

METHODS

Kane's validity framework contains four components of evidence to support the validity argument: Scoring, Generalization, Extrapolation, and Implication/Decision. In this study, we gathered data from various sources and conducted analyses to provide evidence that the L3 examination is validly measuring what it is supposed to measure. These include reviewing content coverage of the L3 examination, documenting scoring and reporting processes, estimating the reliability and decision accuracy/consistency of the scores, quantifying associations between the scores from the MCQ and CDM components and between scores from different competency domains of the L3 examination, exploring the relationships between L3 scores and scores from a performance-based assessment that measures related constructs, performing subgroup comparisons, and describing and justifying the criterion-referenced standard setting process. The analysis data contains first-attempt test scores for 8,366 candidates who took the L3 examination between September 2018 and December 2019. The performance-based assessment utilized as a criterion measure in this study is COMLEX-USA Level 2 Performance Evaluation (L2-PE).

RESULTS

All assessment forms were built through the automated test assembly (ATA) procedure to maximize parallelism in terms of content coverage and statistical properties across the forms. Scoring and reporting follows industry-standard quality-control procedures. The inter-rater reliability of SA rating, decision accuracy, and decision consistency for pass/fail classifications are all very high. There is a statistically significant positive association between the MCQ and the CDM components of the L3 examination. The patterns of associations, both within the L3 subscores and with L2-PE domain scores, fit with what is being measured. The subgroup comparisons by gender, race, and first language showed expected small differences in mean scores between the subgroups within each category and yielded findings that are consistent with those described in the literature. The L3 pass/fail standard was established through implementation of a defensible criterion-referenced procedure.

CONCLUSIONS

This study provides some additional validity evidence for the L3 examination based on Kane's validity framework. The validity of any measurement must be established through ongoing evaluation of the related evidence. The NBOME will continue to collect evidence to support validity arguments for the COMLEX-USA examination series.

Topical Review: Optometry in Nepal-Clinical Practice, Research Advances, and Challenges

SIGNIFICANCE

This article reviews educational standard, clinical practice, research advances, and challenges associated with optometry in Nepal and provides critical considerations for contemporary and new optometry programs in countries with similar socioeconomic status and health care systems.Optometry education started in Nepal in 1998 with the primary objective of addressing the unmet needs of eye health and vision care in the country. Over the last two decades, this program has made significant contributions to facilitating and improving the delivery of quality eye care and establishing the nation's eye health system as an exemplary model in South Asia. Despite the positive impact in a short time, optometry education and the profession continue to face several challenges, including a shortage of training resources and facilities, poor quality control and regulation of practice standards, lack of professional recognition, limited pathways for entry to governmental jobs via the national public service commission, and limited clinical and academic opportunities in existing eye care programs. This article reviews current education and clinical practice standards, highlights research advances, and discusses present and future challenges in sustaining and improving the quality of education and advancing the scope of practice of optometry in Nepal. Given the limited access to primary eye care services in Nepal, appropriate professional recognition and integration into the national health system, and initiatives targeted at improving the delivery of optometry education in alignment with successful international models may provide a long-sought solution to making eye care services accessible to all and lowering the burden of visual impairment in the country.