Smartphone use in ophthalmology: What is their place in clinical practice?

Integration of smartphone technology and artificial intelligence for advanced ophthalmic care: A systematic review

Background

The convergence of smartphone technology and artificial intelligence (AI) has revolutionized the landscape of ophthalmic care, offering unprecedented opportunities for diagnosis, monitoring, and management of ocular conditions. Nevertheless, there is a lack of systematic studies on discussing the integration of smartphone and AI in this field.

Main text

This review includes 52 studies, and explores the integration of smartphones and AI in ophthalmology, delineating its collective impact on screening methodologies, disease detection, telemedicine initiatives, and patient management. The collective findings from the curated studies indicate promising performance of the smartphone-based AI screening for various ocular diseases which encompass major retinal diseases, glaucoma, cataract, visual impairment in children and ocular surface diseases. Moreover, the utilization of smartphone-based imaging modalities, coupled with AI algorithms, is able to provide timely, efficient and cost-effective screening for ocular pathologies. This modality can also facilitate patient self-monitoring, remote patient monitoring and enhancing accessibility to eye care services, particularly in underserved regions. Challenges involving data privacy, algorithm validation, regulatory frameworks and issues of trust are still need to be addressed. Furthermore, evaluation on real-world implementation is imperative as well, and real-world prospective studies are currently lacking.

Conclusions

Smartphone ocular imaging merged with AI enables earlier, precise diagnoses, personalized treatments, and enhanced service accessibility in eye care. Collaboration is crucial to navigate ethical and data security challenges while responsibly leveraging these innovations, promising a potential revolution in care access and global eye health equity.

Leveraging neural plasticity for the treatment of amblyopia

Amblyopia is a form of visual cortical impairment that arises from abnormal visual experience early in life. Most often, amblyopia is a unilateral visual impairment that can develop as a result of strabismus, anisometropia, or a combination of these conditions that result in discordant binocular experience. Characterized by reduced visual acuity and impaired binocular function, amblyopia places a substantial burden on the developing child. Although frontline treatment with glasses and patching can improve visual acuity, residual amblyopia remains for most children. Newer binocular-based therapies can elicit rapid recovery of visual acuity and may also improve stereoacuity in some children. Nevertheless, for both treatment modalities full recovery is elusive, recurrence of amblyopia is common, and improvements are negligible when treatment is administered at older ages. Insights derived from animal models about the factors that govern neural plasticity have been leveraged to develop innovative treatments for amblyopia. These novel therapies exhibit efficacy to promote recovery, and some are effective even at ages when conventional treatments fail to yield benefit. Approaches for enhancing visual system plasticity and promoting recovery from amblyopia include altering the balance between excitatory and inhibitory mechanisms, reversing the accumulation of proteins that inhibit plasticity, and harnessing the principles of metaplasticity. Although these therapies have exhibited promising results in animal models, their safety and ability to remediate amblyopia need to be evaluated in humans.

Measuring Vision at Home in 2023

Introduction: The ability to measure a patient's visual acuity at home (HVA) is by far the most desired remote telemedicine capability sought by ophthalmologists. Methods: A systematic literature review was done using Pubmed to search for publications from 2010 to 2022 in English reporting on 10 studies that compared a patient's HVA to the clinic visual acuity (CVA). Results: Approaches to measuring HVA included using a phone-based application, a physical chart, a computer, and a website. The most accurate of these was the use of personal computers (COMPlog, Macustat, Web based test) at home with a bias of 1 letter. The most accessible and reliable was the use of a printable visual acuity chart, available in the public domain, which had adifference between HVA and CVA of 1 to 3.5 letters. Phone apps (Verana Vision) and stand-alone websites (Farsight.com) both had a greater mean difference of about 6 letters, respectively,with a moderate correlation coefficient. Discussion: Overall, all three methodologies demonstrated a good negative predictive value demonstrating their potential use as an effective screening tool to flag drastic vision decline between clinic visits.

Improving Access to Eye Care in Rural Communities: PocDoc's Web-Based Visual Acuity Screening Tool

Objective: Visual acuity (VA) testing is crucial for early intervention in cases of visual impairment, especially in rural health care. This study aimed to determine the potential of a web-based VA test (PocDoc) in addressing the unique health care needs of rural areas through the comparison in its effectiveness against the conventional VA test in identifying visual impairment among an Indian rural population. Methods: Prospective comparative study conducted in December 2022 at a tertiary referral eye care center in central India. We evaluated all patients with the PocDoc VA tests using three device types, and the conventional VA test. Bland-Altman plot (BAP) compared PocDoc and conventional VA tests. Fisher's exact tests evaluated associations between categorical parameters. Kruskal-Wallis tests followed by post hoc Dunn's tests identified association between categorical parameters and numerical parameters. Results: We evaluated 428 patients (792 measurements of VA) with mean age 36.7 (±23.3) years. PocDoc resulted in slightly worse VA scores (mean logMAR: 0.345) than conventional (mean logMAR: 0.315). Correlation coefficient between the conventional and PocDoc logMAR VA values was rho = 0.845 and rho2 = 0.7133 (p = 6.617 × 10-215; adjusted p = 2.205 × 10-214). Most data points fell within the interchangeable range of ±0.32 on BAP. Difference between the two methods increased with higher logMAR values, indicating poorer agreement for worse VA scores. Conclusions: Identifying and addressing the unique health care needs of rural populations is critical, including access to appropriate and effective VA testing methods. Validating and improving VA testing methods can ensure early intervention and improve the quality of life for individuals with visual impairment.

Clinical Utility of Smartphone Applications in Ophthalmology: A Systematic Review

Topic

Numerous smartphone applications have been devised for diagnosis, treatment, and symptom management in ophthalmology. Despite the importance of systematic evaluation of the purpose, target disease, effectiveness, and utility of smartphone applications to their effective utilization, few studies have formally evaluated their validity, reliability, and clinical utility.

Clinical Relevance

This report identifies smartphone applications with potential for clinical implementation in ophthalmology and summarizes the evidence on their practical utility.

Methods

We searched PubMed and EMBASE on July 28, 2022, for articles reporting original data on the effectiveness of treatment, disease detection, diagnostic accuracy, disease monitoring, and usability of smartphone applications in ophthalmology published between January 1, 1987, and July 25, 2022. Their quality was assessed using the Joanna Briggs Institute Critical Appraisal Checklist.

Results

The initial search yielded 510 articles. After removing 115 duplicates and 285 articles based on inclusion and exclusion criteria, the full texts of the remaining 110 articles were reviewed. Furthermore, 71 articles were included in the final qualitative synthesis. All studies were determined to be of high (87.3%) or moderate (12.7%) quality. In terms of respective application of interest, 24 (33.8%) studies assessed diagnostic accuracy, 17 (23.9%) assessed disease detection, and 3 (4.2%) assessed intervention efficacy. A total of 48 smartphone applications were identified, of which 27 (56.3%) were publicly available. Seventeen (35.4%) applications included functions for ophthalmic examinations, 13 (27.1%) included functions aimed at disease detection, 10 (20.8%) included functions to support medical personnel, five (10.4%) included functions related to disease education, and three (6.3%) included functions to promote treatment adherence for patients. The largest number of applications targeted amblyopia (18.8%), followed by retinal disease (10.4%). Two (4.2%) smartphone applications reported significant efficacy in treating diseases.

Conclusion

In this systematic review, a comprehensive appraisal is presented on studies related to diagnostic accuracy, disease detectability, and efficacy of smartphone applications in ophthalmology. Forty-eight applications with potential clinical utility are identified. Appropriate smartphone applications are expected to enable early detection of undiagnosed diseases via telemedicine and prevent visual dysfunction via remote monitoring of chronic diseases.

Financial Disclosures

Proprietary or commercial disclosure may be found after the references.

Red-Free (Green) Filter-Enhanced Gonioscopy with Smartphone: A Pilot Study

AIM

This pilot study aimed to demonstrate the usefulness of the red-free (green) filter as a novel modification for better iridocorneal angle visibility during routine gonioscopy.

METHODS

As a pilot project, we observed 20 eyes of 10 patients aged 22 to 60 who attended the glaucoma department of a tertiary eye hospital in Bangladesh. All patients underwent a thorough ocular examination, from best-corrected visual acuity to the dilated fundus evaluation. Images and videos were obtained with a smartphone during gonioscopy with standard halogen light and the red-free (green) filter, subjectively analyzed by two glaucoma specialists.

RESULTS

The mean age of the patients was 37 ± 13.42 years, of whom 70% were men. In this study, 40% of the patients had open-angle glaucoma, and 60% had open-angle without glaucoma. Without impairing the ability to see the iridocorneal angle structures in detail, the gonioscopy picture contrast was enhanced objectively for red-free filter images compared to standard light photos. The built-in warm filter of the slit-lamp also provided better visualization of the iridocorneal angle structures.

CONCLUSION

Using the red-free (green) filter and a warm filter instead of the traditionally used standard light of the slit-lamp may significantly enhance the diagnostic capability during routine gonioscopy.

Smartphone ophthalmoscope as a tool in teaching direct ophthalmoscopy: a crossover randomized controlled trial

To evaluate the effectiveness of smartphone ophthalmoscope (SO) in teaching ophthalmoscopy, compared with direct ophthalmoscope (DO). In this cross-over study, 45 final-year medical students attending sessions at a single institution were randomly allocated to two groups (A and B). Both groups attended two training sessions. In the first session, Group A students were taught ophthalmoscopy using DO and Group B students using SO. In the second session, the training sessions were crossed over. A series of eye models with 10 letters placed on the inner surface were designed to assess the students' skill on ophthalmoscopy. Students performed ophthalmoscopy on the eye models, recorded their findings, and completed a questionnaire of feedback on DO and SO. The main outcome measure was the score of ophthalmoscopy, assessed by the student correctly recording each letter (score 1 for each letter). For Group A, the mean score of ophthalmoscopy on the eye model using DO and SO was 3.9±2.4 and 8.2±2.2, respectively. For Group B, the mean score of ophthalmoscopy on the eye model using SO and DO 8.7±1.8 and 5.7±3.5 . Students scored significantly higher in ophthalmoscopy when using SO than DO (P<0.001). They expressed better visualization of the fundus using SO than DO (4.49±0.65 vs 4.13±0.81, P=0.004). Students' performance of ophthalmoscopy was better when SO was used compared with DO. The use of SO as an adjunctive tool is recommended to improve the effectiveness of teaching ophthalmoscopy.

The use of the built-in macro mode of smartphone cameras for pediatric external and anterior segment digital photography

We describe a novel method for clinical ophthalmic photography that uses the inherent macro-photography mode available in most recent smartphones, without additional attachments. This method facilitates acquisition of high-quality external and anterior segment clinical photography in children who may have difficulty remaining still enough for anterior segment photography at the slit lamp. We describe this technique and discuss its advantages and limitations.

Artificial intelligence enabled smart digital eye wearables

PURPOSE OF REVIEW

Smart eyewear is a head-worn wearable device that is evolving as the next phase of ubiquitous wearables. Although their applications in healthcare are being explored, they have the potential to revolutionize teleophthalmology care. This review highlights their applications in ophthalmology care and discusses future scope.

RECENT FINDINGS

Smart eyewear equips advanced sensors, optical displays, and processing capabilities in a wearable form factor. Rapid technological developments and the integration of artificial intelligence are expanding their reach from consumer space to healthcare applications. This review systematically presents their applications in treating and managing eye-related conditions. This includes remote assessments, real-time monitoring, telehealth consultations, and the facilitation of personalized interventions. They also serve as low-vision assistive devices to help visually impaired, and can aid physicians with operational and surgical tasks.

SUMMARY

Wearables such as smart eyewear collects rich, continuous, objective, individual-specific data, which is difficult to obtain in a clinical setting. By leveraging sophisticated data processing and artificial intelligence based algorithms, these data can identify at-risk patients, recognize behavioral patterns, and make timely interventions. They promise cost-effective and personalized treatment for vision impairments in an effort to mitigate the global burden of eye-related conditions and aging.

Development and usability evaluation of a mHealth application for albinism self-management

BACKGROUND

Reduced or absence of melanin poses physical, social, and psychological challenges to individuals with albinism. Mobile health (mHealth) applications have the potential to improve the accessibility of information and services while reducing time and costs. This study aimed to develop and evaluate a mHealth application for self-management of albinism.

METHODS

This applied study was conducted in two stages (development and evaluation) in 2022. Initially, the functional requirements were determined, and the conceptual model of the application was then developed using Microsoft Visio 2021. In the second phase, the application was evaluated using the Mobile Application Usability Questionnaire (MAUQ) involving patients with albinism to reflect their views on the usability of the application.

RESULTS

The key capabilities of the application included: reminders, alerts, educational content, useful links, storage and exchange of images of skin lesions, specialist finder, and notifications for albinism-relevant events. Twenty-one users with albinism participated in the usability testing of the application. The users were predominantly satisfied with the application (5.53 ± 1.10; Max: 7.00).

CONCLUSIONS

The findings of this study suggest that the developed mobile application could assist individuals with albinism to effectively manage their condition by considering the users' requirements and services that the application should deliver.

Determination of Munsell Soil Colour Using Smartphones

Soil colour is one of the most important factors in agriculture for monitoring soil health and determining its properties. For this purpose, Munsell soil colour charts are widely used by archaeologists, scientists, and farmers. The process of determining soil colour from the chart is subjective and error-prone. In this study, we used popular smartphones to capture soil colours from images in the Munsell Soil Colour Book (MSCB) to determine the colour digitally. These captured soil colours are then compared with the true colour determined using a commonly used sensor (Nix Pro-2). We have observed that there are colour reading discrepancies between smartphone and Nix Pro-provided readings. To address this issue, we investigated different colour models and finally introduced a colour-intensity relationship between the images captured by Nix Pro and smartphones by exploring different distance functions. Thus, the aim of this study is to determine the Munsell soil colour accurately from the MSCB by adjusting the pixel intensity of the smartphone-captured images. Without any adjustment when the accuracy of individual Munsell soil colour determination is only 9% for the top 5 predictions, the accuracy of the proposed method is 74%, which is significant.

Is your vision blurry? A systematic review of home-based visual acuity for telemedicine

INTRODUCTION

Visual acuity (VA) testing is a vital screening tool for the assessment of ocular function. The coronavirus 2019 pandemic has caused an immediate need for synchronous telemedicine in all specialties, including ophthalmology. While a plethora of mobile VA applications exist, there is no consensus as to what technology can accurately and reproducibly measure a patient's vision at home.

METHODS

A systematic literature search was performed in April 2020 using PubMed, Embase and Medline, identifying English publications from 2010 to 2020 on remote VA tests: 4338 articles were identified and 14 were ultimately included in the review.

RESULTS

Of those 14, the highest quality studies, best reproducibility and correlation with in-clinic acuities measured were found using the Peek Acuity application. The studies included patients throughout the world aged 3-97, with and without correction, with known ocular pathology.The Peek Acuity studies measured distance vision on a Samsung Galaxy S3 with a mean difference of 0.055 Logarithm of the Minimum Angle of Resolution (LogMAR) for home testing compared with the Early Treatment Diabetic Retinopathy Study (ETDRS). Test-retest variability was ±0.029 LogMAR for 95% confidence interval limits.

DISCUSSION

There can be one or more lines of variability in vision testing in a clinical setting using reference standard ETDRS and clinical standard Snellen charts. Test-retest reliability is not perfect even on standard clinical charts (variation up to 0.48 LogMAR). Of the technologies reviewed, Peek Acuity home testing had the greatest correlation with ETDRS clinical vision and high test-retest reliability. Peek Acuity performed no worse than Snellen and ETDRS charts.

Assessing the subjective quality of smartphone anterior segment photography: a non-inferiority study

PURPOSE

To assess the subjective quality of anterior segment photos taken from a smartphone camera adapted to the slit lamp compared to a commercial inbuilt slit-lamp camera.

METHODS

Non-inferiority study. Five paired images of the anterior segment of normal eyes were taken using an iPhone 11 (Apple, Inc., Calif., USA) camera attached to a universal slit-lamp adaptor and a commercial inbuilt slit-lamp camera (Haag-Streit Diagnostics, Bern, Switzerland). Images were collated into a survey in which ophthalmology students, residents, registrars, and consultants participated to select the image taken from the inbuilt slit-lamp camera. If the image quality was subjectively indistinguishable, we expected a 50:50 split for each photograph that was presented. We selected a 10% non-inferiority margin, with the hypothesis that no less than 40% of images believed to be from the conventional camera were in fact from the smartphone camera.

RESULTS

There were 27 respondents in the survey: ophthalmology consultants (n = 7), registrars (n = 10), residents (n = 7), intern (n = 1) and students (n = 2). The mean correct identification across the respondents was 11.3 out of 25 (45.2%) images. Overall, the smartphone camera was non-inferior to the inbuilt slit-lamp camera (p < 0.001). The non-inferiority of the smartphone camera was significant for consultants (47.4%, p < 0.01), registrars (47.6%, p < 0.001) and residents (37.7%, p < 0.0001).

CONCLUSIONS

Anterior segment images obtained with a smartphone camera were non-inferior to the commercial inbuilt slit-lamp camera. Smartphone cameras may be a non-inferior tool for communication of anterior segment images having implications for the ease of access to quality telehealth consultations.

Patient Acceptability of Home Monitoring for Neovascular Age-Related Macular Degeneration Reactivation: A Qualitative Study

Neovascular age-related macular degeneration (nAMD) is a chronic, progressive condition and the commonest cause of visual disability in older adults. This study formed part of a diagnostic test accuracy study to quantify the ability of three index home monitoring (HM) tests (one paper-based and two digital tests) to identify reactivation in nAMD. The aim of this qualitative research was to investigate patients' or participants' views about acceptability and explore adherence to weekly HM. Semi-structured interviews were held with 78/297 participants (26%), with close family members (n = 11) and with healthcare professionals involved in training participants in HM procedures (n = 9) (n = 98 in total). A directed thematic analytical approach was applied to the data using a deductive and inductive coding framework informed by theories of technology acceptance. Five themes emerged related to: 1. The role of HM; 2. Suitability of procedures and instruments; 3. Experience of HM; 4. Feasibility of HM in usual practice; and 5. Impediments to patient acceptability of HM. Various factors influenced acceptability including a patient's understanding about the purpose of monitoring. While initial training and ongoing support were regarded as essential for overcoming unfamiliarity with use of digital technology, patients viewed HM as relatively straightforward and non-burdensome. There is a need for further research about how use of performance feedback, level of support and nature of tailoring might facilitate further the implementation of routinely conducted HM. Home monitoring was acceptable to patients and they recognised its potential to reduce clinic visits during non-active treatment phases. Findings have implications for implementation of digital HM in the care of older people with nAMD and other long-term conditions.

The Gimbalscope - A novel smartphone-assisted retinoscopy technique

The authors describe a novel technique of performing retinoscopy assisted with a smartphone (gimbalscope). We found this technique of digital retinoscopy to be useful for demonstrating and documenting retinoscopic reflexes and in addition as an easy teaching tool. This technical report explains the assembly of our smartphone-assisted retinoscope and provides examples of the range of normal and abnormal reflexes that can be captured.

Eye-SCOR: A Supply Chain Operations Reference-Based Framework for Smart Eye Status Monitoring Using System Dynamics Modeling

This work is a unique integration of three different areas, including smart eye status monitoring, supply chain operations reference (SCOR), and system dynamics, to explore the dynamics of the supply chain network of smart eye/vision monitoring systems. Chronic eye diseases such as glaucoma affect millions of individuals worldwide and, if left untreated, can lead to irreversible vision loss. Nearly half of the affected population is unaware of the condition and can be informed with frequent, accessible eye/vision tests. Tonometry is the conventional clinical method used in healthcare settings to determine the intraocular pressure (IOP) level for evaluating the risk of glaucoma. There are currently very few (under development) non-contact and non-invasive methods using smartphones to determine the risk of IOP and/or the existence of other eye-related diseases conveniently at home. With the overall goal of improving health, well-being, and sustainability, this paper proposes Eye-SCOR: a supply chain operations reference (SCOR)-based framework to evaluate the effectiveness of smartphone-based eye status monitoring apps. The proposed framework is designed using system dynamics modeling as a subset of a new causal model. The model includes interaction/activities between the main players and enablers in the supply chain network, namely suppliers/service providers, smartphone app/device factors, customers, and healthcare professionals, as well as cash and information flow. The model has been tested under various scenarios and settings. Simulation results reveal the dynamics of the model and show that improving the eye status monitoring device/app factors directly increases the efficiency/Eye-SCOR level. The proposed framework serves as an important step towards understanding and improving the overall performance of the supply chain network of smart eye/vision monitoring systems.

High user acceptance of a retina e-learning app in times of increasing digitalisation of medical training for ophthalmologists

Introduction

The aim was to identify changes in continuing education and training in ophthalmology in the context of the COVID-19 pandemic and advancing digitalization and to analyse the acceptance of e-learning tools among German ophthalmologists using a novel Retina Case App as an example.

Methods

The participants' training behaviour before and during the COVID-19 pandemic was surveyed. Furthermore, the acceptance and usability of the Retina Case App were evaluated using the System Usability Scale (SUS). A possible influence of the app on everyday clinical practice was assessed.

Results

A total of 145 ophthalmologists participated in the survey. The frequency of continuing medical education did not decrease for 62.8% of ophthalmologists during the pandemic. A significant increase in at least monthly use of online courses or lectures has been observed (90.3% vs. 28.2%, p < 0.001). No significant difference was identified in terms of frequency of use of print and digital journals or printed textbooks. The majority of participants stated that online training platforms are well suited to replace the absence of face-to-face events (73.8%). The mean SUS score was 87.7 (SD 11.9), which categorizes the app's usability as excellent. The majority agreed that the newly developed app enables faster learning (82.1%) and leads to increased motivation (71.7%). Most ophthalmologists (80.7%) felt that regular use of the app would improve confidence in the treatment of retinal diseases.

Conclusions

The COVID-19 pandemic has led to a significant change in training behaviour in ophthalmology towards e-learning and online courses, which has not been accompanied by a general decline in training activity. The exemplarily investigated application showed a high user acceptance among ophthalmologists.

Smartphone Gonioscopy With a Magnifying Intraocular Lens: A Cost-effective Angle Imaging Device

Gonioscopy is an important part of glaucoma diagnosis and management. Imaging and documentation of the anterior chamber angle has been previously performed using slit-lamp-assisted photography or using smartphones with or without an attached macro lens. Smartphones have transformed ophthalmic imaging by virtue of their availability, easy use, and portability. In this report, the authors aim to demonstrate gonio-imaging using a smartphone attached with an intraocular lens which behaves like a macro lens. With the patient in a sitting position or in the supine position, a goniolens is placed on the patient's cornea. A smartphone with a 10 D intraocular lens attachment over its camera is used to take images or videos of the anterior chamber angle with high magnification. This imaging modality is cost-effective and can be used for screening and photographic documentation of the angle, and can be of immense benefit, especially in primary health care centers.

Tele-ophthalmology as an aid tool for primary care physicians in the IDF, during the Covid-19 lockdown

PURPOSE

To describe tele-ophthalmology consultations for primary-physicians in the IDF during the Covid-19 lockdown.

METHODS

Retrospective cross-sectional study. Medical records of tele-ophthalmology consultations from March to June 2020 were reviewed.

RESULTS

The study included 245 cases in which an ophthalmologist was consulted. In 62.0% cell-phone camera photographs were used. The mean age was 21.5 ± 6.4 years. The most common diagnoses were acute-conjunctivitis (8.6%); conjunctival-hyperemia (non-specific diagnosis, 8.2%); scleritis/episcleritis (7.3%); chronic allergic-conjunctivitis (7.3%); chalazion (7.3%) hordeolum (6.5%); acute allergic-conjunctivitis (4.5%). 37.6% of patients received primary physician-based treatment, 24.9% of patients received specialist-based treatment. 13.1% were referred to the ER. The consult prevented ER referral for 39.2% and changed the physician's treatment plan in 70.6% of cases. Foreign-body sensation complaints were more likely treated by a primary-physician (p = 0.015). Cases with suspected foreign-body diagnosis were referred more to the ER (p < 0.001). For most cases of eyelid complaints and diagnoses, primary physician care was sufficient (p < 0.001). Conjunctival complaints and diagnoses received significantly more ophthalmologist-based treatment (p < 0.001). Corneal disorders were significantly referred more to the ER (p = 0.001).

CONCLUSION

Despite of possible ethical and legal problems and clinical limitations of this instrument, Tele-ophthalmology using objective aids such as smartphone photography can be an efficient tool in aiding the primary-physician, especially for patients with low access to ophthalmologists, with major impact on patient management.

Office-Based Rapid Diagnosis and Management of External Ophthalmomyiasis Via Smartphone-Aided Innovative Tools in an Under-Resourced Setting

PURPOSE

To evaluate the use of smartphone-based innovative tools named Anterior segment photography with intraocular lens (ASPI) and smartphone based intraocular lens microscope (IOLSCOPE) to demonstrate, treat, and diagnose the patients of ophthalmomyiasis caused by Oestrus ovis.

METHODS

A retrospective interventional case series of six patients infested with O. ovis presenting in a rural health center with symptoms of burning, itching, watering, and foreign body sensation diagnosed with ophthalmomyiasis. Diagnosis and treatment were performed using an innovative imaging technique that is, an optical system formed by intraocular lens (IOL) and smartphone.

RESULTS

The smartphone-based ASPI clearly detected and removed the moving larvae from the ocular surface, followed by microbiological diagnosis of O.ovis larvae with the help of an IOLSCOPE.

CONCLUSION

The importance of ASPI and IOLSCOPE for the management of ophthalmomyiasis in peripheral health centers devoid of slitlamp and microscopes has been emphasized here.

Validation of Digital Applications for Evaluation of Visual Parameters: A Narrative Review

The current review aimed to collect and critically analyze the scientific peer-reviewed literature that is available about the use of digital applications for evaluation of visual parameters in electronic devices (tablets and smartphones), confirming if there are studies calibrating and validating each of these applications. Three bibliographic search engines (using the search equation described in the paper) and the Mendeley reference manager search engine were used to complete the analysis. Only articles written in English and that are evaluating the use of tests in healthy patients to measure or characterize any visual function aspects using tablets or smartphones were included. Articles using electronic visual tests to assess the results of surgical procedures or are conducted in pathological conditions were excluded. A total of 19 articles meeting these inclusion and exclusion criteria were finally analyzed. One critical point of all these studies is that there was no mention of the characterization (spatial and/or colorimetrical) of screens and the stimuli used in most of them. Only two studies described some level of calibration of the digital device before the beginning of the study. Most revised articles described non-controlled comparatives studies (73.7%), reporting some level of scientific evidence on the validation of tools, although more consistent studies are needed.

Physicians' Attitudes Toward Prescribable mHealth Apps and Implications for Adoption in Germany: Mixed Methods Study

Background

In October 2020, Germany became the first country, worldwide, to approve certain mobile health (mHealth) apps, referred to as DiGA (Digitale Gesundheitsanwendungen, in German, meaning digital health applications), for prescription with costs covered by standard statutory health insurance. Yet, this option has only been used to a limited extent so far.

Objective

The aim of this study was to investigate physicians’ and psychotherapists’ current attitudes toward mHealth apps, barriers to adoption, and potential remedies.

Methods

We conducted a two-stage sequential mixed methods study. In phase one, semistructured interviews were conducted with physicians and psychotherapists for questionnaire design. In phase two, an online survey was conducted among general practitioners, physicians, and psychotherapists.

Results

A total of 1308 survey responses by mostly outpatient-care general practitioners, physicians, and psychotherapists from across Germany who could prescribe DiGA were recorded, making this the largest study on mHealth prescriptions to date. A total of 62.1% (807/1299) of respondents supported the opportunity to prescribe DiGA. Improved adherence (997/1294, 77.0%), health literacy (842/1294, 65.1%), and disease management (783/1294, 60.5%) were most frequently seen as benefits of DiGA. However, only 30.3% (393/1299) of respondents planned to prescribe DiGA, varying greatly by medical specialty. Professionals are still facing substantial barriers, such as insufficient information (1135/1295, 87.6%), reimbursement for DiGA-related medical services (716/1299, 55.1%), medical evidence (712/1298, 54.9%), legal uncertainties (680/1299, 52.3%), and technological uncertainties (658/1299, 50.7%). To support professionals who are unsure of prescribing DiGA, extended information campaigns (1104/1297, 85.1%) as well as recommendations from medical associations (1041/1297, 80.3%) and medical colleagues (1024/1297, 79.0%) were seen as the most impactful remedies.

Conclusions

To realize the benefits from DiGA through increased adoption, additional information sharing about DiGA from trusted bodies, reimbursement for DiGA-related medical services, and further medical evidence are recommended.

A novel method to measure margin reflex distance using the autorefractometer

PURPOSE

To determine the margin reflex distance (MRD) in healthy subjects using autorefractometer front monitor images (ARFMI) and validate the accuracy of this method by comparing it with conventional methods.

METHODS

One hundred eyes of 50 healthy subjects aged 20-59 years were included in the study. Autorefractometer front monitor images were video-recorded using a smartphone camera, and screenshots were taken to analyze the MRD. The results were compared with those from conventional methods to determine the reliability of the method. To evaluate the repeatability and reproducibility of all measurement methods, we performed two different visits by two observers.

RESULTS

The mean MRD-1 of the autorefractometer image measurement was 4.29 ± 0.90 mm, mean MRD-1 of the of the digital photography image measurement was 3.78 ± 1.03 mm, and mean MRD-1 of the manual measurement was 4.02 ± 1.09 mm. The mean difference (MD) of MRD-1 was analyzed and it was found that MD of the autorefractometer image was significantly higher than the MD of other groups (p < 0.001). The best repeatability was found in the autorefractometer image measurement [intraclass correlation coefficients (ICC): 0.960], and substantial to excellent repeatability was found in the manual (ICC: 0.903) and digital photography image measurements (ICC: 0.843). The mean inter-eye difference of MRD-1 measured by the three methods was analyzed, and there was a statistically significant difference in the autorefractometer and digital image groups (p: 0.001, p: 0.002, respectively).

CONCLUSION

Margin reflex distance measurement using ARFMI analysis is a novel, simple, accurate, reliable, and objective method. The autorefractometer device is readily available and can be found in any ophthalmic clinic. Therefore, ophthalmologists can easily measure and record MRD values and use the accurate and reliable results for follow-up and medicolegal issues.

Low-tech intraocular ophthalmic microsurgery simulation: A low-cost model for home use

In order to maintain manual dexterity and surgical skills, trainees are encouraged to partake in regular simulation. Current options for intraocular surgical simulation require specialist microscopic equipment which is expensive and requires access to simulation facilities. A set of core simulation exercises and basic surgical skills of performing the corneal incisions, capsulorhexis, improving the manual dexterity, and suturing were identified, discussed, and agreed among authors before designing this simulation exercise. In this paper, we propose a smartphone-based, low-cost, low-tech model with corresponding exercises for intraocular simulation that can be used at home for the above-mentioned surgical skill set. This model provides an easy, portable, and reproducible method of simulation and can serve as an adjunct to patient-facing surgical training, especially in the current pandemic, where the excess to the simulation facilities or setup of these facilities may be difficult.

Comparison of conventional and wide field direct ophthalmoscopy on medical students' self-confidence for fundus examination: a 1-year follow-up

BACKGROUND

Fundus examination is an easy, quick and effective way to diagnose sight- and life-threatening diseases. However, medical students and physicians report lack of proficiency and self-confidence in perform fundoscopy. The aim of this study was to compare students' self-confidence in fundus examination, using two different direct ophthalmoscopes, 1 month and 1 year after practical training.

METHODS

In this prospective cohort, medical students (MS) of the same class were divided in small groups for PanOptic (PO) or conventional (CO) direct ophthalmoscope training. The intervention group encompassed MS of the 4th -year (class of 2019), and the control group encompassed MS of year behind (class of 2020). A questionnaire to measure self-confidence in fundoscopy technique assessing optic nerve, cup-to-disc ratio and macula was translated and validated to Portuguese, and applied 1-month and 1-year after practical training.

RESULTS

One-hundred and sixty-seven MS were enrolled (35 PO group, 38 CO group, and 94 control group). PO group had a significantly higher overall self-confidence comparing either control or CO groups, respectively (3.57 ± 0.65 vs. 2.97 ± 1.03 vs. 2.46 ± 0.87, p < 0.01) as well as in evaluate cup-to-disc ratio (3.09 ± 0.75 vs. 2.32 ± 0.87 vs. 1.46 ± 0.81, p < 0.01), optic disc margins (3.26 ± 0.85 vs. 2.71 ± 0.96 vs. 2.01 ± 0.97, p < 0.01) and macula (3.43 ± 1.12 vs. 2.89 ± 1.08 vs. 2.02 ± 0.89, p < 0.01) 1-month after practical training. One-year after intervention, CO group showed a significantly higher score compared to PO group in overall self-confidence (3.31 ± 0.69 vs. 3.18 ± 0.73, p = 0.03) and in optic disc margins assessing (3.16 ± 0.85 vs. 2.95 ± 0.78, p = 0.03), but not significant in the evaluation of cup-to-disc ratio (2.78 ± 0.97 vs. 2.68 ± 0.94, p = 0.08), and macula (3.34 ± 0.79 vs. 3.27 ± 0.98, p = 0.07).

CONCLUSIONS

Students were more confident in use PO as an instrument to perform direct ophthalmoscopy immediately after practical training, but confidence level of CO was higher compared to PO one year after practical training. These findings would help medical schools decide which ophthalmoscope to choose to teach fundus examination.

Enabling teleophthalmology during the COVID-19 pandemic in the Province of Trento, Italy: Design and implementation of a mHealth solution

BACKGROUND

Due to the many restrictions imposed during the COVID-19 emergency, the normal clinical activities have been stopped abruptly in view of limiting the circulation of the virus. The extraordinary containment measures have had a dramatic impact on the undertaking and follow-up of ophthalmic outpatients.

OBJECTIVE

In order to guarantee proper monitoring and routine care, the Pediatric Ophthalmology equipe of Rovereto Hospital (North-East of Italy) supported by the Competence Center on Digital Health TrentinoSalute4.0, designed and implemented a digital platform, TreC Oculistica, enabling teleophthalmology. We report our innovative-albeit restricted-experience aiming at testing and maximizing the efficacy of remote ophthalmic and orthoptic visits.

METHODS

A multidisciplinary team created the TreC Oculistica platform and defined a teleophthalmology protocol. The system consists of a clinician web interface and a patient mobile application. Clinicians can prescribe outpatients with the App and some preliminary measurements to be self-collected before the televisit. The App conveys the clinician's requests (i.e. measurements) and eases the share of the collected information in a secure digital environment, promoting a new health care workflow.

RESULTS

Four clinicians took part in the testing phase (2 ophthalmologists and 2 orthoptists) and recruited 37 patients (mostly pediatric) in 3 months. Thanks to a continuous feedback between the testing and the technical implementation, it has been possible to identify pros and cons of the implemented functionalities, considering possible improvements. Digital solutions such as TreC Oculistica advance the digitalization of the Italian health care system, promoting a structured and effective reorganization of the workload supported by digital systems.

CONCLUSIONS

The study tested an innovative digital solution in the teleophthalmology context and represented the first experience within the Italian healthcare system. This solution opens up new possibilities and scenarios that can be effective not only during the pandemic, but also in the traditional management of public health services.

The iPhone, the reflex, and the vinyl record: is the smartphone taking the best intraoperative photographs?

Surgical field photography is a tough exercise: surgeons dedicate the required time for photography even during complex surgeries; the intense lighting of the operating field works against photography, and the surgeon has to utilise whatever equipment is available. We selected five complex interventions and two surgeons (one with an iPhone^® and one with a Digital Single Lens Reflex [DSLR] camera) who each took a photograph of the operating field. The source of photographs was blinded, and the image quality was scored using a 5-point Likert scale by three groups of team members with differing experiences: six senior surgeons, two junior surgeons, and four surgical residents. We evaluated the resolution (adequate for clinical interpretation), colour (appear true and natural), contrast (adequate to distinguish different structures), and overall quality. The mean ± SEM overall image quality was similar for both the smartphone and DSLR (3.7 ± 0.1 vs. 3.8 ± 0.11; p = 0.87), as were most of the scores for each image characteristic. Surgeons seek objectivity and efficiency. The smartphone is a more convenient photographic equipment and produces identical results than the DSLR. Human beings can be sensitive to image quality. The DSLR image was found to be sharper, however, this was found to be imperceptible.

[Adherence to anti-VEGF treatment-Considerations and practical recommendations]

BACKGROUND

Numerous studies have identified a lack of treatment adherence as an important factor that often conflicts with the necessary number of anti-VEGF injections and therefore a better functional result.

OBJECTIVE

This article discusses approaches and possible measures to reduce the risk of late and infrequent intravitreal injections leading to the major issue of undertreatment.

MATERIAL AND METHOD

In the course of an expert dialogue, relevant parameters of treatment adherence and variables were identified. Meaningful processes were structured and assigned to organizational areas.

RESULTS

The compilation of meaningful measures enables practitioners to optimize their own implementation in different areas. Regular monitoring measures can identify the extent of treatment interruption and discontinuation. For specific indicators (treatments per time interval, longest pause interval, minimum coverage per unit time, delay) an effect on the development of visual function was demonstrated. Organizational measures, training of teams and referring physicians, redundant and iterative information transfer to patients have been proven in the experience of experts. The firm integration of these processes into the structures is facilitated by working with checklists.

CONCLUSION

An optimization of the processes is possible to improve the adherence and the functional results; however, interventional studies showing how adherence and persistence can be increased in the German treatment setting are still lacking.

Learning curve evaluation upskilling retinal imaging using smartphones

Smartphone-based fundus imaging (SBFI) is a low-cost approach for screening of various ophthalmic diseases and particularly suited to resource limited settings. Thus, we assessed how best to upskill alternative healthcare cadres in SBFI and whether quality of obtained images is comparable to ophthalmologists. Ophthalmic assistants and ophthalmologists received a standardized training to SBFI (Heine iC2 combined with an iPhone 6) and 10 training examinations for capturing central retinal images. Examination time, total number of images, image alignment, usable field-of-view, and image quality (sharpness/focus, reflex artifacts, contrast/illumination) were analyzed. Thirty examiners (14 ophthalmic assistants and 16 ophthalmologists) and 14 volunteer test subjects were included. Mean examination time (1st and 10th training, respectively: 2.17 ± 1.54 and 0.56 ± 0.51 min, p < .0001), usable field-of-view (92 ± 16% and 98 ± 6.0%, p = .003) and image quality in terms of sharpness/focus (p = .002) improved by the training. Examination time was significantly shorter for ophthalmologists compared to ophthalmic assistants (10th training: 0.35 ± 0.21 and 0.79 ± 0.65 min, p = .011), but there was no significant difference in usable field-of-view and image quality. This study demonstrates the high learnability of SBFI with a relatively short training and mostly comparable results across healthcare cadres. The results will aid implementing and planning further SBFI field studies.

Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective

The simultaneous maturation of multiple digital and telecommunications technologies in 2020 has created an unprecedented opportunity for ophthalmology to adapt to new models of care using tele-health supported by digital innovations. These digital innovations include artificial intelligence (AI), 5th generation (5G) telecommunication networks and the Internet of Things (IoT), creating an inter-dependent ecosystem offering opportunities to develop new models of eye care addressing the challenges of COVID-19 and beyond. Ophthalmology has thrived in some of these areas partly due to its many image-based investigations. Tele-health and AI provide synchronous solutions to challenges facing ophthalmologists and healthcare providers worldwide. This article reviews how countries across the world have utilised these digital innovations to tackle diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, glaucoma, refractive error correction, cataract and other anterior segment disorders. The review summarises the digital strategies that countries are developing and discusses technologies that may increasingly enter the clinical workflow and processes of ophthalmologists. Furthermore as countries around the world have initiated a series of escalating containment and mitigation measures during the COVID-19 pandemic, the delivery of eye care services globally has been significantly impacted. As ophthalmic services adapt and form a "new normal", the rapid adoption of some of telehealth and digital innovation during the pandemic is also discussed. Finally, challenges for validation and clinical implementation are considered, as well as recommendations on future directions.

Cell Phone Selfies: Clinching the Diagnosis of Iris Microhemangiomatosis

Four patients presented with a history of "blood" or a "dark spot" in the eye captured on cell phone photos. These episodes prompted presentation to an ophthalmologist where they all had normal slit lamp exams without a hyphema at initial evaluation. With evidence of a spontaneous hyphema seen on photos, further testing was performed including iris fluorescein angiography which revealed hyperfluorescent iris margin vascular tufts, confirming the diagnosis of iris microhemangiomatosis in each patient. All cases were managed conservatively, and only 1 needed topical antihypertensives. Without these patient-initiated photos, the diagnosis of iris microhemangiomatosis would likely remain elusive as slit lamp exam was normal at the time of initial examination in all 4 cases. Ophthalmologists should be aware of this rare diagnosis in the event a patient comes with a cell phone selfie documenting a spontaneous hyphema, especially when emanating from pupillary border.

The Use of Mobile Messaging for Telecommunications with Patients in Ophthalmology: A Systematic Review

Background: Communication and concordance between patients and providers are crucial for improved outcomes and disease prevention. Mobile health strategies have been shown to improve patient accessibility and convenience. Mobile messaging is one strategy that has demonstrated varying degrees of effectiveness in patient care. The aim of this review is to investigate methods, outcomes, and conclusions of studies that have assessed mobile messaging interventions in ophthalmology. Methods: A qualitative systematic review of PubMed, Scopus, Web of Science, and Embase databases was conducted to identify studies that investigated the implementation and efficacy of mobile messaging services in ophthalmology practice. Included articles were categorized based on study content: appointment attendance, patient preference and willingness, education, concordance, and other clinical outcomes. Three tools were used to assess for potential bias. Results: Out of a total of 3,655 unique titles retrieved, 15 articles were included in the final qualitative synthesis after abstract and full-text screening. Included studies were published between 2008 and 2020 from seven different countries and across various contexts. All but one study found that the use of mobile messaging in ophthalmology care led to improved process measures or patient outcomes. Evidence for a positive effect was the strongest for appointment follow-up. Survey and feedback data suggest that patients, more so younger patients, are open to mobile message interventions. Conclusion: Mobile messaging interventions can play a role in improving appointment attendance, patient education, and patient practices for ophthalmology patients. Further study is necessary to determine the effectiveness of this tool across various groups and settings.

Anterior Segment Imaging Devices in Ophthalmic Telemedicine

Obtaining a clear assessment of the anterior segment is critical for disease diagnosis and management in ophthalmic telemedicine. The anterior segment can be imaged with slit lamp cameras, robotic remote controlled slit lamps, cell phones, cell phone adapters, digital cameras, and webcams, all of which can enable remote care. The ability of these devices to identify various ophthalmic diseases has been studied, including cataracts, as well as abnormalities of the ocular adnexa, cornea, and anterior chamber. This article reviews the current state of anterior segment imaging for the purpose of ophthalmic telemedical care.

Clinically useful smartphone ophthalmic imaging techniques

Imaging devices in ophthalmology are numerous, and most of them are sophisticated and specialized for specific regions of the eye. In addition, these are fixed and involve close interaction of the patient and the examiner; therefore, simple, portable and tele facility-imbibed imaging tools can be considered optimal alternatives to routine exercises. In the last 10 years, utility of smartphones in ophthalmology is being continuously explored to unearth their potential benefits. In this direction, a smartphone device with/without simple attachments has been noted to aid in detailed, high-quality imaging of the ocular adnexa, cornea, angle, iris, lens, optic disc, and the retina including its periphery. In addition, such utility has also been extended in strabismology workup and intraocular pressure measurements. Hence, using these clinician friendly tools and techniques or by devising newer and more comprehensive tool kits, ophthalmic care can be well-managed with apt use of technology. Also, the smartphone companies are encouraged to collaborate with the medical experts to endeavor more, and help and serve the people better.

A smartphone-based petrographic microscope

Photomicrographs of thin sections provide a swift and efficient means of sharing information for consultation, education, documentation and publication within the Geosciences and related areas. In general terms, the main way to capture digital microscopic images involves the use of a mounted camera unit on a high-end costly benchtop microscope. However, freehand methods to capture microscope-scale images using a smartphone, as well as smartphone adapters that can be attached to a microscope have emerged during recent years. This paper presents the design features of a costless system able to obtain photomicrographs without requiring a conventional microscope. The imaging device is comprised of a mini-objective lens attached to a smartphone and a structure that allows it to focus as well as to rotate the stage and to insert/remove a polarized sheet. The quality and magnification of the images attainable from the new design is comparable to the images normally obtained by a conventional petrographic microscope using a ×4 objective and a ×10 ocular (total magnification ×40).

Smartphone-Based Data Collection in Ophthalmology

Due to their widespread use among the population and their wide range of functions and sensors, smartphones are suitable for data collection for medical purposes. App-supported input masks, patient diaries, and patient information systems, mobile access to the patient file as well as telemedical services will continue to find their way into our field of expertise in the future. In addition, the use of smartphone sensors (GPS and motion sensors, touch display, microphone) and coupling possibilities with biosensors (for example with Continuous Glucose Monitoring [CGM] systems), advanced camera technology, the possibility of regular and appointment independent checking of the visual system (visual acuity/contrast vision) as well as real-time data transfer offer interesting possibilities for patient treatment and clinical research. The present review deals with the current status and future perspectives of smartphone-based data collection and possible applications in ophthalmology.

Smart phone apps every ophthalmologist should know about

We are living in a mobile world, where the number of medical apps is surging in recent years. Over 320 000 healthcare apps are now available as shown in the latest research. The major function and potential of these apps vary, from assisting the learning and practice of clinicians as well as achieving better outcomes of patients to preventing eye diseases through the education of healthy individuals. However, based on the various features, ophthalmology apps nowadays contain a wide range of subjects and focus on different stakeholders in the ophthalmic practice, including but not limited to doctors, patients, and researchers. Here, we review special and advanced apps that ophthalmologists will find useful in their clinical practice.

Smartphone-Based Fundus Imaging-Where Are We Now?

With the advent of smartphone-based fundus imaging (SBFI), a low-cost alternative to conventional digital fundus photography has become available. SBFI allows for a mobile fundus examination, is applicable both with and without pupil dilation, comes with built-in connectivity and post-processing capabilities, and is relatively easy to master. Furthermore, it is delegable to paramedical staff/technicians and, hence, suitable for telemedicine. Against this background a variety of SBFI applications have become available including screening for diabetic retinopathy, glaucoma, and retinopathy of prematurity and its applications in emergency medicine and pediatrics. In addition, SBFI is convenient for teaching purposes and might serve as a surrogate for direct ophthalmoscopy. First wide-field montage techniques are available and the combination of SBFI with machine learning algorithms for image analyses is promising. In conclusion, SBFI has the potential to make fundus examinations and screenings for patients particularly in low- and middle-income settings more accessible and, therefore, aid tackling the burden of diabetic retinopathy, glaucoma, and retinopathy of prematurity screening. However, image quality for SBFI varies substantially and a reference standard for grading appears prudent. In addition, there is a strong need for comparison of different SBFI approaches in terms of applicability to disease screening and cost-effectiveness.

Law and order of modern ophthalmology: Teleophthalmology, smartphones legal and ethics

In recent years, new technologies used in the field of ophthalmology have been emerging and developing rapidly. Two major aspects of these advancements are teleophthalmology and smartphones, which have enabled practitioners to achieve optimal outcomes in record time with minimal costs. Several rules and regulations have been applied to these technologies in order to frame them under the appropriate medico-legal ethics, and specialized committees have been dedicated to maintaining their efficacy and avoiding shortcomings. In addition multiple studies and case reports conducted worldwide have assessed them according to specific diseases or global concerns. This review article constitutes an up-to date account of almost all of the applications and medico-legal perspectives of technologies used in ophthalmology in order to summarize and better visualize their advantages and disadvantages.

Evidence-based medicine self-assessment, knowledge, and integration into daily practice: a survey among Romanian physicians and comparison between trainees and specialists

BACKGROUND

A gap between the attitude towards evidence-based medicine (EBM), knowledge and awareness has been reported among physicians from different parts of the world. However, no investigation on Romanian physicians is available in the scientific literature. Our study aimed, firstly, to assess EBM awareness and the knowledge used by Romanian physicians, and, secondly, to compare resident trainees with specialists.

METHODS

Romanian trainee and specialist physicians were invited to participate in this cross-sectional study. The study tool was an online questionnaire designed to explore their awareness, knowledge, usefulness, the attitude in medical documentation, and the use of professional EBM resources. Data were collected by Google Form from January 1st to April 30th, 2017, respecting the responders' anonymity. Two groups of physicians were investigated as trainees and specialists, respectively. Descriptive statistics (number, percentage, median and interquartile range) was used to describe the survey-related variables. Statistical significance on qualitative data was calculated with the Chi-square test, Fisher's exact test, or the Z-test for proportions.

RESULTS

Two hundred and 50 physicians participated in this study (68% trainees vs. 32% specialists). In both groups, a significantly high percentage was represented by women as compared to men (trainees 72.4%, specialists 70%). The correct definition of EBM was identified by most respondents (75.6%). Affirmatively, both trainees and specialists always looked at levels of evidence when reading scientific literature, but a small percentage (6.5% trainees and 3% specialists) adequately identified the uppermost types of evidence in the hierarchy. Almost a quarter of the respondents shared the name of mobile EBM resources that they used to support the daily practice. Only six out of the 49 listed mobile resources met the EBM criteria.

CONCLUSIONS

The participants proved to have limited knowledge of EBM and a positive attitude towards the concept. They made use of mobile medical resources without understanding which of these were evidence-based.