Development and psychometric testing of the Readiness to Engage with Patient-Facing Health Information Technology Tools (RE-PHIT) scale

Healthcare professionals' digital health competence and its core factors; development and psychometric testing of two instruments

BACKGROUND

Healthcare professionals' digital health competence is an important phenomenon to study as healthcare practices are changing globally. Recent research aimed to define this complex phenomenon and identify the current state of healthcare professionals' competence in digitalisation but did not include an overarching outlook when measuring digital health competence of healthcare professionals.

OBJECTIVES

The purpose of this study was to develop and psychometrically validate two self-assessed instruments measuring digital health competence and factors associating with it.

METHODS

The study followed three phases of instrument development and validation: 1) conceptualisation and item pool generation; 2) content validity testing and pilot study; and 3) construct validity and reliability testing. The conceptual background of the instruments was based on individual interviews conducted with healthcare professionals (n = 20) and previous systematic reviews. A total of 17 experts assessed the instrument's content validity. Face validity was evaluated by a group of healthcare professionals (n = 20). Data collection from 817 professionals took place in spring-summer 2022 in nine organisations. Construct validity was confirmed with exploratory factor analysis. Cronbach's alpha was used to assess the internal consistency of the instruments.

RESULTS

The instrument development and validation process resulted in two instruments: DigiHealthCom and DigiComInf. DigiHealthCom included 42 items in 5 factors related to digital health competence, and DigiComInf included 15 items in 3 factors related to educational and organisational factors associated with digital health competence. The DigiHealthCom instrument explained 68.9 % of the total variance and the factors' Cronbach alpha values varied between 0.91 and 0.97. The DigiComInf instrument explained 59.6 % of the total variance and the factors' Cronbach alpha values varied between 0.76 and 0.88.

CONCLUSIONS

The two instruments gave valid and reliable results in psychometric testing. The instruments could be used to evaluate healthcare professionals' digital health competence and associated factors.

Development and validation of a new tool to identify factors that influence users' motivation toward the use of teleconsultation systems: A modified Delphi study

BACKGROUND

Healthcare providers have improved consumer access to healthcare services by the adoption of information communication technology and the use of telemedicine. With the current COVID-19 pandemic, consumers are shifting to remote teleconsultation. There are several studies regarding consumers' acceptance and satisfaction with telemedicine among healthcare providers and a few among patients at healthcare facilities. However, studies about patients' motivation toward the use of teleconsultation systems are very few.

AIM

The aim of this study was to validate an instrument of a newly developed framework to identify factors that motivate patients to use a teleconsultation system.

METHOD

This study used a modified eDelphi method incorporating content validity index and content validity ratio procedures to validate the instrument among fifteen experts from different disciplines. The eDelphi consisted of three rounds to review each item's relevance, clarity, importance and the overall validity of the instrument.

RESULT

The result showed a significant level of agreement among experts for individual items' relevance, clarity and importance. For relevance, all items had excellent I-CVI above 0.889, except one item with I-CVI = 0.78, which is still acceptable. For clarity, all items had an excellent I-CVI > 0.889, except one with I-CVI = 0.667. For importance, most items had CVR above the threshold value of 0.778, except 5 items. Also, the result showed moderate to high content validity of the overall instrument (S-CVI/UA = 0.694; S-CVI/Ave = 0.996).

DISCUSSION

These findings support the validity and reliability of the developed instrument, which can be used to identify factors that motivated patients to use a teleconsultation system. Future testing of the instrument should be conducted with a larger population that uses a teleconsultation system.

CONCLUSION

An instrument was developed to identify factors that motivated consumers to use teleconsultation, using a modified eDelphi method among experts. The eDelphi method consisted of three rounds and the results showed that the instrument is a valid and reliable tool.

Development of an Instrument for Assessing the Maturity of Citizens for Consumer Health Informatics in Developing Countries: The Case of Chile, Ghana, and Kosovo

OBJECTIVE

 We aimed to develop a survey instrument to assess the maturity level of consumer health informatics (ConsHI) in low-middle income countries (LMIC).

METHODS

 We deduced items from unified theory of acceptance and use of technology (UTAUT), UTAUT2, patient activation measure (PAM), and ConsHI levels to constitute a pilot instrument. We proposed a total of 78 questions consisting of 14 demographic and 64 related maturity variables using an iterative process. We used a multistage convenient sampling approach to select 351 respondents from all three countries.

RESULTS

 Our results supported the earlier assertion that mobile devices and technology are standard today than ever, thus confirming that mobile devices have become an essential part of human activities. We used the Wilcoxon Signed-Rank Test (WSRT) and item response theory (IRT) to reduce the ConsHI-related items from 64 to 43. The questionnaire consisted of 10 demographic questions and 43 ConsHI relevant questions on the maturity of citizens for ConsHI in LMIC. Also, the results supported some moderators such as age and gender. Additionally, more demographic items such as marital status, educational level, and location of respondents were validated using IRT and WSRT.

CONCLUSION

 We contend that this is the first composite instrument for assessing the maturity of citizens for ConsHI in LMIC. Specifically, it aggregates multiple theoretical models from information systems (UTAUT and UTAUT2) and health (PAM) and the ConsHI level.