Development and validation of a questionnaire to evaluate the factors influencing training transfer among nursing professionals

A longitudinal assessment of factors affecting training transfer among new clinical nurse specialists

Objective

This study aimed to explore the determinants influencing training transfer and evaluate how those factors change over time among nurses who graduated from clinical nurse specialist training to provide a theoretical basis for improving the training transfer of clinical nurse specialists (CNSs).

Methods

A quantitative longitudinal survey with four rounds of data collection was utilized to measure the influencing aspects of training transfer from June 2018 to December 2019. A total of 46 new CNSs participated in this study, including 30 and 16 nurses receiving training programs for CNSs in Infusion, Wound and Ostomy. The factor influencing training transfer (FITT) questionnaire was used to collect data for the first month (time 1), the third month (time 2), the sixth month (time 3), and the first year (time 4) after training. This questionnaire contains 53 items divided into five dimensions, including managerial support (20 items); hindrance in the organization (6 items); the validity of the training program (10 items); organizational and personal facilitators (11 items); and personal attitudes towards training transfer (6 items).

Results

The influencing factors of CNSs transfer decreased over time, with managerial support, hindrance in the organization, the validity of the training program, and personal attitudes towards training transfer changing statistically over time (P < 0.05), and no statistical difference in organizational and personal facilitators over time (P = 0.229). During early after training (the first month and the third month after training), hindrance in the organization is the biggest obstacle to training transfer. During the later of training (the sixth month and first year after the training), managerial support is the biggest obstacle to training transfer. Overall level of influencing factors of training transfer decreased in three months after training among Infusion nurses (P < 0.001), and Wound and Ostomy nurses decreased in the first year after training (P < 0.001).

Conclusions

The trend and level of training transfer predictors decreased depending on time. Clarifying the factors influencing transfer and its patterns may help nursing managers enhance the implementation and impact of nurse specialist training.

Development and validation of a questionnaire to measure the congenital heart disease of children's family stressor

Background

Families of children with congenital heart disease (CHD) face tremendous stressors in the process of coping with the disease, which threatens the health of families of children with CHD. Studies have shown that nursing interventions focusing on family stress management can improve parents' ability to cope with illness and promote family health. At present, there is no measuring tool for family stressors of CHD.

Methods

The items of the scale were generated through qualitative interviews and a literature review. Initial items were evaluated by seven experts to determine content validity. Factor analysis and reliability testing were conducted with a convenience sample of 670 family members. The criterion-related validity of the scale was calculated using scores on the Self-Rating Anxiety Scale (SAS).

Results

The CHD Children's Family Stressor Scale consisted of six dimensions and 41 items. In the exploratory factor analysis, the cumulative explained variance of the six factors was 61.085%. In the confirmatory factor analysis, the six factors in the EFA were well validated, indicating that the model fits well. The correlation coefficient between CHD Children's Family Stressor Scale and SAS was r = 0.504 (p < 0.001), which indicated that the criterion-related validity of the scale was good. In the reliability test, Cronbach's α coefficients of six sub-scales were 0.774-0.940, and the scale-level Cronbach's α coefficient value was 0.945.

Conclusion

The study indicates that the CHD Children's Family Stressor Scale is valid and reliable, and it is recommended for use in clinical practice to assess CHD children's family stressors.

The development and validation of the hospital organizational environment scale for medical staff in China

Objectives

There is currently no measure of the hospital organizational environment targeting both clinicians and nurses in China. This study was conducted with the aim of developing and testing an instrument to assess the properties of the hospital organizational environment that is applicable to Chinese medical staff.

Methods

Items were developed based on a literature review, semi-structured interviews and an expert review and finalized based on corrected item-total correlation, content validity, construct validity, convergent validity, discriminant validity and reliability. The two samples for testing the first and final version of the Hospital Organizational Environment Scale (HOES) included 447 and 424 participants, respectively.

Results

The primary test, which comprised 18 items, contained four factors: hospital culture, work situation, organizational support and scientific research situation. The Cronbach's alphas were 0.935, 0.824, 0.943, and 0.920, respectively. The results of the validation test showed that the questionnaire had good validity and reliability.

Conclusion

The HOES is a comprehensive instrument with demonstrated validity and reliability that can be adopted among medical staff to assess the organizational environment in hospitals.

Enhancing earthquake preparedness knowledge and practice among Nepalese immigrants residing in Japan

This study aims at increasing earthquake preparedness knowledge perception and practice among Nepalese immigrants residing in Japan through an educational intervention. A single arm quasi experimental study was conducted among Nepalese immigrants residing in Japan. An educational intervention was prepared along with a 52 itemed questionnaire. In total, 165 participants responded to our questionnaire. Majority of them were male (67.88%), and the mean age was 32.78 years. Generalized equation model showed that the knowledge score of earthquake preparedness was 4.01 points higher immediately after the intervention [95% CI (2.78-5.24), p-value < 0.001] compared to baseline with a further increase by 7.02 points [95% CI (5.96-8.09), p-value < 0.001] at two weeks follow up. However, the practice score increased only by 2.83 points [95% CI (2.51-3.14), p-value < 0.001] immediately after the intervention with a similar increase at two weeks and 12 weeks follow up period [OR: 2.62, 95% CI (2.29-2.96), p-value < 0.001]. The educational intervention, when conducted in native language, can increase both the knowledge and practice score of earthquake preparedness hence, information related to earthquake preparedness in Nepali languages in the government websites of Japan could potentially increase information seeking behavior of people.

Design and validation of a new Healthcare Systems Usability Scale (HSUS) for clinical decision support systems: a mixed-methods approach

OBJECTIVE

To develop and validate a questionnaire to assess the usability of clinical decision support systems (CDSS) and to assist in the early identification of usability issues that may impact patient safety and quality of care.

DESIGN

Mixed research methods were used to develop and validate the questionnaire. The qualitative study involved scale item development, content and face validity. Pilot testing established construct validity using factor analysis and facilitated estimates for reliability and internal consistency using the Cronbach's alpha coefficient.

SETTING

Two hospitals within a single National Health Service Trust.

PARTICIPANTS

We recruited a panel of 7 experts in usability and questionnaire writing for health purposes to test content validity; 10 participants to assess face validity and 78 participants for the pilot testing. To be eligible for this last phase, participants needed to be health professionals with at least 3 months experience using the local hospital electronic patient record system.

RESULTS

Feedback from the face and content validity phases contributed to the development and improvement of scale items. The final Healthcare Systems Usability Scale (HSUS) proved quick to complete, easy to understand and was mostly worded by potential users. Exploratory analysis revealed four factors related to patient safety, task execution, alerts or recommendations accuracy, the effects of the system on workflow and ease of system use. These separate into four subscales: patient safety and decision effectiveness (seven items), workflow integration (six items), work effectiveness (five items) and user control (four items). These factors affect the quality of care and clinician's ability to make informed and timely decisions when using CDSS. The HSUS has a very good reliability with global Cronbach's alpha 0.914 and between 0.702 and 0.926 for the four subscales.

CONCLUSION

The HSUS is a valid and reliable tool for usability testing of CDSS and early identification of usability issues that may cause medical adverse events.

The Relationship between Demographics and Knowledge Risk Perception of High School Teachers: Training as a Mediator

As a knowledge-based career, teachers can be exposed to knowledge risks. Since risk perception is the product of the experiences, values, memories and ideologies of individuals, the ways of perceiving knowledge risks could be useful for setting up prevention and mitigation strategies for these kinds of risks. The present paper aimed at analyzing the relationship between the demographics and the knowledge risk perception of high school teachers. The role of a teacher’s training as a mediator of said relationship was analyzed as well. Using a sample of high school teachers working in Italian schools, a questionnaire was administered to gather data, and structural equation modeling analysis was employed to test the hypotheses. The results showed that demographics had a significant effect on teachers’ knowledge risk perception and that training mediated this relationship. The study could be helpful for educational institutions that want to train their teachers to be prepared to face risky events related to knowledge management.

Statistical Methods for Item Reduction in a Representative Lifestyle Questionnaire: Pilot Questionnaire Study

Background

Reducing the number of items in a questionnaire while maintaining relevant information is important as it is associated with advantages such as higher respondent engagement and reduced response error. However, in health care, after the original design, an a posteriori check of the included items in a questionnaire is often overlooked or considered to be of minor importance. When conducted, this is often based on a single selected method. We argue that before finalizing any lifestyle questionnaire, a posteriori validation should always be conducted using multiple approaches to ensure the robustness of the results.

Objective

The objectives of this study are to compare the results of two statistical methods for item reduction (variance inflation factor [VIF] and factor analysis [FA]) in a lifestyle questionnaire constructed by combining items from different sources and analyze the different results obtained from the 2 methods and the conclusions that can be made about the original items.

Methods

Data were collected from 79 participants (heterogeneous in age and sex) with a high risk of metabolic syndrome working in a financial company based in Tokyo. The lifestyle questionnaire was constructed by combining items (asked with daily, weekly, and monthly frequency) from multiple validated questionnaires and other selected questions. Item reduction was conducted using VIF and exploratory FA. Adequacy tests were used to check the data distribution and sampling adequacy.

Results

Among the daily and weekly questions, both VIF and FA identified redundancies in sleep-related items. Among the monthly questions, both approaches identified redundancies in stress-related items. However, the number of items suggested for reduction often differed: VIF suggested larger reductions than FA for daily questions but fewer reductions for weekly questions. Adequacy tests always confirmed that the structural detection was adequate for the considered items.

Conclusions

As expected, our analyses showed that VIF and FA produced both similar and different findings, suggesting that questionnaire designers should consider using multiple methods for item reduction. Our findings using both methods indicate that many questions, especially those related to sleep, are redundant, indicating that the considered lifestyle questionnaire can be shortened.

Current Awareness of Health Professionals on the Safety of Herbal Medicine and Associated Factors in the South West of Ethiopia

Background

Recently, the World Health Organization has strongly evidenced the importance of herbal medicine safety monitoring within the existing pharmacovigilance system through active involvement of health professionals. However, there is a widespread lack of awareness among health professionals about the safety of herbal medicines. Thus, this study assessed the current awareness of health professionals on the safety of herbal medicine in the South West of Ethiopia.

Methodology

The study employed a cross-sectional study design involving multistage sampling among health professionals (n=286) working in the medical center of Jimma University, January to February, 2021. The pre-tested self-administered questionnaire containing structured questions on a five-point Likert scale was appropriately filled and returned for statistical analysis. For the analysis of data, Statistical Package for Social Sciences (SPSS) was used. The associations between status of awareness and predictors were determined at 5% (p<0.05) level of significance by employing multivariate logistic regression.

Results

The study revealed around 51.8% of respondents had a good awareness regarding herbal medicine safety. Working experience of 6-10 years (AOR: 0.215, 95% CI: 0.093, 0.499), having training (AOR: 0.357, 95% CI: 0.166, 0.770), and practice of safety monitoring (AOR: 0.169, 95% CI: 0.077, 0.370) were significantly associated with awareness of safety of herbal medicine.

Conclusion

This study revealed that awareness of health professionals regarding safety of herbal medicine is not satisfactory. The years of experience, training, and practice of safety monitoring of herbal medicine are the major factors affecting status awareness. Therefore, the National Regulatory Authority must urgently facilitate integrated and consistent training for all health professionals.

Development of the competency assessment scale for clinical nursing teachers: Results of a Delphi study and validation

BACKGROUND

Highly competent clinical faculty is a prerequisite for graduating competent nurses, and it is very important to explore the comprehensive ability and post competence of clinical nursing teachers (CNT).

OBJECTIVE

To construct the competency evaluation elements of clinical nursing teachers and test the reliability and validity of the scale.

DESIGN

A Delphi study.

SETTINGS

34 Grade A tertiary hospitals and eight colleges and universities in China, covering 14 provinces, autonomous regions, and municipalities directly under the Central Government.

METHODS

Modified Delphi method was used in this study. Between August 2018 and May 2019, 40 experts participated in three rounds of consultation to build the CNT competency assessment scale. The expert coordination coefficient (W) and the coefficient of variation (CV) were used to examine the level of coordination and concentration of expert advice. Then, the reliability and validity of the scale were tested. Using the convenient sampling method, a total of 190 questionnaires were distributed to nursing teachers, and 187 were recovered. Cronbach's α coefficient was used to evaluate the reliability of the scale. Validity was evaluated using the content validity index.

RESULTS

After the three rounds of expert consultation, the questionnaire contained five dimensions and 44 elements. After expert inquiry, the total coefficient of variation index (CVI) value of the scale was 0.992, and the CVI of each item was 0.95-1.00. The Spearman-Brown correlation coefficient was 0.984. By comparing the results of the two surveys 2 months apart, the Pearson correlation coefficient was tested, and the retest reliability was 0.852. The Cronbach's α of the scale was 0.962, indicating excellent internal consistency.

CONCLUSIONS

The scale of clinical nursing teachers' competence has high reliability and validity. This tool could be widely used to evaluate and improve nursing teaching.

Antimicrobial Resistance, Pharmacists, and Appreciative Inquiry: Development of a Novel Measurement Tool

Antimicrobial resistance (AMR) is a threat to achieving the United Nation’s (UN) sustainable development goals (SDGs). The behavior of stakeholders has directly influenced the extent of AMR and understanding underpinning knowledge and attitudes is an important step towards understanding these behaviors. The aim of this study was to develop and validate a novel questionnaire, utilizing the theory of Appreciative Inquiry, to measure knowledge and attitudes around antibiotic resistance amongst community pharmacists throughout Thailand. A survey tool was developed using the Appreciative Inquiry theory, and was piloted in a non-probability sample of practicing community pharmacists. Descriptive and inferential statistics were applied and the tool validated, using a three-step psychometric validation process. A total of 373 community pharmacists participated in the study. The survey tool was found to be valid and reliable. The “Knowledge” domain of the survey tool showed an acceptable level of reliability (Cronbach’s alpha 0.64); while the “Attitude” domain showed an excellent reliability level (Cronbach’s alpha 0.84). This new survey tool has been designed to measure attitudes and knowledge of antibiotic resistance by utilizing the Discovery phase of Appreciative Inquiry theory amongst community pharmacists in Thailand. This survey tool has the potential to be used by other researchers across different settings.

Development and Validation of an Evaluation Tool to Measure the Effectiveness of a Smoking Cessation Training among Healthcare Providers in Malaysia: The Providers' Smoking Cessation Training Evaluation (ProSCiTE)

Background: In line with Article 14 of the Framework Convention for Tobacco Control, we have witnessed vast developments in smoking cessation training for healthcare providers, offering help for smokers. However, there is no specific evaluation tool to monitor and evaluate the effectiveness of these programs for future enhancement and sustainability. Objective: To develop and validate a new tool for evaluating smoking cessation training programs for healthcare providers called the Providers' Smoking Cessation Training Evaluation (ProSCiTE). Methods: The 74-item ProSCiTE tool was developed based on a review of the literature and an expert panel review. The tool was validated in a sample of 403 healthcare providers using a cross-sectional study design from July to December 2016. Content validity was assessed by the Scale-Content Validity Index (S-CVI). The construct validity of the ProSCiTE was analyzed using exploratory factor analysis (EFA) to confirm psychometric properties. Internal consistency reliability was determined using Cronbach's alpha. Results: The content validity showed that the S-CVI ranged from 0.82 to 1.00 for consistency, representativeness, relevancy, and the clarity of each construct, resulting in 67 items for the questionnaire. The construct validity of the ProSCiTE (based on eigenvalues and factor loadings to confirm the four-factor structure (attitude, self-efficacy, behavior, and barriers) with 54.74% total variance) was acceptable (Kaiser-Mayer-Olkin = 0.923; Bartlett's test of sphericity was significant, p < 0.001). The internal consistency reliability of the four-factor structure was very good, with Cronbach's alpha values at 0.89, 0.94, 0.95, and 0.90, respectively. Conclusions: This study showed that 67 items of the ProSCiTE demonstrated good content and construct validity, as well as a high internal consistency reliability for the measurement of knowledge, attitudes, self-efficacy, behavior, and barriers to smoking cessation interventions among healthcare providers. Therefore, the ProSCiTE is a valid and reliable research tool with which to evaluate the effectiveness of smoking cessation training programs.

Self-efficacy and employee job performance

Purpose

Relationship between self-efficacy (SE) and employee job performance (EJP) is of vital importance for organizations but remains unclear. A more comprehensive understanding demonstrated that perceived workplace support (PWS), motivation to transfer (MT) and transfer of training (TT) had mediating effects on the relationship between SE and EJP. The paper aims to discuss these issues.

Design/methodology/approach

Empirical data were garnered from 250 alumni of the Engineering Faculty, Rajamangala University of Technology Thanyaburi, Thailand through a questionnaire requesting 62 answers. A research outline was proposed, with structural equation modeling utilized to test the framework, determine the direct influence of SE on EJP and also any indirect influences on EJP through PWS, MT and TT variables.

Findings

SE increased EJP through enhancing PWS, MT and TT. In addition, PWS, MT and TT were determined as partial mediator factors of SE on EJP.

Originality/value

Empirical evidence was presented as two mechanisms that helped to explain the effect of SE on EJP. To enhance EJP, organizations should consider contributions associated with SE, PWS, MT and TT when designing and implementing transfer training for effective EJP.