Competencies for proficiency in basic point-of-care ultrasound in anesthesiology: national expert recommendations using Delphi methodology

PURPOSE

Point-of-care ultrasound (POCUS) allows for rapid bedside assessment and guidance of patient care. Recently, POCUS was included as a mandatory component of Canadian anesthesiology training; however, there is no national consensus regarding the competencies to guide curriculum development. We therefore aimed to define national residency competencies for basic perioperative POCUS proficiency.

METHODS

We adopted a Delphi process to delineate relevant POCUS competencies whereby we circulated an online survey to academic anesthesiologists identified as POCUS leads/experts (n = 25) at all 17 Canadian anesthesiology residency programs. After reviewing a list of competencies derived from the Royal College of Physicians and Surgeons of Canada's National Curriculum, we asked participants to accept, refine, delete, or add competencies. Three rounds were completed between 2022 and 2023. We discarded items with < 50% agreement, revised those with 50-79% agreement based upon feedback provided, and maintained unrevised those items with ≥ 80% agreement.

RESULTS

We initially identified and circulated (Round 1) 74 competencies across 19 clinical domains (e.g., basics of ultrasound [equipment, nomenclature, clinical governance, physics]; cardiac [left ventricle, right ventricle, valve assessment, pericardial effusion, intravascular volume status] and lung ultrasound anatomy, image acquisition, and image interpretation; and clinical applications [monitoring and serial assessments, persistent hypotension, respiratory distress, cardiac arrest]). After three Delphi rounds (and 100% response rate maintained), panellists ultimately agreed upon 75 competencies.

CONCLUSION

Through national expert consensus, this study identified POCUS competencies suitable for curriculum development and assessment in perioperative anesthesiology. Next steps include designing and piloting a POCUS curriculum and assessment tool(s) based upon these nationally defined competencies.

[Better assessment, better care: Quetci, a questionnaire for assessing cognitive disorders in nursing practice]

Cognitive disorders can have significant repercussions on the quality of care and daily life for patients. We have developed a new tool specifically designed for nursing practice to identify these problems in patients with brain tumors. The Cognitive Impairment Assessment Questionnaire for nursing practice is an objective, quick and easy-to-administer tool that is readily accepted by patients.

Validation of the Portuguese Version of the Perceived Physical Literacy Instrument

BACKGROUND

The Perceived Physical Literacy Instrument (PPLI) has been the most adopted physical literacy instrument designed for adults to date, having been already translated to 5 languages. Still, despite its popularity, there is limited evidence of its psychometric properties. The aim of this study was to translate and adapt cross-culturally the PPLI to the Portuguese language and to analyze the psychometric properties of the Portuguese version in a sample of Portuguese-speaking adults.

METHODS

The study sample was composed of 434 participants (70% females) with a median age of 25 (18-39) years. Confirmatory factor analysis was used to assess psychometric properties of the scale. In addition, instrument assumptions between sexes through invariance testing were examined. Finally, concurrent validity, test-retest reliability, and test-retest agreement analyses were performed to gather additional evidence.

RESULTS

The results of the present study generally supported the measurement model. The 9-item, 3-factor model presented a good fit to the data and adequate construct validity (χ2 = 82.859 [24], P < .001, comparative-fit index = .948, Tucker-Lewis index = .922, standardized root mean square residual = .049, root mean square error of approximation = .075). In addition, the scale presented concurrent validity. Some issues arose with measurement invariance and overtime consistency.

CONCLUSIONS

Considering the lack of validated instruments, we suggest a fair use of Portuguese version of PPLI to access physical literacy in adults. This study contributes to the validation of the PPLI by providing evidence of its psychometric properties in the Portuguese-speaking adult population and facilitates comparative analysis with previous and future studies utilizing the PPLI instrument.

Development of a Simulation-Based Mastery Learning Curriculum for Late Goals of Care Discussions

INTRODUCTION

Fellows in critical care medicine (CCM) routinely help patients and families navigate complex decisions near the end of life. These "late goals of care" (LGOC) discussions require rigorous skills training and impact patient care. Innovation is needed to ensure that fellow training in leading these discussions is centered on reproducible competency-based standards. The aims of this study were to (1) describe the development of a simulation-based mastery learning (SBML) curriculum for LGOC discussions and (2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners.

INNOVATION

We developed an SBML curriculum for CCM fellows structured around REMAP, a mnemonic outlining foundational components of effective communication around serious illness. A multidisciplinary expert panel iteratively created an LGOC discussion assessment tool. Pilot testing was completed to refine the checklist, set the MPS, and assess skill acquisition.

OUTCOMES

The LGOC discussion assessment tool included an 18-item checklist and 6 scaled items. The tool produced reliable data (k ≥ 0.7 and ICC of ≥ 0.7). Using the Mastery Angoff method, the panel set the MPS at 87%. Ten CCM fellows participated in the pilot study. Performance on the checklist significantly improved from a median score of 52% (IQR 44%-72%) at pretest to 96% (IQR 82%-97%) at post-test (P = 0.005). The number of learners who met the MPS similarly improved from 10% during pre-testing to 70% during post-testing (P = 0.02).

COMMENT

We describe the development of a LGOC SBML curriculum for CCM fellows which includes a robust communication skills assessment and the delineation of a defensible MPS.

Validation of the Japanese version of the Social Functioning in Dementia scale and COVID-19 pandemic's impact on social function in mild cognitive impairment and mild dementia

OBJECTIVES

We aimed to psychometrically evaluate and validate a Japanese version of the Social Functioning in Dementia scale (SF-DEM-J) and investigate changes in social function in people with dementia during the coronavirus disease-19 (COVID-19) pandemic.

DESIGN

We interviewed people with mild cognitive impairment (MCI) and mild dementia and their caregivers during June 2020-March 2021 to validate patient- and caregiver-rated SF-DEM-J and compared their scores at baseline (April 2020 to May 2020) and at 6-8 months (January 2021 to March 2021) during a time of tighter COVID-19 restrictions.

SETTING

The neuropsychology clinic in the Department of Psychiatry at Osaka University Hospital and outpatient clinic in the Department of Psychiatry and Neurology at Daini Osaka Police Hospital, Japan.

PARTICIPANTS

103 dyads of patients and caregivers.

MEASUREMENTS

SF-DEM-J, Mini-Mental State Examination, Neuropsychiatric Inventory, UCLA Loneliness Scale, and Apathy Evaluation Scale.

RESULTS

The scale's interrater reliability was excellent and test-retest reliability was substantial. Content validity was confirmed for the caregiver-rated SF-DEM-J, and convergent validity was moderate. Caregiver-rated SF-DEM-J was associated with apathy, irritability, loneliness, and cognitive impairment. The total score of caregiver-rated SF-DEM-J and the score of Section 2, "communication with others," significantly improved at 6-8 months of follow-up.

CONCLUSIONS

The SF-DEM-J is acceptable as a measure of social function in MCI and mild dementia. Our results show that the social functioning of people with dementia, especially communicating with others, improved during the COVID-19 pandemic, probably as a result of adaptation to the restrictive life.

Psychometric properties of the Japanese version of the standardised assessment of personality abbreviated scale

This study was undertaken to translate the Standardised Assessment of Personality - Abbreviated Scale (SAPAS) into Japanese and to evaluate its validity and reliability. SAPAS is one of the most rapid tools for assessing personality disorder (PD) and has excellent sensitivity and good specificity, whereas other PD assessment tools require such a significant investment of time that they are infeasible for large surveys or routine clinical practice. Customary assessment in clinical practice ideally incorporates screening for PD, as it is associated with a substantial public health burden, including premature mortality and increased health service utilization. Furthermore, PD's status as a key prognostic variable of mental disorders also drives PD screening. While SAPAS has been translated into several languages, there has been no Japanese version. Therefore, we translated SAPAS into Japanese (SAPAS-J) and evaluated its reliability and validity. Study 1 recruited undergraduates to reveal its test-retest reliability. Although its internal consistency was not high, since the intent of the original SAPAS was to assess the broad character of personality disorder with the fewest possible items, minimal correlations between items were reasonable. We tested two factorial models, the single-factor model and the higher-order-single-factor model, and the latter offered better fitting. This higher-order model contained a three-factor structure corresponding to clusters described in DSM-5. It measures general PD traits as a common higher-order latent variable comprising those factors. Correlations of SAPAS-J with the much longer PD screening questionnaire in Study 1 and depressive and anxiety symptoms in Study 2 from the general population support its validity. Although validation for the clinical use of SAPAS-J is limited, our research with non-clinical populations demonstrated sufficient validity to justify its use in the context of psychopathological analog research. Since PD is understood as a continuum, the severity of which is distributed dimensionally, the analog study recruiting from the general population and attempting to reveal psychopathological mechanisms of PD is meaningful.

A qualitative study of a recovery capital assessment tool in alcohol and drug treatment facilities: Perspectives from social work professionals

The ambition to translate the concept of recovery capital (RC) from research to practice has entailed operationalisations of RC to measure progress and outcomes of alcohol and other drug (AOD) treatments.At the same time, the role played by standardisation in social work organisations is known to be a complex matter, and research suggests that the implementation of standardisation should be carried out with caution. By examining the need for a RC assessment tool in a Swedish AOD treatment context, this paper contributes to the discussion on the use of assessment tools for measuring treatment progress and outcome in AOD treatments, as well as interrelations between standardisation aims and social work professionals. Four group interviews with employees at AOD treatment facilities were conducted in Stockholm, Sweden. The interviewees were presented with an example of an RC-based assessment tool and asked to review the applicability of the tool in their daily work. The findings provide insights on the applicability of specific assessment list items, as well as general observations on the complex relationship between standardisation and discretion in social work. The findings suggest that professionals will ultimately rely on their knowledge and experience, and act accordingly to support the service user, regardless of any manual or standardisation that regulates their work.

Family Medicine Resident Experience Toward Workplace-Based Assessment Form in Improving Clinical Teaching: An Exploratory Qualitative Study

Background

Workplace-Based Assessment (WPBA) has been widely utilized for assessing performance in training sites for both formative and summative purposes. Currently, with the recently updated duration of the family medicine (FM) training program in Saudi Arabia from four years to three years, the possible impact of such a change on assessment would need to be investigated. This objective was to explore the experiences of FM residents regarding the usage of WPBA as an assessment tool for improving clinical teaching at King Abdulaziz Hospital (KAH), Al Ahsa, Saudi Arabia.

Methods

The study involves an exploratory qualitative phenomenological approach targeting family medicine resident in KAH was used. Purposive sampling techniques were used. In this descriptive study, data was collected through the utilization of 1:1 semi-structured interviews guided by directive prompts. All recorded interviews were transcribed verbatim. An inductive analytical approach was applied for thematic analysis of transcripts.

Results

Fifteen participants were individually interviewed until data saturation was reached. The themes that emerged were organized into the categories of underlying principles of WPBA, the impact of the learning environment, associated opportunities and challenges, and making WPBA more effective. Participants expressed that the orientation provided by the program was insufficient, although the core principles were clear to them. They valued the senior peers' support and encouragement for the creation of a positive learning environment. However, time limit, workload, and a lack of optimum ideal implementation reduced the educational value and effectiveness of WPBA among senior residents.

Conclusion

The study examined residents' experiences with WPBA and concluded that low levels of satisfaction were attributed to implementation-related problems. Improvements should be made primarily in two areas: better use of available resources and more systematic prior planning. Revision and assignment of the selection process were suggested, in addition to the implementation of the new curriculum. The research will assist stakeholders in selecting and carrying out evaluation techniques that will enhance residents' abilities.

Assessment of Dyspnea in Critically Ill Patients: A Comparative Analysis of Evaluation Scales

Purpose This study aimed to evaluate the Respiratory Distress Observation Scale (RDOS), Intensive Care RDOS (IC-RDOS), and Mechanical Ventilation RDOS (MV-RDOS) as potential markers of dyspnea in ICU patients by describing their relationship with the Dyspnea Visual Analog Scale (D-VAS). Materials and methods A researcher and a trained nurse independently assessed ICU patients simultaneously. One researcher assessed the RDOS (IC/MV-RDOS) and the depth of sedation. An objective evaluation using the observational D-VAS was simultaneously performed by a trained nurse. Results The correlation coefficients for each scale were 0.338 for the D-VAS and RDOS, 0.239 for the IC-RDOS, and 0.237 for the MV-RDOS, indicating a low correlation. The prediction of self-reported dyspnea showed that each scale's area under the curve (AUC) as a predictor of D-VAS ≥4 was 0.79 (95% Confidence Interval [CI] 0.71-0.87) for RDOS, 0.77 (95% CI 0.68-0.84) for IC-RDOS, and 0.73 (95% CI 0.64-0.81) for MV-RDOS. Conclusions The objective rating scales RDOS, IC-RDOS, and MV-RDOS can predict subjective dyspnea to a certain extent; however, they have limitations in accurately discriminating dyspnea intensity.

Assessment Tools for Measuring Health Literacy and Digital Health Literacy in a Hospital Setting: A Scoping Review

Assessment of (digital) health literacy in the hospital can raise staff awareness and facilitate tailored communication, leading to improved health outcomes. Assessment tools should ideally address multiple domains of health literacy, fit to the complex hospital context and have a short administration time, to enable routine assessment. This review aims to create an overview of tools for measuring (digital) health literacy in hospitals. A search in Scopus, PubMed, WoS and CINAHL, following PRISMA guidelines, generated 7252 hits; 251 studies were included in which 44 assessment tools were used. Most tools (57%) were self-reported and 27% reported an administration time of <5 min. Almost all tools addressed the domain 'understanding' (98%), followed by 'access' (52%), 'apply' (50%), 'appraise' (32%), 'numeracy' (18%), and 'digital' (18%). Only four tools were frequently used: the Newest Vital Sign (NVS), the Short Test of Functional Health Literacy for Adults ((S)TOFHLA), the Brief Health Literacy Screener (BHLS), and the Health Literacy Questionnaire (HLQ). While the NVS and BHLS have a low administration time, they cover only two domains. HLQ covers the most domains: access, understanding, appraise, and apply. None of these four most frequently used tools measured digital skills. This review can guide health professionals in choosing an instrument that is feasible in their daily practice, and measures the required domains.

Community health workers' quality of comprehensive care: a cross-sectional observational study across three districts in South Africa

Background

Community healthcare worker (CHW) training programs are becoming increasingly comprehensive (an expanded range of diseases). However, the CHWs that the program relies on have limited training. Since CHWs' activities occur largely during household visits, which often go unsupervised and unassessed, long-term, ongoing assessment is needed to identify gaps in CHW competency, and improve any such gaps. We observed CHWs during household visits and gave scores according to the proportion of health messages/activities provided for the health conditions encountered in households. We aimed to determine (1) messages/activities scores derived from the proportion of health messages given in the households by CHWs who provide comprehensive care in South Africa, and (2) the associated factors.

Methods

In three districts (from two provinces), we trained five fieldworkers to score the messages provided by, and activities of, 34 CHWs that we randomly selected during 376 household visits in 2018 and 2020 using a cross-sectional study designs. Multilevel models were fitted to identify factors associated with the messages/activities scores, adjusted for the clustering of observations within CHWs. The models were adjusted for fieldworkers and study facilities (n = 5, respectively) as fixed effects. CHW-related (age, education level, and phase of CHW training attended/passed) and household-related factors (household size [number of persons per household], number of conditions per household, and number of persons with a condition [hypertension, diabetes, HIV, tuberculosis TB, and cough]) were investigated.

Results

In the final model, messages/activities scores increased with each extra 5-min increase in visit duration. Messages/activities scores were lower for households with either children/babies, hypertension, diabetes, a large household size, numerous household conditions, and members with either TB or cough. Increasing household size and number of conditions, also lower the score. The messages/activities scores were not associated with any CHW characteristics, including education and training.

Conclusion

This study identifies important factors related to the messages provided by and the activities of CHWs across CHW teams. Increasing efforts are needed to ensure that CHWs who provide comprehensive care are supported given the wider range of conditions for which they provide messages/activities, especially in households with hypertension, diabetes, TB/cough, and children or babies.

Reconsidering the Use of Population Health Surveys for Monitoring of Mental Health

Monitoring of the mental health status of the population and assessment of its determinants are 2 of the most relevant pillars of public mental health, and data from population health surveys could be instrumental to support them. Although these surveys could be an important and suitable resource for these purposes, due to different limitations and challenges, they are often relegated to the background behind other data sources, such as electronic health records. These limitations and challenges include those related to measurement properties and cross-cultural validity of the tools used for the assessment of mental disorders, their degree of representativeness, and possible difficulties in the linkage with other data sources. Successfully addressing these limitations could significantly increase the potential of health surveys in the monitoring of mental disorders and ultimately maximize the impact of the relevant policies to reduce their burden at the population level. The widespread use of data from population health surveys, ideally linked to electronic health records data, would enhance the quality of the information available for research, public mental health decision-making, and ultimately addressing the growing burden of mental disorders.

Content Quality of YouTube Videos About Metastatic Breast Cancer in Young Women: Systematic Assessment

BACKGROUND

Young women with metastatic breast cancer (MBC) are part of a digitally connected generation yet are underserved in terms of information needs. YouTube is widely used to find and identify health information. The accessibility of health-related content on social media together with the rare and marginalized experiences of young women with MBC and the digital media practices of younger generations imply a considerable likelihood that young women with MBC will seek information and community on the internet.

OBJECTIVE

This study aims to assess the content quality of MBC YouTube videos and to identify themes in the experiences of young women with MBC based on YouTube videos.

METHODS

A systematic assessment of MBC YouTube videos using the search term "metastatic breast cancer young" was conducted in August 2021. The search was performed in an incognito browser and with no associated YouTube or Google account. Search results were placed in order from most to least views. Title, date uploaded, length, poster identity, number of likes, and number of comments were collected. Understandability and actionability were assessed using the Patient Education Materials Assessment Tool (PEMAT); information reliability and quality were assessed with DISCERN. Themes, sponsorships, and health care professionals' and patients' narratives were reported.

RESULTS

A total of 101 videos were identified. Of these, 78.2% (n=79) included sponsorships. The mean PEMAT scores were 78.8% (SD 15.3%) and 43.1% (SD 45.2%) for understandability and actionability, respectively. The mean DISCERN score was 2.44 (SD 0.7) out of 5. Identified themes included treatment (n=67, 66.3%), family relationship (n=46, 45.5%), and motherhood (n=38, 37.6%).

CONCLUSIONS

YouTube videos about young women with MBC are highly understandable but demonstrate moderate rates of actionability, with low reliability and quality scores. Many have a commercial bias. While web-based materials have limitations, their potential to provide patient support is not fully developed. By acknowledging their patients' media habits, health care professionals can further develop a trusting bond with their patients, provide a space for open and honest discussions of web-based materials, and avoid any potential instances of confusion caused by misleading, inaccurate, or false web-based materials.

Technical assessment in minimally invasive complete mesocolic excision: Is the complete mesocolic excision competency assessment tool valid and reliable?

AIM

The complete mesocolic excision competency assessment tool (CMECAT) is a novel tool designed to assess technical skills in minimally invasive complete mesocolic excision (CME) surgery. The aim of this study was to assess construct validity and reliability of CMECAT in a clinical context.

METHOD

Colorectal surgeons were asked to submit video recorded laparoscopic CME resections for independent assessment of their technical abilities. The videos were grouped by surgeons' training level, and four established CME experts were recruited as CMECAT assessors. Extended reliability analysis (G-theory) was applied to describe assessor agreement.

RESULTS

A total of 19 videos and 72 assessments were included in the analysis. Overall, technical skills assessed by CMECAT improved with increased training level: the experts scored significantly better than the untrained surgeons (3.3 vs. 2.5 points; p < 0.01). On right-sided resections, significantly higher scores were reported with increased training level for all categories and sections, while for left-sided resections, the variance across groups was smaller and significantly higher scores were only reported for oncological safety describing items. Overall, assessor agreement was high (G-coefficient: 0.81).

CONCLUSION

This study confirms that CMECAT can be applied to video recorded CME cases for technical skill assessment. Further, it can reliably assess technical performance in right sided CME surgery, where construct validity has now been established. More videos are required to evaluate its validity on left colonic CME. In the future, we hope CMECAT can improve feedback during CME training, serve as a tool in certification processes and contribute to distinguishing CME from conventional surgery in future research.

Assessment Tools Measuring Fundamental Movement Skills of Primary School Children: A Narrative Review in Methodological Perspective

This paper aimed to analyze fundamental movement skill (FMS) assessment tools that could be used for primary school children. In this narrative review, the Motoriktest für Vier- bis Sechjärige Kinder (MOT 4-6), Movement Assessment Battery for Children-2 (M-ABC-2), Motorische Basiskompetenzen (MOBAK) Körperkoordinationtest für Kinder (KTK), Test of Gross Motor Development (TGMD), Maastricht Motoriek Test (MMT) and the Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2) were analyzed from a methodological perspective, such as the number of test items, tools and types of tests, in terms of the FMS area. The analysis revealed that to assess locomotor movement skills, the BOT-2 has an excellent test for running ability, but for detecting technical difficulties, the TGMD is recommended. To test hopping, the MMT is the best test. Object control movement skills are measured with throws, dribbles and catches. Most of the tools assessed these skills, but it turned out that the TGMD is the best for measuring object control. Stability movement skills are tested with static and dynamic balance tests. Dynamic balance is more frequently used, and the MOT 4-6, KTK and BOT-2 have the most tools to use. However, the MMT is an excellent test for static balance. Fine motor movement skills are easy to assess with the MMT and MOT 4-6, since they have low equipment requirements. The BOT-2 is the best measurement tool; however, it has high equipment requirements. All of the FMS assessment tools are good; however, we concluded that although these tools are excellent for research purposes, they are difficult to apply in a school setting. Thus, teachers and coaches are advised to always select a single task from the available assessment tools that is appropriate for the skills they would like to measure.

Development and validation of a tool to assess the readiness of a clinical teaching site for interprofessional education (InSITE)

Interprofessional education within clinical teaching sites is a key part of training for pre-professional students. However, the necessary characteristics of these interprofessional clinical teaching sites is unclear. We developed a tool, the Interprofessional Education Site Readiness, or InSITE, tool, for individuals at a site to use as a self-assessment of the site's current readiness for providing interprofessional education. The tool progressed through six stages of development, collecting evidence for validity and reliability, resulting in a final tool with 23 questions distributed across five domains. Data from 94 respondents from a variety of national sites were used for the item analysis showing acceptable item-to-total correlations. Internal reliability testing gave a Cronbach's coefficient alpha of more than 0.70 for each group level comparison. Known groups validity testing provides strong evidence for its responsiveness in detecting differences in sites where IPE is implemented. The results of the testing lead us to conclude that the InSITE tool has acceptable psychometric properties. Additionally, we discovered that the process in which the InSITE tool was used demonstrated that it can facilitate learning in practice for the health professionals and can help make implicit, informal workplace learning and the hidden curriculum explicit.

Development and validation of GLVS (Generic Laparoscopic Video Scoring System), a tool for assessment of laparoscopic skills in gynaecology using videotaped procedures: Are edited videos representative of their full-length version?

Background

Anonymized videotaped endoscopic procedures can be used for the assessment of surgical competence, but a reliable non-procedure-specific scoring system is needed for gynaecology.

Objectives

To design and evaluate the validity of the Generic Laparoscopic Video Scoring System (GLVS), a novel tool in the assessment of various gynaecological laparoscopic procedures.

Materials and Methods

Seventeen anonymized unedited video recordings of various gynaecological laparoscopic procedures and the 4-minute-long edited versions of the same videos were independently scored by two experts, twice, using GLVS.

Main outcome measures

Internal consistency reliability, test-retest, and inter-rater reliability of GLVS. We also compared the scored achieved by edited videos with those of the full-length version of the same videos.

Results

The mean score achieved by 4-minute-long edited videos was similar to that of the unedited version (p= 0.13 - 0.19). There was excellent correlation between the pooled scores for edited and unedited versions (intra-class correlation coefficient = 0.86). GLVS had excellent internal consistency reliability (Cronbach's alpha 0.92-0.97). Test-retest and inter-rater reliability were generally better for edited 4-minute-long videos compared to their full-length version. Test-retest reliability for edited videos was excellent for scorer 1 and good for scorer 2 with intra-class correlation coefficient (ICC) of 0.88 and 0.62 respectively. Inter-rater reliability was good for edited videos (ICC=0.64) but poor for full-length versions (ICC= -0.24).

Conclusion

GLVS allows for objective surgical skills assessment using anonymized shortened self-edited videos of basic gynaecological laparoscopic procedures. Shortened video clips of procedures seem to be representative of their full-length version for the assessment of surgical skills.

What’s new?

We devised and undertook a validation study for a novel tool to assess surgical skills using surgical video clips. We believe this addition clearly delineates the unique contributions of our study.

Promoting active transport in rural communities through infrastructural modifications: the PABEM needs assessment tool

The design of the built environment in communities influences active transport and physical activity levels of citizens. Existing instruments for quantitatively assessing built environments were developed for use in urban areas and mainly by experts. Participative assessment of built environment modifications (PABEM) is a needs assessment tool that involves citizens and community decision-makers within a structured process for identifying needed changes to promote walking and cycling in rural areas. This article describes the development of the PABEM process and evaluates its initial use in three rural towns in Austria. PABEM consists of the following seven steps: (i) qualitative interviews; (ii) expert assessment of the built environment; (iii) citizen assessment of the built environment; (iv) social media interaction; (v) household questionnaire; (vi) participatory workshop; and (vii) evaluation and scoring workshop. The main modifications identified as necessary in rural towns were the revitalization of existing walking and cycling facilities and the construction of new barrier-free and safe sidewalks. In addition cycling routes to schools, to public transport facilities and to central public places as well as cleaner and inviting seating, a car-free school environment, speed reduction in town centres, more crosswalks and improved cleanliness in public places were also deemed necessary modifications. PABEM's provisions to ensure collaborative participation of citizens and local decision-makers fostered a continuous dialogue about the requirements of the built environment, user needs and opportunities for realization throughout the whole process.

NeoCheck: A New Checklist to Assess Performance during Newborn Life Support-A Validation Study

BACKGROUND

The aim of this study was to design and validate a new checklist and standardized scenario for assessing providers' performance during Newborn Life Support (NLS).

METHODS

We invited twelve experts in Neonatology to take part in a three-step Delphi process. They rated the importance of each item of a newly designed assessment tool to evaluate participants' performance during Newborn Life Support independently on a numeric rating scale from 1 to 5 (1 = lowest; 5 = highest) and were able to give additional comments. All items achieving a mean rating below four after the third round were deleted. For the reliability of the checklist, we calculated interrater reliability.

RESULTS

Using a standardized Delphi process, we revised the initial checklist according to the experts' ratings and comments. The final assessment tool includes 38 items covering all relevant steps during NLS. The mean expert rating of all items was 4.40. Interrater reliability showed substantial agreement between the two raters in the first draft (κ = 0.80) as well as in the final draft of the checklist (κ = 0.73).

CONCLUSION

We designed a feasible assessment tool for evaluating performance during NLS. We proved the checklist to be valid and reasonable using a Delphi validation process and calculating interrater reliability.

Development and validation of a new questionnaire to assess perceptions regarding DWELL: Design for WELLness

Designing home environments for health and wellness is a crucial strategy for disease prevention and health promotion. Yet, there is not a tool to evaluate perceptions regarding home design for health and wellness. This study aimed to develop and validate a new instrument to measure people's perceptions regarding the concept of DWELL: Design for WELLness in the home environment. We developed a short 5-item online questionnaire to detect changes in knowledge, awareness, engagement and self-efficacy regarding DWELL. The instrument was validated in an online study. Of the 613 mothers who answered the questionnaire initially, 397 answered the questionnaire a second time. Factor analysis and Cronbach's alpha indicated that all five DWELL questions load into one single factor (the model explained 61.84% of total variance), and measure a reliable scale of the same construct, with high levels of internal consistency (Cronbach's α = 0.85) at both first and second administrations. Spearman correlations between DWELL first and second administrations of the questionnaire indicated moderate-to-high test-retest reliability (0.55-0.70, p < 0.001). DWELL was found to be a valid tool which fills a gap in the public health literature. This measure serves as a free and convenient online instrument to gain insights regarding the effect of modifying environments for disease prevention and health promotion. The tool may be used to assess perceptions in the conditions leading wellness promotion in the home.

The development of a tool to assess medical students' non-technical skills - The Norwegian medical students' non-technical skills (NorMS-NTS)

PURPOSE

New physicians need to master non-technical skills (NTS), as high levels of NTS have been shown to increase patient safety. It has also been shown that NTS can be improved through training. This study aimed to establish the necessary NTS for Norwegian medical students to create a tool for formative and summative assessments.

METHODS

Focus group interviews were conducted with colleagues and patients of newly graduated physicians. Interviews were then analyzed using card sort methods, and the identified NTS were used to establish a framework. Focus groups commented on a prototype of an NTS assessment tool. Finally, we conducted a search of existing tools and literature. The final tool was developed based on the combined inputs.

RESULTS

We created Norwegian medical students' non-technical skills (NorMS-NTS) assessment tool containing four main categories; together comprising 13 elements and a rating scale for the NTS of the person observed.

CONCLUSIONS

The NorMS-NTS represents a purpose-made tool for assessing newly graduated physicians' NTS. It is similar to existing assessment tools but based on domain-specific user perspectives obtained through focus group interviews and feedback, integrated with results from a literature search, and with consideration of existing NTS tools.

The Chinese Version of the Breast Cancer Literacy Assessment Tool: Translation, Adaptation, and Validation Study

BACKGROUND

Breast cancer is the most common cancer among Chinese women, with an age-standardized prevalence of 21.6 cases per 100,000 women. Limited cancer health literacy reduces females' ability to engage in cancer prevention and detection. It is necessary to assess Chinese women's breast cancer literacy to deliver targeted interventions and effective education. However, there is no Breast Cancer Literacy Assessment Tool (B-CLAT) available in China currently.

OBJECTIVE

This study aimed to translate and linguistically and culturally adapt the B-CLAT into a simplified-Chinese version (C-B-CLAT), and then validate its psychometric properties by administering it to Chinese college students.

METHODS

First, we translated the B-CLAT into a simplified-Chinese version and verified its validity and reliability using rigorous translation and validation guidelines proposed in previous studies. We then evaluated the psychometric properties among 50 female participants with a mean age of 19.62 (SD 1.31) years recruited from Nantong University, China.

RESULTS

Items 1, 6, 8, 9, 10, 16, 17, 20, 21, 22, 23, 24, 25, 26, 29, and 30 were deleted to increase the relevant subscale internal consistency. Items 3, 12, 13, 14, 18, 20, 27, and 31 were deleted due to their Cronbach α being lower than .5 in the test-retest analysis. After deletion, the internal consistency of the entire scale was fair with α=.607. The prevention and control subscale had the highest internal consistency with α=.730, followed by the screening and knowledge subscale with α=.509, while the awareness subscale had the lowest internal consistency with α=.224. The intraclass correlation coefficient for the C-B-CLAT (items 2, 4, 5, 7, 11, 15, 28, 32, 33, and 34) was fair to excellent (odds ratio [OR] 0.88, 95% CI 0.503-0.808). The values of Cronbach α for items 2, 4, 5, 7, 11, 15, 28, 32, 33, and 34 ranged from .499 to .806, and the α value for the C-B-CLAT was .607. This indicates fair test-retest reliability. The mean difference in the C-B-CLAT scores between stage 1 and stage 2 was 0.47 (OR 0.67, 95% CI -0.53 to 1.47), which was not significantly different from zero (t₄₈=0.945; P=.35). This result implies that the C-B-CLAT produced the same scores at stage 1 and stage 2 on average, thus showing good agreement in the C-B-CLAT scores between stage 1 and stage 2. The SD of the difference was 3.48. The 95% limits of agreement were -6.34 to 7.28.

CONCLUSIONS

We developed a simplified-Chinese version of the B-CLAT through translation and adaptation. Psychometric properties testing has proven this version valid and reliable for assessing breast cancer literacy among Chinese college students.

Supporting reorientation of health services in Indigenous Australian communities: the health promotion systems assessment tool

Few tools and mechanisms exist to assist the reorientation of health services, especially in the Indigenous Australian health context; where improving health status and life expectancy is a priority. We developed a health promotion systems assessment tool (HPSAT) to provide health services with the information and support they need to drive health system change. Tool development occurred using a participatory, iterative approach that included a literature review, expert input by Indigenous and non-Indigenous stakeholders and annual group workshops in four Indigenous Australian primary health care (PHC) services. Four health system components: (i) organizational environment; (ii) service delivery systems; (iii) information systems and decision support; and (iv) adaptability and integration, form the framework of the tool. A scoring system monitors system change over time. The HPSAT provides a constructive framework to support health services to collectively assess and support reorientation in Indigenous Australian PHC services. Participation of key stakeholders with an intimate knowledge about the local context was pivotal in developing a user-friendly and fit-for-purpose tool. Maximum benefits of the tool are likely to be gained when used as part of a continuous quality improvement intervention.

Assessment Tools for the Evaluation of Simulation-Based Competency In Ultrasound-Guided Regional Anesthesia: An Integrative Review

Ultrasound-guided regional anesthesia (UGRA) requires the interaction of technical skills, manual dexterity, and cognitive knowledge which many novice anesthesia providers find challenging. Although simulation improves clinical competency and enhances patient safety, there is no standard tool for assessing UGRA competency in the simulation setting. Therefore, this integrative review aims to determine the most accurate, reliable, and feasible method of evaluating UGRA competency in a simulation environment. Strict inclusion and exclusion criteria were used to conduct this review, yielding 19 articles. The primary objective was the evaluation of validity and reliability outcomes of tools used to assess provider skill level. Secondary objectives were the evaluation of multirater agreement, internal and external reliability, and feasibility. Hand motion analysis and eye motion tracking demonstrated promising results, however, expense and training requirements limit widespread accessibility of those tools. The Regional Anesthesia Procedural Skills tool and McLeod checklist possessed discriminate ability of skill level, high interrater agreement, and feasibility in assessing psychometric competency in simulation. The Naik Global Rating Scale allows for assessment of nontechnical professional attributes. Based on the evidence of this review, the validity and reliability of these tools have the most utility as simulation-based competency tools compared with other tools reviewed.

Validation of the Parental Understanding and Misperceptions about BAby's Sleep Questionnaire using auto-videosomnography

BACKGROUND

Previous studies have suggested that parental cognitions about child's sleep may be an important factor underlying pediatric sleep problems. The current study aimed to (a) develop an assessment tool measuring parental understanding and misperceptions about baby's sleep (PUMBA-Q); (b) validate the questionnaire using self-report and objective sleep measures.

METHODS

There were 1,420 English-speaking caregivers (68.0% mothers, 46.8% of children being females, mean age 12.3 months), who has completed online self-reported questionnaires. The PUMBA-Q, which was developed for this study, Dysfunctional Beliefs and Attitudes about Sleep (DBAS) and Maternal Cognitions about Infant Sleep Questionnaire (MCISQ) were included to evaluate participant's thoughts on their own or child's sleep. Insomnia Severity Index (ISI) was collected to access participant's subjective insomnia severity. Brief Infant Sleep Questionnaire-Revised (BISQ-R) was used to assess parental-reported child sleep. Auto-videosomnography was used to record child's sleep.

RESULTS

Exploratory factor analysis indicated the best fit with a 4-factor model using 23 items (RMSEA = .039). The four subscales were labeled: (a) Misperceptions about parental intervention; (b) Misperceptions about feeding; (c) Misperceptions about child's sleep; and (d) General anxiety of parents. Internal consistency was adequate (Cronbach's alpha = .86). PUMBA-Q scores were significantly associated with MCISQ (r = .64, p < .01), DBAS (r = .36, p < .01), ISI (r = .29, p < .01), BISQ-R (r = .-49, p < .01), objective child's total sleep time (r = -.24, p < .01) and objective number of parental nighttime visits (r = .26, p < .01).

CONCLUSIONS

The results demonstrated that PUMBA-Q 23 is a valid assessment tool for parental cognitions of child sleep. The link between parental cognitions and child sleep highlights the importance of managing parental cognitions about child sleep when treating pediatric sleep problems.

Development and psychometric property testing of a Medical Device-related Pressure Injuries Knowledge and Practice Assessment Tool

AIMS

We aimed to develop and test the psychometric properties of a Medical Device-related Pressure Injuries Knowledge and Practice Assessment Tool.

BACKGROUND

Assessment of nurses' knowledge and practices is critical in the prevention of Medical Device-related Pressure Injuries.

DESIGN

This was an instrument development and testing study.

METHODS

The sample of the study consisted of nurses (n = 189). The study was conducted in three phases between January and February 2021. In the first phase, multiple-choice items contained within Aetiology/Risk Factors, Prevention Interventions, and Staging domains were created. In the second phase, content validity and criterion validity were evaluated, and the tool was pre-tested. The third phase examined item difficulty, discrimination index and distractor quality. The test-retest method was used for reliability.

RESULTS

The Content Validity Index was found to be 0.75, 0.86 and 0.96 for the domains of Aetiology/Risk Factors, Prevention and Staging, respectively. The item difficulty values of the items were between 0.18 and 0.96. A positive, strong and significant relationship was found between the results and a positive, moderate and significant relationship between the tools administered for the proof of scale validity. The Cronbach's alpha reliability coefficient was found to be 0.54.

CONCLUSIONS

The tool is a suitable measurement instrument for use in nursing education, research and clinical settings.

Exploratory Factor Analysis (EFA) of the Short Functional Geriatric Evaluation (SFGE) to Assess the Multidimensionality of Frailty in Community-Dwelling Older Adults

The Short Functional Geriatric Evaluation (SFGE) is a multidimensional and short questionnaire to assess biopsychosocial frailty in older adults. This paper aims to clarify the latent factors of SFGE. Data were collected from January 2016 to December 2020 from 8800 community-dwelling older adults participating in the "Long Live the Elderly!" program. Social operators administered the questionnaire through phone calls. Exploratory factor analysis (EFA) was carried out to identify the quality of the structure of the SFGE. Principal component analysis was also performed. According to the SFGE score, 37.7% of our sample comprised robust, 24.0% prefrail, 29.3% frail, and 9.0% very frail individuals. Using the EFA, we identified three main factors: psychophysical frailty, the need for social and economic support, and the lack of social relationships. The Kaiser-Meyer-Olkin measure of sampling adequacy was 0.792, and Bartlett's test of sphericity had a statistically significant result (p-value < 0.001). The three constructs that emerged explain the multidimensionality of biopsychosocial frailty. The SFGE score, 40% of which is social questions, underlines the crucial relevance of the social domain in determining the risk of adverse health outcomes in community-dwelling older adults.

Using Decision Trees as an Expert System for Clinical Decision Support for COVID-19

COVID-19 has impacted billions of people and health care systems globally. However, there is currently no publicly available chatbot for patients and care providers to determine the potential severity of a COVID-19 infection or the possible biological system responses and comorbidities that can contribute to the development of severe cases of COVID-19. This preliminary investigation assesses this lack of a COVID-19 case-by-case chatbot into consideration when building a decision tree with binary classification that was stratified by age and body system, viral infection, comorbidities, and any manifestations. After reviewing the relevant literature, a decision tree was constructed using a suite of tools to build a stratified framework for a chatbot application and interaction with users. A total of 212 nodes were established that were stratified from lung to heart conditions along body systems, medical conditions, comorbidities, and relevant manifestations described in the literature. This resulted in a possible 63,360 scenarios, offering a method toward understanding the data needed to validate the decision tree and highlighting the complicated nature of severe cases of COVID-19. The decision tree confirms that stratification of the viral infection with the body system while incorporating comorbidities and manifestations strengthens the framework. Despite limitations of a viable clinical decision tree for COVID-19 cases, this prototype application provides insight into the type of data required for effective decision support.

Postoperative Discharge Scoring Criteria After Outpatient Anesthesia: A Review of the Literature

PURPOSE

The aim of this review was to explore the existing literature on discharge criteria, tools and strategies used in the postanesthesia care unit (PACU) after ambulatory surgery and to identify the essential components of an effective and feasible scoring system based on applicable criteria for the three phases of anesthesia recovery to assess patient discharge after outpatient anaesthesia.

DESIGN

A review of the literature.

METHODS

In this study, a review of sixteen articles was conducted to analyze the affecting factors, evaluation tools, and the current research status of patients discharge after outpatient anesthesia.

FINDINGS

The main factors affecting the discharge after diagnostic or therapeutic procedures under outpatient anesthesia were hospital management, medical treatment and patients themselves. Physiological systems-based discharge assessment had several advantages over traditional time-based discharge assessment. The Aldrete scoring scale was often used for patients in the first stage of anesthesia recovery to leave the PACU, and the Chung's scoring scale was often used to evaluate patients in the second stage of recovery until they leave the hospital. These two scales were often used in combination for outpatient anesthesia. The Fast-tracking assessment tool was used in patients who directly returned to the ward or discharge of patients after ambulatory surgery. There is currently no uniform standard or tool for assessing patients discharge after diagnostic or therapeutic procedures under the outpatient anesthesia.

CONCLUSIONS

Optimal care under anesthesia should allow the patient to recover from anesthesia smoothly and quickly and leave the hospital safely. When the patients can safely leave the hospital after outpatient anesthesia is still a problem that needs to be solved in the nursing field. Various existing scoring systems have their historical advancements, but we need to formulate more in line with the current status of postoperative patients discharge standards.

Differentiating Use of Facial Expression between Individuals with and without Traumatic Brain Injury Using Affectiva Software: A Pilot Study

This study investigated the feasibility of using an automated facial coding engine, Affectiva (integrated in iMotions, version 8.2), for evaluating facial expression after traumatic brain injury (TBI). An observational cross-sectional study was conducted based on facial expression data from videos of participants with TBI and control participants. The aims were to compare TBI and control groups, and identify confounding factors affecting the data analysis. Video samples of two narrative tasks (personal event and story retell) from ten participants with severe TBI and ten control participants without TBI were analyzed using Affectiva. Automated data on participants' engagement, smile and brow furrow were compared statistically between and within groups. Qualitative notes for each sample were also recorded. Affectiva detected a higher percentage of time of engagement for TBI participants than for control participants on both tasks. There was also a higher percentage of time of smiling for TBI participants in one task. Within groups, there were no significant differences between the two narrative tasks. Affectiva provides standardized data about facial expression and may be sensitive to detecting change in the use of facial expression after TBI. This study also identified factors to avoid during videorecording to ensure high quality samples for future research.

Development and Validation of Social-Cognitive Theory Based Oral Cancer Awareness Assessment Tool for Adolescents

Introduction

Creating oral cancer awareness among adolescents will bring change by modifying the risk factors responsible for oral cancer. Social cognitive theory (SCT) is one promising theory for developing oral cancer awareness programmes among school adolescents. However, data are limited on SCT-based intervention assessment in creating oral cancer awareness among rural community. To develop and validate a SCT-based Oral Cancer Awareness (SCT-OCA) assessment/survey tool for evaluation of intervention implementation.

Material and Methods

A mixed method design encompassing both qualitative and quantitative was accomplished to develop and validate the assessment tool for rural setting.

Methods and Material

Domains and items for SCT-OCA assessment tool for adolescents were selected using subject matter expert. A 21-item assessment tool was developed using three rounds of Delphi technique and validated using Lawshe method. The knowledge on oral cancer and its risk factors and key constructs of social-cognitive theory was selected as items of the tool. The final assessment tool was translated to regional language, which was used for evaluation of intervention implementation. Statistical analysis was conducted using SPSS, version 16. Descriptive statistics includes means, standard deviations and frequency. Validation using Lawshe, component factor analysis and Cronbach alpha coefficients were calculated.

Results

The overall content validity ratio was agreeable, and 21 items were finally selected in assessment tool. The overall Cronbach's alphas of 0.718 for survey was acceptable. The agreement was good for the domains of tool.

Conclusions

This study developed the SCT-OCA assessment tool for intervention specifically designed for adolescents to measure oral cancer awareness.

Development of a procedure-specific tool for skill assessment in left- and right-sided laparoscopic complete mesocolic excision

AIM

To (1) develop an assessment tool for laparoscopic complete mesocolic excision (LCME) and (2) report evidence of its content validity.

METHOD

Assessment statements were revealed through (1) semi-structured expert interviews and (2) consensus by the Delphi method, both involving an expert panel of five LCME surgeons. All experts were interviewed and then asked to rate LCME describing statements from 1 (strongly disagree) to 5 (strongly agree). Responses were returned anonymously to the panel until consensus was reached. Statements were directly included as content in the assessment tool if ≥60% of the experts responded "agree" or "strongly agree" (ratings 4 and 5), with the remaining responses being "neither agree nor disagree" (rating 3). Interclass correlation coefficient (ICC) was calculated for expert agreement evaluation. All included statements were subsequently reformulated as tool items and approved by the experts.

RESULTS

Four Delphi rounds were performed to reach consensus. Disagreement was reported for statements describing instrument handling around pancreas; visualisation of landmarks before inferior mesenteric artery ligation; lymphadenectomy around the inferior mesenteric artery, and division of the terminal ileum and transverse colon. ICC in the last Delphi-round was 0.84. The final tool content included 73 statements, converted to 48 right- and 40 left-sided items for LCME assessment.

CONCLUSION

A procedure-specific, video-based tool, named complete mesocolic excision competency assessment tool (CMECAT), has been developed for LCME skill assessment. In the future, we hope it can facilitate assessment of LCME surgeons, resulting in improved patient outcome after colon cancer surgery.

The Development of the Innovation Readiness Inventory: An Assessment Tool to Assess Innovation Readiness of Nursing Organizations

Nursing organizations are expected to make contributions to innovation in Healthcare. However, they are often not innovation ready. How do nursing organizations know how Innovation Ready they are? What should nursing organizations do to become more Innovation Ready? In literature, there exists no consolidated resource to help nursing organizations to answer these questions. Therefore, this research aimed to support nurse-led innovation by developing an Innovation Readiness Inventory to be used as an assessment tool to qualitatively assess the innovation readiness of nursing organizations and support decision-making on actions to be implemented towards innovation readiness. The researchers performed a literature review to provide the theoretical basis for the assessment tool. Thereafter, the researchers engaged innovation experts and end-users in the form of nurse directors and managers, and frontline nurses. The researchers conducted semi-structured interviews, surveys, and design workshops and performed directed qualitative content analysis where relevant. Throughout, emphasis was placed on the scientific rigor of the research methodology with the intent to ensure the "trustworthiness" of the outcomes. To this end, the researchers implemented published best practices, when relevant and appropriate. As contribution to the discussion around nurse-led innovation, this research delivers the innovation readiness inventory that focusses the discussion on nursing organizations and the nurses within, and discusses challenges and opportunities related to the use thereof.

Assessing and Promoting Cardiovascular Health for Adolescent Women: User-Centered Design Approach

BACKGROUND

Cardiovascular disease (CVD) is the leading cause of death among women in the United States. A considerable number of young women already have risk factors for CVD. Awareness of CVD and its risk factors is critical to preventing CVD, yet younger women are less aware of CVD prevalence, its risk factors, and preventative behaviors compared to older women.

OBJECTIVE

The purpose of this study is to assess CVD awareness among adolescent and young adult women and develop a lifestyle-based cardiovascular risk assessment tool for the promotion of CVD awareness among this population.

METHODS

This study used a 3-phase iterative design process with young women and health care practitioners from primary care and reproductive care clinics in Atlanta, Georgia. In phase 1, we administered a modified version of the American Heart Association Women's Health Survey to young women, aged 15-24 years (n=67), to assess their general CVD awareness. In phase 2, we interviewed young women, aged 13-21 years (n=10), and their health care practitioners (n=10), to solicit suggestions for adapting the Healthy Heart Score, an existing adult cardiovascular risk assessment tool, for use with this age group. We also aimed to learn more about the barriers and challenges to health behavior change within this population and the clinical practices that serve them. In phase 3, we used the findings from the first 2 phases to create a prototype of a new online cardiovascular risk assessment tool designed specifically for young women. We then used an iterative user-centered design process to collect feedback from approximately 105 young women, aged 13-21 years, as we adapted the tool.

RESULTS

Only 10.5% (7/67) of the young women surveyed correctly identified CVD as the leading cause of death among women in the United States. Few respondents reported having discussed their personal risk (4/67, 6%) or family history of CVD (8/67, 11.9%) with a health care provider. During the interviews, young women reported better CVD awareness and knowledge after completing the adult risk assessment tool and suggested making the tool more teen-friendly by incorporating relevant foods and activity options. Health care practitioners emphasized shortening the assessment for easier use within practice and discussed other barriers adolescents may face in adopting heart-healthy behaviors. The result of the iterative design process was a youth-friendly prototype of a cardiovascular risk assessment tool.

CONCLUSIONS

Adolescent and young adult women demonstrate low awareness of CVD. This study illustrates the potential value of a cardiovascular risk assessment tool adapted for use with young women and showcases the importance of user-centered design when creating digital health interventions.

Investigating the interaction between neuropsychiatry features and daily activities on social function in patients with Parkinson's disease with mild cognitive impairment

BACKGROUND

Social functioning is crucial for daily living and is an essential indicator of dementia in patients with Parkinson's disease. The pattern of social functioning in patients with Parkinson's disease without dementia (i.e. those who are cognitively intact or have mild cognitive impairment (PD-MCI)) and its determinants are unclear.

AIMS

In exploring the heterogeneity of social functioning among patients with Parkinson's disease-associated dementia, we determined the optimal cut-off score of the Parkinson's Disease Social Functioning Scale (PDSFS) for patients with PD-MCI, and the variables influencing patients' social functioning.

METHOD

A total of 302 participants underwent the Mini-Mental State Examination (MMSE) and PDSFS; 120 patients with Parkinson's disease completed the measurements (MMSE, Activities of Daily Living Scale and Neuropsychiatric Inventory). Group comparisons, receiver operating characteristic curves, Spearman correlation and multiple and hierarchical regression analyses were conducted.

RESULTS

The PD-MCI group scored the lowest on the PDSFS (F = 10.10, P < 0.001). The PDSFS cut-off score was 53 (area under the curve 0.700, sensitivity 0.800, specificity 0.534). The MMSE (β = 0.293, P = 0.002), Activities of Daily Living Scale (β = 0.189, P = 0.028) and Neuropsychiatric Inventory (β = -0.216, P = 0.005) scores predicted the PDSFS score. Further, there was an interaction effect between the Activities of Daily Living Scale and Neuropsychiatric Inventory scores on the PDSFS score (β = 0.305, P < 0.001).

CONCLUSIONS

We determined a PDSFS cut-off score for detecting PD-MCI and found that patients with PD-MCI have social dysfunction. Future research should focus on the effects of neuropsychiatry symptoms and activities of daily living on social functioning, and tailor the intervention programme for patients with Parkinson's disease.

An Assessment Tool to Provide Targeted Feedback to Robotic Surgical Trainees: Development and Validation of the End-To-End Assessment of Suturing Expertise (EASE)

Purpose

To create a suturing skills assessment tool that comprehensively defines criteria around relevant sub-skills of suturing and to confirm its validity.

Materials and Methods

5 expert surgeons and an educational psychologist participated in a cognitive task analysis (CTA) to deconstruct robotic suturing into an exhaustive list of technical skill domains and sub-skill descriptions. Using the Delphi methodology, each CTA element was systematically reviewed by a multi-institutional panel of 16 surgical educators and implemented in the final product when content validity index (CVI) reached ≥0.80. In the subsequent validation phase, 3 blinded reviewers independently scored 8 training videos and 39 vesicourethral anastomoses (VUA) using EASE; 10 VUA were also scored using Robotic Anastomosis Competency Evaluation (RACE), a previously validated, but simplified suturing assessment tool. Inter-rater reliability was measured with intra-class correlation (ICC) for normally distributed values and prevalence-adjusted bias-adjusted Kappa (PABAK) for skewed distributions. Expert (≥100 prior robotic cases) and trainee (<100 cases) EASE scores from the non-training cases were compared using a generalized linear mixed model.

Results

After two rounds of Delphi process, panelists agreed on 7 domains, 18 sub-skills, and 57 detailed sub-skill descriptions with CVI ≥ 0.80. Inter-rater reliability was moderately high (ICC median: 0.69, range: 0.51-0.97; PABAK: 0.77, 0.62-0.97). Multiple EASE sub-skill scores were able to distinguish surgeon experience. The Spearman's rho correlation between overall EASE and RACE scores was 0.635 (p=0.003).

Conclusions

Through a rigorous CTA and Delphi process, we have developed EASE, whose suturing sub-skills can distinguish surgeon experience while maintaining rater reliability.

Development of an Assessment Scale for the Risk of Falling in Pregnant Women

Introduction

In pregnant women, the rate of falling is similar to that of women older than 70 years. According to the literature review, there is no risk of falling assessment tool that is specific to pregnancy. The aim of the study was to develop a risk of falling assessment scale for pregnant women.

Methods

This is a methodological study. The study's population consisted of pregnant women who sought follow-up care at a state hospital's maternity ward between November 2016 and November 2017. The study sample included 630 pregnant women who met the inclusion criteria and volunteered for the study. The Pregnant Women Information Form and Assessment Scale for Risk of Falling in Pregnant Women were used as data collection tools.

Results

During the scale development process, an item pool draft of 63 questions was developed and submitted to 10 experts for feedback. The findings of the content validity analysis revealed that the average of the items was 0.95, validity was good, and the number of items on the scale was reduced to 42 according to the experts' suggestions. The Cronbach α coefficient of the scale was found to be 0.604 (moderately reliable). It was discovered that the CART and QUEST algorithms on the scale were successful models for estimating the status of falls in pregnant women.

Conclusion

A 42-item assessment scale for the risk of falling in pregnant women was developed, and it was determined that the scale was a valid and reliable tool.

Evaluation of a nausea assessment tool in the pediatric oncology population

PURPOSE

Nausea is a symptom that is often experienced but misunderstood. Its impact is amplified in pediatric oncology patients. Nausea assessments in pediatric oncology are few and not yet widely used. The Baxter Retching Faces (BARF) scale holds promise and is used in some pediatric oncology units. The purpose of this evidence-based practice project was to evaluate the impact of the BARF scale on nursing assessments in inpatient pediatric hematology/oncology and stem cell transplant settings.

CONCLUSIONS

Project work took place on one hematology/oncology unit and one stem cell transplant unit. Thirty nurses completed the acceptability of intervention measure (AIM), intervention appropriateness measure (IAM), and feasibility of intervention measure (FIM) to provide initial feedback on the BARF scale. Nurses used the BARF scale over an 8-week period. Patient demographics and BARF scores were collected during nausea assessments. Twenty nurses completed AIM/IAM/FIM scores postintervention. There were no significant changes in scores, though nurses stated that the tool was easy to use and provided valuable symptom feedback.

PRACTICE IMPLICATIONS

Symptom management will continue to be a challenge in the pediatric setting given developmental and disease-specific considerations inherent to the specialty. While this small-scale project did not achieve statistical significance, the evidence and feedback from nursing staff present a compelling case that efforts to investigate and integrate improved methods of assessing nausea and other problematic symptoms are needed to enhance nursing practice and impact patient-centered outcomes.

Can virtual-reality simulation ensure transthoracic echocardiography skills before trainees examine patients?

OBJECTIVES

This study aimed to develop and gather the validity evidence for a standardised simulation-based skills test in transthoracic echocardiography and to establish a credible pass/fail score.

METHODS

Experts developed a virtual-reality simulator test in cardiology, medical education and simulation-based education. Thirty-six physicians with different experiences in transthoracic echocardiography completed the test at Odense University Hospital, Denmark. The performances of novice, intermediate and experienced participants were compared using the Bonferroni post hoc test. Cronbach's alpha was used to determine the internal consistency reliability of the test. The consistency of performance was analysed using the intraclass correlation coefficient. A pass/fail score was established using the contrasting groups' standard-setting method.

RESULTS

We developed a test with high consistent reliability (Alpha = .81), 95% CI [.69, .89]. In both cases, the performers' level was consistent, fitting others at the same level of experience (intraclass correlation r₍₃₅₎=.81, p<.001). A pass/fail score of 48/50 points was established based on the mean test score of novice and experienced physicians.

CONCLUSIONS

We developed a standardised virtual-reality simulation-based test of echocardiography skills with the ability to distinguish between participants with different levels of transthoracic echocardiography experience. This test could direct a mastery learning training program where trainees practise until they reach the pre-defined level and secure a higher level of competency to ensure quality and safety for patients.

Development and Validation of the Chinese Frailty Screening Scale: A Study among Community-Dwelling Older Adults in Shanghai

BACKGROUND

Based on intrinsic capacity (IC) as defined by the World Health Organization, an accelerated decline may be an important precursor of frailty among older adults; however, there is a lack of validated instruments that both screen for frailty and monitor IC. This study aims to develop a comprehensive and acculturative frailty screening scale to determine healthy aging among older Chinese adults.

SETTING AND PARTICIPANTS

A cross-sectional and a cohort study both based on community-dwelling older adults aged 65 and older.

METHODS

This study mainly consisted of two parts. First, the selection and revision of 20 items related to frailty based on a literature review, expert consultation, and stakeholder analysis; second, a cross-sectional study was conducted to simplify the scale and test the reliability and validity of the new frailty screening tool. The fatigue, resistance, ambulation, illness, and loss of weight (FRAIL) scale, the Tilburg frailty indictor (TFI), and a 49-item Frailty Index (FI) were investigated as criteria. Additionally, a cohort study in Shanghai was conducted to verify the predictive validity of the new screening scale. The disability measured by the activity of daily living (ADL), instrumental activity of daily living (IADL) and all-cause mortality were documented as outcomes.

RESULTS

A 10-item Chinese frailty screening scale (CFSS-10) was successfully developed and validated. It presented a Cronbach's α of 0.63 and an intraclass correlation coefficient of 0.73, which indicated good reliability. Taking the other frailty tools as criteria, Kappa values of 0.54-0.58 and an area under the curve of 0.87-0.91 showed good validity. The results of the log-binomial and Poisson models showed a high score, which predicted a higher risk of disability and all-cause mortality. An optimal cut-off point of 5 gave an excellent prediction of one-year disability.

CONCLUSIONS

The CFSS-10 has good validity and reliability as a quick and acculturative frailty screening scale for community-dwelling older adults in Shanghai. It may also supplement existing frailty screening tools.

Using a grey relational analysis in an improved Grunow-Finke assessment tool to detect unnatural epidemics

The Grunow-Finke epidemiological assessment tool (GFT) has several limitations in its ability to differentiate between natural and man-made epidemics. Our study aimed to improve the GFT and analyze historical epidemics to validate the model. Using a gray relational analysis (GRA), we improved the GFT by revising the existing standards and adding five new standards. We then removed the artificial weights and final decision threshold. Finally, by using typically unnatural epidemic events as references, we used the GRA to calculate the unnatural probability and obtain assessment results. Using the advanced tool, we conducted retrospective and case analyses to test its performance. In the validation set of 13 historical epidemics, unnatural and natural epidemics were divided into two categories near the unnatural probability of 45%, showing evident differences (p < 0.01) and an assessment accuracy close to 100%. The unnatural probabilities of the Ebola virus disease of 2013 and Middle East Respiratory Syndrome of 2012 were 30.6% and 36.1%, respectively. Our advanced epidemic assessment tool improved the accuracy of the original GFT from approximately 55% to approximately 100% and reduced the impact of human factors on these outcomes effectively.

Development of Principles for Health-Related Information on Social Media: Delphi Study

Background

Health-related misinformation can be propagated via social media and is a threat to public health. Several quality assessment tools and principles to evaluate health-related information in the public domain exist; however, these were not designed specifically for social media.

Objective

This study aims to develop Principles for Health-related Information on Social Media (PRHISM), which can be used to evaluate the quality of health-related social media content.

Methods

A modified Delphi approach was used to obtain expert consensus on the principles and functions of PRHISM. Health and social media experts were recruited via Twitter, email, and snowballing. A total of 3 surveys were administered between February 2021 and May 2021. The first survey was informed by a literature review and included open-ended questions and items from existing quality assessment tools. Subsequent surveys were informed by the results of the proceeding survey. Consensus was deemed if ≥80% agreement was reached, and items with consensus were considered relevant to include in PRHISM. After the third survey, principles were finalized, and an instruction manual and scoring tool for PRHISM were developed and circulated to expert participants for final feedback.

Results

A total of 34 experts consented to participate, of whom 18 (53%) responded to all 3 Delphi surveys. In total, 13 principles were considered relevant and were included in PRHISM. When the instructions and PRHISM scoring tool were circulated, no objections to the wording of the final principles were received.

Conclusions

A total of 13 quality principles were included in the PRHISM tool, along with a scoring system and implementation tool. The principles promote accessibility, transparency, provision of authoritative and evidence-based information and support for consumers’ relationships with health care providers. PRHISM can be used to evaluate the quality of health-related information provided on social media. These principles may also be useful to content creators for developing high-quality health-related social media content and assist consumers in discerning high- and low-quality information.

The suitability and usability of a tool to assess contact status from COVID-19 exposures in the workplace

OBJECTIVE

To assess the usability of a self-assessment COVID-19 exposure tool for workplaces.

METHODS

A COVID-19 exposure tool for workplaces was developed using five risk criteria. Public Health Unit (PHU) assessors who administered the tool documented when they administered the tool, the time taken for finalisation of the assessment and ease of administration. The System Usability Scale was used for workplace managers' perceptions on tool use. Data were assessed using both quantitative and qualitative analysis.

RESULTS

Eighty-four workplaces used the tool to assess COVID-19 exposure risk. Of those, the outcome provided by the tool did not require modification by the PHU assessor in 70% of workplaces. Eighty per cent of the assessments were completed by the next day. PHU assessors rated the overall ease of administration of the tool as 'easy' or 'very easy' for 85% of workplaces and indicated they would employ the tool across a number of settings including complex workplaces. The mean System Usability Scale was 82. Workplace managers were predominately positive regarding its suitability.

CONCLUSION

The tool provides an easy-to-use assessment of SARS-CoV-2 exposure in the workplace.

IMPLICATIONS FOR PUBLIC HEALTH

The tool's adoption will empower workplace managers and improve the capacity of public health units to prevent further transmission of SARS-CoV-2 in workplaces.

Development of Leisure Valuation Assessment Tool for the Elderly

This study aimed to develop a leisure valuation assessment tool to revitalize leisure activities for the elderly living in the community. The research method, literature review, and Delphi survey were conducted for the expert panel. Then, the leisure value and participatory leisure activity items were derived to form the assessment items. The two Delphi surveys revealed 38 leisure value assessment items and 41 participating leisure activity items. We attempted to verify the model suitability and validity of the leisure value assessment items through confirmatory factor analysis. The verification showed a good fit. Based on the intensive validity test result, AVE (average variance extracted) values were 66 for physical leisure activities, 65 for emotional leisure activities, and 65 for social leisure activities. The conceptual reliability was 0.96 for physical leisure activities, 0.95 for emotional leisure activities, and 0.96 for social leisure activities. Regarding the internal consistency for reliability verification, Cronbach’s alpha values for physical leisure, emotional leisure, and social leisure activities were 0.909, 0.925, and 0.955, respectively. Hence, the items were highly interrelated and homogeneous tests that measured the same characteristics. The assessment tool can be used to identify useful information on the leisure activities of the elderly and to activate leisure activities for the elderly.

Care partner needs of people with neurodegenerative disorders: What are the needs, and how well do the current assessment tools capture these needs? A systematic meta-review

OBJECTIVES

The burden on care partners, particularly once dementia emerges, is among the greatest of all caregiving groups. This meta-review aimed to (1) synthesis evidence on the self-reported needs of care partners supporting people living with neurodegenerative disorders; (2) compare the needs according to care partner and care recipient characteristics; and (3) determine the face validity of existing care partner needs assessment tools.

METHODS

We conducted a systematic review of reviews involving a thematic synthesis of care partner needs and differences in needs according to demographic and other characteristics. We then conducted a gap analysis by identifying the themes of needs from existing needs assessment tools specific to dementia and cross-matching them with the needs derived from the thematic synthesis.

RESULTS

Drawing on 17 published reviews, the identified range of needs fell into four key themes: (1) knowledge and information, (2) physical, social and emotional support, (3) care partner self-care, and (4) care recipient needs. Needs may differ according to disease trajectory, relationship to the care recipient, and the demographic characteristics of the care partner and recipient. The 'captured needs' range between 8% and 66% across all the included needs assessment tools.

CONCLUSIONS

Current tools do not fully or adequately capture the self-identified needs of care partners of people living with neurodegenerative disorders. Given the high burden on care partners, which has been further exacerbated by the COVID-19 (SARS CoV-2) pandemic, the needs assessment tools should align with the self-reported needs of care partners throughout the caregiving trajectory to better understand unmet needs and target supportive interventions.

A New Academic Quality at Work Tool (AQ@workT) to Assess the Quality of Life at Work in the Italian Academic Context

The present study provides evidence for a valid and reliable tool, the Academic Quality at Work Tool (AQ@workT), to investigate the quality of life at work in academics within the Italian university sector. The AQ@workT was developed by the QoL@Work research team, namely a group of expert academics in the field of work and organizational psychology affiliated with the Italian Association of Psychologists. The tool is grounded in the job demands-resources model and its psychometric properties were assessed in three studies comprising a wide sample of lecturers, researchers, and professors: a pilot study (N = 120), a calibration study (N = 1084), and a validation study (N = 1481). Reliability and content, construct, and nomological validity were supported, as well as measurement invariance across work role (researchers, associate professors, and full professors) and gender. Evidence from the present study shows that the AQ@workT represents a useful and reliable tool to assist university management to enhance quality of life, to manage work-related stress, and to mitigate the potential for harm to academics, particularly during a pandemic. Future studies, such as longitudinal tests of the AQ@workT, should test predictive validity among the variables in the tool.

Building a Health Literacy Indicator from Angola Demographic and Health Survey in 2015/2016

Health literacy is a determinant factor for population health. It is important both for the prevention of health problems and the better management of those problems and unexpected situations that happen. Low health literacy has been consistently associated with poor health outcomes. This study aimed to develop a health literacy indicator for Angola and to analyze pertinent demographic characteristics related to it. Data were obtained from the first Angola Demographic and Health Survey conducted in 2015/16; we included 10 questions related to the American National Academy of Medicine definition of health literacy. Using factor analysis, we extracted one i indicator corresponding to four dimensions of health literacy. The indicator was dichotomized, and we used Logistic Regression to estimate factors associated with health literacy level: we obtained data from 19,785 adolescents and adults, aged 15–49 years. The internal consistency of the i indicator was reliable (Cronbach’s α  =  0.83). Adjusting for other variables, males with complete secondary education or above and living in urban areas were more likely to have a high level of health literacy. There were substantial differences between the 18 regions. This is the first study evaluating health literacy in Angola using the American National Academy of Medicine definition and a Demographic and Health survey. Our study shows unfavorable results for women, individuals living in rural areas and those less educated.

Tapping the Potential of Resilience to Support an Integrated and Person-Centred Approach to Health and Wellbeing-Developing a Simple Assessment Tool for Practice

(1) Background: The push towards population health management and the need for new approaches in health services delivery focusing on the prevention and management of chronic diseases has helped in advocating for more person-centred care, and thus for integration of physical and mental health. Resilience plays a key role in supporting sustainable lifestyle changes and promoting health and wellbeing, but most assessment tools available today are too long for widespread use. The purpose of this paper is to describe the development of a new diagnostic tool to capture a person's resilience and resources. (2) Methods: This paper outlines the interrelatedness of different theories of salutogenesis, social determinants of health and health promotion with resilience and establishes resilience as a key enabler to promote health and wellbeing. (3) Results: A new, short questionnaire is proposed based on the triade of evidence-based medicine, which should be easy to use and give a good assessment of a person's resilience. (4) Conclusions: There are many reasons why the call for a short and easy-to-use assessment tool for resilience is warranted. In view of the international transition towards integrated, person-centred health systems, such a tool would find many usages. It would also support the strategies to tackle multi-morbidity, complex conditions and the social determinants of health in its focus on strengthening an individual's ability to cope with adverse events, and actively engage in health promotion and community involvement programmes. The next step is to test the tool in practice and validate it.

Validation and Reliability of the Japanese Version of the Modified Parkinson Activity Scale (M-PAS)

Objective:

The Modified Parkinson Activity Scale (M-PAS) is used to identify the most important activity limitations in patients with Parkinson’s disease. We developed a Japanese version of the M-PAS and evaluated its reliability and validity.

Methods:

Twenty-five patients with Parkinson’s disease (median age 71 years old, range 58–83) were enrolled, and two raters used the Japanese version of M-PAS to assess the subjects. The inter-rater reliability was evaluated using Cohen’s weighted kappa coefficient for the total score and three domain scores; systematic error was investigated using Bland-Altman analysis. Concurrent validity of the Japanese M-PAS was measured using Spearman’s rank correlation coefficients.

Results:

Cohen’s kappa coefficients for the total score and the three domain scores were in the range 0.81–0.98, and 95% confidence intervals included zero for each item, suggesting excellent agreement and no systematic errors. The scores of the Japanese version of M-PAS were significantly correlated with the scores of the Movement Disorder Society–Unified Parkinson’s Disease Rating Scale Part II (Spearman’s rho=–0.56, P <0.01) and Part III (Spearman’s rho=–0.32, P <0.01). The percentage of patients with the highest and the lowest scores in the Japanese version of M-PAS suggested no ceiling or floor effects.

Conclusion:

The Japanese version of M-PAS showed excellent inter-rater reliability and good concurrent validity without ceiling or floor effects.

Assessing Older Community Members Using a Social Work Tool: Developing an Organizational Response

Social Worker’s undertake psycho-social assessments and facilitate access to evidence-informed psychological and practical supports to optimize the physical, psychological, and social wellbeing of the community members in their care. Social workers employed at an aged and community care organization undertook a review of the gray and peer reviewed literature and did not identify any existing evidence-based tools. However, 10 key domains were identified from the search. Gaps in the domains were discovered, together with the need for guidance and prompts for less experienced staff and students. Five Social Workers, using co-design principles, reviewed the domains, and added further domains from their social work practice. An evidence-based assessment tool was developed which incorporated 11 domains. The tool can be used to assess the needs of people living in the community who are older and/or have compromised health and wellbeing. Further work is required to pilot test the tool.