Assessing behaviour support plans for people with intellectual disability before and after the Victorian Disability Act 2006

Can the Behaviour Intervention Plan Quality Evaluation, Version 2, be simplified for use by stakeholders with limited experience of positive behaviour support?

BACKGROUND

Behaviour support plan (BSP) quality auditing tools like the Behaviour Intervention Plan Quality Evaluation, Version 2 (BIPQEII), assess the quality of a BSP from the perspective of technical compliance with behavioural principles. However, these principles may be inaccessible to interested stakeholders with limited experience and knowledge of positive behaviour support (PBS). The aim of this study was to test if a simplified version of the BIPQEII [the Behaviour Support Plan Audit Tool (BSPA-tool)] offers a reliable and valid assessment of a BSP's technical compliance with behavioural principles when used by professional stakeholders with varying levels of PBS experience and knowledge.

METHODS

Four scorers rated 50 de-identified BSPs using the BSPA-tool, with one scorer also rating the BSPs using the BIPQEII. Four weeks later, each scorer rated 25 of the 50 BSPs again using the BSPA-tool. Prior to BSP scoring, a group of PBS practitioners provided feedback on the BSPA-tool's content validity.

RESULTS

The BSPA-tool was found to have acceptable content and parallel-form validity; however, acceptable internal consistency and inter-rater and intra-rater reliability were dependent on PBS experience/knowledge, that is, scorers with more experience/knowledge achieved more acceptable levels of reliability.

CONCLUSIONS

This study confirms that even with simplification, BSP quality auditing tools based on technical compliance with behavioural principles are still only accessible to stakeholders with extensive experience/knowledge of PBS. To engage less-experienced stakeholders in BSP quality auditing processes, new audit tools need to be developed that focus on other aspects of BSP quality (e.g. readability and consultation).

Reliability and utility of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII) for auditing and quality development in services for adults with intellectual disability and challenging behaviour

BACKGROUND

Having an objective means of evaluating the quality of behaviour support plans (BSPs) could assist service providers and statutory authorities to monitor and improve the quality of support provided to people with intellectual disability (ID) who exhibit challenging behaviour. The Behaviour Support Plan Quality Evaluation Guide II (BSP-QEII) was developed to monitor and assess BSPs prepared by teachers to support children with disability in the school system. This study investigated the application of the BSP-QEII to the assessment of BSPs for adults with ID in community support services.

METHOD

The inter-rater reliability of the BSP-QEII was assessed. The utility of the BPS-QEII was then investigated with reference to a time series study of matched pairs of BSPs, developed for the same clients over a period of approximately 3 years. Differences in plan quality measured across a number of service and systemic variables were also investigated.

RESULTS

The BSP-QEII was found to have good inter-rater reliability and good utility for audit purposes. It was able to discriminate changes in plan quality over time. Differences in plan quality were also evident across different service types, where specialist staff had or had not been involved, and in some instances where a statutory format for the plan had or had not been used. There were no differences between plans developed by government and community sector agencies, nor were there any regional differences across the jurisdiction.

CONCLUSIONS

The BSP-QEII could usefully be adopted as an audit tool for measuring the quality of BSPs for adults with ID. In addition to being used for research and administrative auditing, the principles underpinning the BSP-QEII could also be useful to guide policy and educational activities for staff in community based services for adults with ID.

The content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII) and its potential application in accommodation and day-support services for adults with intellectual disability

BACKGROUND

The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide the development of BSPs for children in school settings, and evaluated its application for use in accommodation and day-support services for adults with intellectual disability.

METHOD

A three-round Delphi study involving a purposive sample of experienced behaviour support practitioners (n = 30) was conducted over an 8-week period. The analyses included deductive content analysis and descriptive statistics.

RESULTS

The 12 quality domains of the BSP-QEII were affirmed as valid for application in adult accommodation and day-support service settings. Two additional quality domains were suggested, relating to the provision of detailed background on the client and the need for plans to reflect contemporary service philosophy. Furthermore, the results suggest that some issues previously identified in the literature as being important for inclusion in BSPs might not currently be a priority for practitioners. These included: the importance of specifying replacement or alternative behaviours to be taught, descriptions of teaching strategies to be used, reinforcers, and the specification of objective goals against which to evaluate the success of the intervention programme.

CONCLUSIONS

The BSP-QEII provides a potentially useful framework to guide and evaluate the development of BSPs in services for adults with intellectual disability. Further research is warranted to investigate why practitioners are potentially giving greater attention to some areas of intervention practice than others, even where research has demonstrated these others areas of practice could be important to achieving quality outcomes.

A preliminary investigation of the utility of the "Behavior Support Plan Quality Evaluation Guide II" for use in Australia

BACKGROUND

The quality of behaviour support plans (BSPs) can be an important influence on the quality of the support provided to people with disability who show challenging behaviours. The Behavior Support Plan Quality Evaluation Guide II (BSP-QE II) is one tool that may be useful in assessing the quality of behaviour support plans. It has previously been used to assess BSPs to support children in schools in the USA. In this preliminary study, we examined the utility of the BSP-QE II for assessing behaviour support plans designed for adults with an intellectual disability in community support services in Australia.

METHOD

Experienced practitioners were surveyed concerning the relevance of BSP-QE II components to the evaluation of BSPs in Australia, and an audit was conducted of randomly selected BSPs submitted as a statutory requirement to the Office of the Senior Practitioner.

RESULTS

The BSP-QE II showed evidence of acceptable construct validity and interrater reliability. There was evidence of a need for substantial improvement in the quality of BSPs, consistent with previous findings conducted using other audit tools.

CONCLUSIONS

The findings support the utility of the BSP-QE II, to inform and evaluate service planning in supporting adults with intellectual disability who show challenging behaviour.