Computers and evaluation of clinical competence

L’évaluation des pratiques cliniques : quels modes de recueil des données et à partir de quelles sources d’information?

OBJECTIVE

The aim of our study is to present the methods used to observe clinical practices, to evaluate their advantages and limits, and to specify the context in which they are preformed.

METHODS

We conducted a bibliographical search on MEDLINE using key words, completed by an offline search. We selected articles published in French or English between 1985 and 2003.

RESULTS

Thirty articles, of which 3 were reviews, as well as an additional 5 reports and 9 books, were selected. We distinguished direct or objective approaches to clinical practices as well as indirect or declarative approaches. We also noted whether the approach was individual with data collected from individual practitioners, or collective, with data coming from databases. Most methods of collecting data used medical records, often in the context of internal or external clinical audits or peer reviews. The other sources of data were self-administered questionnaires, written case simulations and simulated patients. Data was also extracted from previously existing databases: claims databases, registries and ad hoc databases.

CONCLUSION

An objective individual approach insures the highest quality of information, but possible high costs can limit the use of this approach. It is necessary to continue researching the best means of collecting data on clinical practices, because of the obligation of each practitioner to evaluate individual clinical practices.

Assessing clinical competency in medical senior house officers: how and why should we do it?

Most consultants are involved in the training and assessment of several grades of doctors in training especially senior house officers (SHOs) and specialist registrars. In the medical and other specialties there is an increasing trend towards assessing junior doctors' competency using the record of in-training assessment process for specialist registrars and using the Royal College of Physicians folder to record competences of medical SHOs. It is necessary to consider why there is a need to assess competency, how it may be done practically, and the advantages and disadvantages of this system of assessment. There are considerable hurdles to the implementation of this system in the medical specialties within today's NHS and the organisation may need to undergo fairly radical change to facilitate this system.

The impact of a new educational strategy on acquiring neonatology skills

OVERVIEW

A shortage of staff for teaching neonatology skills to large numbers of students, in small groups and following a new curriculum, necessitated an innovative educational strategy. This entailed the development and implementation of an interactive multimedia program (CD-ROM) to deliver information about skills and to demonstrate them.

METHODS

Students had to study a specific skill using the CD-ROM and then practise in the Skills Laboratory, supported by lecturers who provided formative evaluation.

OBJECTIVES

The aims of this study were to assess the students' perspectives on the new strategy, and to compare the skills of students following the new curriculum to those of students following the traditional curriculum, who do not follow structured programmes on practical skills but experience a practical neonatology rotation.

RESULTS

The evaluation of the CD-ROM program was very favourable. The majority of students still preferred live demonstrations but found the CD-ROM useful for revision purposes. With the exception of one skill, endotracheal intubation, the new curriculum students were found to be as competent as the students following the traditional curriculum and performed mask ventilation and cardiac massage significantly better than them.