Critical issues in evaluating the impact of IT on information activity in academic research: Developing a qualitative research solution

A study of non-users of digital libraries: the case of the Capes digital library in Brazil

Purpose

The purpose of this paper is to understand the reasons that hinder the use of digital libraries.

Design/methodology/approach

This study analyzed data obtained through a web survey sent to 14,763 faculty members in Brazilian universities. Of the 6,689 respondents, 1,075 (16.1%) reported not using the Capes digital library and 1,017 answered the questionnaire for non-users.

Findings

Results showed that the main reasons for non-use are lack of knowledge of the existence of the Capes digital library, use of other resources, preference for printed journals and difficulty of access. Eight factors of non-use were elicited: insufficient dissemination, inadequacies in contents, in infrastructure, in access policy, in training and in the interface, personal constraints and personal attitude. The reasons and factors for non-use were categorized as intrinsic and extrinsic to the digital library. Intrinsic reasons relate to characteristics of the Capes digital library. Extrinsic factors are influenced by user characteristics. The chi-square test demonstrated that the variables: area of knowledge, age, hours dedicated to research and computer skills influence non-use.

Originality/value

This study has contributed to research about non-users of digital libraries, differing from previous research by surveying a large-scale population and by investigating in a single work the reasons for non-use, other electronic sources used by non-users, advantages of using the digital library and intention of non-users to become users if barriers were removed. Qualitative data complemented the quantitative data collected which allowed a more complete picture of the respondent’s positions.

Im Labyrinth

Ausgehend von der Fallstudie der Bibliotheksbenutzung durch Johann Wolfgang von Goethe wird die Operation des Suchens und Findens speziell in der Bibliothek als risikoreiches Eintreten in ein Labyrinth beschrieben. Den aktuellen Versuchen gerade auch nutzerorientierter Formalisierung des Suchprozesses wird entgegen gehalten, dass diese nicht der eigentlichen „Qualität“ der Bibliothek entsprechen. Es wird eine Bibliothekskritik gefordert, die das Operative des Findens jenseits von Recommender-Systemen und einfacher Serendipity in den Blick nimmt.

An exploration into the information-seeking behaviours of engineers and scientists

This article considers findings from Master’s research that investigated the information-seeking behaviours of engineers and scientists in the workplace. The objectives of this research were to establish where engineers and scientists look for information, consider their search preferences and determine the understanding they have of online search engine operation. There is limited current research in these areas looking at engineers and scientists in the workplace. The research was undertaken using a mixed methods research methodology. A survey was conducted with engineers and scientists working in the UK, using an online questionnaire and interviews to obtain quantitative and qualitative data. Due to the small sample size (115: 58 engineers, 57 scientists) this research does not make generalisations about the wider population. The research showed both similarities and differences between engineers’ and scientists’ information-seeking behaviours. The most popular resources used by both engineers and scientists were online search engines, specialist databases and scholar search engines; and the most used sources were from within their own organisation (colleagues and documents). Electronic versions of sources were preferred over print because of their searchability; however, when an item was found it was often printed out to read. Although the main focus of this research was not information literacy it is suggested that there are significant gaps in the understanding of search engine functionality by both engineers and scientists, even though it is the most heavily used resource for information seeking. Whilst this research does not make generalisations about the wider engineer and scientist populations, potential implications for information professionals working with these groups are considered.

How French research scientists are making use of electronic journals: a case study conducted at Pierre et Marie Curie University and Denis Diderot University

There have been few studies to date on how French research scientists are using electronic journals in their work. Under a national programme for document digitisation in higher education and research, a qualitative study was conducted at the Jussieu Campus in Paris among 25 researchers and doctoral students and nine documentalists. The main disciplines covered were physics, chemistry and biology, with some representatives from mathematics, computer science and earth sciences. A user typology was built up, and several of the findings agree substantially with those in the (mainly Anglo-Saxon) literature, which demonstrate the importance of factors such as the discipline concerned and the immediate working environment of researchers, including equipment, local practice, and the resources that are promoted or made available. Other more subjective factors also need to be taken into account.

Information skills for an electronic world: training doctoral research students

The electronic library/Internet intensifies the need for information skills in academic research, in three categories: judgement; knowledge and operation of resources; linguistic/logical skills. There is a corresponding quantum leap in the information skills training requirement. Strategies for training within the doctoral supervision process are outlined. Qualitative data, from the Information Access project, on current practice among supervisors suggest that to train researchers successfully: (i) recognition of the size of the problem is required; (ii) a different model of library skills training needs to be adopted; (iii) the developmental nature of training needs to be recognised; (iv) research supervisors have an important role to play along-side librarians; (v) explicit discussion of metacognitive aspects of these skills is necessary; (vi) national and local institutions need to formulate training policy; (vii) supervisors themselves need training and support; (viii) academics and students need to take responsibility for their learning in this area.

The benchmarking of information systems supporting the university administrative activities

Purpose

The issue investigated in this work is relative to the features of the information sub‐systems supporting specific university administrative processes (accountancy, personnel management, student services). This paper attempt: to develop a benchmarking model; and apply the suggested model to a group of Italian universities.

Design/methodology/approach

While the literature analysis has been useful to achieve the first goal, the empirical methodology of case studies has been employed for both the objectives. It means that there has been a full commitment of the involved universities also in the theoretical phase of the work.

Findings

Two types of specific results are expected through the application of the suggested benchmarking model. The first is the pertinent position of each university in respect with some observed features of the information sub‐systems. The second is the identification of possible trends that are widespread within the selected universities.

Research limitations/implications

Generalization of the benchmarking trends is not possible, because trends arise from a limited group of universities.

Practical implications

The universities involved in the project have discovered the importance of benchmarking as a means of improving their processes and systems.

Originality/value

This paper represents a first attempt at developing a model to compare the condition of the administrative information systems in a selected group of Italian universities.

Availability of a virtual learning environment does not compensate for the lack of a physical facility

A virtual learning environment (VLE), including access to on-line journals, was set up in support of a new medical curriculum delivered at two campuses. We evaluated student perceptions and use of the VLE including the library facilities using several qualitative and quantitative data methods and the results were triangulated. Paper copies of set texts are provided at each site; however, one site also has a traditional library for the training of professions allied to medicine. As the teaching was identical at each site, this gave us the opportunity for a study exploring the effect of having a physical library facility on the use of the VLE. Although ten-fold more loans were made from the library with the medical sources than from the other site, use of the VLE was very similar at both sites, suggesting that reduced access to hard copy books and journals was not compensated for by increased use of electronic library resources. As expected, training, ease of navigation and access to the VLE were very important to student satisfaction.

User requirements specifications: a hierarchical structure covering strategical, tactical and operational requirements

The present study is a long-term review and follow-up on conclusions and recommendations on the role and contents of a User Requirements Specification Document (URD) from a previous in-depth case study. The follow-up comprises a succession of investigations and two case studies to explore the role and contents of a URD within systems development and assessment, thereby gradually extending and refining the original recommendations. Finally, the recommended three-layered structure and approach for a URD were applied in full scale within a real-life project, in which the URD serves as the basis for a Call for Tender. The preparation was entirely user-driven with the aid of a consultant for four man months. The present paper outlines the essence of the approach and the outcome of applying the recommended structure, with numerous examples of the implications.

Methodology for constructive assessment of IT-based systems in an organisational context

Even if painted in black and white, there is no doubt that the assumptions for the application of traditional approaches for user requirements specification are more or less unfulfilled. This indicates a need for evolutionary system development combined with constructive assessment throughout the life-cycle of an IT-based solution. A methodology for constructive technology assessment is presented, which 1) covers the entire system life-cycle; 2) has users from the application domain of the future system, or their representatives, as the target users of the assessment methodology; 3) enables constructive assessment during the development of an IT-based solution; 4) is applicable independently of the system development approach; and 5) provides users of the IT-based solution with information enabling them to decide whether or not to take the system into real-life clinical usage.

Using reflexivity to optimize teamwork in qualitative research

Reflexivity is often described as an individual activity. The authors propose that reflexivity employed as a team activity, through the sharing of reflexive writing (accounts of personal agendas, hidden assumptions, and theoretical definitions) and group discussions about arising issues, can improve the productivity and functioning of qualitative teams and the rigor and quality of the research. The authors review the literature on teamwork, highlighting benefits and pitfalls, and define and discuss the role for reflexivity. They describe their own team and detail how they work together on a project investigating doctor-patient communication about prescribing. The authors present two reflexive tools they have used and show through examples how they have influenced the effectiveness of their team in terms of process, quality, and outcome.

Cognitive evaluation: how to assess the usability of information technology in healthcare

As the adoption of information technology has increased, so too has the demands that these systems become more adapted to the physicians and nurses environments, to make access and management of information easier. The developers of information systems in Healthcare must use quality management techniques to ensure that their product will satisfy given requirements. This underlines the importance of the preliminary phase where Users Requirements are elicited. Some methodologies, such as KAVAS (E.M.S. Van Gennip, F. Grémy, Med. Inform. 18, 1993, 179) chose to use a continuous assessment protocol as a key strategy for quality management. At each stage of the conception and development of a prototype, the assessment checks that it conforms to the expectation of the users' requirements. The methodology of evaluation is then seen as a dynamic process which is able to improve the design and development of a dedicated system. The purpose of this paper is to demonstrate the necessity to include a cognitive evaluation phase in the process of evaluation by: (1) evaluating the integration (usability) of the I.T. in the activity of the users; and (2) understanding the motives underlying their management of information. This will help the necessary integration of information management in the workload of the healthcare professionals and the compatibility of the prototypes with the daily activity of the users.