A Distracted Scientist: The Life and Contributions of John Senders

OBJECTIVE

To provide an evaluative and personal overview of the life and contributions of Professor John Senders and to introduce this Special Issue dedicated to his memory.

BACKGROUND

John Senders made many profound contributions to HF/E. These various topics are exemplified by the range of papers which compose the Special Issue. Collectively, these works document and demonstrate the impact of his many valuable research works.

METHOD

The Special Issue serves to summarize Senders' collective body of work as can be extracted from archival sources. This introductory paper recounts a series of remembrances derived from personal relationships, as well as the products of cooperative investigative research.

RESULTS

This collective evaluative process documents Senders' evident and deserved status in the highest pantheon of HF/E pioneers. It records his extraordinary life, replete with accounts of his insights and joie de vivre in exploring and explaining the world which surrounded him.

APPLICATIONS

Senders' record of critical contributions provides the example, par excellence, of the successful and fulfilling life in science. It encourages all, both researchers and practitioners alike, in their own individual search for excellence.

A review of recent research in social robotics

Research in social robotics has a different emphasis from research in robotics for factory, military, hospital, home (vacuuming), aerial (drone), space, and undersea applications. A social robot is one whose purpose is to serve a person in a caring interaction rather than to perform a mechanical task. Both because of its newness and because of its narrower psychological rather than technological emphasis, research in social robotics tends currently to be concentrated in a single journal and single annual conference. This review categorizes such a research into three areas: (1) Affect, Personality and Adaptation; (2) Sensing and Control for Action; and (3 Assistance to the Elderly and Handicapped. Current application is primarily for children's toys and devices to comfort the elderly and handicapped, as detailed in Section 'Toys and the market for social robots in general'.

Extending Three Existing Models to Analysis of Trust in Automation: Signal Detection, Statistical Parameter Estimation, and Model-Based Control

OBJECTIVE

The objective is to propose three quantitative models of trust in automation.

BACKGROUND

Current trust-in-automation literature includes various definitions and frameworks, which are reviewed.

METHOD

This research shows how three existing models, namely those for signal detection, statistical parameter estimation calibration, and internal model-based control, can be revised and reinterpreted to apply to trust in automation useful for human-system interaction design.

RESULTS

The resulting reinterpretation is presented quantitatively and graphically, and the measures for trust and trust calibration are discussed, along with examples of application.

CONCLUSION

The resulting models can be applied to provide quantitative trust measures in future experiments or system designs.

APPLICATIONS

Simple examples are provided to explain how model application works for the three trust contexts that correspond to signal detection, parameter estimation calibration, and model-based open-loop control.

Individual Differences in Attributes of Trust in Automation: Measurement and Application to System Design

Computer-based automation of sensing, analysis, memory, decision-making, and control in industrial, business, medical, scientific, and military applications is becoming increasingly sophisticated, employing various techniques of artificial intelligence for learning, pattern recognition, and computation. Research has shown that proper use of automation is highly dependent on operator trust. As a result the topic of trust has become an active subject of research and discussion in the applied disciplines of human factors and human-systems integration. While various papers have pointed to the many factors that influence trust, there currently exists no consensual definition of trust. This paper reviews previous studies of trust in automation with emphasis on its meaning and factors determining subjective assessment of trust and automation trustworthiness (which sometimes but not always are regarded as an objectively measurable properties of the automation). The paper asserts that certain attributes normally associated with human morality can usefully be applied to computer-based automation as it becomes more intelligent and more responsive to its human user. The paper goes on to suggest that the automation, based on its own experience with the user, can develop reciprocal attributes that characterize its own trust of the user and adapt accordingly. This situation can be modeled as a formal game where each of the automation user and the automation (computer) engage one another according to a payoff matrix of utilities (benefits and costs). While this is a concept paper lacking empirical data, it offers hypotheses by which future researchers can test for individual differences in the detailed attributes of trust in automation, and determine criteria for adjusting automation design to best accommodate these user differences.

The Intricacies of User Adjustments of Alerting Thresholds

OBJECTIVE

We address the question of necessary conditions for users to adjust system settings, such as alarm thresholds, correctly.

BACKGROUND

When designing systems, we need to decide which system functions users should control. Giving control to users empowers them, but users must have the relevant information and the ability to adjust settings correctly for their control to be beneficial.

METHOD

Using the example of adjusting an alerting threshold, we analyze the conditions for when users can and when they cannot possibly adjust threshold settings adequately.

RESULTS

We identify two obstacles that limit users' ability to adjust thresholds adequately: (a) the difficulty of determining the correct threshold settings, especially because of users' strong response to false positive indications, and (b) the difficulty of collecting the information necessary for setting the threshold.

CONCLUSION

Users often cannot identify the optimal settings for a system, so it is unlikely that they choose adequate system settings.

APPLICATION

System designers must consider the difficulties users face and analyze them explicitly when deciding on user involvement in processes.

A Closed-Loop Model of Operator Visual Attention, Situation Awareness, and Performance Across Automation Mode Transitions

OBJECTIVE

This article describes a closed-loop, integrated human-vehicle model designed to help understand the underlying cognitive processes that influenced changes in subject visual attention, mental workload, and situation awareness across control mode transitions in a simulated human-in-the-loop lunar landing experiment.

BACKGROUND

Control mode transitions from autopilot to manual flight may cause total attentional demands to exceed operator capacity. Attentional resources must be reallocated and reprioritized, which can increase the average uncertainty in the operator's estimates of low-priority system states. We define this increase in uncertainty as a reduction in situation awareness.

METHOD

We present a model built upon the optimal control model for state estimation, the crossover model for manual control, and the SEEV (salience, effort, expectancy, value) model for visual attention. We modify the SEEV attention executive to direct visual attention based, in part, on the uncertainty in the operator's estimates of system states.

RESULTS

The model was validated using the simulated lunar landing experimental data, demonstrating an average difference in the percentage of attention ≤3.6% for all simulator instruments. The model's predictions of mental workload and situation awareness, measured by task performance and system state uncertainty, also mimicked the experimental data.

CONCLUSION

Our model supports the hypothesis that visual attention is influenced by the uncertainty in system state estimates.

APPLICATION

Conceptualizing situation awareness around the metric of system state uncertainty is a valuable way for system designers to understand and predict how reallocations in the operator's visual attention during control mode transitions can produce reallocations in situation awareness of certain states.

Musings on Models and the Genius of Jens Rasmussen

Two well-known Rasmussen models, the skill-rule knowledge (SRK) paradigm and the abstraction hierarchy, are compared to well-known models in both physics and psychology. Some of the latter are quantitative and make explicit predictions; some are qualitative, such as the Rasmussen models, being more useful for provoking thought about the relevant issues. Each of the Rasmussen models is evaluated with respect to six-attribute model taxonomy recently introduced by the author. The SRK model is shown to characterize modern automation as well as human behavior, with computer and physical devices exhibiting the a skill-based, rule-based and knowledge-based properties, and with monitoring and intermittent intervention by a human supervisor. A further suggestion is that the Rasmussen abstraction hierarchy could be applied not only to systems such as air traffic control but also to general situations of living.

An Interactive Multi-Objective Decision-Aiding System for Tactical Mission Planning

This paper describes an interactive computer-aiding system for tactical aircraft mission planning. A Multiple-Objective Decision-Making approach has been applied to the tactical mission planning domain. The planner specifies a set of potential flight routes and selects an optimum one as the result of a human-computer dialogue. In this dialogue, the planner iteratively specifies acceptable constraints and desired weights on several mission-related decision objectives. The system provides graphic feedback about the merit of the selected route vis a vis the specified objectives, and allows the planner to tailor the mission route plan to meet explicit decision objectives.

Human-Robot Interaction: Status and Challenges

OBJECTIVE

The current status of human-robot interaction (HRI) is reviewed, and key current research challenges for the human factors community are described.

BACKGROUND

Robots have evolved from continuous human-controlled master-slave servomechanisms for handling nuclear waste to a broad range of robots incorporating artificial intelligence for many applications and under human supervisory control.

METHODS

This mini-review describes HRI developments in four application areas and what are the challenges for human factors research.

RESULTS

In addition to a plethora of research papers, evidence of success is manifest in live demonstrations of robot capability under various forms of human control.

CONCLUSIONS

HRI is a rapidly evolving field. Specialized robots under human teleoperation have proven successful in hazardous environments and medical application, as have specialized telerobots under human supervisory control for space and repetitive industrial tasks. Research in areas of self-driving cars, intimate collaboration with humans in manipulation tasks, human control of humanoid robots for hazardous environments, and social interaction with robots is at initial stages. The efficacy of humanoid general-purpose robots has yet to be proven.

APPLICATIONS

HRI is now applied in almost all robot tasks, including manufacturing, space, aviation, undersea, surgery, rehabilitation, agriculture, education, package fetch and delivery, policing, and military operations.

Significance of histologic pattern of carcinoma and sarcoma components on survival outcomes of uterine carcinosarcoma

BACKGROUND

To examine the effect of the histology of carcinoma and sarcoma components on survival outcome of uterine carcinosarcoma.

PATIENTS AND METHODS

A multicenter retrospective study was conducted to examine uterine carcinosarcoma cases that underwent primary surgical staging. Archived slides were examined and histologic patterns were grouped based on carcinoma (low-grade versus high-grade) and sarcoma (homologous versus heterologous) components, correlating to clinico-pathological demographics and outcomes.

RESULTS

Among 1192 cases identified, 906 cases were evaluated for histologic patterns (carcinoma/sarcoma) with high-grade/homologous (40.8%) being the most common type followed by high-grade/heterologous (30.9%), low-grade/homologous (18.0%), and low-grade/heterologous (10.3%). On multivariate analysis, high-grade/heterologous (5-year rate, 34.0%, P = 0.024) and high-grade/homologous (45.8%, P = 0.017) but not low-grade/heterologous (50.6%, P = 0.089) were independently associated with decreased progression-free survival (PFS) compared with low-grade/homologous (60.3%). In addition, older age, residual disease at surgery, large tumor, sarcoma dominance, deep myometrial invasion, lymphovascular space invasion, and advanced-stage disease were independently associated with decreased PFS (all, P < 0.01). Both postoperative chemotherapy (5-year rates, 48.6% versus 39.0%, P < 0.001) and radiotherapy (50.1% versus 44.1%, P = 0.007) were significantly associated with improved PFS in univariate analysis. However, on multivariate analysis, only postoperative chemotherapy remained an independent predictor for improved PFS [hazard ratio (HR) 0.34, 95% confidence interval (CI) 0.27-0.43, P < 0.001]. On univariate analysis, significant treatment benefits for PFS were seen with ifosfamide for low-grade carcinoma (82.0% versus 49.8%, P = 0.001), platinum for high-grade carcinoma (46.9% versus 32.4%, P = 0.034) and homologous sarcoma (53.1% versus 38.2%, P = 0.017), and anthracycline for heterologous sarcoma (66.2% versus 39.3%, P = 0.005). Conversely, platinum, taxane, and anthracycline for low-grade carcinoma, and anthracycline for homologous sarcoma had no effect on PFS compared with non-chemotherapy group (all, P > 0.05). On multivariate analysis, ifosfamide for low-grade/homologous (HR 0.21, 95% CI 0.07-0.63, P = 0.005), platinum for high-grade/homologous (HR 0.36, 95% CI 0.22-0.60, P < 0.001), and anthracycline for high-grade/heterologous (HR 0.30, 95% CI 0.14-0.62, P = 0.001) remained independent predictors for improved PFS. Analyses of 1096 metastatic sites showed that carcinoma components tended to spread lymphatically, while sarcoma components tended to spread loco-regionally (P < 0.001).

CONCLUSION

Characterization of histologic pattern provides valuable information in the management of uterine carcinosarcoma.

Evaluating models in systems ergonomics with a taxonomy of model attributes

A model, as the term is used here, is a way of representing knowledge for the purpose of thinking, communicating to others, or implementing decisions as in system analysis, design or operations. It can be said that to the extent that we can model some aspect of nature we understand it. Models can range from fleeting mental images to highly refined mathematical equations of computer algorithms that precisely predict physical events. In constructing and evaluating models of ergonomic systems it is important that we consider the attributes of our models in relation to our objectives and what we can reasonably aspire to. To that end this paper proposes a taxonomy of models in terms of six independent attributes: applicability to observables, dimensionality, metricity, robustness, social penetration and conciseness. Each of these attributes is defined along with the meaning of different levels of each. The attribute taxonomy may be used to evaluate the quality of a model. Examples of system ergonomics models having different combinations of attributes at different levels are provided. Philosophical caveats regarding models in system ergonomics are discussed, as well as the relation to scientific method.

How Bad Is a Near-Miss in Driving? A Proposed Metric Based on Reenactment Variability

How bad is a near miss? After the fact, the collision probability is zero. The real concern is what might have happened under slightly different conditions. In this article, I propose a safety measure commensurate with probability of collision for an event reenactment that depends on estimating the variability of closest proximity between vehicles. Example calculations are provided for several combinations of vehicles passing, stopping, or converging. Until recently, this radically different approach has been impractical, but new technology to measure and store proximity data changes that outlook. Various means are suggested by which the metric can be used to enhance driver safety.

Human Response Is Lognormal; Plan on Waiting If You Want Reliability

Human response times fit a lognormal probability function, which poses severe constraints on the time a system designer must allow to accommodate a significant fraction of respondents; for example, 6 standard deviations for 95% confidence and 11 standard deviations for 99% confidence. When a human operates in series with machine elements, there may be no justification for demanding a quick response from the machine.

Risk, human error, and system resilience: fundamental ideas

OBJECTIVE

I review and critique basic ideas of both traditional error/risk analysis and the newer and contrasting paradigm of resilience engineering.

BACKGROUND

Analysis of human error has matured and been applied over the past 50 years by human factors engineers, whereas the resilience engineering paradigm is relatively new.

METHOD

Fundamental ideas and examples of human factors applications of each approach are presented and contrasted.

RESULTS

Probabilistic risk analysis provides mathematical rigor in generalizing on past error events to identify system vulnerabilities, but prediction is problematical because (a) error definition is arbitrary, and thus it is difficult to infer valid probabilities of human error to input to quantitative models, and (b) future accident conditions are likely to be quite different from those of past accidents. The new resilience engineering paradigm, in contrast, is oriented toward organizational process and is concerned with anticipating, mitigating, and preparing for graceful recovery from future events.

CONCLUSION

Resilience engineering complements traditional error analysis but has yet to provide useful quantification and operational methods.

APPLICATION

A best safety strategy is to use both approaches.

Making the operating room of the future safer

There is an increasing demand for interventions to improve patient safety, but there is limited data to guide such reform. In particular, because much of the existing research is outcome-driven, we have a limited understanding of the factors and process variations that influence safety in the operating room. In this article, we start with an overview of safety terminology, suggesting a model that emphasizes "safety" rather than "error" and that can encompass the spectrum of events occurring in the operating room. Next, we provide an introduction to techniques that can be used to understand safety at the point of care and we review the data that exists relating such studies to improved outcomes. Future work in this area will need to prospectively study the processes and factors that impact patient safety and vulnerability in the operating room.

Making the Operating Room of the Future Safer

There is an increasing demand for interventions to improve patient safety, but there is limited data to guide such reform. In particular, because much of the existing research is outcome-driven, we have a limited understanding of the factors and process variations that influence safety in the operating room. In this article, we start with an overview of safety terminology, suggesting a model that emphasizes “safety” rather than “error” and that can encompass the spectrum of events occurring in the operating room. Next, we provide an introduction to techniques that can be used to understand safety at the point of care and we review the data that exists relating such studies to improved outcomes. Future work in this area will need to prospectively study the processes and factors that impact patient safety and vulnerability in the operating room.

A prospective study of patient safety in the operating room

BACKGROUND

To better understand the operating room as a system and to identify system features that influence patient safety, we performed an analysis of operating room patient care using a prospective observational technique.

METHODS

A multidisciplinary team comprised of human factors experts and surgeons conducted prospective observations of 10 complex general surgery cases in an academic hospital. Minute-to-minute observations were recorded in the field, and later coded and analyzed. A qualitative analysis first identified major system features that influenced team performance and patient safety. A quantitative analysis of factors related to these systems features followed. In addition, safety-compromising events were identified and analyzed for contributing and compensatory factors.

RESULTS

Problems in communication and information flow, and workload and competing tasks were found to have measurable negative impact on team performance and patient safety in all 10 cases. In particular, the counting protocol was found to significantly compromise case progression and patient safety. We identified 11 events that potentially compromised patient safety, allowing us to identify recurring factors that contributed to or mitigated the overall effect on the patient's outcome.

CONCLUSIONS

This study demonstrates the role of prospective observational methods in exposing critical system features that influence patient safety and that can be the targets for patient safety initiatives. Communication breakdown and information loss, as well as increased workload and competing tasks, pose the greatest threats to patient safety in the operating room.

Driver distraction from a control theory perspective

Distraction from cell phones, navigation systems, information/entertainment systems, and other driver-interactive devices now finding their way into the highway vehicles is a serious national safety concern. However, driver distraction is neither well defined nor well understood. In an effort to bring some better definition to the problem, a framework is proposed based on the ideas of control theory. Loci and causes of distraction are represented as disturbances to various functional elements of a control loop involving driver intending (goal setting), sensing, deciding on control response, dynamics of the vehicle, and human body activation and energetics. It is argued that activation should be classed separately from the other functions. Attention switching from environmental observation/control to internal device manipulation is modeled as sampled-data control. Also fit within the control framework are mental modeling and anticipation of events in the driver's preview. The control framework is shown to suggest some salient research questions and experiments. Actual or potential applications of this research include a refined understanding of driver distraction and better modeling and prediction of driving performance as a function of vehicle and highway design.

Human factors in telesurgery: effects of time delay and asynchrony in video and control feedback with local manipulative assistance

This paper presents the results of experiments examining the performance of a telesurgeon and an assistant local to the patient performing simulated laparoscopic tasks under a variety of time-delay conditions. Of particular interest is a comparison between the surgeon provided with audio/video and force feedbck synchronously with various time delays, and the surgeon performing asynchronously, where video is delayed relative to force feedback. These conditions are relevant since current telecommunication systems have limited bandwidth, and video signals must be compressed for efficient transmission. This produces a time lag between the video camera and the surgeon's monitor, Force feedback and position commands from a surgical teleoperator require much lower bandwidth, and can be transmitted in near-real time. In the first of two series of experiments, two laparoscopic training tasks were performed under different time-delay conditions, with force and video feedback delayed by equal amounts. In the second series, using the same tasks, the force feedback was more immediate, while the video delay lagged by the time required for compression and decompression. In both experiments, there were various role assignments in terms of whether the telesurgeon or the assistant controlled the laparoscope and/or the various surgical tools required. The three most striking results are that (1) nontrivial time delays significantly degraded the performance of the surgical tasks, (2) asynchronous force feedback resulted in significantly faster task-performance than did synchronous performance when the surgeon operated the laparoscopic tools, and (3) there was no difference between synchrony and asynchrony when the remote surgeon operated the laparoscope and gave commands while the local assistant operated the surgical tools.

A model for types and levels of human interaction with automation

Technical developments in computer hardware and software now make it possible to introduce automation into virtually all aspects of human-machine systems. Given these technical capabilities, which system functions should be automated and to what extent? We outline a model for types and levels of automation that provides a framework and an objective basis for making such choices. Appropriate selection is important because automation does not merely supplant but changes human activity and can impose new coordination demands on the human operator. We propose that automation can be applied to four broad classes of functions: 1) information acquisition; 2) information analysis; 3) decision and action selection; and 4) action implementation. Within each of these types, automation can be applied across a continuum of levels from low to high, i.e., from fully manual to fully automatic. A particular system can involve automation of all four types at different levels. The human performance consequences of particular types and levels of automation constitute primary evaluative criteria for automation design using our model. Secondary evaluative criteria include automation reliability and the costs of decision/action consequences, among others. Examples of recommended types and levels of automation are provided to illustrate the application of the model to automation design.

Human versus automation in responding to failures: an expected-value analysis

A simple analytical criterion is provided for deciding whether a human or automation is best for a failure detection task. The method is based on expected-value decision theory in much the same way as is signal detection. It requires specification of the probabilities of misses (false negatives) and false alarms (false positives) for both human and automation being considered, as well as factors independent of the choice--namely, costs and benefits of incorrect and correct decisions as well as the prior probability of failure. The method can also serve as a basis for comparing different modes of automation. Some limiting cases of application are discussed, as are some decision criteria other than expected value. Actual or potential applications include the design and evaluation of any system in which either humans or automation are being considered.

Teleoperator performance with varying force and visual feedback

An experimental study was conducted to determine the effects of various forms of visual and force feedback on human performance for several "peg-in-hole"-type telemanipulation tasks. Each of six human test subjects used a master/slave manipulator during two experimental sessions. In one session the subjects performed the tasks with direct vision, where subtended visual angle, force feedback, task difficulty, and the interaction of subtended visual angle and force feedback made significant differences in task completion times. During the other session the tasks were performed using a video monitor for visual feedback, and video frame rate, force feedback, task difficulty, and the interaction of frame rate and force feedback were found to make significant differences in task times. An analysis between the direct and video viewing environments showed that apart from subtended visual angle and reduced frame rate, the video medium itself did not significantly affect task times relative to direct viewing.

The "feel" of rotary controls: friction and inertia

The purpose of this study was to determine the influence of friction and inertia levels on the “feel” of rotary controls. Detection thresholds for changes in friction and inertia were determined and found to be about 10 to 20 per cent of the initial values. Preference ratings obtained for various combinations of friction and inertia increased as a function of inertia level and decreased as a function of friction level. Preferences for viscous friction were greater than for stick-slip friction. Psychophysical evaluations such as these are related to customer acceptance factors and provide a useful supplement to purely functional design criteria.