1
|
Lange D, Judson-Torres R, Zangle TA, Lex A. Aardvark: Composite Visualizations of Trees, Time-Series, and Images. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2025; 31:1290-1300. [PMID: 39255114 DOI: 10.1109/tvcg.2024.3456193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2024]
Abstract
How do cancer cells grow, divide, proliferate, and die? How do drugs influence these processes? These are difficult questions that we can attempt to answer with a combination of time-series microscopy experiments, classification algorithms, and data visualization. However, collecting this type of data and applying algorithms to segment and track cells and construct lineages of proliferation is error-prone; and identifying the errors can be challenging since it often requires cross-checking multiple data types. Similarly, analyzing and communicating the results necessitates synthesizing different data types into a single narrative. State-of-the-art visualization methods for such data use independent line charts, tree diagrams, and images in separate views. However, this spatial separation requires the viewer of these charts to combine the relevant pieces of data in memory. To simplify this challenging task, we describe design principles for weaving cell images, time-series data, and tree data into a cohesive visualization. Our design principles are based on choosing a primary data type that drives the layout and integrates the other data types into that layout. We then introduce Aardvark, a system that uses these principles to implement novel visualization techniques. Based on Aardvark, we demonstrate the utility of each of these approaches for discovery, communication, and data debugging in a series of case studies.
Collapse
|
2
|
Piccolotto N, Bögl M, Miksch S. Visual Parameter Space Exploration in Time and Space. COMPUTER GRAPHICS FORUM : JOURNAL OF THE EUROPEAN ASSOCIATION FOR COMPUTER GRAPHICS 2023; 42:e14785. [PMID: 38505647 PMCID: PMC10947302 DOI: 10.1111/cgf.14785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
Computational models, such as simulations, are central to a wide range of fields in science and industry. Those models take input parameters and produce some output. To fully exploit their utility, relations between parameters and outputs must be understood. These include, for example, which parameter setting produces the best result (optimization) or which ranges of parameter settings produce a wide variety of results (sensitivity). Such tasks are often difficult to achieve for various reasons, for example, the size of the parameter space, and supported with visual analytics. In this paper, we survey visual parameter space exploration (VPSE) systems involving spatial and temporal data. We focus on interactive visualizations and user interfaces. Through thematic analysis of the surveyed papers, we identify common workflow steps and approaches to support them. We also identify topics for future work that will help enable VPSE on a greater variety of computational models.
Collapse
Affiliation(s)
- Nikolaus Piccolotto
- TU WienInstitute of Visual Computing and Human‐Centered TechnologyWienAustria
| | - Markus Bögl
- TU WienInstitute of Visual Computing and Human‐Centered TechnologyWienAustria
| | - Silvia Miksch
- TU WienInstitute of Visual Computing and Human‐Centered TechnologyWienAustria
| |
Collapse
|
3
|
Shi N, Xu J, Li H, Guo H, Woodring J, Shen HW. VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulations. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2023; 29:820-830. [PMID: 36166538 DOI: 10.1109/tvcg.2022.3209413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
We propose VDL-Surrogate, a view-dependent neural-network-latent-based surrogate model for parameter space exploration of ensemble simulations that allows high-resolution visualizations and user-specified visual mappings. Surrogate-enabled parameter space exploration allows domain scientists to preview simulation results without having to run a large number of computationally costly simulations. Limited by computational resources, however, existing surrogate models may not produce previews with sufficient resolution for visualization and analysis. To improve the efficient use of computational resources and support high-resolution exploration, we perform ray casting from different viewpoints to collect samples and produce compact latent representations. This latent encoding process reduces the cost of surrogate model training while maintaining the output quality. In the model training stage, we select viewpoints to cover the whole viewing sphere and train corresponding VDL-Surrogate models for the selected viewpoints. In the model inference stage, we predict the latent representations at previously selected viewpoints and decode the latent representations to data space. For any given viewpoint, we make interpolations over decoded data at selected viewpoints and generate visualizations with user-specified visual mappings. We show the effectiveness and efficiency of VDL-Surrogate in cosmological and ocean simulations with quantitative and qualitative evaluations. Source code is publicly available at https://github.com/trainsn/VDL-Surrogate.
Collapse
|
4
|
Mota R, Ferreira N, Silva JD, Horga M, Lage M, Ceferino L, Alim U, Sharlin E, Miranda F. A Comparison of Spatiotemporal Visualizations for 3D Urban Analytics. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2023; 29:1277-1287. [PMID: 36166521 DOI: 10.1109/tvcg.2022.3209474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Recent technological innovations have led to an increase in the availability of 3D urban data, such as shadow, noise, solar potential, and earthquake simulations. These spatiotemporal datasets create opportunities for new visualizations to engage experts from different domains to study the dynamic behavior of urban spaces in this under explored dimension. However, designing 3D spatiotemporal urban visualizations is challenging, as it requires visual strategies to support analysis of time-varying data referent to the city geometry. Although different visual strategies have been used in 3D urban visual analytics, the question of how effective these visual designs are at supporting spatiotemporal analysis on building surfaces remains open. To investigate this, in this paper we first contribute a series of analytical tasks elicited after interviews with practitioners from three urban domains. We also contribute a quantitative user study comparing the effectiveness of four representative visual designs used to visualize 3D spatiotemporal urban data: spatial juxtaposition, temporal juxtaposition, linked view, and embedded view. Participants performed a series of tasks that required them to identify extreme values on building surfaces over time. Tasks varied in granularity for both space and time dimensions. Our results demonstrate that participants were more accurate using plot-based visualizations (linked view, embedded view) but faster using color-coded visualizations (spatial juxtaposition, temporal juxtaposition). Our results also show that, with increasing task complexity, plot-based visualizations perform better in preserving efficiency (time, accuracy) compared to color-coded visualizations. Based on our findings, we present a set of takeaways with design recommendations for 3D spatiotemporal urban visualizations for researchers and practitioners. Lastly, we report on a series of interviews with four practitioners, and their feedback and suggestions for further work on the visualizations to support 3D spatiotemporal urban data analysis.
Collapse
|
5
|
Shi N, Xu J, Wurster SW, Guo H, Woodring J, Van Roekel LP, Shen HW. GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulations. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:2301-2313. [PMID: 35389867 DOI: 10.1109/tvcg.2022.3165345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
We propose GNN-Surrogate, a graph neural network-based surrogate model to explore the parameter space of ocean climate simulations. Parameter space exploration is important for domain scientists to understand the influence of input parameters (e.g., wind stress) on the simulation output (e.g., temperature). The exploration requires scientists to exhaust the complicated parameter space by running a batch of computationally expensive simulations. Our approach improves the efficiency of parameter space exploration with a surrogate model that predicts the simulation outputs accurately and efficiently. Specifically, GNN-Surrogate predicts the output field with given simulation parameters so scientists can explore the simulation parameter space with visualizations from user-specified visual mappings. Moreover, our graph-based techniques are designed for unstructured meshes, making the exploration of simulation outputs on irregular grids efficient. For efficient training, we generate hierarchical graphs and use adaptive resolutions. We give quantitative and qualitative evaluations on the MPAS-Ocean simulation to demonstrate the effectiveness and efficiency of GNN-Surrogate. Source code is publicly available at https://github.com/trainsn/GNN-Surrogate.
Collapse
|
6
|
Liu J, Dwyer T, Tack G, Gratzl S, Marriott K. Supporting the Problem-Solving Loop: Designing Highly Interactive Optimisation Systems. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2021; 27:1764-1774. [PMID: 33112748 DOI: 10.1109/tvcg.2020.3030364] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Efficient optimisation algorithms have become important tools for finding high-quality solutions to hard, real-world problems such as production scheduling, timetabling, or vehicle routing. These algorithms are typically "black boxes" that work on mathematical models of the problem to solve. However, many problems are difficult to fully specify, and require a "human in the loop" who collaborates with the algorithm by refining the model and guiding the search to produce acceptable solutions. Recently, the Problem-Solving Loop was introduced as a high-level model of such interactive optimisation. Here, we present and evaluate nine recommendations for the design of interactive visualisation tools supporting the Problem-Solving Loop. They range from the choice of visual representation for solutions and constraints to the use of a solution gallery to support exploration of alternate solutions. We first examined the applicability of the recommendations by investigating how well they had been supported in previous interactive optimisation tools. We then evaluated the recommendations in the context of the vehicle routing problem with time windows (VRPTW). To do so we built a sophisticated interactive visual system for solving VRPTW that was informed by the recommendations. Ten participants then used this system to solve a variety of routing problems. We report on participant comments and interaction patterns with the tool. These showed the tool was regarded as highly usable and the results generally supported the usefulness of the underlying recommendations.
Collapse
|
7
|
Improving Transactional Data System Based on an Edge Computing–Blockchain–Machine Learning Integrated Framework. Processes (Basel) 2021. [DOI: 10.3390/pr9010092] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
Abstract
The modern industry, production, and manufacturing core is developing based on smart manufacturing (SM) systems and digitalization. Smart manufacturing’s practical and meaningful design follows data, information, and operational technology through the blockchain, edge computing, and machine learning to develop and facilitate the smart manufacturing system. This process’s proposed smart manufacturing system considers the integration of blockchain, edge computing, and machine learning approaches. Edge computing makes the computational workload balanced and similarly provides a timely response for the devices. Blockchain technology utilizes the data transmission and the manufacturing system’s transactions, and the machine learning approach provides advanced data analysis for a huge manufacturing dataset. Regarding smart manufacturing systems’ computational environments, the model solves the problems using a swarm intelligence-based approach. The experimental results present the edge computing mechanism and similarly improve the processing time of a large number of tasks in the manufacturing system.
Collapse
|
8
|
Hazarika S, Li H, Wang KC, Shen HW, Chou CS. NNVA: Neural Network Assisted Visual Analysis of Yeast Cell Polarization Simulation. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:34-44. [PMID: 31425114 DOI: 10.1109/tvcg.2019.2934591] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Complex computational models are often designed to simulate real-world physical phenomena in many scientific disciplines. However, these simulation models tend to be computationally very expensive and involve a large number of simulation input parameters, which need to be analyzed and properly calibrated before the models can be applied for real scientific studies. We propose a visual analysis system to facilitate interactive exploratory analysis of high-dimensional input parameter space for a complex yeast cell polarization simulation. The proposed system can assist the computational biologists, who designed the simulation model, to visually calibrate the input parameters by modifying the parameter values and immediately visualizing the predicted simulation outcome without having the need to run the original expensive simulation for every instance. Our proposed visual analysis system is driven by a trained neural network-based surrogate model as the backend analysis framework. In this work, we demonstrate the advantage of using neural networks as surrogate models for visual analysis by incorporating some of the recent advances in the field of uncertainty quantification, interpretability and explainability of neural network-based models. We utilize the trained network to perform interactive parameter sensitivity analysis of the original simulation as well as recommend optimal parameter configurations using the activation maximization framework of neural networks. We also facilitate detail analysis of the trained network to extract useful insights about the simulation model, learned by the network, during the training process. We performed two case studies, and discovered multiple new parameter configurations, which can trigger high cell polarization results in the original simulation model. We evaluated our results by comparing with the original simulation model outcomes as well as the findings from previous parameter analysis performed by our experts.
Collapse
|
9
|
Walch A, Schwarzler M, Luksch C, Eisemann E, Gschwandtner T. LightGuider: Guiding Interactive Lighting Design using Suggestions, Provenance, and Quality Visualization. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:569-578. [PMID: 31443004 DOI: 10.1109/tvcg.2019.2934658] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
LightGuider is a novel guidance-based approach to interactive lighting design, which typically consists of interleaved 3D modeling operations and light transport simulations. Rather than having designers use a trial-and-error approach to match their illumination constraints and aesthetic goals, LightGuider supports the process by simulating potential next modeling steps that can deliver the most significant improvements. LightGuider takes predefined quality criteria and the current focus of the designer into account to visualize suggestions for lighting-design improvements via a specialized provenance tree. This provenance tree integrates snapshot visualizations of how well a design meets the given quality criteria weighted by the designer's preferences. This integration facilitates the analysis of quality improvements over the course of a modeling workflow as well as the comparison of alternative design solutions. We evaluate our approach with three lighting designers to illustrate its usefulness.
Collapse
|
10
|
He W, Wang J, Guo H, Wang KC, Shen HW, Raj M, Nashed YSG, Peterka T. InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:23-33. [PMID: 31425097 DOI: 10.1109/tvcg.2019.2934312] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations.
Collapse
|
11
|
Wang J, Hazarika S, Li C, Shen HW. Visualization and Visual Analysis of Ensemble Data: A Survey. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2019; 25:2853-2872. [PMID: 29994615 DOI: 10.1109/tvcg.2018.2853721] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Over the last decade, ensemble visualization has witnessed a significant development due to the wide availability of ensemble data, and the increasing visualization needs from a variety of disciplines. From the data analysis point of view, it can be observed that many ensemble visualization works focus on the same facet of ensemble data, use similar data aggregation or uncertainty modeling methods. However, the lack of reflections on those essential commonalities and a systematic overview of those works prevents visualization researchers from effectively identifying new or unsolved problems and planning for further developments. In this paper, we take a holistic perspective and provide a survey of ensemble visualization. Specifically, we study ensemble visualization works in the recent decade, and categorize them from two perspectives: (1) their proposed visualization techniques; and (2) their involved analytic tasks. For the first perspective, we focus on elaborating how conventional visualization techniques (e.g., surface, volume visualization techniques) have been adapted to ensemble data; for the second perspective, we emphasize how analytic tasks (e.g., comparison, clustering) have been performed differently for ensemble data. From the study of ensemble visualization literature, we have also identified several research trends, as well as some future research opportunities.
Collapse
|
12
|
Johnson S, Orban D, Runesha HB, Meng L, Juhnke B, Erdman A, Samsel F, Keefe DF. Bento Box: An Interactive and Zoomable Small Multiples Technique for Visualizing 4D Simulation Ensembles in Virtual Reality. Front Robot AI 2019; 6:61. [PMID: 33501076 PMCID: PMC7805880 DOI: 10.3389/frobt.2019.00061] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Accepted: 07/05/2019] [Indexed: 11/13/2022] Open
Abstract
We present Bento Box, a virtual reality data visualization technique and bimanual 3D user interface for exploratory analysis of 4D data ensembles. Bento Box helps scientists and engineers make detailed comparative judgments about multiple time-varying data instances that make up a data ensemble (e.g., a group of 10 parameterized simulation runs). The approach is to present an organized set of complementary volume visualizations juxtaposed in a grid arrangement, where each column visualizes a single data instance and each row provides a new view of the volume from a different perspective and/or scale. A novel bimanual interface enables users to select a sub-volume of interest to create a new row on-the-fly, scrub through time, and quickly navigate through the resulting virtual "bento box." The technique is evaluated through a real-world case study, supporting a team of medical device engineers and computational scientists using in-silico testing (supercomputer simulations) to redesign cardiac leads. The engineers confirmed hypotheses and developed new insights using a Bento Box visualization. An evaluation of the technical performance demonstrates that the proposed combination of data sampling strategies and clipped volume rendering is successful in displaying a juxtaposed visualization of fluid-structure-interaction simulation data (39 GB of raw data) at interactive VR frame rates.
Collapse
Affiliation(s)
- Seth Johnson
- Interactive Visualization Lab, Department of Computer Science, University of Minnesota, Minneapolis, MN, United States
| | - Daniel Orban
- Interactive Visualization Lab, Department of Computer Science, University of Minnesota, Minneapolis, MN, United States
| | | | - Lingyu Meng
- Research Computing Center, University of Chicago, Chicago, IL, United States
| | - Bethany Juhnke
- Department of Mechanical Engineering, Earl E. Bakken Medical Devices Center, University of Minnesota, Minneapolis, MN, United States
| | - Arthur Erdman
- Department of Mechanical Engineering, Earl E. Bakken Medical Devices Center, University of Minnesota, Minneapolis, MN, United States
| | - Francesca Samsel
- Texas Advanced Computing Center, University of Texas, Austin, TX, United States
| | - Daniel F Keefe
- Interactive Visualization Lab, Department of Computer Science, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
13
|
Zhou F, Lin X, Liu C, Zhao Y, Xu P, Ren L, Xue T, Ren L. A survey of visualization for smart manufacturing. J Vis (Tokyo) 2018. [DOI: 10.1007/s12650-018-0530-2] [Citation(s) in RCA: 52] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
14
|
Okuya Y, Ladeveze N, Fleury C, Bourdot P. ShapeGuide: Shape-Based 3D Interaction for Parameter Modification of Native CAD Data. Front Robot AI 2018; 5:118. [PMID: 33500997 PMCID: PMC7806106 DOI: 10.3389/frobt.2018.00118] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Accepted: 09/20/2018] [Indexed: 11/24/2022] Open
Abstract
While Virtual Reality (VR) technologies are commonly used in industrial companies, loading and modifying CAD parts of commercial CAD systems in virtual environments are still challenging. A few VR applications for Computer Aided Design (CAD) enable users to modify native CAD data in an immersive environment. Even if such VR-CAD applications use 3D interaction space, interaction with parameter values of CAD parts could be enhanced. This paper presents ShapeGuide, a technique allowing users to modify native CAD parts using a shape-based 3D interaction technique. With ShapeGuide, users can achieve modification of parameter values by directly pushing or pulling the surface of a CAD object. In addition, force feedback can be integrated into the technique to enhance the precision of the users' hand motions in the 3D space. In a controlled experiment, we compared ShapeGuide to a standard one-dimensional scroll technique to measure its added value for parametric CAD data modification on a simple industrial product example with an adjusted modification capability. We also evaluated the effect of force feedback assistance on both techniques. Results of this experiment demonstrate that ShapeGuide is significantly faster and more efficient than the scroll technique. Furthermore, they show that the force feedback assistance enhances the precision of both techniques, especially of ShapeGuide.
Collapse
Affiliation(s)
- Yujiro Okuya
- VENISE Team, LIMSI, CNRS, Univ. Paris-Sud, Université Paris-Saclay, Orsay, France.,LRI, Univ. Paris-Sud, CNRS, Inria, Université Paris-Saclay, Orsay, France
| | - Nicolas Ladeveze
- VENISE Team, LIMSI, CNRS, Univ. Paris-Sud, Université Paris-Saclay, Orsay, France
| | - Cédric Fleury
- LRI, Univ. Paris-Sud, CNRS, Inria, Université Paris-Saclay, Orsay, France
| | - Patrick Bourdot
- VENISE Team, LIMSI, CNRS, Univ. Paris-Sud, Université Paris-Saclay, Orsay, France
| |
Collapse
|
15
|
Orban D, Keefe DF, Biswas A, Ahrens J, Rogers D. Drag and Track: A Direct Manipulation Interface for Contextualizing Data Instances within a Continuous Parameter Space. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2018; 25:256-266. [PMID: 30136980 DOI: 10.1109/tvcg.2018.2865051] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
We present a direct manipulation technique that allows material scientists to interactively highlight relevant parameterized simulation instances located in dimensionally reduced spaces, enabling a user-defined understanding of a continuous parameter space. Our goals are two-fold: first, to build a user-directed intuition of dimensionally reduced data, and second, to provide a mechanism for creatively exploring parameter relationships in parameterized simulation sets, called ensembles. We start by visualizing ensemble data instances in dimensionally reduced scatter plots. To understand these abstract views, we employ user-defined virtual data instances that, through direct manipulation, search an ensemble for similar instances. Users can create multiple of these direct manipulation queries to visually annotate the spaces with sets of highlighted ensemble data instances. User-defined goals are therefore translated into custom illustrations that are projected onto the dimensionally reduced spaces. Combined forward and inverse searches of the parameter space follow naturally allowing for continuous parameter space prediction and visual query comparison in the context of an ensemble. The potential for this visualization technique is confirmed via expert user feedback for a shock physics application and synthetic model analysis.
Collapse
|
16
|
Lin CL, Coffey D, Keefe D, Erdman A. Optimizing Design With Extensive Simulation Data: A Case Study of Designing a Vacuum-Assisted Biopsy Tool. J Med Device 2018; 12:0210071-210077. [PMID: 30083279 DOI: 10.1115/1.4040043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2018] [Revised: 03/26/2018] [Indexed: 11/08/2022] Open
Abstract
Design by Dragging (DBD) [1] is a virtual design tool, which displays three-dimensional (3D) visualizations of many simulation results obtained by sampling a large design space and ties this visual display together with a new user interface. The design space is explored through mouse-based interactions performed directly on top of the 3D data visualizations. Our previous study [1] introduced the realization of DBD with a simplistic example of biopsy needle design under a static bending force. This paper considers a realistic problem of designing a vacuum-assisted biopsy (VAB) needle that brings in more technical challenges to include dynamic tissue reaction forces, nonlinear tissue deformation, and progressive tissue damage in an integrated visualization with design suggestions. The emphasis is placed on the inverse design strategy in DBD, which involves clicking directly on a stress (or other output field parameter) contour and dragging it to a new (usually preferable) position on the contour. Subsequently, the software computes the best fit for the design variables for generating a new output stress field based on the user input. Three cases demonstrated how the inverse design can assist users in intuitively and interactively approaching desired design solutions. This paper illustrates how virtual prototyping may be used to replace (or reduce reliance on) purely experimental trial-and-error methods for achieving optimal designs.
Collapse
Affiliation(s)
- Chi-Lun Lin
- Department of Mechanical Engineering, National Cheng Kung University, No. 1, University Road, Tainan City 701, Taiwan e-mail:
| | - Dane Coffey
- Walt Disney Imagineering, 1401 Flower Street, Glendale, CA 91201 e-mail:
| | - Daniel Keefe
- Department of Computer Science and Engineering, University of Minnesota, 200 Union St SE, Minneapolis, MN 55455 e-mail:
| | - Arthur Erdman
- Mem. ASME Department of Mechanical Engineering, University of Minnesota, 111 Church St SE, Minneapolis, MN 55455 e-mail:
| |
Collapse
|
17
|
Guy Erdman A. Lessons Learned From Kinematics Research Applied to Medical Device Design. J Biomech Eng 2018; 140:2666966. [PMID: 29247252 DOI: 10.1115/1.4038764] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2017] [Indexed: 11/08/2022]
Affiliation(s)
- Arthur Guy Erdman
- Professor Department of Mechanical Engineering, University of Minnesota, Minneapolis, MN 55455-0150 e-mail:
| |
Collapse
|
18
|
Liu J, Dwyer T, Marriott K, Millar J, Haworth A. Understanding the Relationship Between Interactive Optimisation and Visual Analytics in the Context of Prostate Brachytherapy. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2018; 24:319-329. [PMID: 28866546 DOI: 10.1109/tvcg.2017.2744418] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The fields of operations research and computer science have long sought to find automatic solver techniques that can find high-quality solutions to difficult real-world optimisation problems. The traditional workflow is to exactly model the problem and then enter this model into a general-purpose "black-box" solver. In practice, however, many problems cannot be solved completely automatically, but require a "human-in-the-loop" to iteratively refine the model and give hints to the solver. In this paper, we explore the parallels between this interactive optimisation workflow and the visual analytics sense-making loop. We assert that interactive optimisation is essentially a visual analytics task and propose a problem-solving loop analogous to the sense-making loop. We explore these ideas through an in-depth analysis of a use-case in prostate brachytherapy, an application where interactive optimisation may be able to provide significant assistance to practitioners in creating prostate cancer treatment plans customised to each patient's tumour characteristics. However, current brachytherapy treatment planning is usually a careful, mostly manual process involving multiple professionals. We developed a prototype interactive optimisation tool for brachytherapy that goes beyond current practice in supporting focal therapy - targeting tumour cells directly rather than simply seeking coverage of the whole prostate gland. We conducted semi-structured interviews, in two stages, with seven radiation oncology professionals in order to establish whether they would prefer to use interactive optimisation for treatment planning and whether such a tool could improve their trust in the novel focal therapy approach and in machine generated solutions to the problem.
Collapse
|
19
|
von Landesberger T, Fellner DW, Ruddle RA. Visualization System Requirements for Data Processing Pipeline Design and Optimization. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2017; 23:2028-2041. [PMID: 28113376 DOI: 10.1109/tvcg.2016.2603178] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The rising quantity and complexity of data creates a need to design and optimize data processing pipelines-the set of data processing steps, parameters and algorithms that perform operations on the data. Visualization can support this process but, although there are many examples of systems for visual parameter analysis, there remains a need to systematically assess users' requirements and match those requirements to exemplar visualization methods. This article presents a new characterization of the requirements for pipeline design and optimization. This characterization is based on both a review of the literature and first-hand assessment of eight application case studies. We also match these requirements with exemplar functionality provided by existing visualization tools. Thus, we provide end-users and visualization developers with a way of identifying functionality that addresses data processing problems in an application. We also identify seven future challenges for visualization research that are not met by the capabilities of today's systems.
Collapse
|
20
|
Pajer S, Streit M, Torsney-Weir T, Spechtenhauser F, Muller T, Piringer H. WeightLifter: Visual Weight Space Exploration for Multi-Criteria Decision Making. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2017; 23:611-620. [PMID: 27875176 DOI: 10.1109/tvcg.2016.2598589] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
A common strategy in Multi-Criteria Decision Making (MCDM) is to rank alternative solutions by weighted summary scores. Weights, however, are often abstract to the decision maker and can only be set by vague intuition. While previous work supports a point-wise exploration of weight spaces, we argue that MCDM can benefit from a regional and global visual analysis of weight spaces. Our main contribution is WeightLifter, a novel interactive visualization technique for weight-based MCDM that facilitates the exploration of weight spaces with up to ten criteria. Our technique enables users to better understand the sensitivity of a decision to changes of weights, to efficiently localize weight regions where a given solution ranks high, and to filter out solutions which do not rank high enough for any plausible combination of weights. We provide a comprehensive requirement analysis for weight-based MCDM and describe an interactive workflow that meets these requirements. For evaluation, we describe a usage scenario of WeightLifter in automotive engineering and report qualitative feedback from users of a deployed version as well as preliminary feedback from decision makers in multiple domains. This feedback confirms that WeightLifter increases both the efficiency of weight-based MCDM and the awareness of uncertainty in the ultimate decisions.
Collapse
|
21
|
Obermaier H, Bensema K, Joy KI. Visual Trends Analysis in Time-Varying Ensembles. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2016; 22:2331-2342. [PMID: 26685253 DOI: 10.1109/tvcg.2015.2507592] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Visualization and analysis techniques play a key role in the discovery of relevant features in ensemble data. Trends, in the form of persisting commonalities or differences in time-varying ensemble datasets, constitute one of the most expressive feature types in ensemble analysis. We develop a flow-graph representation as the core of a system designed for the visual analysis of trends in time-varying ensembles. In our interactive analysis framework, this graph is linked to a representation of ensemble parameter-space and the ensemble itself. This facilitates a detailed examination of trends and their correlations to properties of input-space. We demonstrate the utility of the proposed trends analysis framework in several benchmark data sets, highlighting its capability to support goal-driven design of time-varying simulations.
Collapse
|
22
|
|
23
|
Runesha HB, Tanasoiu BF, Subashki G, Erdman AG, Keefe DF. Fluid–Structure Interaction Simulation of Cardiac Leads in the Heart: Developing a Computational Model for Use in Medical Device Design1. J Med Device 2016. [DOI: 10.1115/1.4033872] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Affiliation(s)
| | - Bogdan Florin Tanasoiu
- Research Computing Center, University of Chicago, Chicago, IL 60637
- Mechanical Engineering, Purdue University, Lafayette, IN 47907
| | | | - Arthur G. Erdman
- Mechanical Engineering, University of Minnesota, Minneapolis, MN 55455
| | - Daniel F. Keefe
- Computer Science, University of Minnesota, Minneapolis, MN 55455
| |
Collapse
|
24
|
Sorger J, Ortner T, Luksch C, Schwärzler M, Gröller E, Piringer H. LiteVis: Integrated Visualization for Simulation-Based Decision Support in Lighting Design. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2016; 22:290-299. [PMID: 26529708 DOI: 10.1109/tvcg.2015.2468011] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
State-of-the-art lighting design is based on physically accurate lighting simulations of scenes such as offices. The simulation results support lighting designers in the creation of lighting configurations, which must meet contradicting customer objectives regarding quality and price while conforming to industry standards. However, current tools for lighting design impede rapid feedback cycles. On the one side, they decouple analysis and simulation specification. On the other side, they lack capabilities for a detailed comparison of multiple configurations. The primary contribution of this paper is a design study of LiteVis, a system for efficient decision support in lighting design. LiteVis tightly integrates global illumination-based lighting simulation, a spatial representation of the scene, and non-spatial visualizations of parameters and result indicators. This enables an efficient iterative cycle of simulation parametrization and analysis. Specifically, a novel visualization supports decision making by ranking simulated lighting configurations with regard to a weight-based prioritization of objectives that considers both spatial and non-spatial characteristics. In the spatial domain, novel concepts support a detailed comparison of illumination scenarios. We demonstrate LiteVis using a real-world use case and report qualitative feedback of lighting designers. This feedback indicates that LiteVis successfully supports lighting designers to achieve key tasks more efficiently and with greater certainty.
Collapse
|
25
|
Sedlmair M, Heinzl C, Bruckner S, Piringer H, Möller T. Visual Parameter Space Analysis: A Conceptual Framework. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2014; 20:2161-2170. [PMID: 26356930 DOI: 10.1109/tvcg.2014.2346321] [Citation(s) in RCA: 64] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Various case studies in different application domains have shown the great potential of visual parameter space analysis to support validating and using simulation models. In order to guide and systematize research endeavors in this area, we provide a conceptual framework for visual parameter space analysis problems. The framework is based on our own experience and a structured analysis of the visualization literature. It contains three major components: (1) a data flow model that helps to abstractly describe visual parameter space analysis problems independent of their application domain; (2) a set of four navigation strategies of how parameter space analysis can be supported by visualization tools; and (3) a characterization of six analysis tasks. Based on our framework, we analyze and classify the current body of literature, and identify three open research gaps in visual parameter space analysis. The framework and its discussion are meant to support visualization designers and researchers in characterizing parameter space analysis problems and to guide their design and evaluation processes.
Collapse
|
26
|
Beham M, Herzner W, Gröller ME, Kehrer J. Cupid: Cluster-Based Exploration of Geometry Generators with Parallel Coordinates and Radial Trees. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2014; 20:1693-1702. [PMID: 26356883 DOI: 10.1109/tvcg.2014.2346626] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Geometry generators are commonly used in video games and evaluation systems for computer vision to create geometric shapes such as terrains, vegetation or airplanes. The parameters of the generator are often sampled automatically which can lead to many similar or unwanted geometric shapes. In this paper, we propose a novel visual exploration approach that combines the abstract parameter space of the geometry generator with the resulting 3D shapes in a composite visualization. Similar geometric shapes are first grouped using hierarchical clustering and then nested within an illustrative parallel coordinates visualization. This helps the user to study the sensitivity of the generator with respect to its parameter space and to identify invalid parameter settings. Starting from a compact overview representation, the user can iteratively drill-down into local shape differences by clicking on the respective clusters. Additionally, a linked radial tree gives an overview of the cluster hierarchy and enables the user to manually split or merge clusters. We evaluate our approach by exploring the parameter space of a cup generator and provide feedback from domain experts.
Collapse
|
27
|
Kondo B, Collins C. DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2014; 20:2003-2012. [PMID: 26356914 DOI: 10.1109/tvcg.2014.2346250] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
We introduce a new direct manipulation technique, DimpVis, for interacting with visual items in information visualizations to enable exploration of the time dimension. DimpVis is guided by visual hint paths which indicate how a selected data item changes through the time dimension in a visualization. Temporal navigation is controlled by manipulating any data item along its hint path. All other items are updated to reflect the new time. We demonstrate how the DimpVis technique can be designed to directly manipulate position, colour, and size in familiar visualizations such as bar charts and scatter plots, as a means for temporal navigation. We present results from a comparative evaluation, showing that the DimpVis technique was subjectively preferred and quantitatively competitive with the traditional time slider, and significantly faster than small multiples for a variety of tasks.
Collapse
|
28
|
Waldon SM, Thompson PM, Hahn PJ, Taylor RM. SketchBio: a scientist's 3D interface for molecular modeling and animation. BMC Bioinformatics 2014; 15:334. [PMID: 25359079 PMCID: PMC4287593 DOI: 10.1186/1471-2105-15-334] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2014] [Accepted: 09/19/2014] [Indexed: 11/25/2022] Open
Abstract
Background Because of the difficulties involved in learning and using 3D modeling and rendering software, many scientists hire programmers or animators to create models and animations. This both slows the discovery process and provides opportunities for miscommunication. Working with multiple collaborators, a tool was developed (based on a set of design goals) to enable them to directly construct models and animations. Results SketchBio is presented, a tool that incorporates state-of-the-art bimanual interaction and drop shadows to enable rapid construction of molecular structures and animations. It includes three novel features: crystal-by-example, pose-mode physics, and spring-based layout that accelerate operations common in the formation of molecular models. Design decisions and their consequences are presented, including cases where iterative design was required to produce effective approaches. Conclusions The design decisions, novel features, and inclusion of state-of-the-art techniques enabled SketchBio to meet all of its design goals. These features and decisions can be incorporated into existing and new tools to improve their effectiveness. Electronic supplementary material The online version of this article (doi:10.1186/1471-2105-15-334) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Shawn M Waldon
- University of North Carolina at Chapel Hill, 27599 Chapel Hill, NC, USA.
| | | | | | | |
Collapse
|
29
|
Lin CL, Srivastava A, Coffey D, Keefe D, Horner M, Swenson M, Erdman A. A System for Optimizing Medical Device Development Using Finite Element Analysis Predictions. J Med Device 2014; 8:0209411-209413. [PMID: 25225592 DOI: 10.1115/1.4027096] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2014] [Revised: 03/04/2014] [Indexed: 11/08/2022] Open
Affiliation(s)
- Chi-Lun Lin
- Department of Mechanical Engineering , University of Minnesota, 111 Church Street SE, Minneapolis, MN 55455
| | | | - Dane Coffey
- Department of Computer Science and Engineering , University of Minnesota, 4-192 Keller Hall, 200 Union St., Minneapolis, MN 55455
| | - Daniel Keefe
- Department of Computer Science and Engineering , University of Minnesota, 4-192 Keller Hall, 200 Union St., Minneapolis, MN 55455
| | - Marc Horner
- ANSYS, Inc. , 8009 34th Ave. S #1475, Bloomington, MN 55425
| | - Mark Swenson
- ANSYS, Inc. , 8009 34th Ave. S #1475, Bloomington, MN 55425
| | - Arthur Erdman
- Department of Mechanical Engineering , University of Minnesota, 111 Church Street SE , Minneapolis, MN 55455
| |
Collapse
|