Correlated Photon Mapping for Interactive Global Illumination of Time-Varying Volumetric Data

Real-Time Denoising of Volumetric Path Tracing for Direct Volume Rendering

Direct volume rendering (DVR) using volumetric path tracing (VPT) is a scientific visualization technique that simulates light transport with objects' matter using physically-based lighting models. Monte Carlo (MC) path tracing is often used with surface models, yet its application for volumetric models is difficult due to the complexity of integrating MC light-paths in volumetric media with none or smooth material boundaries. Moreover, auxiliary geometry-buffers (G-buffers) produced for volumes are typically very noisy, failing to guide image denoisers relying on that information to preserve image details. This makes existing real-time denoisers, which take noise-free G-buffers as their input, less effective when denoising VPT images. We propose the necessary modifications to an image-based denoiser previously used when rendering surface models, and demonstrate effective denoising of VPT images. In particular, our denoising exploits temporal coherence between frames, without relying on noise-free G-buffers, which has been a common assumption of existing denoisers for surface-models. Our technique preserves high-frequency details through a weighted recursive least squares that handles heterogeneous noise for volumetric models. We show for various real data sets that our method improves the visual fidelity and temporal stability of VPT during classic DVR operations such as camera movements, modifications of the light sources, and editions to the volume transfer function.

Direct Transmittance Estimation in Heterogeneous Participating Media Using Approximated Taylor Expansions

Evaluating the transmittance between two points along a ray is a key component in solving the light transport through heterogeneous participating media and entails computing an intractable exponential of the integrated medium's extinction coefficient. While algorithms for estimating this transmittance exist, there is a lack of theoretical knowledge about their behaviour, which also prevent new theoretically sound algorithms from being developed. For this purpose, we introduce a new class of unbiased transmittance estimators based on random sampling or truncation of a Taylor expansion of the exponential function. In contrast to classical tracking algorithms, these estimators are non-analogous to the physical light transport process and directly sample the underlying extinction function without performing incremental advancement. We present several versions of the new class of estimators, based on either importance sampling or Russian roulette to provide finite unbiased estimators of the infinite Taylor series expansion. We also show that the well known ratio tracking algorithm can be seen as a special case of the new class of estimators. Lastly, we conduct performance evaluations on both the central processing unit (CPU) and the graphics processing unit (GPU), and the results demonstrate that the new algorithms outperform traditional algorithms for heterogeneous mediums.

Deep Volumetric Ambient Occlusion

We present a novel deep learning based technique for volumetric ambient occlusion in the context of direct volume rendering. Our proposed Deep Volumetric Ambient Occlusion (DVAO) approach can predict per-voxel ambient occlusion in volumetric data sets, while considering global information provided through the transfer function. The proposed neural network only needs to be executed upon change of this global information, and thus supports real-time volume interaction. Accordingly, we demonstrate DVAO's ability to predict volumetric ambient occlusion, such that it can be applied interactively within direct volume rendering. To achieve the best possible results, we propose and analyze a variety of transfer function representations and injection strategies for deep neural networks. Based on the obtained results we also give recommendations applicable in similar volume learning scenarios. Lastly, we show that DVAO generalizes to a variety of modalities, despite being trained on computed tomography data only.

Inviwo - A Visualization System with Usage Abstraction Levels

The complexity of today's visualization applications demands specific visualization systems tailored for the development of these applications. Frequently, such systems utilize levels of abstraction to improve the application development process, for instance by providing a data flow network editor. Unfortunately, these abstractions result in several issues, which need to be circumvented through an abstraction-centered system design. Often, a high level of abstraction hides low level details, which makes it difficult to directly access the underlying computing platform, which would be important to achieve an optimal performance. Therefore, we propose a layer structure developed for modern and sustainable visualization systems allowing developers to interact with all contained abstraction levels. We refer to this interaction capabilities as usage abstraction levels, since we target application developers with various levels of experience. We formulate the requirements for such a system, derive the desired architecture, and present how the concepts have been exemplary realized within the Inviwo visualization system. Furthermore, we address several specific challenges that arise during the realization of such a layered architecture, such as communication between different computing platforms, performance centered encapsulation, as well as layer-independent development by supporting cross layer documentation and debugging capabilities.

On Evaluating Runtime Performance of Interactive Visualizations

As our field matures, evaluation of visualization techniques has extended from reporting runtime performance to studying user behavior. Consequently, many methodologies and best practices for user studies have evolved. While maintaining interactivity continues to be crucial for the exploration of large data sets, no similar methodological foundation for evaluating runtime performance has been developed. Our analysis of 50 recent visualization papers on new or improved techniques for rendering volumes or particles indicates that only a very limited set of parameters like different data sets, camera paths, viewport sizes, and GPUs are investigated, which make comparison with other techniques or generalization to other parameter ranges at least questionable. To derive a deeper understanding of qualitative runtime behavior and quantitative parameter dependencies, we developed a framework for the most exhaustive performance evaluation of volume and particle visualization techniques that we are aware of, including millions of measurements on ten different GPUs. This paper reports on our insights from statistical analysis of this data, discussing independent and linear parameter behavior and non-obvious effects. We give recommendations for best practices when evaluating runtime performance of scientific visualization applications, which can serve as a starting point for more elaborate models of performance quantification.

Reliable subsurface scattering for volume rendering in three-dimensional ultrasound imaging

Light effects have been frequently used in volume rendering because they can depict the shapes of objects more realistically. Global illumination reflects light intensity values at relevant pixel positions of reconstructed images based on the considerations of scattering and extinction phenomena. However, in the cases of ultrasound volumes that do not use Cartesian coordinates, internal lighting operations generate errors owing to the distorted direction of light propagation, and thus increase the amount of light and its effects according to the position of the volume inside. In this study, we present a novel global illumination method with calibrated light along the progression direction in accordance with volume ray casting in non-Cartesian coordinates. In addition, we reduce the consumption of lighting operation in these lighting processes using a light-distribution template. Experimental results show the volume rendering outcomes in non-Cartesian coordinates that realistically visualize the global illumination effect. The light scattering effect is expressed uniformly in the top and bottom areas where many distortions are generated in the ultrasound coordinates by using the light template kernels adaptively. Our method can effectively identify dark areas that are invisible owing to differences in brightness at the upper and lower regions of the ultrasound coordinates. Our method can be used to realistically show the shapes of the fetus during relevant examinations with ultrasonography.

Visual Analysis for Understanding Irritable Bowel Syndrome

The cause of irritable bowel syndrome (IBS), a chronic disorder characterized by abdominal pain and disturbed bowel habits, is largely unknown. It is believed to be related to physical properties in the gut, central mechanisms in the brain, psychological factors, or a combination of these. To understand the relationships within the gut-brain axis with respect to IBS, large numbers of measurements ranging from stool samples to functional magnetic resonance imaging are collected from patients with IBS and healthy controls. As such, IBS is a typical example in medical research where research turns into a big data analysis challenge. In this chapter we demonstrate the power of interactive visual data analysis and exploration to generate an environment for scientific reasoning and hypothesis formulation for data from multiple sources with different character. Three case studies are presented to show the utility of the presented work.