Stable-phase method for hierarchical annealing in the reconstruction of porous media images

Hierarchical reconstruction of three-dimensional porous media from a single two-dimensional image with multiscale entropy statistics

Despite the development of 3D imaging technology, the reconstruction of three-dimensional (3D) microstructure from a single two-dimensional (2D) image is still a prominent problem. In this paper, we propose a hierarchical reconstruction method based on simulated annealing, which is named hierarchical simulated annealing method (HSA), with the multiscale entropy statistics as the morphological information descriptor to reconstruct its corresponding three-dimensional (3D) microstructure from a single two-dimensional (2D) image. Both hierarchical simulated annealing (HSA) method and simulated annealing (SA) method are used to perform on the 2D and 3D microstructure reconstruction from a single 2D image, where the two-point cluster function and the standard two-point correlation function are used as the measurement metrics for the reconstructed 2D and 3D structures. From the 2D reconstructions, it can be seen that all the reconstructions of HSA method and SA method not only captures the similar morphological information with the original images, but also have a good agreement with the target microstructures in two-point cluster function. For the reconstructed 3D microstructures, the comparison of two-point correlation function shows that both HSA method and SA method can effectively reconstruct its 3D microstructure and the comparison of the reconstruction time between HSA method and SA method shows that the reconstruction speed of HSA method is an order of magnitude faster than that of SA method.

Three-dimensional reconstruction of granular porous media based on deep generative models

Reconstruction of microstructure in granular porous media, which can be viewed as granular assemblies, is crucial for studying their characteristics and physical properties in various fields concerned with the behavior of such media, including petroleum geology and computational materials science. In spite of the fact that many existing studies have investigated grain reconstruction, most of them treat grains as simplified individuals for discrete reconstruction, which cannot replicate the complex geometrical shapes and natural interactions between grains. In this work, a hybrid generative model based on a deep-learning algorithm is proposed for high-quality three-dimensional (3D) microstructure reconstruction of granular porous media from a single two-dimensional (2D) slice image. The method extracts 2D prior information from the given image and generates the grain set as a whole. Both a self-attention module and effective pattern loss are introduced in a bid to enhance the reconstruction ability of the model. Samples with grains of varied geometrical shapes are utilized for the validation of our method, and experimental results demonstrate that our proposed approach can accurately reproduce the complex morphology and spatial distribution of grains without any artificiality. Furthermore, once the model training is complete, rapid end-to-end generation of diverse 3D realizations from a single 2D image can be achieved.

Improved recurrent generative model for reconstructing large-size porous media from two-dimensional images

Modeling the three-dimensional (3D) structure from a given 2D image is of great importance for analyzing and studying the physical properties of porous media. As an intractable inverse problem, many methods have been developed to address this fundamental problems over the past decades. Among many methods, the deep learning-(DL) based methods show great advantages in terms of accuracy, diversity, and efficiency. Usually, the 3D reconstruction from the 2D slice with a larger field-of-view is more conducive to simulate and analyze the physical properties of porous media accurately. However, due to the limitation of reconstruction ability, the reconstruction size of most widely used generative adversarial network-based model is constrained to 64^{3} or 128^{3}. Recently, a 3D porous media recurrent neural network based method (namely, 3D-PMRNN) (namely 3D-PMRNN) has been proposed to improve the reconstruction ability, and thus the reconstruction size is expanded to 256^{3}. Nevertheless, in order to train these models, the existed DL-based methods need to down-sample the original computed tomography (CT) image first so that the convolutional kernel can capture the morphological features of training images. Thus, the detailed information of the original CT image will be lost. Besides, the 3D reconstruction from a optical thin section is not available because of the large size of the cutting slice. In this paper, we proposed an improved recurrent generative model to further enhance the reconstruction ability (512^{3}). Benefiting from the RNN-based architecture, the proposed model requires only one 3D training sample at least and generates the 3D structures layer by layer. There are three more improvements: First, a hybrid receptive field for the kernel of convolutional neural network is adopted. Second, an attention-based module is merged into the proposed model. Finally, a useful section loss is proposed to enhance the continuity along the Z direction. Three experiments are carried out to verify the effectiveness of the proposed model. Experimental results indicate the good reconstruction ability of proposed model in terms of accuracy, diversity, and generalization. And the effectiveness of section loss is also proved from the perspective of visual inspection and statistical comparison.

Fast reconstruction of multiphase microstructures based on statistical descriptors

In this paper, we propose a hierarchical simulated annealing of erosion method (HSAE) to improve the computational efficiency of multiphase microstructure reconstruction, whose computational efficiency can be improved by an order of magnitude. Reconstruction of the two-dimensional (2D) and three-dimensional (3D) multiphase microstructures (pore, grain, and clay) based on simulated annealing (SA) and HSAE are performed. In the reconstruction of multiphase microstructure with HSAE and SA, three independent two-point correlation functions are chosen as the morphological information descriptors. The two-point cluster function which contains significant high-order statistical information is used to verify the reconstruction results. From the analysis of 2D reconstruction, it can find that the proposed HSAE technique not only improves the quality of reconstruction, but also improves the computational efficiency. The reconstructions of our proposed method are still imperfect. This is because the used two-point correlation functions contain insufficient information. For the 3D reconstruction, the two-point correlation functions of the 3D generation are in excellent agreement with those of the original 2D image, which illustrates that our proposed method is effective for the reconstruction of 3D microstructure. The comparison of the energy vs computational time between the SA and HSAE methods shows that our presented method is an order of magnitude faster than the SA method. That is because only some of the pixels in the overall hierarchy need to be considered for sampling.

Three-dimensional reconstruction of porous media using super-dimension-based adjacent block-matching algorithm

As porous media play an essential role in a variety of industrial applications, it is essential to understand their physical properties. Nowadays, the super-dimensional (SD) reconstruction algorithm is used to stochastically reconstruct a three-dimensional (3D) structure of porous media from a given two-dimensional image. This algorithm exhibits superiority in accuracy compared with classical algorithms because it learns information from the real 3D structure. However, owing to the short development time of the SD algorithm, it also has some limitations, such as inexact porosity characterization, long run time, blocking artifacts, and suboptimal accuracy that may be improved. To mitigate these limitations, this study presents the design of a special template that contains two parts of data (i.e., adjacent blocks and a central block); the proposed method matches adjacent blocks during reconstruction and assigns the matched central block to the area to be reconstructed. Furthermore, we design two important mechanisms during reconstruction: one for block matching and the other for porosity control. To verify the effectiveness of the proposed method compared with an existing SD method, both methods were tested on silica particle material and three homogeneous sandstones with different porosities; meanwhile, we compared the proposed method with a multipoint statistics method and a simulated annealing method. The reconstructed results were then compared with the target both visually and quantitatively. The experimental results indicate that the proposed method can overcome the aforementioned limitations and further improve the accuracy of existing methods. This method achieved 4-6 speedup factor compared with the traditional SD method.

Reconstruction of 3D greyscale image for reservoir rock from a single image based on pattern dictionary

Most methods that model 3D porous media from 2D images are based on binary images. In this paper, we propose a method for reconstructing 3D greyscale isotropic porous media images from a single image. Our proposed method incorporates a fast-sampling procedure to control the continuity and variability between adjoining reconstruction layers, a new similarity calculation method to obtain the most similar patterns from a pattern dictionary, and a central area simulation procedure to solve the block effect problem. The reconstruction results from application of our proposed method to a real reservoir 3D model obtained via computed tomography (CT) and a comparison with the original CT structure demonstrate that our proposed method can reproduce properties such as autocorrelation function, linear function, shape distribution, average shape factor, average pore radius size, average throat radius size, average pore volume, permeability and grey histogram. Further, the comparison results indicate that the statistical characteristics of the reconstructions match the training image and the CT model perfectly.

Three-dimensional multiscale fusion for porous media on microtomography images of different resolutions

Accurately acquiring the three-dimensional (3D) image of a porous medium is an imperative issue for the prediction of multiple physical properties. Considering the inherent nature of the multiscale pores contained in porous media such as tight sandstones, to completely characterize the pore structure, one needs to scan the microstructure at different resolutions. Specifically, low-resolution (LR) images cover a larger field of view (FOV) of the sample, but are lacking small-scale features, whereas high-resolution (HR) images contain ample information, but sometimes only cover a limited FOV. To address this issue, we propose a method for fusing the spatial information from a two-dimensional (2D) HR image into a 3D LR image, and finally reconstructing an integrated 3D structure with added fine-scale features. In the fusion process, the large-scale structure depicted by the 3D LR image is fixed as background and the 2D image is utilized as training image to reconstruct a small-scale structure based on the background. To assess the performance of our method, we test it on a sandstone scanned with low and high resolutions. Statistical properties between the reconstructed image and the target are quantitatively compared. The comparison indicates that the proposed method enables an accurate fusion of the LR and HR images because the small-scale information is precisely reproduced within the large one.

Reconstruction of porous media from extremely limited information using conditional generative adversarial networks

Porous media are ubiquitous in both nature and engineering applications. Therefore, their modeling and understanding is of vital importance. In contrast to direct acquisition of three-dimensional (3D) images of this type of medium, obtaining its subregion (s) such as 2D images or several small areas can be feasible. Therefore, reconstructing whole images from limited information is a primary technique in these types of cases. Given data in practice cannot generally be determined by users and may be incomplete or only partially informed, thus making existing reconstruction methods inaccurate or even ineffective. To overcome this shortcoming, in this study we propose a deep-learning-based framework for reconstructing full images from their much smaller subareas. In particular, conditional generative adversarial network is utilized to learn the mapping between the input (a partial image) and output (a full image). To ensure the reconstruction accuracy, two simple but effective objective functions are proposed and then coupled with the other two functions to jointly constrain the training procedure. Because of the inherent essence of this ill-posed problem, a Gaussian noise is introduced for producing reconstruction diversity, thus enabling the network to provide multiple candidate outputs. Our method is extensively tested on a variety of porous materials and validated by both visual inspection and quantitative comparison. It is shown to be accurate, stable, and even fast (∼0.08 s for a 128×128 image reconstruction). The proposed approach can be readily extended by, for example, incorporating user-defined conditional data and an arbitrary number of object functions into reconstruction, while being coupled with other reconstruction methods.

Hierarchical Optimization: Fast and Robust Multiscale Stochastic Reconstructions with Rescaled Correlation Functions

Stochastic reconstructions based on universal correlation functions allow obtaining spatial structures based on limited input data or to fuse multiscale images from different sources. Current application of such techniques is severely hampered by the computational cost of the annealing optimization procedure. In this study we propose a novel hierarchical annealing method based on rescaled correlation functions, which improves both accuracy and computational efficiency of reconstructions while not suffering from disadvantages of existing speeding-up techniques. A significant order of magnitude gains in computational efficiency now allows us to add more correlation functions into consideration and, thus, to further improve the accuracy of the method. In addition, the method provides a robust multiscale framework to solve the universal upscaling or downscaling problem. The novel algorithm is extensively tested on binary (two-phase) microstructures of different genesis. In spite of significant improvements already in place, the current implementation of the hierarchical annealing method leaves significant room for additional accuracy and computational performance tweaks. As described here, (multiscale) stochastic reconstructions will find numerous applications in material and Earth sciences. Moreover, the proposed hierarchical approach can be readily applied to a wide spectrum of constrained optimization problems.

Improved multipoint statistics method for reconstructing three-dimensional porous media from a two-dimensional image via porosity matching

Reconstructing a three-dimensional (3D) structure from a single two-dimensional training image (TI) is a challenging issue. Multiple-point statistics (MPS) is an effective method to solve this problem. However, in the traditional MPS method, errors occur while statistical features of reconstruction, such as porosity, connectivity, and structural properties, deviate from those of TI. Due to the MPS reconstruction mechanism that the voxel being reconstructed is dependent on the reconstructed voxel, it may cause error accumulation during simulations, which can easily lead to a significant difference between the real 3D structure and the reconstructed result. To reduce error accumulation and improve morphological similarity, an improved MPS method based on porosity matching is proposed. In the reconstruction, we search the matching pattern in the TI directly. Meanwhile, a multigrid approach is also applied to capture the large-scale structures of the TI. To demonstrate its superiority over the traditional MPS method, our method is tested on different sandstone samples from many aspects, including accuracy, stability, generalization, and flow characteristics. Experimental results show that the reconstruction results by the improved MPS method effectively match the CT sandstone samples in correlation functions, local porosity distribution, morphological parameters, and permeability.

Reconstruction of a digital core containing clay minerals based on a clustering algorithm

It is difficult to obtain a core sample and information for digital core reconstruction of mature sandstone reservoirs around the world, especially for an unconsolidated sandstone reservoir. Meanwhile, reconstruction and division of clay minerals play a vital role in the reconstruction of the digital cores, although the two-dimensional data-based reconstruction methods are specifically applicable as the microstructure reservoir simulation methods for the sandstone reservoir. However, reconstruction of clay minerals is still challenging from a research viewpoint for the better reconstruction of various clay minerals in the digital cores. In the present work, the content of clay minerals was considered on the basis of two-dimensional information about the reservoir. After application of the hybrid method, and compared with the model reconstructed by the process-based method, the digital core containing clay clusters without the labels of the clusters' number, size, and texture were the output. The statistics and geometry of the reconstruction model were similar to the reference model. In addition, the Hoshen-Kopelman algorithm was used to label various connected unclassified clay clusters in the initial model and then the number and size of clay clusters were recorded. At the same time, the K-means clustering algorithm was applied to divide the labeled, large connecting clusters into smaller clusters on the basis of difference in the clusters' characteristics. According to the clay minerals' characteristics, such as types, textures, and distributions, the digital core containing clay minerals was reconstructed by means of the clustering algorithm and the clay clusters' structure judgment. The distributions and textures of the clay minerals of the digital core were reasonable. The clustering algorithm improved the digital core reconstruction and provided an alternative method for the simulation of different clay minerals in the digital cores.

Inferring low-dimensional microstructure representations using convolutional neural networks

We apply recent advances in machine learning and computer vision to a central problem in materials informatics: the statistical representation of microstructural images. We use activations in a pretrained convolutional neural network to provide a high-dimensional characterization of a set of synthetic microstructural images. Next, we use manifold learning to obtain a low-dimensional embedding of this statistical characterization. We show that the low-dimensional embedding extracts the parameters used to generate the images. According to a variety of metrics, the convolutional neural network method yields dramatically better embeddings than the analogous method derived from two-point correlations alone.

Evaluating the morphological completeness of a training image

Understanding the three-dimensional (3D) stochastic structure of a porous medium is helpful for studying its physical properties. A 3D stochastic structure can be reconstructed from a two-dimensional (2D) training image (TI) using mathematical modeling. In order to predict what specific morphology belonging to a TI can be reconstructed at the 3D orthogonal slices by the method of 3D reconstruction, this paper begins by introducing the concept of orthogonal chords. After analyzing the relationship among TI morphology, orthogonal chords, and the 3D morphology of orthogonal slices, a theory for evaluating the morphological completeness of a TI is proposed for the cases of three orthogonal slices and of two orthogonal slices. The proposed theory is evaluated using four TIs of porous media that represent typical but distinct morphological types. The significance of this theoretical evaluation lies in two aspects: It allows special morphologies, for which the attributes of a TI can be reconstructed at a special orthogonal slice of a 3D structure, to be located and quantified, and it can guide the selection of an appropriate reconstruction method for a special TI.

Pattern density function for reconstruction of three-dimensional porous media from a single two-dimensional image

Three-dimensional (3D) structures are useful for studying the spatial structures and physical properties of porous media. A 3D structure can be reconstructed from a single two-dimensional (2D) training image (TI) by using mathematical modeling methods. Among many reconstruction algorithms, an optimal-based algorithm was developed and has strong stability. However, this type of algorithm generally uses an autocorrelation function (which is unable to accurately describe the morphological features of porous media) as its objective function. This has negatively affected further research on porous media. To accurately reconstruct 3D porous media, a pattern density function is proposed in this paper, which is based on a random variable employed to characterize image patterns. In addition, the paper proposes an original optimal-based algorithm called the pattern density function simulation; this algorithm uses a pattern density function as its objective function, and adopts a multiple-grid system. Meanwhile, to address the key point of algorithm reconstruction speed, we propose the use of neighborhood statistics, the adjacent grid and reversed phase method, and a simplified temperature-controlled mechanism. The pattern density function is a high-order statistical function; thus, when all grids in the reconstruction results converge in the objective functions, the morphological features and statistical properties of the reconstruction results will be consistent with those of the TI. The experiments include 2D reconstruction using one artificial structure, and 3D reconstruction using battery materials and cores. Hierarchical simulated annealing and single normal equation simulation are employed as the comparison algorithms. The autocorrelation function, linear path function, and pore network model are used as the quantitative measures. Comprehensive tests show that 3D porous media can be reconstructed accurately from a single 2D training image by using the method proposed in this paper.

Multigrid hierarchical simulated annealing method for reconstructing heterogeneous media

A reconstruction methodology based on different-phase-neighbor (DPN) pixel swapping and multigrid hierarchical annealing is presented. The method performs reconstructions by starting at a coarse image and successively refining it. The DPN information is used at each refinement stage to freeze interior pixels of preformed structures. This preserves the large-scale structures in refined images and also reduces the number of pixels to be swapped, thereby resulting in a decrease in the necessary computational time to reach a solution. Compared to conventional single-grid simulated annealing, this method was found to reduce the required computation time to achieve a reconstruction by around a factor of 70-90, with the potential of even higher speedups for larger reconstructions. The method is able to perform medium sized (up to 300(3) voxels) three-dimensional reconstructions with multiple correlation functions in 36-47 h.

Universal Stochastic Multiscale Image Fusion: An Example Application for Shale Rock

Spatial data captured with sensors of different resolution would provide a maximum degree of information if the data were to be merged into a single image representing all scales. We develop a general solution for merging multiscale categorical spatial data into a single dataset using stochastic reconstructions with rescaled correlation functions. The versatility of the method is demonstrated by merging three images of shale rock representing macro, micro and nanoscale spatial information on mineral, organic matter and porosity distribution. Merging multiscale images of shale rock is pivotal to quantify more reliably petrophysical properties needed for production optimization and environmental impacts minimization. Images obtained by X-ray microtomography and scanning electron microscopy were fused into a single image with predefined resolution. The methodology is sufficiently generic for implementation of other stochastic reconstruction techniques, any number of scales, any number of material phases, and any number of images for a given scale. The methodology can be further used to assess effective properties of fused porous media images or to compress voluminous spatial datasets for efficient data storage. Practical applications are not limited to petroleum engineering or more broadly geosciences, but will also find their way in material sciences, climatology, and remote sensing.

Universal spatial correlation functions for describing and reconstructing soil microstructure

Structural features of porous materials such as soil define the majority of its physical properties, including water infiltration and redistribution, multi-phase flow (e.g. simultaneous water/air flow, or gas exchange between biologically active soil root zone and atmosphere) and solute transport. To characterize soil microstructure, conventional soil science uses such metrics as pore size and pore-size distributions and thin section-derived morphological indicators. However, these descriptors provide only limited amount of information about the complex arrangement of soil structure and have limited capability to reconstruct structural features or predict physical properties. We introduce three different spatial correlation functions as a comprehensive tool to characterize soil microstructure: 1) two-point probability functions, 2) linear functions, and 3) two-point cluster functions. This novel approach was tested on thin-sections (2.21×2.21 cm2) representing eight soils with different pore space configurations. The two-point probability and linear correlation functions were subsequently used as a part of simulated annealing optimization procedures to reconstruct soil structure. Comparison of original and reconstructed images was based on morphological characteristics, cluster correlation functions, total number of pores and pore-size distribution. Results showed excellent agreement for soils with isolated pores, but relatively poor correspondence for soils exhibiting dual-porosity features (i.e. superposition of pores and micro-cracks). Insufficient information content in the correlation function sets used for reconstruction may have contributed to the observed discrepancies. Improved reconstructions may be obtained by adding cluster and other correlation functions into reconstruction sets. Correlation functions and the associated stochastic reconstruction algorithms introduced here are universally applicable in soil science, such as for soil classification, pore-scale modelling of soil properties, soil degradation monitoring, and description of spatial dynamics of soil microbial activity.

Reconstruction of three-dimensional porous media from a single two-dimensional image using three-step sampling

A random three-dimensional (3D) porous medium can be reconstructed from a two-dimensional (2D) image by reconstructing an image from the original 2D image, and then repeatedly using the result to reconstruct the next 2D image. The reconstructed images are then stacked together to generate the entire reconstructed 3D porous medium. To perform this successfully, a very important issue must be addressed, i.e., controlling the continuity and variability among adjacent layers. Continuity and variability, which are consistent with the statistics characteristic of the training image (TI), ensure that the reconstructed result matches the TI. By selecting the number and location of the sampling points in the sampling process, the continuity and variability can be controlled directly, and thus the characteristics of the reconstructed image can be controlled indirectly. In this paper, we propose and develop an original sampling method called three-step sampling. In our sampling method, sampling points are extracted successively from the center of 5×5 and 3×3 sampling templates and the edge area based on a two-point correlation function. The continuity and variability of adjacent layers were considered during the three steps of the sampling process. Our method was tested on a Berea sandstone sample, and the reconstructed result was compared with the original sample, using tests involving porosity distribution, the lineal path function, the autocorrelation function, the pore and throat size distributions, and two-phase flow relative permeabilities. The comparison indicates that many statistical characteristics of the reconstructed result match with the TI and the reference 3D medium perfectly.