Gaussian processes retrieval of LAI from Sentinel-2 top-of-atmosphere radiance data

Retrieval of vegetation properties from satellite and airborne optical data usually takes place after atmospheric correction, yet it is also possible to develop retrieval algorithms directly from top-of-atmosphere (TOA) radiance data. One of the key vegetation variables that can be retrieved from at-sensor TOA radiance data is leaf area index (LAI) if algorithms account for variability in atmosphere. We demonstrate the feasibility of LAI retrieval from Sentinel-2 (S2) TOA radiance data (L1C product) in a hybrid machine learning framework. To achieve this, the coupled leaf-canopy-atmosphere radiative transfer models PROSAIL-6SV were used to simulate a look-up table (LUT) of TOA radiance data and associated input variables. This LUT was then used to train the Bayesian machine learning algorithms Gaussian processes regression (GPR) and variational heteroscedastic GPR (VHGPR). PROSAIL simulations were also used to train GPR and VHGPR models for LAI retrieval from S2 images at bottom-of-atmosphere (BOA) level (L2A product) for comparison purposes. The BOA and TOA LAI products were consistently validated against a field dataset with GPR (R² of 0.78) and with VHGPR (R ² of 0.80) and for both cases a slightly lower RMSE for the TOA LAI product (about 10% reduction). Because of delivering superior accuracies and lower uncertainties, the VHGPR models were further applied for LAI mapping using S2 acquisitions over the agricultural sites Marchfeld (Austria) and Barrax (Spain). The models led to consistent LAI maps at BOA and TOA scale. The LAI maps were also compared against LAI maps as generated by the SNAP toolbox, which is based on a neural network (NN). Maps were again consistent, however the SNAP NN model tends to overestimate over dense vegetation cover. Overall, this study demonstrated that hybrid LAI retrieval algorithms can be developed from TOA radiance data given a cloud-free sky, thus without the need of atmospheric correction. To the benefit of the community, the development of such hybrid models for the retrieval vegetation properties from BOA or TOA images has been streamlined in the freely downloadable ALG-ARTMO software framework.

Gaussian processes retrieval of LAI from Sentinel-2 top-of-atmosphere radiance data

Retrieval of vegetation properties from satellite and airborne optical data usually takes place after atmospheric correction, yet it is also possible to develop retrieval algorithms directly from top-of-atmosphere (TOA) radiance data. One of the key vegetation variables that can be retrieved from at-sensor TOA radiance data is leaf area index (LAI) if algorithms account for variability in atmosphere. We demonstrate the feasibility of LAI retrieval from Sentinel-2 (S2) TOA radiance data (L1C product) in a hybrid machine learning framework. To achieve this, the coupled leaf-canopy-atmosphere radiative transfer models PROSAIL-6SV were used to simulate a look-up table (LUT) of TOA radiance data and associated input variables. This LUT was then used to train the Bayesian machine learning algorithms Gaussian processes regression (GPR) and variational heteroscedastic GPR (VHGPR). PROSAIL simulations were also used to train GPR and VHGPR models for LAI retrieval from S2 images at bottom-of-atmosphere (BOA) level (L2A product) for comparison purposes. The BOA and TOA LAI products were consistently validated against a field dataset with GPR (R² of 0.78) and with VHGPR (R ² of 0.80) and for both cases a slightly lower RMSE for the TOA LAI product (about 10% reduction). Because of delivering superior accuracies and lower uncertainties, the VHGPR models were further applied for LAI mapping using S2 acquisitions over the agricultural sites Marchfeld (Austria) and Barrax (Spain). The models led to consistent LAI maps at BOA and TOA scale. The LAI maps were also compared against LAI maps as generated by the SNAP toolbox, which is based on a neural network (NN). Maps were again consistent, however the SNAP NN model tends to overestimate over dense vegetation cover. Overall, this study demonstrated that hybrid LAI retrieval algorithms can be developed from TOA radiance data given a cloud-free sky, thus without the need of atmospheric correction. To the benefit of the community, the development of such hybrid models for the retrieval vegetation properties from BOA or TOA images has been streamlined in the freely downloadable ALG-ARTMO software framework.

Comparative analysis of atmospheric radiative transfer models using the Atmospheric Look-up table Generator (ALG) toolbox (version 2.0)

Atmospheric radiative transfer models (RTMs) are software tools that help researchers in understanding the radiative processes occurring in the Earth's atmosphere. Given their importance in remote sensing applications, the intercomparison of atmospheric RTMs is therefore one of the main tasks used to evaluate model performance and identify the characteristics that differ between models. This can be a tedious tasks that requires good knowledge of the model inputs/outputs and the generation of large databases of consistent simulations. With the evolution of these software tools, their increase in complexity bears implications for their use in practical applications and model intercomparison. Existing RTM-specific graphical user interfaces are not optimized for performing intercomparison studies of a wide variety of atmospheric RTMs. In this paper, we present the Atmospheric Look-up table Generator (ALG) version 2.0, a new software tool that facilitates generating large databases for a variety of atmospheric RTMs. ALG facilitates consistent and intuitive user interaction to enable the running of model executions and storing of RTM data for any spectral configuration in the optical domain. We demonstrate the utility of ALG in performing intercomparison studies of radiance simulations from broadly used atmospheric RTMs (6SV, MODTRAN, and libRadtran) through global sensitivity analysis. We expect that providing ALG to the research community will facilitate the usage of atmospheric RTMs to a wide range of applications in Earth observation.

Gradient-Based Automatic Lookup Table Generator for Radiative Transfer Models

Physically based radiative transfer models (RTMs) are widely used in Earth observation to understand the radiation processes occurring on the Earth's surface and their interactions with water, vegetation, and atmosphere. Through continuous improvements, RTMs have increased in accuracy and representativity of complex scenes at expenses of an increase in complexity and computation time, making them impractical in various remote sensing applications. To overcome this limitation, the common practice is to precompute large lookup tables (LUTs) for their later interpolation. To further reduce the RTM computation burden and the error in LUT interpolation, we have developed a method to automatically select the minimum and optimal set of input-output points (nodes) to be included in an LUT. We present the gradient-based automatic LUT generator algorithm (GALGA), which relies on the notion of an acquisition function that incorporates: 1) the Jacobian evaluation of an RTM and 2) the information about the multivariate distribution of the current nodes. We illustrate the capabilities of GALGA in the automatic construction and optimization of MODTRAN-based LUTs of different dimensions of the input variables space. Our results indicate that when compared with a pseudorandom homogeneous distribution of the LUT nodes, GALGA reduces:1) the LUT size by >24%; 2) the computation time by 27%; and 3) the maximum interpolation relative errors by at least 10%. It is concluded that an automatic LUT design might benefit from the methodology proposed in GALGA to reduce interpolation errors and computation time in computationally expensive RTMs.

Emulation as an Accurate Alternative to Interpolation in Sampling Radiative Transfer Codes

Computationally expensive radiative transfer models (RTMs) are widely used to realistically reproduce the light interaction with the earth surface and atmosphere. Because these models take long processing time, the common practice is to first generate a sparse look-up table (LUT) and then make use of interpolation methods to sample the multidimensional LUT input variable space. However, the question arise whether common interpolation methodsperform most accurate. As an alternative to interpolation, this paper proposes to use emulation, i.e., approximating the RTM output by means of the statistical learning. Two experiments were conducted to assess the accuracy in delivering spectral outputs using interpolation and emulation: at canopy level, using PROSAIL; and at top-of-atmosphere level, using MODTRAN. Various interpolation (nearest-neighbor, inverse distance weighting, and piece-wice linear) and emulation [Gaussian process regression (GPR), kernel ridge regression, and neural networks] methods were evaluated against a dense reference LUT. In all experiments, the emulation methods clearly produced more accurate output spectra than classical interpolation methods. The GPR emulation performed up to ten times more accurately than the best performing interpolation method, and this with a speed that is competitive with the faster interpolation methods. It is concluded that emulation can function as a fast and more accurate alternative to commonly used interpolation methods for reconstructing RTM spectral data.

Motion Driven Tonal Stabilization

This paper addresses the problem of tonal fluctuation in videos. Due to the automatic settings of consumer cameras, the colors of objects in image sequences might change over time. We propose here a fast and computationally light method to stabilize this tonal appearance, while remaining robust to motion and occlusions. To do so, a minimally viable color correction model is used, in conjunction with an effective estimation of dominant motion. The final solution is a temporally weighted correction, explicitly driven by the motion magnitude, both visually efficient and very fast, with potential to real time processing. Experimental results obtained on a variety of sequences outperform the current state of the art in terms of tonal stability, at a much reduced computational complexity.

[Natural history of an optic disc macroaneurysm]

CASE REPORT

A 75-year old man with reduced vision in his left eye (0.05) presented with hypertensive retinopathy, retinal haemorrhages and cotton wool spots in the papillomacular bundle, as well as macular oedema. Fluorescein angiography showed a saccular hyperfluorescent lesion corresponding to arterial macroaneurysm on the optic disc, with the optical coherence tomography demonstrating macular oedema. At 2 months follow-up, vision had improved to 0.7 with spontaneous closure of the macroaneurysm and resolution of the macular oedema.

DISCUSSION

Arterial macroaneurysms on the optic disc are unusual and are difficult to diagnose clinically. There is no safe and effective treatment, and our case, as the few single cases reported, showed that they can spontaneously close and enable visual function to recover.

[Delayed diagnosis of ophthalmic artery obstruction due to atrial myxoma]

CASE REPORT

A 56 year old woman with atrial myxoma presented with a visual acuity of no light perception after acute ophthalmic artery obstruction (OAO) associated with stroke. She developed late retinal pigmentary changes due choroidal infarction, typical of the OAO.

DISCUSSION

Simultaneous obstruction of the retinal and choroidal circulation was observed in the OAO. Atrial myxoma should be suspected in patients who suffer from OAO associated with stroke. Systemic studies should be performed to find the origin of OAO.

Meaningful matches in stereovision

This paper introduces a statistical method to decide whether two blocks in a pair of images match reliably. The method ensures that the selected block matches are unlikely to have occurred "just by chance." The new approach is based on the definition of a simple but faithful statistical background model for image blocks learned from the image itself. A theorem guarantees that under this model, not more than a fixed number of wrong matches occurs (on average) for the whole image. This fixed number (the number of false alarms) is the only method parameter. Furthermore, the number of false alarms associated with each match measures its reliability. This a contrario block-matching method, however, cannot rule out false matches due to the presence of periodic objects in the images. But it is successfully complemented by a parameterless self-similarity threshold. Experimental evidence shows that the proposed method also detects occlusions and incoherent motions due to vehicles and pedestrians in nonsimultaneous stereo.