Spatially Aware Transformer Networks for Contextual Prediction of Diabetic Nephropathy Progression from Whole Slide Images

Spatial transcriptomics in health and disease

The ability to localize hundreds of macromolecules to discrete locations, structures and cell types in a tissue is a powerful approach to understand the cellular and spatial organization of an organ. Spatially resolved transcriptomic technologies enable mapping of transcripts at single-cell or near single-cell resolution in a multiplex manner. The rapid development of spatial transcriptomic technologies has accelerated the pace of discovery in several fields, including nephrology. Its application to preclinical models and human samples has provided spatial information about new cell types discovered by single-cell sequencing and new insights into the cell-cell interactions within neighbourhoods, and has improved our understanding of the changes that occur in response to injury. Integration of spatial transcriptomic technologies with other omics methods, such as proteomics and spatial epigenetics, will further facilitate the generation of comprehensive molecular atlases, and provide insights into the dynamic relationships of molecular components in homeostasis and disease. This Review provides an overview of current and emerging spatial transcriptomic methods, their applications and remaining challenges for the field.

Application of visual transformer in renal image analysis

Deep Self-Attention Network (Transformer) is an encoder-decoder architectural model that excels in establishing long-distance dependencies and is first applied in natural language processing. Due to its complementary nature with the inductive bias of convolutional neural network (CNN), Transformer has been gradually applied to medical image processing, including kidney image processing. It has become a hot research topic in recent years. To further explore new ideas and directions in the field of renal image processing, this paper outlines the characteristics of the Transformer network model and summarizes the application of the Transformer-based model in renal image segmentation, classification, detection, electronic medical records, and decision-making systems, and compared with CNN-based renal image processing algorithm, analyzing the advantages and disadvantages of this technique in renal image processing. In addition, this paper gives an outlook on the development trend of Transformer in renal image processing, which provides a valuable reference for a lot of renal image analysis.