The maximum entropy principle for compositional data

The calculus of codes - From entropy, complexity, and information to life

Exploring the core components that define living systems and their operational mechanisms within emerging biological entities is a complex endeavor. In the realm of biological systems literature, the terms matter, energy, information, complexity, and entropy are frequently referenced. However, possessing these concepts alone does not guarantee a comprehensive understanding or the ability to reconstruct the intricate nature of life. This study aims to illuminate the trajectory of these organic attributes, presenting a theoretical framework that delves into the integrated role of these concepts in biology. We assert that Code Biology serves as a pivotal steppingstone for unraveling the mechanisms underlying life. Biological codes (BCs) emerge not only from the interplay of matter and energy but also from Information. Contrary to deriving information from the former elements, we propose that information holds its place as a fundamental physical aspect. Consequently, we propose a continuum perspective called Calculus of Fundamentals involving three fundamentals: Matter, Energy, and Information, to depict the dynamics of BCs. To achieve this, we emphasize the necessity of studying Entropy and Complexity as integral organic descriptors. This perspective also facilitates the introduction of a mathematical theoretical framework that aids in comprehending continuous changes, the driving dynamics of biological fundamentals. We posit that Energy, Matter, and Information constitute the essential building blocks of living systems, and their interactions are governed by Entropy and Complexity analyses, redefined as biological descriptors. This interdisciplinary perspective of Code Biology sheds light on the intricate interplay between the controversial phenomenon of life and advances the idea of constructing a theory rooted in information as an organic fundamental.

Geometric graph neural networks on multi-omics data to predict cancer survival outcomes

The advance of sequencing technologies has enabled a thorough molecular characterization of the genome in human cancers. To improve patient prognosis predictions and subsequent treatment strategies, it is imperative to develop advanced computational methods to analyze large-scale, high-dimensional genomic data. However, traditional machine learning methods face a challenge in handling the high-dimensional, low-sample size problem that is shown in most genomic data sets. To address this, our group has developed geometric network analysis techniques on multi-omics data in connection with prior biological knowledge derived from protein-protein interactions (PPIs) or pathways. Geometric features obtained from the genomic network, such as Ollivier-Ricci curvature and the invariant measure of the associated Markov chain, have been shown to be predictive of survival outcomes in various cancers. In this study, we propose a novel supervised deep learning method called geometric graph neural network (GGNN) that incorporates such geometric features into deep learning for enhanced predictive power and interpretability. More specifically, we utilize a state-of-the-art graph neural network with sparse connections between the hidden layers based on known biology of the PPI network and pathway information. Geometric features along with multi-omics data are then incorporated into the corresponding layers. The proposed approach utilizes a local-global principle in such a manner that highly predictive features are selected at the front layers and fed directly to the last layer for multivariable Cox proportional-hazards regression modeling. The method was applied to multi-omics data from the CoMMpass study of multiple myeloma and ten major cancers in The Cancer Genome Atlas (TCGA). In most experiments, our method showed superior predictive performance compared to other alternative methods.