Empirical abundance distributions are more uneven than expected given their statistical baseline

Exploring and accounting for the emergent properties of ecosystems as complex systems is a promising horizon in the search for general processes to explain common ecological patterns. For example the ubiquitous hollow-curve form of the species abundance distribution is frequently assumed to reflect ecological processes structuring communities, but can also emerge as a statistical phenomenon from the mathematical definition of an abundance distribution. Although the hollow curve may be a statistical artefact, ecological processes may induce subtle deviations between empirical species abundance distributions and their statistically most probable forms. These deviations may reflect biological processes operating on top of mathematical constraints and provide new avenues for advancing ecological theory. Examining ~22,000 communities, we found that empirical SADs are highly uneven and dominated by rare species compared to their statistical baselines. Efforts to detect deviations may be less informative in small communities-those with few species or individuals-because these communities have poorly resolved statistical baselines. The uneven nature of many empirical SADs demonstrates a path forward for leveraging complexity to understand ecological processes governing the distribution of abundance, while the issues posed by small communities illustrate the limitations of using this approach to study ecological patterns in small samples.

Multiple data sources and freely available code is critical when investigating species distributions and diversity: a response to Knouft (2018)

A recent comment from Knouft () has suggested that our original article (Dallas et al. ) was an 'inappropriate application of biodiversity data'. Here, we affirm our results, and address the more general point about biodiversity data use.

The database of the PREDICTS (Projecting Responses of Ecological Diversity In Changing Terrestrial Systems) project

The PREDICTS project-Projecting Responses of Ecological Diversity In Changing Terrestrial Systems (www.predicts.org.uk)-has collated from published studies a large, reasonably representative database of comparable samples of biodiversity from multiple sites that differ in the nature or intensity of human impacts relating to land use. We have used this evidence base to develop global and regional statistical models of how local biodiversity responds to these measures. We describe and make freely available this 2016 release of the database, containing more than 3.2 million records sampled at over 26,000 locations and representing over 47,000 species. We outline how the database can help in answering a range of questions in ecology and conservation biology. To our knowledge, this is the largest and most geographically and taxonomically representative database of spatial comparisons of biodiversity that has been collated to date; it will be useful to researchers and international efforts wishing to model and understand the global status of biodiversity.

An extensive comparison of species-abundance distribution models

A number of different models have been proposed as descriptions of the species-abundance distribution (SAD). Most evaluations of these models use only one or two models, focus on only a single ecosystem or taxonomic group, or fail to use appropriate statistical methods. We use likelihood and AIC to compare the fit of four of the most widely used models to data on over 16,000 communities from a diverse array of taxonomic groups and ecosystems. Across all datasets combined the log-series, Poisson lognormal, and negative binomial all yield similar overall fits to the data. Therefore, when correcting for differences in the number of parameters the log-series generally provides the best fit to data. Within individual datasets some other distributions performed nearly as well as the log-series even after correcting for the number of parameters. The Zipf distribution is generally a poor characterization of the SAD.

Scaling laws predict global microbial diversity

Scaling laws underpin unifying theories of biodiversity and are among the most predictively powerful relationships in biology. However, scaling laws developed for plants and animals often go untested or fail to hold for microorganisms. As a result, it is unclear whether scaling laws of biodiversity will span evolutionarily distant domains of life that encompass all modes of metabolism and scales of abundance. Using a global-scale compilation of ∼35,000 sites and ∼5.6⋅10(6) species, including the largest ever inventory of high-throughput molecular data and one of the largest compilations of plant and animal community data, we show similar rates of scaling in commonness and rarity across microorganisms and macroscopic plants and animals. We document a universal dominance scaling law that holds across 30 orders of magnitude, an unprecedented expanse that predicts the abundance of dominant ocean bacteria. In combining this scaling law with the lognormal model of biodiversity, we predict that Earth is home to upward of 1 trillion (10(12)) microbial species. Microbial biodiversity seems greater than ever anticipated yet predictable from the smallest to the largest microbiome.

Linking environmental filtering and disequilibrium to biogeography with a community climate framework

We present a framework to measure the strength of environmental filtering and disequilibrium of the species composition of a local community across time, relative to past, current, and future climates. We demonstrate the framework by measuring the impact of climate change on New World forests, integrating data for climate niches of more than 14000 species, community composition of 471 New World forest plots, and observed climate across the most recent glacial-interglacial interval. We show that a majority of communities have species compositions that are strongly filtered and are more in equilibrium with current climate than random samples from the regional pool. Variation in the level of current community disequilibrium can be predicted from Last Glacial Maximum climate and will increase with near-future climate change.

Climate and species richness predict the phylogenetic structure of African mammal communities

We have little knowledge of how climatic variation (and by proxy, habitat variation) influences the phylogenetic structure of tropical communities. Here, we quantified the phylogenetic structure of mammal communities in Africa to investigate how community structure varies with respect to climate and species richness variation across the continent. In addition, we investigated how phylogenetic patterns vary across carnivores, primates, and ungulates. We predicted that climate would differentially affect the structure of communities from different clades due to between-clade biological variation. We examined 203 communities using two metrics, the net relatedness (NRI) and nearest taxon (NTI) indices. We used simultaneous autoregressive models to predict community phylogenetic structure from climate variables and species richness. We found that most individual communities exhibited a phylogenetic structure consistent with a null model, but both climate and species richness significantly predicted variation in community phylogenetic metrics. Using NTI, species rich communities were composed of more distantly related taxa for all mammal communities, as well as for communities of carnivorans or ungulates. Temperature seasonality predicted the phylogenetic structure of mammal, carnivoran, and ungulate communities, and annual rainfall predicted primate community structure. Additional climate variables related to temperature and rainfall also predicted the phylogenetic structure of ungulate communities. We suggest that both past interspecific competition and habitat filtering have shaped variation in tropical mammal communities. The significant effect of climatic factors on community structure has important implications for the diversity of mammal communities given current models of future climate change.

How species richness and total abundance constrain the distribution of abundance

The species abundance distribution (SAD) is one of the most intensively studied distributions in ecology and its hollow-curve shape is one of ecology's most general patterns. We examine the SAD in the context of all possible forms having the same richness (S) and total abundance (N), i.e. the feasible set. We find that feasible sets are dominated by similarly shaped hollow curves, most of which are highly correlated with empirical SADs (most R(2) values > 75%), revealing a strong influence of N and S on the form of the SAD and an a priori explanation for the ubiquitous hollow curve. Empirical SADs are often more hollow and less variable than the majority of the feasible set, revealing exceptional unevenness and relatively low natural variability among ecological communities. We discuss the importance of the feasible set in understanding how general constraints determine observable variation and influence the forms of predicted and empirical patterns.

The EcoData retriever: improving access to existing ecological data

Ecological research relies increasingly on the use of previously collected data. Use of existing datasets allows questions to be addressed more quickly, more generally, and at larger scales than would otherwise be possible. As a result of large-scale data collection efforts, and an increasing emphasis on data publication by journals and funding agencies, a large and ever-increasing amount of ecological data is now publicly available via the internet. Most ecological datasets do not adhere to any agreed-upon standards in format, data structure or method of access. Some may be broken up across multiple files, stored in compressed archives, and violate basic principles of data structure. As a result acquiring and utilizing available datasets can be a time consuming and error prone process. The EcoData Retriever is an extensible software framework which automates the tasks of discovering, downloading, and reformatting ecological data files for storage in a local data file or relational database. The automation of these tasks saves significant time for researchers and substantially reduces the likelihood of errors resulting from manual data manipulation and unfamiliarity with the complexities of individual datasets.

Characterizing species abundance distributions across taxa and ecosystems using a simple maximum entropy model

The species abundance distribution (SAD) is one of themost studied patterns in ecology due to its potential insights into commonness and rarity, community assembly, and patterns of biodiversity. It is well established that communities are composed of a few common and many rare species, and numerous theoretical models have been proposed to explain this pattern. However, no attempt has been made to determine how well these theoretical characterizations capture observed taxonomic and global-scale spatial variation in the general form of the distribution. Here, using data of a scope unprecedented in community ecology, we show that a simple maximum entropy model produces a truncated log-series distribution that can predict between 83% and 93% of the observed variation in the rank abundance of species across 15 848 globally distributed communities including birds, mammals, plants, and butterflies. This model requires knowledge of only the species richness and total abundance of the community to predict the full abundance distribution, which suggests that these factors are sufficient to understand the distribution for most purposes. Since geographic patterns in richness and abundance can often be successfully modeled, this approach should allow the distribution of commonness and rarity to be characterized, even in locations where empirical data are unavailable.