Collective computation in biological populations
Ecosystems may seem unlikely substrates for sophisticated computation. But two key features make them a promising way for solving sophisticated machine learning problems based on constrained optimization. First of all, self-replication provides stable constraint enforcement. Stable coexistence requires that the environmental state satisfy a precise set of conditions, such that the population growth rates of all species are simultaneously zero. A slight deviation from this constraint will lead to exponential growth or decay of one or more population sizes, which in turn will modify the environment until these conditions are restored. Secondly, distributing the computation over a whole ecosystem provides automatic parallelization, which becomes particularly important for solving problems efficiently in high dimension.
This intuition can be transformed into a precise mathematical duality, as my coauthors and I have recently shown (Mehta et al., 2019). The duality opens some interesting horizons for thinking about ecosystems and about classic machine learning problems, suggesting new observables for field ecologists (Marsland III et al., 2020) and new algorithms for online learning (Howell et al., 2020).
But is it possible to actually use an ecosystem to perform a computation? The adaptive immune system is a natural place to start. T cells are clearly performing a collective computation to determine whether a given antigen comes from a native protein or from a pathogen. My colleagues and I have recently developed a model of immune self-tolerance that sheds new light on the nature of this computation (Marsland III et al., 2021).
References
- Mehta, P., Cui, W., Wang, C.-H., & Marsland III, R. (2019). Constrained optimization as ecological dynamics with applications to random quadratic programming in high dimensions. Physical Review E, 99(5), 052111.
- Marsland III, R., Cui, W., & Mehta, P. (2020). The minimum environmental perturbation principle: A new perspective on niche theory. The American Naturalist, 196.
- Howell, O., Wenping, C., Marsland III, R., & Mehta, P. (2020). Machine Learning as Ecology. Journal of Physics A: Mathematical and Theoretical, 53, 334001.
- Marsland III, R., Howell, O., Mayer, A., & Mehta, P. (2021). Tregs self-organize into a computing ecosystem and implement a sophisticated optimization algorithm for mediating immune response. PNAS, 118, e2011709118.