Reviewer #1 (Public review):
Summary
The authors build a "digital sphinx" by stitching together two neural network models: (i) a recurrent network with fixed parameters derived from the C. elegans connectome and imputed physiological (e.g. neural input/output) functions, and (ii) a feedforward encoder-decoder model with learnable parameters intended to represent a central brain - to - motor interface, then harnessing the combined model to a Drosophila biomechanical model situated in a physics simulator, and finally using deep reinforcement learning (DRL) training to optimize the parameters of the encoder-decoder model to reproduce a set of spatiotemporal patterns of jointed limb activations that together produce the overall organismal behavior of walking, within the physics simulator.
The primary intent of this paper is to dispel the recent grandiose claims made in the mainstream press by a private company, Eon Systems, to have achieved a major advance in biologically based brain simulation of the production of a set of ethologically relevant motor behaviors by the fly. Representatives of the company referred to this modeling and training process euphemistically and deceptively as "brain uploading". The authors proceed with a reduction-to-triviality exercise by constructing their own high-parameter dynamical brain-plus-body model situated in a physical simulation that produces, after training by reinforcement learning, satisfying ethological behavioral imitation in the same vein as the private company claim, but based on a clearly absurd and biologically unrealistic set of model assumptions.
Secondarily, the paper provides two overall admonitions that they assert their computational demonstration illustrates: that training high parameter network models to imitate behavior, even if they possess some biological detail, will deliver little or no biological insight, and that models of behavioral generation must be built from detailed biological data and, crucially, developed in a hypothesis generation/falsification loop with experimental validation, in order to be scientifically useful.
Appraisal
The authors are well justified in challenging the non-rigorous claims of "uploading" or even the delivery of a neurobehavioral simulation with potential scientific utility, in unison with the vocal criticisms of many other researchers in the fields of AI and neuroscience, and it is an important message to deliver to the world. However, the authors' own modeling counter-exercise, while clever and vivid in imagery, suffers from its own lack of rigor, both in disclosure of implementation and in scientific case-making. Some sacrifice of clarity and thoroughness in the interest of brevity is inevitable under the brief format of this manuscript; however, we suggest that crucial additions and modifications should be made to avoid falling into a similar trap of non-rigorous sensationalism.
Because the private company claims were not accompanied by a scientific paper, preprint, code repository, or much methodological disclosure of any kind, the authors have the particular challenge of building a refutation case against an undefined target. As a consequence, the authors chose their own task, model structure, and training paradigm.
The authors argue that brain models need to be built from biological data to be useful for yielding biological insight. We agree with the overall principle; however, in practice, this procedure is fraught with epistemological difficulty. Biological modeling suffers from a unique challenge within the larger endeavor of scientific/physical modeling, which is that it is generally unclear as to precisely what biological quantities should be measured and at what level of detail they should be measured. Additionally, biological data will by necessity be incomplete and noisy, and thus decisions of coarse-graining must be made at the outset of large-scale data collection projects, and some, possibly a substantial, level of data imputation will have to be performed in order to build testable models in our lifetimes. Despite the astonishing success of scaling (in both parameter count and corpus size) in engineered neural networks for certain human-like tasks, it is not at all clear that simply adding more detail to biological models will produce deeper scientific insight, or whether cataloging parameters from snapshot data will yield functional simulations. The failed Blue Brain mega-project should provide a lesson, as well as Marder's longstanding work on parameter variation in neural systems. The coupled, pernicious questions of choosing measurement detail and modeling detail represent a deep, unsolved challenge area for the field, and this context should be raised in the text.
The message about overinterpreting models trained with deep reinforcement learning, while valid and important, should be broadened to be a message about overinterpreting trained high-parameter models in general, in their ability to fit data or reproduce simple behavior. Other parameter optimization/learning procedures for building underdetermined and/or high-parameter models risk the same misinterpretation. The prescription of building models in conjunction with experimental prediction and validation is an important point.
The authors leave out an additional important and underappreciated challenge of brain-model-building, which is that imitating a time segment of behavior is a computational task of unspecified, and possibly low complexity. Successful recapitulation of behavioral time series may simply not be considered cognitively interesting, even if the model is built entirely on biological data. While quantifying task complexity is another open area of computational and neuroscientific research, the authors should, at a minimum, describe their particular task data in explicit mathematical terms and preferentially provide some complexity analysis. In the absence of task complexity analysis, at a minimum, computational controls should be applied to demonstrate the necessity of whatever structure or data is being asserted in the model. This epistemological practice is glaringly absent in much, if not most, of the neurobehavioral modeling literature. This paper would be a good opportunity to set an example of rigor.
Finally, the authors' description of prior work in the field of whole-organism neurobiological simulation feels incomplete and skewed toward work in Drosophila versus other model organisms. An internet search reveals many published efforts to build neurobehavioral models at varying levels of detail in C. elegans, of which only two are referenced.
We do feel this work constitutes an illustrative scientific exercise and important counterpoint to the sensationalism building around efforts in neurobiological simulation. It should inspire further work in defining a rigorous and scientifically productive epistemological framework for these kinds of brain modeling efforts.
Further Comments
(1) The authors oversell the completeness and quality of connectome datasets and what they lack.
Language such as "complete wiring diagrams," "nearly comprehensive connectomes" neglects the well-appreciated gaps in biological data that most practitioners believe necessary for useful, detailed models to be built. There is a brief mention that biological parameters "remain unknown" and that interfaces are "incompletely characterized", but beyond that, the authors do not explain which parameters are missing, why these parameters might matter, and what still needs to be addressed in order to make any plausible whole-brain emulation claims. This may also inadvertently bolster the sensationalist claims that the manuscript is trying to deflate by giving the impression that neurobiological and physiological data collection is a near-complete exercise.
(2) Prior work in C. elegans neurobehavioral modeling should be more acknowledged, if nothing else, for why it has been largely unsatisfying.
C. elegans is rarely discussed, while Drosophila is primarily focused on. The status of C. elegans connectomics, physiological mapping, biomechanics, and neurobehavioral modeling is worth more treatment.
(3) Critiques of Eon Systems announcements also, by and large, apply to more detailed and disclosed efforts in neurobehavioral modeling using RL for parameter imputation, and this should be recognized.
By way of reference to a tweet in the first paragraph, the authors are responding to a recent claim made by a startup that they have fully "uploaded" a fly brain, a significant advance vis-à-vis prior work in neurobehavioral modeling in Drosophila, such as references [3 and 9], which are mentioned as background in the paper but left out of the methodological critique. But one of the central warnings of the paper is around the challenge of interpretability when using reinforcement learning to optimize model parameters. The authors also should acknowledge that the use of RL has been justified by building neurobehavioral model builders as a proxy for the learning and tuning processes thought to occur during animal development.
(4) Substantiate the reservoir computing explanatory claim with appropriate computational controls.
The reservoir computing idea is the only piece of hypothesizing a necessary function for the central brain component model in the paper. This claim could be substantiated with some basic computational controls rather than just hypothesized. We suggest the following possibilities as additions to the model: (a) replace the connectome with an RRNN, (b) shuffle the connectome, or (c) use other simple dynamical systems in place of the worm brain model.
Specific Manuscript Comments
(1) Abstract
"New connectome datasets and musculoskeletal models now enable integrated, closed-loop simulations of the neural and biomechanical systems of the fruit fly Drosophila, an ideal model organism to investigate embodied intelligence."<br />
This sentence could mislead non-specialists into thinking all current simulations are novel because the connectome datasets are new. In fact, FlyWire (2024), NeuroMechFly (2022), and other connectomes have already been available for some years now. We believe that this sentence is a chance to make the opposite point that these resources have existed for a while, and that many simulations have been built before.
"However, many biological parameters of the nervous system and the body, as well as how they interface, remain unknown."<br />
Some examples of specific parameter/physiological data types that are missing and thought to be critical, such as neuronal input/output functions, are warranted. See below for a comment on the confusing construct of "interface" as a distinct entity from the neural network.
(2) Introduction
"Among animals that walk, the integration of brain wiring and body models is perhaps closest to fruition in Drosophila, due to the recent completion of multiple complete wiring diagrams (known as connectomes) of the fly nervous system." ...and... "The fly is the only animal with legs for which nearly comprehensive connectomes of its brain and nerve cord exist."<br />
The walking qualifier allows the authors to skirt around the substantial and decades-long work on connectomes in C. elegans, which crawls and does not walk. Yet sinusoidal crawling is a multidimensional, adaptive behavior, so it seems this exclusion was for narrative convenience rather than contextual accuracy.
"Despite this progress, closed-loop integration of biomechanical and neural models remains far from straightforward."<br />
Work (and shortcomings) in C. elegans neurobehavioral modeling should also be stated here alongside the fly.
"Where interfaces between brains and body models are missing or only partially characterized, one approach is to train an artificial neural network (ANN) to approximate these interfaces with deep reinforcement learning (DRL)."<br />
The choice of "interface" as a distinct, well-defined neurobiological entity is somewhat confusing and may mislead non-practitioner readers. If neuronal and muscular (and their interactions) physiology are incorporated into a neurobehavioral model, then in principle there is nothing left to call an "interface". It would be clearer to explain that prior neurobehavioral models have often inserted a trainable multilayer feedforward network between sensory and central brain and between the central brain and motor effectors in order to have a substrate for learning, and that this insertion may render the entire biological modeling exercise scientifically pointless, or at a minimum require a set of computational controls.
"In building virtual animal models, a motor policy is commonly learned by DRL so that the integrated, closed-loop virtual body successfully mimics the detailed kinematics of real animal behavior."<br />
The authors could define "motor policy" in simple terms and give a brief example.
"Additional realism is added when the motor policy network is constrained by a connectome dataset. However, many biophysical parameters for individual neurons and synapses remain un-measured."<br />
"motor policy network" is confusing; this is referring to the entire network model here, presumably.
(3) Methods
"We used the adult hermaphrodite C. elegans nematode connectome dataset [15, 16, 5], including the identities of its 302 neurons and their synapses (Fig. 1A)."<br />
We believe the authors should specify the dataset type, which is a structural, unsigned connectome lacking grounding in physiological function.
"The policy network was trained in closed loop using PPO as implemented by MIMIC-MJX"<br />
The authors should define "PPO" and "MIMIC-MJX" in simple terms and explain why they were used.
(4) Discussion
"Its role in the movement policy could be fulfilled equally well by a randomly connected RNN, akin to reservoir computing [20], since all the learning happens in the black-box ANN motor decoder."<br />
See above - this computational exercise should actually be performed.
"Looking further ahead, swapping brain and body models of related species may one day yield real insights into how their brains and bodies diverged through evolution. However, far more model development and experimental validation is needed before we can learn anything from such a digital sphinx."<br />
These two sentences about future possible cross-species chimeras feel superfluous and unsubstantiated, and weaken the main argument of the paper about whole-brain emulation.