Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors
Authors: Liu Xiangxiao , Loring Matthew D. , Zunino Luca , Fouke Kaitlyn E. , Longchamp François A. , Bernardino Alexandre , Ijspeert Auke J. , Naumann Eva A. 
Published: January 2025

All brains evolve within specific sensory and physical environments1. Traditionally, neuroscience has focused on studying neural circuits in isolation, yet holistic characterization of their function requires integrative brain-body testing2,3. To investigate the neural and biomechanical mechanisms of sensorimotor transformations, we constructed realistic neuromechanical simulations (simZFish) of the larval zebrafish optomotor response, a visual stabilization behavior4,5. By computationally reproducing the body, physical body-water interactions, visual environments, and experimentally derived neural architectures, we closely replicated the behavior of real zebrafish6. Through systematic manipulation of physiological and circuit features, impossible in biological experiments, we demonstrate how embodiment shapes neural circuit architecture and behavior. When challenged with novel visual stimuli,simZFishpredicted neuronal response types, which we identified via calcium imaging in the brain of real zebrafish and used to update thesimZFishneural network. In virtual rivers,simZFishperformed rheotaxis by using current-induced optic flow as navigational cues, compensating for the simulated water flow. Finally, a physical robot (ZBot) validated the role of embodied sensorimotor circuits in maintaining position in a real river with complex fluid dynamics and visual environments. Together, by iterating between simulations, behavioral observations, neural imaging, and robotic testing, we demonstrate the power of an integrative approach to investigating sensorimotor processing.

Research Highlights

DevelopedsimZFish, an open-source neuromechanical simulation modeling the zebrafish optomotor response (OMR).

Demonstrated thatsimZFishvisuomotor neural circuits are sufficient to maintain position in virtual water currents without additional sensory modalities.

Investigated how variations in eye geometry influence neural circuit functionality and behavior.

Conducted optic flow analysis of simulated visual input to identify retinal connectivity requirements, uncovering the factors that shape pretectal neurons’ preference for the lower posterior visual field.

simZFishpredicted new neural response types confirmed via real zebrafish calcium imaging.

ValidatedsimZFishcircuits with a physical robot,ZBot,performing rheotaxis in a natural river with rich visual and complex flow dynamics compared to idealized lab and simulation experiments.

Graphical abstract

Combining data-driven neuromechanical simulations and robotic testing, we established an integrative framework for investigating embodied neural circuit functions. Leveraging the behavioral, neurobiological, and theoretical foundations of the visually guided optomotor response in larval zebrafish (blue, left), we developed a virtual zebrafish,simZFish(red, middle), to replicate realistic hydrodynamic, anatomical, sensory, neural, and behavioral aspects, permitting the investigation of emergent properties driven by embodiment. Validating these findings using a physical, zebrafish-inspired robot,ZBot(grey, right), in naturalistic environments informs further experiments, hypotheses, and robotic design.