Enhancing deep neural networks through complex-valued representations and Kuramoto synchronization dynamics
Authors: Sabine Muzellec
Andrea Alamia
Thomas Serre
Rufin VanRullen
Venue: Accepted by TMLR ()

Abstract: Neural synchrony is hypothesized to play a crucial role in how the brain organizes visual scenes into structured representations, enabling the robust encoding of multiple objects within a scene. However, current deep learning models often struggle with object binding, limiting their ability to represent multiple objects effectively. Inspired by neuroscience, we investigate whether synchrony-based mechanisms can enhance object encoding in artificial models trained for visual categorization. Specifically, we combine complex-valued representations with Kuramoto dynamics to promote phase alignment, facilitating the grouping of features belonging to the same object. We evaluate two architectures employing synchrony: a feedforward model and a recurrent model with feedback connections to refine phase synchronization using top-down information. Both models outperform a real-valued baseline and complex-valued models without Kuramoto synchronization on tasks involving multi-object images, such as overlapping handwritten digits, noisy inputs, and out-of-distribution transformations. Our findings highlight the potential of synchrony-driven mechanisms to enhance deep learning models, improving their performance, robustness, and generalization in complex visual categorization tasks.

Published in Transactions on Machine Learning Research (06/2025)
Enhancing deep neural networks through complex-valued representations and Kuramoto synchronization dynamics
Sabine Muzellec
bobin__maselle@@@rrum.eed
CerCo CNRS, University of Toulouse, France Carney Institute for Brain Science, Brown University, USA
Andrea Alamia
CerCo CNRS, University of Toulouse, Prance
Thomas Serre
thomas serpnns__srree@rrur....m edu
Carney Institute for Brain Science, Brown University, USA
Rufin VanRullen
rufin.wanrullenneenrs.f
CerCo CNRS, University of Toulouse, France
Reviewed on OpenReview: https: openreview. net/ net/ forum? id= 206QGmBL44
Abstract
Neural synchrony is hypothesized to play a crucial role in how the brain organizes visual scenes into structured representations, enabling the robust encoding of multiple objects within scenc. However, current deep learning models often struggle with object binding, limiting their ability to represent multiple objects effectively. Inspired by neuroscience, we investigate whether synchrony- brased mechanisms can enhance object encoding in artificial models trained for visual categorization. Specifically, we combine complex-valued represen- tations with Kuramoto dynamics to promote phase alignment, facilitating the grouping of features belonging to the same object. We evaluate two architect employing syuchrony: feedforward model and recurrent model with feedback connections refine phase syn- chronization using top-down information. Both models outperform real-valued bascline and complex-valued models without Kuramoto synchronization on tasks involving multi- object images, such as overlapping handwritten digits, noisy inputs, and out-of-distribution transformations. Our findings highlight the potential of synchrony-driven mechanisms to enhance deep learning models, improving their performance, robustness, and generalization complex visual categorization taske
1 Introduction
Learning structured representations in artificial neural networks (ANNs) has been a topic of extensive re- scarch (Zhang et al.
Chiou 2022 Dittadi 2023 Le Khac 2024). yet remains open challenge (Schott) Notably, some researchers argue l that the inability of ANNs to effectively bind and maintain structured representations may underlie their limited generalization capabilities and susceptibility
2013
el al. 2021 Dittadi 2023).
to distributional shifts (Greff et al. 2020).
In neuroscience, the Binding Problem (Tressman 1996 Roskies 1999: Singer 2007 refers to the brain's capacity integrate various attributes
stimulus such as color, shape, motion, and location-into a unified perception. This process involves understanding how distinct features of an object are combined across different processing stages (in other words, object binding), enabling the brain to construct meaningful
*Code available https://gthhub.com/55111 http://hhwbbb..o///tt///////aaaa

---

Published in Transactions on Machine Learning Research (06/2025)
and cohesive representations of individual objects within scene. Neural synchrony has been proposed as key mechanism underlying this integrative process (Sineer
2007 Uhlhaas et al. 2009).
Kuramoto dynamics and related oscillator models have been widely studied (uuzzinkki et al. 2022; 2023
and specifically employed in computational neuroscience to explore synchronization phenomena in neural systems [Breakspear et al. 2010 Chauhan et al.] 2022). These models provide insights into complex neural processes, such as phase syuchronization and coordinated neural activity. Beyond neuroscience, the Kuramoto model has also found applications in artificial intelligence, offering framework for understanding
synchronization in complex systems (Ódor & Kelling 2019 Rodrigues et al. 2016). Recently, its utility has
extended to computer vision tasks (Ricci et al., 2021 Miyato et al. 2024 Benigno et al. 2023 Liboni et al.
2025 demonstrating its potential to enhance representation learning in ANNs.
Building on these insights, we propose leveraging the Kuramoto model to investigate the role of neural synchrony in convolutional neural networks (CNNs) for multi-object classification. We hypothesize that incorporating neural synchrony, inspired by the brain's 's solution to the Binding Problem, can be implemented using Kuramoto dynamics within ANNs, thereby enhancing their generalization abilities.
To test this hypothesis, we design a hicrarchical model, KomplexNet, that integrates layers of complex-valued units with bottom-up up information flow. In KomplexNet, Kuramoto dynamics are applied at the initial layer to induce a synchronized state, which is then propagated through subsequent layers via carefully designed complex-valued operations. This approach enables the model to exploit the phase dimension of its neurons to bind visual features and organize visual scenes into distinct object representations, while the amplitude dimension retains standard CNN functionality.
We further extend KomplexNet by incorporating feedback connections to refine synchronization through top-down information (i.e., higher-level contextual signals, derived from global scene understanding or task goals, that influence local processing within the network). This extension demonstrates the critical role of top-down processes in enhancing phase synchrony and structuring object reprosentations. Overall, our findings highlight the potential of neural synchrony mechanisms,, modeled using Kuramoto dynamics, to improve the robustness, generalization, and representational capacity of deep learning architectures.
Overall, our contributions as follows:
We introduce KomplexNet, a complex-valued neural network that leverages Kuramoto dynamics for multi-object classification.
KomplexNet. has better classification accuracy than comparable baselines.
KomplexNet also exhibits better robustness to images perturbed with Gaussian noise and generaliza- tion to out-of-distribution classification problems.
Extending KomplexNet with foodback connections leads to better phase synchrony, exhibiting higher robustness and generalization abilities than KomplexNet without feedback.
2
Related work
Complex-valued models. complex-valued neural networks are popular and extensively used in signal processing to model complex-valued data, such as spectrograms (sce (Bassey et al. 2021] h for a review). The term Complex-Valuee Valued Neural Network (CVNN) is commonly used to refer to fully complex networks: not only is the activation function complex, but are the parameters. Trabelsi et al. (2017) proposes list of operations adapted to parametrization in the complex domain, including convolutions, activation functions, and normalizations. Mocnning & Manandhar (2018) systematically compares
complex-valuce
networks and their real-valued counterparts for object classification. Their findings highlight the importance of the choice of activation functions and architectures reflecting the interaction of the real and imaginary parts. However, when applied to real-valued data, the field lacks appropriate conversion mochanisms to the complex domain. One proposal by Yaday & Jerripothula (2023) includes a novel way to convert a real input image into the complex domain and loss acting on both the magnitude and the phase. They implement their
2

---

Published in Transactions on Machine Learning Research (06/2025)
transformation on several convolutional architectures and outperform their real-valued counterpart on visual categorization datasets. Additionally, such approaches often lace challenges related to the non-differentiabiliy of complex-vaued loss functions and nonlinearities, which can complicate training and gradient propagation. In contrast, our model uses real-valued weights and applics complex-valued operations only in the activation space, allowing us to avoid these issues and train using standard backpropagation, Importantly, none of these papers use phase synchrony as a mechanism for perceptual organization in multi-object scenes.
Synchrony in artificial models. Some work has explored binding by synchrony or leveraging synchrony in artificial models without complex-valued activity. Ricci et al. (2021) proposes framework for learning in oscillatory systems, harnessing synchrony for generalization. This approach is, however, limited by its learning procedure: the model is designed to learn to segment one half of an image and generalize on the other. Zheng et al. (2022) extends a spiking neural network with attention mechanisms to solve the binding problem, though the impact of synchrony on performance or robustness is not evaluated. While these models successfully group entities by synchronizing the spikes of neurons, synchrony was not designed to assist in solving visual tasks. In particular, it unclear from the work if and how the resulting representations help improve the neural network's overall performance, robustness, generalization ability.
Complex-valued representations and binding by synchrony. A growing body of literature uses complex-valuee representations to explicitly model neural synchrony. Early models were designed to implement a form of binding by synchrony via complex-valued units to perform phase- based image segmentation [Zeeel ict al.
1995 Weber & Wermter 2005) or object-based attention (Behrmann et al., 1998). These models were shallow architectures, and they were trained on small datasets. Different mechanisms,, including feedback mechanisms (Rao et al.) 2008; Rao & Cecchil 2010 2011), were later explored to influence synchrony in deeper architectures. However, all models were trained on datascts that remained limited to toy objects. Specifically, despite the simplicity of the objects, the images contained individual objects only, limiting the potential benefit of synchrony. Finally, Reichert & Serre (2013) scaled to Boltzmann machines and multi-object datasets. The authors proposed a general framework that included operations for binding by synchrony. Binding was shown to emerge through the phase of neurons. However, the approach did not include backpropagation training or end-to-end deep learning. Specifically, a real-valued Boltzmann machine was first trained, and the phases were introduced during test. Synchrony was, therefore, a completely emergent property and did not take any part in helping the model learn the task. Building on this work, Löwe et al. (2022) adapted the approach for training a complex auto-encoder to reconstruct multi-object images. This model was fully complex, even during training. The phase synchrony helped the model reconstruct an input image and outperform its real-valued counterpart. Finally, Stanić et al. (023)) scaled up the model to more objects and color images by adding a contrastive objective on the phases, followed by Gopalakrishnan el al. (2024) who improved the phase synchrony using recurrence and complex-weights. Our work distinguishes itself from previous work, notably in how we exploit synchrony mechanisms. In all the aforementioned approaches, synchrony is sought as an emergent properly of the task and the neural operations implemented in the network. In contrast, we propose to introduce it using Kuramoto system as an explicit synchronizer. We then study the benefit of synchrony for object categorization performance, as well as robustness and generalization.
3 Binding by Synchrony and Oscillatory Grouping Mechanisms
The binding by synchrony theory, as supported by a body of research both experimental (Singer 2007 von der Malsburg 1981 and computational Milner (1974); Grossberg (1976) (but see [Roelfsema (2023); Shadlen & Movshon [9999] for alternative hypothesis), provides comprehensive theory to understand how the brain integrates and perceives diverso sensory inputs. This theory asserts that synchronous neural activity, induced by neural oscillations, plays foundational role in cognilive processes. According to this theory, when distinct features of a sensory stimulus are processed by specialized regions of the brain, the neurons responsible for representing these features synchronize their firing patterns at specific frequencies. This synchronization of neural oscillations enables precise coordination and the temporal binding of neuronal responses from different.
regions, thus uniting them into coherent percept (Fries et al. 1997: 2002)
3

---

Published in Transactions on Machine Learning Research (06/2025)
39
3
3
9
9
Figure 1: The binding by synchrony hypothesis. Brain activity exhibits an oscillatory pattern affecting population of neurons; local neuronal interactions (e.g., excitation, inhibition) result in different groups of neurons being activated at different phase values. According to the binding by synchrony theory, neurons firing together (at the same phase) encode for the same object. Here, we use the phase of complex number to represent this mechanism (right panel).
While carlier interpretations often linked this theory to Gestalt principles of perceptual organization such proximity and similarity (Wertheimer 1938 Gray & Singer] 1989: Todorovic 2008) contemporary neuroscience has greatly expanded the mechanistic and empirical understanding of oscillatory dynamics. The study of neural oscillations has become central in systems neuroscience, providing insight into how different brain regions coordinate information processing across scales (Buzsaki & Draguhn 2004). Oscillatory activity across frequency bands (e.g., theta, alpha, beta, gamma) has been shown to support attention, working memory, and multisensory integration. These rhythms are not isolated events but often participate in structured spatiotemporal patterns, such traveling waves, which propagate information through cortical circuits (Jacobs et al. 2025 Keller & Welling 2023 Mazzoni al., 2015 and local field potentials (LFPs), which provide experimentally accessible signatures of population-level coordination (Haziza al. 2024
Buzsáki et al. 2012).
Our model draws inspiration from this modern view: KomplexNet uses complex-valued representations to encode oscillatory activity and implements Kuramoto dynamics to coordinate phase alignment basod on spatial proximily. While the model incorporates structural constraints reminiscent of Gestalt heuristics, it operates as a dynamical system which synchrony is explicitly induced by structured coupling. We view synchrony as controlled computational mechanism, guided by the architecture and coupling kernel, to group features based spatial and task-relevant relationships. For simplicity, we assume single oscillation frequency; the phase of each neuron reflects its aligmment with this shared rhythm. Neurons with aligned phases are considered functionally grouped, reflecting coordinated patterns similar to those observed in structured neural activity during perception and cognition (see Figure
In summary, while our model conceptually echoes early theories of binding and perceptual grouping, is grounded in mechanisms that resonate with modern systems neuroscience. By aligning phaso-based grouping with oscillatory principles observed in cortical cireuits, such LFP coherence, nested rhythms, and traveling waves, KomplexNet provides tractable framework to explore how structured neural activity supports perceptual integration and cognitive organization.
4 KomplexNet: Kuramoto synchronized complex-valued network
In the following, we describe the details of KomplexNet's implementation. We use Kuramoto system at the first layer Lo synchronize the phases and apply operations in the complex domain for subsequent layers, and we finish with the addition of feedback connections affecting the phase synchrony.
4

---

Published in Transactions on Machine Learning Research (06/2025)
KomplexNet
KomplexNet with feedback
OPQO
Lg
Complex linear layer
opaoQod
1
Complex linear layer
Complex
4
convolutional
layer
Phase synchronization
0
Real
Lo
convolutional layer
Phase synchronization f 2
Input image
Figure 2: Overview of KomplexNet. We show the global architecture on the left and illustrate the phase dynamic on the right. The phases start with random initialization and evolve with time according to Kuramoto's equation. The first complex representation results from the amplitudes and the phases of the first layer (Lo in blue). The plain lines on the right represent the local connections inside the layer. The dashed lines represent some possible top-down connections to control synchronization. At every timestep, the phase of individual neurons gets updated by one Kuramoto iteration and propagated the network layers via complex-valued operations.
4.1 Kuramoto dynamic
Kuramoto model. Instead of considering synchrony as an emergent phenomenon, we choose induce it using a Kuramoto system (Kuramoto) 1975) organize the phases of the first layer. This process serves syuchronize the phases before incorporating them into the activity of the network. As we are dealing with compexx-allued activity, we also need amplitude value for each neuron at the first layer. This information is obtained by applying real-valued convolution to the input image. To reach synchronized state, adapt and propose the dynamic
the original equation of the Kuramoto model (Equation 3 in Kuramoto 1975 described in Equation
CXHXW Σ K=
0ay = x
(rk,ajj c) (in(Ox()) - Oesg (()) tanh(ax))
(1)
The core idea of the Kuramoto model is to synchronize population of oscillators by mutual influence. In our case, the oscillators are the phases 0 E RCxHx (with H and W denoting the size of the input image), where a phase Ozi will be influenced through the sine of the difference between itself and the rest of the population. This influence will be modulated by a learnable coupling kernel r CxCxxxx (with < and w < W) together with a global desynchronization interaction to each influencing phase. In other words, each phase synchronizes with its neighbors (defined by the spatial range of the kernel) and desynchronizes with phases further apart. At the population level, the system favors
R!., as well as the amplitude, a, associated
5

---

Published in Transactions on Machine Learning Research (06/2025)
the emergence of several clusters of phases. Lastly, 1y R! acts a gain parameter, modulating the phase update at each timestep.
Learning the coupling kernel. The coupling kernel is expected to capture the interactions and mutual influence between phases. A pusitive//egaativ value in this kernel means that the corresponding two neurons will tend to synchronize/dessye /desynchronize their phases. The kernel should learn the inherent structure of the objects in the dataset to adjust the interactions between nearby phases. For example, in the case of handwritten digits, the objects are mostly vertical, hence the kernel should favor positive interactions between phases along the vertical axis Here, initialize the kernel with a 2D Gaussian to encourage interactions with closer neighbors.
To learn this kernel, we use the cluster synchrony loss defined in Ricei et al.
2021
1 G - Σ 2 1=1
G
CSToss
VI(0) + 2G
(0)
(2)
1=1
where V(0) is the circular variance, (0) the average of phase group, and G the number of groups. The first part of this loss measures the intra-cluster synchrony while the second part represents the inter-cluster desynchrony. Minimizing the loss resolves to minimize the variance inside groups (each phase cluster should have the same value) and minimize the proximity between the centroids of the clusters on the unitary circle (the clusters should cancel each other out).
In Figure 3 we show some visualization of the phases obtained after 15 steps of our Kuramoto model on the Multi-MNIST dataset (Sabour et al. 2017] (see also Fig. 9 to visualize the learned kernel). The plot represents the 8 convolution channels, masked by the intensity of the amplitude, with the color indicating the phase value. The phases from the same digits are synchronized, and the two clusters of phases are desynchronized with an almost opposite position on the unitary circle. Interestingly, the model does not learn to systematically affect one specific phase value to a class of digits (as observable in Figure with two '9' represented by distinct colors/phase values in the first two images). Indeed, in the binding by synchrony theory, there is no requirement that given object should always and systematically be assigned the same phase value, this would scriously limit the flexibility and adaptability of the coding system.
4.2 Complex representations an artificial neural network
Overall architecture. Our model, KomplexNet combines the Kuramoto dynamic from Section 4.1 and additional complex operations described below, as represented in Figure and Algorithm To summarize, we start by extracting features from the input images by performing real non-strided convolution (8 channels). The initial complex activity comprises these features along with random phases to perform one step of our Kuramoto dynamic. The resulting activation, žt.o E CSx32x32 is propagated in a bottom-up manner through one strided complex-come convolution (ZL, E C8x16x16) and two linear layers (respectively øL, E C50 and Z1 (IO). This is repeated for several timesteps to allow the phases to reach a stable synchronized state through the Kuramoto dynamic.
Each step of the Kuramoto model outputs new state of the phases, combined with the amplitude extracted via the first real convolution to instantiate the complex activity.
Complex operations. We first redefine the standard operations of a convolutional network to be compatible with complex activations z = my.e" E C. We apply some biologically plausible transformations that allow
the model to perform well, as used in (Reichert & Serre 2013 Löwe et al. 2022: Stanié et al. 2023 We
define the linear operations (convolutions and dense layers) as such:
21 = fw( (Re(z)) + fm
(3)
The newly obtained activity results from applying the same set of real-valued weights to both the real and imaginary parts of the input activity, modifying the amplitude and the phase jointly. Then, following the formulation first proposed by Reichert & Serre (2013). ; we apply gating mechanism that selectively attenuates
6

---

Published in Transactions on Machine Learning Research (06/2025)
39
69
81
39
39
8969
8
8
3
/
2
Phase value (radians)
1
1
-2
3 9
3
69
-3
Figure Phase synchronization. Given the input image shown at the top, we present visualizations of the phases from the first layer (across each of the 8 convolution channels) at the last timestep of the Kuramoto dynamic. The color represents the complex phase and we use the complex amplitude to mask out the iongrroudd/oonaccttii pixels.
inputs that are out of phase with the target activity. This prevents scenario where desynchronized inputs (i.e., those with opposing phasos) are treated equivalently to inhibitory inputs resulting from negative weights. Specifically, we compute a modulation term (named classic term in (Reichert & Serre 2013)) X as a function of the input amplitude, and we update the modulation variable m,, by averaging the previous state m., with the newly computed term X-
X = (lzl))
(4)
m2g = 7 (m + +x)
This averaging serves lo smooth the gating dynamics, allowing the network to gradually adapt modulation in response to changes in input amplitude, and ensuring that out-of-phase inputs do not undesirably mimic the effects of inhibition. Lastly, we apply a ReLU non-lincarity only on the amplitude. Considering that a complex amplitude by definition positive, we start by normalizing it before applying the desired function,
done by (Lowe et al. 2022 Stanié et al. 2023 This last step ends block of operations representing
7

---

Published in Transactions on Machine Learning Research (06/2025)
layer in model.
23 -eell((isslneeNNommmma)))))))) E EC
(5)
We can additionally observe, in Figure 4 the effect of the complex operations by visualizing the phase distribution at each layer of the model at the last timestep. The first row represents the polar distribution of the color-coded phases at each layer. We can see that the Kuramoto model allowed the phases to reach a state with two opposite clusters one for each digit- and this distribution is conserved in all the subsequent layers. We show in the second row the same activity but detailing the spatial information provided by the convolutions of the first and second layers.
Layer 0
Layer
Layer 2
Layer
Input image
39
185
339
1:97
4
2
2/17
2/9
2/2
2007
convolutional channels (Layer
Second convolutional channels (Layer 1
9999
3
39
30
9
Figure 4: Phases per layer. Given an input image (top left corner), we show how the complex operations propagate the phase grouping instantiated at the first layer to the last decision layer (all activations are measured at the last step of the Kuramoto dynamic). As the first two layers (Lo and L1) are convolutional, we additionally visualize the eight convolutional channels in each layer (bottom).
4.3 Implementing feedback
We finally propose an extension of KomplexNet by implementing feedback connections to influence the phase synchronization (dashed lines on the right in Figure 2) At each timestep, the higher-level representations from the latter layors (carrying information about advanced features, object parts, and object classcs) can help the synchronization process of the first layer. We combine the lateral synchronization Kuramoto dynamic of Lo with feedback synchronization from higher layers. The resulting phase update per timestep the first layer is described analytically in Equation 0 The first line defines Keij the lateral synchrony in Lo (same Equation 1 and the second combines Keij with the sum of the Kuramoto dynamics across layers.
CxHxW Σ
Keig 17 x
(Tk.ds- c) (i) Oet (t)) tanh(ay)]
k=
(6)
Ni
CixD;
Omi = Koij
(run.ii)) (in( Ont (1) tanh(an))]
We instantiate the activity of each layer the first timestep through a feedforward propagation and introduce the feedback starting at the second step. Algorithm 2 details the corresponding update in the dynamic of
8

---

Published in Transactions on Machine Learning Research (06/2025)
the whole model. Similarly to the lateral coupling kernel of layer Lo, the feedback coupling kernel coming from L is defined in RCXCxhixx1, However, the coupling matrices from the dense layers are defined in RCxD with Dj representing the number of neurons in each layer. More specifically, the convolutional layer L1 still provides spatially structured information to the phases of the first layer Lg. Conversely, the phases of the dense layers affect all the phases of Lo without spatial structure but provide generic information about, the identity of the objects. The feedback couplings in the Kuramoto equation do not comprise the global desynchronizattin term (unwarranted since the latter layers are not spatially structured). However, we initialize all the feedback kernels around 0 (before training) to facilitate reaching negative coupling values, thus desynchronizing certain phases of Lo with phases from higher layers when they do not encode for the same object.
4.4 Experimental setup
Datascts. We perform our experiments on two different datasots. The first one is the Multi-MNIST datasot. (Sabour et al.) 2017), More specifically, consisting of images containing two hand-written digits taken from the MNIST dataset. generate empty (black) images of size 32 x 32, downsample the MNIST images by a fixed factor (depending on the number of digits we want to fit in the image), and place the first digit at a random location around the upper-left corner. We then randomly pick a distinct second digit and assign it a position in the image under two constraints: not surpassing a predefined maximum amount, of overlap, while still fully appearing in the image (none of the digits are cut by the image border). We generate a non-overlapping version of the datasct (maximum overlap = 0%) and an overlapping version where the digits can overlap up to 25% of their active pixels. We use the same procedure to generate images containing more than two digits. Similarly, we generate version of this dataset with greyscaled CIFAR10 (Krizhevsky et al., 2009) images in the background. This makes the digits less easy to separate for the Kuramoto model and represents a more ecological setting to test our models.
For both of these datasets, the models are evaluated on their ability to recognize and classify the two digits, out of 10 different possible classes. When generating the images, we also generate an associated mask tagging the different objects: first digit and second digit (the same logic potentially extends to a higher number of digits). When the digits overlap, the overlapping region is considered as an additional object. The background object. These masks are used to compute the cluster synchrony loss (Equation 2 and
is not considered do not provide information about the identily (label) of the digits.
Baselines. We compare both versions of our model (KomplexNet and KomplexNet with feedback) with different baselines to highlight our contributions: a real model (with an architecture equivalent to KomplexNets) and a complex model without the Kuramoto syuchrony (random phases at the first layer). We also provide comparisons with additional baselines (a real-valued with additional number of parameters and ViT) in Appendix (Figure 12]. We additionally show the performance of a complex model with an ideal phase separation an upper baseline: for this model, using the ground-truth masks, we assign the phases by randomly sampling N equidistant groups on the unitary circle and affecting each value to one object in the image (with N the number of objects, not including the background). When digits overlap, we affect an intermediate phase value (circular mean of the two-digit values) to the overlapping pixels. We also include results and visualizations for a version of KomplexNet with an untrained (fixed) Gaussian coupling kernel to highlight the impact of using spatial masks during training (see Appendix, Figures 16 and 17
Model and training. We train each family of models end-to-end using Adam (Kingina & Ba 2014], a fixed learning rate of le 3,, 3, and batch size of 128 or 32 depending on the dataset. KomplexNets are trained by accumulating the binary cross-entropy loss at each timestep and then combining it with the synchrony loss from the last timestep. The balance between the two quantities is modulated by a hyperparameter, as illustrated in Equation 7 All experiments are implemented in Pytorch 1.13 (Paszke et al. [2017) and run on a single NVIDIA V100. Each curve in the following plot represents the average and standard deviation over 50 runs with different random initializations. Complementarily, we present in the appendix the test accuracy of the best models on the validation set. To obtain the best search and use the best combination of values out of 100 simulations. The concerned parameters are: the
values, we run a param-earrmettr
9

---

Published in Transactions on Machine Learning Research (06/2025)
desynchronization term e, the gain parameters mn for each layer I, the coupling kernel sizes kio and his and the balance of the losses 7.
L(D. v. 0)
Σ BCELoss((e..)) + T.CSLoss((O)
Evaluation. As are optimizing two different losses (cluster synchrony and classification), systemati- cally quantify the performance of our models compared to the baselines along those two separate axes. In all the following sections, we show the first loss under the synchrony label and use the performance label for the classification objective. The models are all trained with two or three non-overlapping digits. In the next sections, we present the results on in-distribution images (two-digit, non-overlapping images, all different from the training sct) and then evaluate the robustness and generalization abilitics of the models (without re-training or fine-tuning). We define here robustness as the model's ability to perform the same task given altered image (compared to the training distribution), while generalization represents the capability of the model to perform a slightly different task from the one it was trained on (here, the categorization of more less digits than during training).
5 Results
5.1 In-distribution performance
Synchrony. We start by evaluating the ability of the Kuramoto model to correctly separate the objects, compared to the other complex baselines (we cannot explicitly evaluate object separation for the real-valued baseline, as this requires phase information). In Figure 5 panel A, we quantify the quality of the solutions provided by the four models using Equation 2 with the random case as a. lower baseline and the ideal case as an upper basclinc; we see that the solutions obtained with Kuramoto (and especially with feedback connections) converge over time lowards the ideal value. In panel C, we show a qualitative example of phase synchrony for an image taken from the test set (illustrated in panel A). As expected, when the digits are spatially separated on clean image, the phases obtained with the Kuramoto model almost perfectly synchronize inside the digits and desynchronize between digits: the two clusters have opposite values on the unitary circle (polar plots in the bottom row) and all the pixels within one digit have similar phase values (phase maps across the 8 convolution channels, middle row). In this image, the area where the digits are close and almost touching is assigned a phase value in-between the two clusters; this scoms a reasonable solution because the coupling kernel around this region will lend to synchronize the phases across the two digits. This behavior emerges naturally from the network's local coupling dynamics, which promote phase alignment across nearby features (i.e., synchronization of phase variables across network units representing features of the same object). It reflects smooth, continuous transition in ambiguous regions, rather than failure of binding. Importantly, this local phase blending aligns with principles from perceptual psychology (Treisman & Gelade 1980 Treisman 1998), which recognize that boundaries between overlapping objects can involve graded or competing representations, while still preserving distinct object identities at a global level. As such, this intermediate phase assignment does not impair object-level binding, but rather reflects a biologically plausible resolution of local ambiguity. A smaller coupling kernel would reduce local phase blending by limiting the spatial extent of interactions, but it would then take more timesteps to reach synchronized state. Visually, the obtained phase maps with KomplexNets seem to lie between the random-phase model (left sub-panel) and the ideal-phase model (right sub-panel) where the clusters show no variance even in ambiguous regions of the image. KomplexNet with feedback shows slightly less dispersed clusters than the leedforward KomplexNet model (middle two sub-panels).
Performance. We then evaluate the elfect of synchrony on the performance of the model. At each Kuramoto step, we evaluate the KomplexNets and obtain an accuracy curve over time. Conversely, the baselines are deprived of temporal dynamics and therefore yield only one accuracy value. The results are reported in Figure 5 panel B. We can observe that the KomplexNets' performance starts below the real-model and random-phase baselines (because the phases are not synchronized yet.) and per-per them after 5 timesteps
10

---

Published in Transactions on Machine Learning Research (06/2025)
A
C
Cluster synchrony loss
0.6
65
Random phases
KomplexNet
KomplexNet with feeback
Ideal phases
0.2
6
6
0.0
Phase value
B
0.94
65
Test Accuracy
0.92
7
0.90
0.88
0.86
10
15
Timesteps
Real model
Random phases model
Ideal phases mode!
KomplexNet
KomplexNet with feedback
In distribution results. Panel A shows the evolution of the cluster synchrony loss through time (computed on the whole test set; lower values indicate better phase scparation across digits). Panel B contains the classification performance of KomplexNets compared to the same baselines, well as the real-valued model. Panel C represents the phases of KomplexNets (red, and KomplexNet with feedback in purple), at the last timestep, compared to the two complex baselines (random phases and ideal phases) on in-distribution images. We show an example of an image (in panel A), the phases of the output channels of the first layer (center sub-panels), and the polar distribution of all the phases channels combined (bottom sub-panels).
Figure 5:
(for KomplexNet with feedback) or 7 timesteps (for KomplexNet without feedback). Surprisingly, after about timesteps, KomplexNet reaches a performance on par with the idcal phase model, while KomplexNet with feedback even oulperforms it. This observation sheds light on the plase-synchronizaale "ideal" here. Because the phase initialization takes place after convolution, the resulting activity is spread over a slightly larger extent than the 'idcal" mask (based on active image pixels). Because of this discrepancy, some activated neurons around the digits are not affected by the phase initialization process, introducing noise in the phase information that is later sent to the rest of the network. Conversely, the Kuramoto dynamic acts on all active neurons, potentially leading to more faithful phase information in the in-distribution case.
strategy we define
We provide in Appendix Figure 10 additional experiments testing the models more timesteps than during training; the results indicate that the synchronized Kuramoto state is stable over time, and the associated performance improvements persist. We also test in Appendix Figure [3 the effect of the feedback coming from each layer (L1, L2, L3) separately; every single layer provides an amelioration, but the model with foedback from all layers combined shows the greatest performance.
5.2 Robustness
We then evaluate the robustness of our trained models on out-of-distribution images. The task remains two- digit classification, and we evaluate both objectives (synchrony and performance) on images with overlapping digits with additive Gaussian noise.
11

---

Published in Transactions on Machine Learning Research (06/2025)
Synchrony. Similarly to the previous section, observe the cluster synchrony loss of KomplexNett with feedback reaching a lower (i.e. better) score compared to KomplexNet (see Figure 6 first row), for both the "overlap" and the "noise" conditions. In both cases but not surprisingly, the gap with the ideal phases remains higher than before, since the ground-truth phase masks (used for the "idcal-phase" model) are not allected by noise or by digit overlap (when digits overlap, pixels from the overlapping region are considered as a separate group in the ground-truth mask, but this group is not included in the synchrony loss computation).
We provide a visualization of the phases for one image (the example shown in Figure 6 in the Appendix
Figure 15
Performance. KomplexNet and Kom- plexNet with feedback show more robust- ness than the basclines, outperforming the real model in accuracy by 10 to 15% (Fig-
Overlap
Noise
Cluster synchrony loss
ure 6 second row). The real model and the random-phases complex model are very affected by the perturbations, while the ideal-phase complex model shows less
0.6
CH
0.6
51
0.4
altered performance. The accuracy val- ues of KomplexNets lie between the upper baseline and the two other models and sur- pass them after fewer timesteps than in the previous case (Figure 5). showing how synchronized phases help resolve ambigu- ous cases. More specifically, KomplexNet. with feedback remains more robust than KomplexNet, motivating the use of feed- back connections to improve phase syn- chronization.
0.2
0.2
0.0
0.7
Test Test Accuracy
0.6
0.5
0.55
0.4
0.3
0.50
10
5
10
15
Timesteps
Timesteps
5.3 Generalization
Random phases model
KomplexNet Real model
Ideal phases model
To evaluate our models' generalization abilities, we report in this section their synchrony and performance when trained on either two or three digits in the images and then tested on the same or a different number of digits, from two to nine digits.
KomplexNet with feedback
Figure 6: Robustness performance. We report the average performance of KomplexNet (red) and KomplexNet with feodback (purple) over time along with the standard devialion for 50 rep- etitions. We compare it with its real-valued baseline (blue), a complex model with random phase initialization (green), and the ideal phase cluster syuchrony (orange). The models are tested on overlapping digits (left column) and noisy images (right column).
Synchrony Figure 7 illustrates the gen- eralization abilities of the KomplexNets at synchronizing the phases in this out-of- distribution setting. Interestingly, despite not having seen 3 digits during training, the coupling kernel of the model trained on two digits can create a third cluster, equidistant to the others on the unitary circle, and correctly affect a single phase value per digit. Likewise, the model trained on three digits adapts well to the two-digit case: the model doesn't 't create a third phase cluster but only shows higher variance in the two opposite clusters compared to the model trained on two digits.
The evolution of the cluster-synchron start around the random-phase case and end close to the ideal-phase case. Interestingly, for a given test setting, no matter the training setting (same or different digit number), the models reach approximately the same synchrony values at test time. This observation highlights an additional form of robustness of our models and suggests an object representation ability not present in non-complex and non-synchronized (random-phase) complex models.
losses illustrates well the general case: losses for both KomplexNets
12

---

Published in Transactions on Machine Learning Research (06/2025)
Trained on digits
Trained on 3 digits
Tested on 2 digits
Cluster synehrony loss
Cluster synchrony loss
00
3
0.4
0.2
8.2
15
10 Timestopa
Timestepe
Tested on 3 digits
Chuster synchrony loes
0.4
Cluster synchreny
0.4
0.2
0.0
0.0
10
15
Timestape
Timesteps
Random phases model
KomplexNet with feedback
Ideal phases model
KomplexNet
Figure 7: Generalization to more or less digits. We show here the generalization ability of KomplexNets trained on two or three digits and tested two three digits, evaluated on the synchrony objective. On each panel, we present visualizations of the phases of KomplexNet with feedback on one representative example, at the last timestep, polar and spatial representation to observe the distribution of the phases and their link with the objects, and the evolution of the cluster synchrony loss through time (over the entire test set), in comparison with the value of the basclines.
Performance the same way, we report the classification accuracy of the models and their baselines when trained on two three digits and tested on two or three digits (Figure g panel A). Consistent with the previous results, both KomplexNets outperform the real and random- mudoo--pasees model baselines, both when tosting in-distribution and out-of-distribution. More interestingly, both versions of KomplexNet reach almost each given test set (within +3%), matter the number of digits seen during
the same performance training, Conversely, the baselines (real and random-phase models) suffer more from this change, leading to a very consequent gap in performance (up to 10%) on the off-diagonal
testing) plots.
Given this success in generalizing the classification lask to one more or one less digit compared to the training set, we next evaluate the maximum number of objects that can be handled by KomplexNets. Consequently, we report the performance of all the models on two to nine digits in the image. In Appendix Figure [4] we report the absolute performance of the models at the last timesteps for each test set (one test set corresponding to a fixed number of digits in the images). As could be expected, performance decreases rapidly as the number of simultaneous objects to classify grows from two or three digits (the number that the models were trained on) up to 9 digits. However, performance drops more quickly for the baselines (real and random-phase models) than for KomplexNNess. As the exact advantage of KomplexNets hard to quantify from this plot, we also report Figure the difference performance between all the models and KomplexNet (panel (first column)
B), and all the models and KomplexNet with feedback (panel C), when trained on either three digits (second column). On these plots, difference means that the tested model reaches the performance KomplexNet (for panel B, KomplexNet with feedback for panel C), while negative difference means that the tested model performed worse than KomplexNet (and conversely). In panel B, we observe a negative difference between KomplexNet and the baselines (except KomplexNet with feedback), persisting up to 8 digits with a peak around to digits. Similarly, KomplexNet with feedback (panel C) systematically outperforms all the other models from two digits. The nino-digit test very hard for all the models because it the furthest one from the in-distribution case and, observable in Figure 14 accuracy is very low.
13

---

Published in Transactions on Machine Learning Research (06/2025)
A
Trained on 2 digits
Trained on 3 digits
B
Trained on digits
Trained on digits
Test accuracy
on 2 ddgits
0.90
0.95
0.95
0.90
Accuracy KomplexNet
minus baselines
0.025
0.000
0.00
0.85
-0.025
-0.05
-0.050
0.10
10
15
5
10
15
2
6
8
Test accuracy
0.95
Accuracy KomplexNet feedback minus
0.025
0.00
on ddigits
baselines
0.000
0.90
-0.025
-0.05
0.85
0.85
0.80
0.80
0.10
0.75
0.75
-0.100
2
8
Timesteps
Timesteps
Number dighs
Number of digits
Real model
Random phases model
Ideal phases model
KomplexNet
KomplexNet with feedback
Figure 8: Performance on generalization. We report. the average performance of Komplex (red) and KomplexNet with feedback (purple) over time along with the standard deviation for 50 repetitions. We compare it with its rcal-valued bascline (bluc), a complex model with random phase initialization (green) as well as a complex model with an ideal phase initialization (orange). The models are trained to classify two or three digits and tested on two or three digits (panel A), and up to nine digits (panels B and C). Panel A shows the classification performance per timestep. Panel B and panel C respectively show the difference in performance between KomplexNet and KomplexNet with feedback and the baseline at the last timesteps when tested on different numbers of digits.
Overall, these results reveal that phase synchronization makes the models more robust and general by rendering them less sensitive to out-of-listribution shifts.
5.4 Additional experiments
Experiments on non-uniform background. To demonstrate that our method is not restricted to images with empty backgrounds, we train our models and the basclines on a version of the multi-MNIST dataset with randomly drawn CIFAR images in the background. The results are presented in Figure [8 Because the meaningful information contained in the image more difficult to extract, both synchrony and performance measures are affected for all the models. However, KomplexNet and especially KomplexNet with feedback still clearly outperform the baselines. This additional experiment highlights the robustness of the Kuramoto model: the difficulty is in ignoring noisy information in the background, therefore relying less proximity and more on similarity principles. For this reason, the cluster synchrony loss of KomplexNet is very altered and far from the ideal case, but the leedback connections of KomplexNet with feedback help to bridge the gap.
Leveraging the temporal dynamic from temporal inputs. Finally, we evaluate the advantage of the Kuramoto dynamic dynamic inputs. More specifically, investigate whether the temporal dimension of the Kuramoto dynamic can act memory mechanism when the input is transformed from static images to videos (with digits moving across the frames). We show in Figure 19 the accuracy per limestep relative to the frame with the maximum amount of overlap (denoted timestep 0). Compared to the real baseline, as well as KomplexNets tested on each frame separately, we observe a significant increase in accuracy when the models are tested on the moving object test set. These results suggest that the phase information coming from the previous frames (where the digits overlapped less) is maintained, leading to better performance. Overall, it.
14

---

Published in Transactions on Machine Learning Research (06/2025)
confirms the hypothesis that Kuramoto can act as system with memory, able to use information from the previous timesteps to create a more qualitative phase separation than a system deprived of such context.
6 Conclusion
6.1
Summary
Here, propose model combining complex-valued activations with Kuramoto pluse-synchronnizaion dynamic modeling of the binding-by-synchie simultaneously indicate the presence of a feature by its activation amplitude (just as in standard real-valued neural networks), and tag the group or object to which this feature belongs by its activation phase. The Kuramoto model serves as a syuchronization process, where the coupling kernels implement an inductive bias of proximity and similarity (akin to Gestalt principles). We show that our model outperforms a real-valued baseline as well complex-valued model with random phases multi-object recognition. More interestingly, the phases play important role in introducing some notions of object representation in the models, making them more robust to ambiguous cases such as overlapping digits, noisy images, more digits in the images, etc. We additionally propose a way to introduce feedback connections in the model, acting on the phases by using information from higher layers to enhance synchrony. As the phase information becomes more reliable (better cluster synchrony loss) with the leedback extension, the performance, nosustnesss and generalization of the model increase, highlighting the added value of good phase synchronization for multi-digit classification.
theory in neuroscience. A complex-valle valued neuron can
6.2 Limitations and discussion
Model Depth and Scalability. The models studied in this work are relatively shallow. We intentionally designed a limited architecture to restrict feature representation abilities and highlight the benefits of synchrony in such a setting. While this serves as a proof of concept, scaling up our approach requires identifying tasks and datasets where ttate-of-the-art models struggle with feature binding in multi-object scenarios. Given the computational demands of training large models extensive datasets, opted for a smaller-scale demonstration. Notably, the phase-based grouping in our model is local and parallelizable by design, which suggests favorable properties for scaling to larger architectures and higher-dimensions data. Exploring the scalability of our approach to larger networks and more complex object recognition tasks is a promising direction for future research.
Hyper-Parameter Dependence. The Kuramoto dynamics introduced in our model rely on several eyper-parameters. including e, 17 for each layer I, the coupling kernel sizes kn and kt and the loss balance parameter Finding optimal values for these parameters requires hyper-parameter tuning to ensure phase synchronization. However, our experiments indicate that these values remain consistent across different tasks (see Table 1], suggesting that hypee-parameter tuning is only necessary when changing dalasets.
Explicit vs. Emergent Synchronization. A potential limitation of our approach is the explicit addition of Kuramoto dynamics, in contrast to prior work where synchrony emerges through training Löwe et al. 2023 As noted by Stanić et al. (2023), the Complex Autoencoder (CAE) (Löwe et al. can achieve phase synchronization, but only on simple datasets with a limited number of objects.
2022 Stanić et al.
2022
While Stanié al. (2023) proposed a method scale this behavior, they required an additional objective to achieve synchronization on more complex datasets. The emergence of synchrony
scale for complex visual scenes remains an open and non-trivial challenge. Our approach circunvents this difficulty by directly incorporaling synchrony via Kuramoto dynamics, providing controlled framework to assess its benefits. This serves as proof of concept, demonstrating the advantages of complex-value valued representations and synchronized activity in visual tasks. Furthermore, our approach aligns with experimental findings in neuroscience Frics et al. 1997); emphasizing the role of synchrony in early visual processing.
Neuroscientifie Relevance. Our study primarily motivated by the binding by synchrony thoory, a concept widely discussed in neuroscience. While this theory remains influential, it has faced experimental challenges (Roelssema) 2023 Shadlen & Movshon 1999). However, recent. evidence supports the functional
15

---

Published in Transactions on Machine Learning Research (06/2025)
Additionally, our implementation of feedback connections resonates with the predictive coding framework in neuroscience, where recurrent loops convey top-down predictions that refine lower-level representations (Rao & Ballard 1999 Friston 2005). In our model, foodback promotes alignment of phase representations, effectively broadcasting higher-lovel integration to refine local urature binding. This is consistent with evidence that leedback improves object representation and segmentation, especially under ambiguous conditions. Furthermore, our design parallels physiological findings showing that early visual areas like V1 receive substantial feedback input after initial feedforward sweeps (Lamme & Roelfsemal 2000; Keller et al. 2020). Such feedback has been implicated in refining perceptual organization and enhancing context-dependent interpretation of sensory input, closely aligning with the role of feedback in KomplexNet to improve grouping and segregation over time, Consequently, our work does not aim to provide new insights into biological vision but instead proposes synchrony as a viable solution for feature binding in artificial models. By leveraging neuroscientific principles, we offer an alternative computational mechanism that may inspire future advancements in doep learning architectures.
importance of synchronized activity Frics 2023
Disentangled representations. KomplexNet introduces an explicit factorization of the representation space by docoupling feature identity (amplitude) from object membership (phasc). Traditional deep networks enlangle these factors in single representation space (as proposed by the manifold hypothesis), where natural data form a -ineiiensional but tangled subspace (Bengio et al. 2013). In contrast, KomplexNet structures the phase representation explicitly: phase variables encode object binding, while amplitude variables capture feature identity, enabling disentangled representations by design. The Kuramoto dynamics further enforce this separation by structuring the phase space through stable attractor states, as established in dynamical systems theory (Kuramoto) 1975 Breakspear et al., 2010). Each attractor corresponds to an object-centric group of neurons, offering robustness to noise and perturbations (which we empirically confirm and illustrate in Figure 6). Importantly, this synchronization process parallels spectral clustering on a graph: neurons act as nodes, and the learned coupling kernel defines weighted edges based on feature similarity and spatial proximity (Rodrigues et al. 2016). Specifically, the Kuramoto model can be generalized to arbitrary weights between nodes in graph-based Kuramoto networks (see also Equation 12 in (Rodrigues et al. 2016)): ):
0. = wi + Σ Wi. sin(O; 0.) -0))
(8)
Where Way is the coupling weight between node and node j, and wi is the natural frequency of oscillator (generally set to 0 because we assume homogeneous or negligible intrinsic frequency). The dynamical system defined by the graph- based Kuramoto model is a gradient flow of the energy function:
E(0) = = - Σ
Way cos(O, - 0g,)
(9)
5
Intuitively, cos(O,- 02) is minimized when 0g = 0j. So, minimizing B(O) leads to synchronization of neighboring nodes with strong weights Way- The negative sign ensures that energy is minimized as phases align. This leads to coherent phase clusters that correspond to object groupings (visualized in Figures 3 and g.. This perspective aligns with known connections between synchronization phenomena and graph partitioning methods oOdor & Kelling 2019). Moreover, this dynamic phase clustering supports compositional generalization: as observed empirically (Figure S KomplexNet generalizes to unseen object counts by flexibly allocating new phase clusters. Theoretically, this aligus with the Kuramoto model's 's capacity for scalable clustering based on coupling dynamics (Strogatz, 2000), ensuring that object representations remain modular and recombinable. In sum, KomplexNet's explicit use of theoretical properties of the Kuramoto model to act on the phase representation yields grounded benelits for semantic disentanglement and compositionality, leveraging manifold separation and graph-structured dynamics to form robust, interpretable representations.
More complex and conceptual binding problems. The binding problem refers to the challenge of associating multiple features belonging to the same object when they are extracted independently, especially in scenes containing multiple objects. Solving this problem involves developing representations that robustly maintain object identity and separation. In this work, we address binding at the level of perceptual grouping, evaluating our solution primarily through object segregation metrics such as the cluster synchrony loss.
16

---

Published in Transactions on Machine Learning Research (06/2025)
However, we view this as first step toward broader applications, where such phase-based representations could support more abstract forms of reasoning.
Recent work has demonstrated the potential of oscillatory dynamics for solving structured, symbolic problems. For example, Miyato et al. (2024) shows that phase synchronization can encode complex constraint satisfaction tasks, such as Sudoku, by assigning distinct phase states to satisfy relational constraints between variables. Similarly, Muzellec et al. (2024) illustrates how dynamic phase grouping enables robust tracking of object identity over time, even visual features undergo transformations. These findings suggest that phase synchronization dynamics extend beyond perceptual grouping, offering flexible mechanism for encoding and maintaining structured, identity-preserving represcntations that could form the foundation for more abstract reasoning tasks. Moreover, such dynamics could support multi-modal binding for instance, linking visual features to associated linguistic descriptors (e.g., binding the visual identity of a 'red apple" to its corresponding textual or auditory label). By assigning aligned phases to corresponding elements across sensory modalities, phaso-based representations could support unified, cross-modal concept formation enabling grounded semantic representations that dynamically associate visual and language attributes in compositional and context-sensitive way.
Extending this to conceptual binding, we propose that phase clusters can serve as dynamic labels that fiexibly assign features or entities to specific roles in abstract relational structures. For example, in a symbolic reasoning task, one phase cluster could correspond to the role of 'subject,' * another to 'predicate,' and another to 'object." Features or entities participating in these roles would align their phases accordingly, enabling the network to represent not just object identity but also relational structure between objects. Importantly, because phase synchronization is dynamic, these assignments can change flexibly depending on the context or task property critical for symbolic reasoning, which requires reusable and composable bindings across different structures (Smolensky 1990; Hummel & Holyoak 2003). Thus, dynamic phase assignment provides a potential mechanism for implementing variable-role binding, where the 'variable" is the feature or entity, and the "role" is specified by its phase alignment. This dynamic labeling could also extend to predicale-argument binding, such as binding adjectives or attributes (e.g., "red," " "tall") to their corresponding referents ('apple," "tree") through shared phase alignment. Recent work (Chaturvedi & Asher 2024) has shown that transformer-based language models struggle at extracting predicate-argument structure from simple sentences. Phase synchronization across feature spaces could offer biologically inspired and cerputationally efficient mechanism for aligning attributes with entities in structured representations. In this way, structured relational representations can emerge from the same oscillatory dynamics that support perceptual grouping in KomplexNet.
Furthermore, recent work on rotating features (Töwe et al. 2024 provides a compelling demonstration of how relational and hierarchical structures can be encoded through learned rotations in feature space. In their model, transformations between entities are represented by applying structured rotations to feature vectors. This concept closely parallels use of phase representation, where rotation in the complex plane corresponds to shifting relational attributes or grouping features under shared identities. Extending this idea, a natural progression for KomplexNet would be to implement multiple phase manifolds operating at distinct levels (akin to frequencies in the brain). Lowest level phases (i.e., faster oscillations) could encode local perceptual groupings, while highest level phases (i.e., slower oscillations) could capture higher-order relational and conceptual structure. This aligns with several thcorics in neuroscience that propose oscillatory multiplexing for hierarchical processing. caammunicaiion---oouo-oooooooeoo suggests that synchronized gamma oscillations enable selective communication between brain regions, while the theta-gamma neural code thcory (Lisman & Jensen 2013) posits that fast gamma cycles nested within slower theta rhythms support the concurrent maintenance of multiple items. Both theories offer compatible perspectives on how nested oscillatory dynamics could support complex, multi-level information integration. In parallel, recent work by Jacobs et al. (2025) proposes traveling wave dynamics in recurrent neural networks as mechanism for spatial integration, where wave propagation accumulates global context over time. While our approach similarly relies local dynamics to achieve global integration, it differs in using steady-state phase synchronization to support object-centric binding within single time frame. These perspectives are complementary: traveling waves facilitate broad spatial propagation, while phase alignment enables precise and flexible grouping. Combining these mechanisms in future architectures could enable integration of
(CTC) (Fries) 2015) theory
17

---

Published in Transactions on Machine Learning Research (06/2025)
information across both space and time, further aligning with principles of cortical computation. By adopting such multi-frequency and multi-dynamic approach, KomplexNet could not only segregate perceptual features but also build hierarchies of concepts, dynamically linking low-level perception with abstract semantic relationships - a step toward structured, symbolic reasoning within the same dynamical system.
7
Acknowledgment
Our work supported by ONR (N00014-241120229,, NSF (ISS-4408755) to T.S. and ERC (ERC Advanced GLOW No. 101096017) to R. V., as well as "OSCI-DEEP" [Joint Collaborative Research Computational NeuroScience (CRCNS) Agence Nationale Rochorcho-Nationll Science Fondation (ANR-NSF) Grant R.V. (ANR-19-NEUC-O00) and T.S. (1I--1912280), and the ANR-3IA Artificial and Natural Intelligence Toulouse Institute (ANR-11--P3A--004) to R.V. and T.S. Additional support was provided by the Carney Institute for Brain Science and the Center for Computation and Visualization (CCV). We acknowledge the Cloud TPU hardware resources that Google made available via the TensorFlow Research Cloud (TFRC) program as well as computing hardware supported by NIH Office of the Director grant S100D025181.
18

---

Published in Transactions on Machine Learning Research (06/2025)
References
Joshua Basscy, Lijun Qian, and Xianfang Li. A survey of complex-valued neural networks. arXic preprint arXiv:2101.1220 12249, 2021.
Marlene Behrmann, Richard S Zemel, and Michael Mozer. Object-based attention and occlusion: evidence from normal participants and a computational model. Journal of Experimental Psychology: Humon Perception and Performance, 24(4):1011, 1998.
Yoshua Bengio, Aaron Courville, and Pascal Vincent. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence, 35(8):1798-1828, 2013.
Gabriel B Benigno, Roberto C Budzinski, Zachary W Davis, John H Reynolds, and Lyle Muller. Waves travel- ing over a map of visual space can ignite short-term predictions of sensory input. Nature Communiiaaiinss, 14(1):3409, 2023.
Michael Breakspear, Stewart Heitmann, and Andreas Daffertshofer. Generative models of cortical oscillations: neurobiological implications of the kuramoto model. Pronliers in human neuroscience, 4:190, 2010.
Roberto C Budzinski, Tung T Nguyen, Jacqueline Doån, Ján Mináč, Terrence J Sejnowski, and Lyle E Muller. Geometry unites synchrony, chimeras, and waves in nonlinear oscillator networks. Chaos: An Interdisciplinary Journel of Nonlinear Science, 32(3), 2022.
Roberto C Budzinski, Tung T Nguyen, Gabriel B Benigno, Jacqueline Doån, Ján Mináč, Terrence Sejnowski, and Lyle E Muller. Analytical prediction of specific spatiotemporal patterns in nonlinear oscillator networks with distance-dependent time delays. Physical Review Research, 5(1):013159, 2023.
Gyorgy Buzsaki and Andreas Draguhn. Neuronal oscillations in cortical networks. science, 304(5679): 1926-1929, 2004.
György Buzsáki, Costas Anastassiou, and Christof Koch. The origin of extracellular fields and currents- -cg,, ecog, 1fp and spikes. Nalure reviews neuroscience, 13(6):407 420, 2012.
Akshay Chaturvedi and Nicholas Asher. Learning semantic structure through first-order-logc translation. In
EMNLP2024, pp. 6669 0669-6680, 2024.
Kanishk Chanhan, Ali Khaledi-Nasab, Alexander B Neiman, and Peter A Tass. Dynamics of phase oscillator networks with synaptic weight and structural plasticity. Scientific Reports, 12(1):15003, 2022.
Meng-Jiun Chiou. Learning Structured Representations of Visual Scenes. PhD thesis, National University of Singapore (Singapore), 2022.
Andrea Dittadi. On the generalization of learned structured representations. arXiv preprinl ar310:2304.13001, 2023.
Pascal Fries. Rhythms for cognition: communication through coherence. Newron, 88(1):220 235, 2015.
Pascal Fries. Rhythmic attentional scanning. Newron, 111( 970, 2023.
Pascal Fries, Pieter R Roelfsema, Andreas K Engel, Peter König, and Wolf Singer. Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry. Proceedings of the National Academy of Sciences, 94(23):12699-12700 1997.
Pascal Fries, Hinrich Schröder, Pieter R Roelfsema, Wolf Singer, and Andreas K Engel. Oscillatory neu- ronal synchronization in primary visual cortex as a correlate of stimulus selection. Journal of Neuroscience, 3779) 3754, 2002.
Karl Friston. A theory of cortical responses. Philosophical transactions of the Royal Society B: Biological sciences, 360(14566) (456))8815 836, 2005.
19

---

Published in Transactions on Machine Learning Research (06/2025)
Anand Gopalakrishnan, Aleksandar Stanić, Jürgen Schmidhuber, and Michael Curtis Mozer. Recurrent complex-weighted autoencoders for unsupervised object discovery. arXiv preprint arXiv:2405. 17283, 2024.
Charles M Gray and Wolf Singer. Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proceedings of the National Academy of Sciences, 86(5):1698-1702 1989.
Klaus Greff, Sjoerd Van Steenkiste, and Jürgen Schmidhuber. On the binding problem in artificial neural networks. ar preprint arXi::201..05008, 2020.
Stephen Grossberg, Adaptive pattern classification and universal recoding: li. feedback, expectation, olfaction, illusions. Biological cybernetics, 23(4):187-20) 1976.
Simon Haziza, Radoslaw Chrapkiewicz, Yanping Zhang, Vasily Kruzhilin, Jane Li, Jizhou Li, Geoffroy Delamare, Rachel Swanson, György Buzsáki, Madhuvanthi Kannan, et al. Imaging frguffreyyency voltage dynamics in multiple neuron classes of behaving mammals. bioRriv, 2024.
John E Hummel and Keith J Holyoak. A symbollie-comeettonnit theory of relational inference and generaliza- tion. Psychological review, 110(2):220, 2003.
Mozes Jacobs, Roberto C Budzinski, Lyle Muller, Demba. Ba, and T Anderson Keller, Traveling waves integrate spatial information into spectral representations. arXiv preprint arXim:200.00000 2025.
Andreas J Keller, Morgane M Roth, and Massimo Scanziani. Feedback generates a second receptive field in neurons of the visual cortex. Nature, 582(78133:5445544) 2020.
T Anderson Keller and Max Welling. Neural wave machines: learning spatiotemporally structured represen- tations with locally coupled oscillatory recurrent neural networks. In International Conference on Machine Learning, pp. 16168 16189. PMLR, 2023.
Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
Alex Krizhevsky, Geoffrey Hinton, et al. Learning multiple layers of features from tiny images. 2009.
Yoshiki Kuramoto. Self-entrainment of a population of coupled non-linear oscillators. In International Symposium on Mathematical Problems in Theoretical Physics: January 23-29, 1975, Kyoto University, Kyoto/Japan, pp. 420-422. Springer, 1975.
Victor AF Lamme and Pieter R Roelfsema. The distinct modes of vision offered by feedforward and recurrent processing. Trends in neurosciences, 23(11):577157) 579, 2000.
Phuc H Le Khac. Toward efficient learning of structured representations in computer vision. PhD thesis, Dublin City University, 2024.
Luisa HB Liboni, Roberto C Budzinski, Alexandra N Busch, Sindy Löwe, Thomas A Keller, Max Welling, and Lyle E Muller, Image segmentation with traveling waves in exactly solvable recurrent neural network. Proceedings of the National Academy of Sciences, (22(11122211111 2025.
John E Lisman and Ole Jensen. The theta-gamma neural code. Neuron, 77(6):1002 1016, 2013.
Sindy Löwe, Phillip Lippe, Maja Rudolph, and Max Welling. Complex-valued autoencoders for object discovery. arXiv preprint XrXiv2204.02077, 2022.
Sindy Löwe, Francesco Locatello, and Max Welling. Binding dynamics in rotating features. arXiv preprint arXin:2402.05627, 2024.
Alberto Mazzoni, Henrik Lindén, Hermann Cuntz, Anders Lansner, Stefano Panzeri, and Gaute T Einevoll. Computing the local field potential (lfp) from integrate-and-fire network models. PLoS compulational biology, :e1125.e0044584, 2015.
Peter M Milner. A model for visual shape recognition. Psychological review, 81(6):521, 1974.
20

---

Published in Transactions on Machine Learning Research (06/2025)
Takeru Miyato, Sindy Löwe, Andreas Geiger, and Max Welling. Artificial kuramoto oscillatory neurons. arviv preprint arXim:2400. 13822,,, 2024.
Nils Moenning and Suresh Manandhar. Complex-and real-valued neural network architectures. 2018.
Sabine Muzellec, Drew Linsley, Alekh K Ashok, Ennio Mingolla, Girik Malik, Rufin VanRullen, and Thomas Serre. Tracking objects that change in appearance with phase synchrony. arXiv preprint KKi:2410002000 2024.
Géza Ódor and Jeffrey Kelling. Critical synchronization dynamics of the kuramoto model on connectome and small world graphs. Scientifie reports, 9(1):19621, 2019.
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in pytorch. 2017.
A Ravishankar Rao and Guillermo A Cecchi. An objective function utilizing complex sparsity for efficient. segmentation in multi-layer oscillatory networks. International Journal of Intelligent Computing and Cyberneties, 3(2):173 206, 2010.
A Ravishankar Rao and Guillermo A Cecchi. The effects of feedback and lateral connections on perceptual processing: study using oscillatory networks. In The 2011 international joinl conference on newrul networks, pp.
IEEE, 2011.
A Ravishankar Rao, Guillermo A Cecchi, Charles C Peck, and James R Kozloski. Unsupervised segmentation with dynamical units. IEEE Transactions on Neural Networks, 19(1):168 182, 2008.
Rajesh PN Rao and Dana H Ballard. Predictive coding in the visual cortex: functional interpretation of some extra-classical receptive-field effects. Nature neuroscience, ((1):79-87, 1999.
David P Reichert and Thomas Serre. Neuronal synchrony in complex-valued deep networks. arXiv preprint wiXiv:1312.6115. 2013.
Matthew Ricci, Minju Jung, Yuwei Zhang, Mathieu Chalvidal, Aneri Soni, and Thomas Serre. Kuranet: systems of coupled oscillators that learn to synchronize. arXiv preprint arXiv:2105. 100.02005 2021.
Francisco A Rodrigues, Thomas DM Peron, Peng Ji, and Jürgen Kurths. The kuramoto model in complex networks. Physics Reports, 610:1 98, 2016.
Pieter R Roelfsema. Solving the binding problem: Assemblies form when newrons enhance their firing rate they don't need to oscillate synchronize. Newron, 111(():1003 1019, 2023.
Adina L Roskies. The binding problem. Neuron, 24(1):7 9, 1999.
Sara Sabour, Nicholas Frosst, and Geoffrey E Hinton. Dynamic routing between capsules. Advances in neural informalion processing systems, 30, 2017.
Lukas Schott, Julius Von Kügelgen, Frederik Träuble, Peter Gehler, Chris Russell, Matthias Bethge, Bernhard Schölkopf, Francesco Locatello, and Wieland Brendel. Visual representation learning does not generalize strongly within the same domain. arXiv preprint drXiv:2107.08221, 2021.
Michael N Shadlen and J Anthony Movshon. Synchrony unbound: critical evaluation of the temporal binding hypothesis. Newron, 24(1):67 77, 1999.
Wolf Singer. Binding by synchrony. Scholarpedia, 2 112):1655,, 2007.
Paul Smolensky. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial intelligence, 46(1-2):159 216, 1990.
Aleksandar Stanié, Anand Gopalakrishnan, Kazuki Irie, and Jürgen Schmidhuber. Contrastive training of complex-valued autoencoders for object discovery. aixio preprint ar Xiv::2330.. 15001, 2023.
21

---

Published in Transactions on Machine Learning Research (06/2025)
Steven H. Strogatz. From kuramoto to crawford: exploring the onset of synchronization in populations of coupled oscillators. Physica D: Nonlinear Phenomena, 143(1-4):1 2000.
D. Todorovic. Gestalt principles. Scholarpedia, 3(12):5345, 2008.
Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang, Dmitriy Serdyuk, Sandeep Subramanian, João Pelipe Santos, Soroush Mehri, Negar Rostamzadeh, Yoshua Bengio, and Christopher Pal. Deep complex networks (2017). arXiv preprint
2017.
Anne Treisman. The binding problem. Current opinion in newrobiology, 6(2):171-178, 1996.
Anne Treisman. Feature binding, attention and object perception. Philosophicol Transactions of the Royal Society of London. Series B: Biological Sciences, 353(1373):1295 1306, 1998.
Anne Treisman and Garry Gelade. A feature-integrattio theory of attention. Cognitive psychology, 12(1):
97 136, 1980.
Peter Uhlhaas, Gordon Pipa, Bruss Lima, Lucia Melloni, Sergio Neuenschwander, Danko Nikolić, and Wolf Singer. Neural synchrony in cortical networks: history, concept and current status. Frontiers in integrative meuroscience, 3:543, 2009.
Christoph von der Malsburg. The correlation theory of brain function (internal report 81-2). Goettingen: Department of Neurobiology, Max Planck Intitute for Biophysical Chemistry, 1981.
Cornelius Weber and Stefan Wermter. Image segmentation by complex-valued units. In Artificial Newral Networks: Biological Inspirations ICANN 2005: 15th International Conference, Warsaw, Poland, September 11-15, 2005. Proceedings, Part I 15, pp. 519 524.5224462 Springer, 2005.
Max Wertheimer. Laws organization perceptual forms. 1938.
Saurabh Yadav and Koteswar Rao Jerripothula. Feens: Fully complex-valued convolutional networks using complex-valued color model and loss function. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 10689-10699 2023.
Richard S Zemel, Christopher KI Williams, and Michael C Mozer. Lending direction to neural networks. Neural Networks, 8(4):503 512, 1995.
Yangmuzi Zhang, Zhuolin Jiang, and Larry S Davis. Learning structured low-rank representations for image classification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp- 676 683, 2013.
Hao Zheng, Hui Lin, Rong Zhao, and Luping Shi. Dance of smn and amn: Solving binding problem by combining spike timing and reconstructive attention. Advances Neural Information Processing Systems, 35:31430- 14400-33444,, 31443, 2022.
A Appendix
A.1 Algorithms
We detail here the different steps of both versions of KomplexNet using the pseudo-code algorithm. Algorithm describes the operations of KomplexNet and Algorithm 2 specifies how feedback connections intograte in the previous dynamic.
A.2
Coupling kernel
22

---

Published in Transactions on Machine Learning Research (06/2025)
Algorithm KomplexNet
Require: Input image X, number of timesteps T, set of layers L, with E O,... Ny 1, Kuramoto function K, Kuramoto parameters coupling kernel R, desynchrony term learning rate
for ł + to - do at - Lx())
0.. - 00 + K (ax, 1, e,
20, -- C..00
for i + to N₁ 1 do
21, t- (2),,
return Predictions 1N7-11
Algorithm 2 KomplexNet with feedback
Require: Input image X, Initial phases with random values finit, number of timesteps T, set of layers Li Kuramoto function K, Kuramolo parameters : coupling kernels Ri, desynchrony term ei, learning rate A with i 0, Ni.
ag Lo(X)
0,,0 Dinit + K(ao, Osnit; Ro, co, 2a)
20.0 2.000
for i to Ni - do
21,0 +- 1;
for --1 1o
do
0t (X)
0, - f0,-11 +
Ro, 20) ( 11, Res e,, Xx)
20,1 + a.et :00
for + Ni- do
21, + (=(2)111)
return Predictions 1
23

---

Published in Transactions on Machine Learning Research (06/2025)
Source channels
6
4
Coupling strength
Target channels
2
0
- 2
-
6
Figure 9: Visualization of the learned coupling kernel after training. We show the coupling kernels (Fk,et in Equation ! learned by KomplexNet, associated with the feature weights learned by the convolution. Each coupling kernel Tk,eij represents how phases (0x) in the source channel influence phases (Dwiz) in the target channel (resulting in non-symmetric interaction).
A.3 Complementary results
We show in this section the complementary results and various tests, to give more insights into the functioning of the proposed method.
Test on more timesteps. Without retraining KomplexNets, we test the models on more timesteps than during training. The resulting performance (Figure 10) shows the robustness of the Kuramoto dynamic to maintain a good phase representation over time.
Best validation model. The results presented the main paper are obtained by averaging the performance (synchrony and accuracy) on 50 different initializations and shown with the standard deviation. Complementary this choice, we select the best model on the validation and plot in Figure 11 the synchrony on the first and the performance the second row for each type of model and three different test sets (in-distribution,
24

---

Published in Transactions on Machine Learning Research (06/2025)
In distribution
Overlap
Noise
1.00
0.70
0.7
0.65
0.6
Test accuracy
Test accuracy
0.95
0.5
0.60
0.4
0.90
0.55
0.3
0.50
0.85
0.2
20
40
40
40
Timesteps
Timesteps
Timesteps
Real model
Ideal phases model
Kuramoto phases model with feedback from 12,3,4
Random phases model
Kuramoto phases model
Figure 10: Results on multi-MNISST when tested on more timesteps. We report the average performance of KomplexNet (red) and KomplexNet with feedback (purple) over time along with the standard deviation for 50 repetitions. We compare it with a real-valued baseline (blue), a complex model with random phase initialization (green), and the ideal phase cluster synchrony (orange). The models are tested on the in-distribution dataset (left plot), overlapping digits (middle plot), and noisy images (right plot). The vertical bar represents the number of timesteps in the training condition.
overlap, and noise). The results are consistent. with the ones in the main text (except for the performance of KomplexNet with feedback on noisy images).
Extended Benchmark. We compare both versions of KomplexNet against additional baselines: (1) a real-valued model with increased capacity match KomplexNet's parameter count, accounting for the additional parameters introduced by the coupling kernel (dotted blue line in Figure 12 and (2) a Vision Transformer (ViT) with a comparable nunber of parameters, providing baseline from dilferent architectural family (brown line in Figure I2 The VIT was trained for 50 epochs spochs-longer than the 30 epochs used for other models to cnsure convergence. While both models perform competitively on the in-distribution test set, they generalize less effectively than KomplexNets when faced with overlapping digits or additive Gaussian noise.
Influence of the feedback layer. KomplexNet with feedback receives feedback information from all the layers. To highlight the contribution of each layer specifically, we train separated models with feedback coming from only one of the layers and report the performance in Figure 13 We can first observe that KomplexNet with feedback (coming from all the layers) outperforms all the other versions on robustness tests, emphasizing the need for various types of information to solve ambiguous cases. Conversely, KomplexNet performs worse than all the models with feedback (both in-distribution and robustness). We additionally provide for cach case the value of the hyper-parametes found to maximize the performance in Table [ In conformance with our expectations, has to be higher when the models are provided with feedback connections compensate for more synchronized activity coming from other layers. The size of the local kernel & remains the same across the versions, corresponding more less to the size of the digit in the image. Likewise, ki, is smaller than k to account for the downsampling of L,. Finally, the influence of local synchrony, modulated by X is higher than the influence of the feedback phases (Ar, < A for i E 1,),
Raw performance on the generalization test sets. The main text. reports the difference in the performance of KomplexNet and KomplexNet with feedback when tested on two to nine digits to evaluate their gencralization abilitics. We show in Figure 14 the raw performance of each model and the basclines trained two or three digits. All the models show more difficulty in classifying correctly the number of digits in the image increases. However, KomplexNets show consistently higher performance (see Figure
25

---

Published in Transactions on Machine Learning Research (06/2025)
In distribution
Overlap
Noise
Cluster synchrony loss
0.6
0.6
0.6
0.4
0.4
0.4
0.2
0.2
0.2
0.0
0.0
0.0
0.950
0.65
0.6
Test Accuracyy
0.925
0.5
0.60
0.900
0.4
0.55
0.875
0.3
0.850
0.50
0.2
0.1
Timesteps
Timesteps
Timesteps
Random phases model
KomplexNet Real model
Ideal phases model
KomplexNet with feedback
Figure 11: Results on multi-MNIIST. We report the test synchrony (first row) and performance (second row) of KomplexNet (red) and KomplexNet with feedback (purple) over time along of the best model the validation set. We compare it with a real-valued baseline (blue), complex model with random phase initialization (green), and the ideal phase cluster synchrony (orange). The models are tested on the in-distribution dataset (left plot), overlapping digits (middle plot), and noisy images (right plot).
k
ly
À
d
A,2
A
KomplexNet
0.2
13
0.006
KomplexNet with feedback from 12
13
0.006
0.003
KomplexNet with feedback from 13
13
0.005
0.004
KomplexNet with feedback from 14
13
0.005
0.004
KomplexNet with feedback from 12,3,4
13
5
0.009
0.005
0.004
0.004
Table 1: We perform hyper-parameee scarch to find the optimal parameters for the Kuramoto dynamic and report the values for the different versions of the models. represents the desynchrony term in the local dynamic, k and h2 respectively the size of the local coupling kernel and the kernel coming from L1, and X and Ar for i E 1, modulate the influence of the phase modification by the local dynamic and the one coming from the feedback layers Lg for i i 1,2,3.
A.4 Visualizations
Similarly to the in-distribution tests, provide in Figure 15 visualizations of the phases of all complex models. The random case remains unchanged. However, the overlapping digits by almost creating three equidistant clusters, with the overlapping pixels belonging to a cluster in between the two others on the unitary circle. Despite no supervision, KomplexNets found a solution close to the one we adopted for the "ideal" case, consisting of affecting the overlapping pixels to a third cluster, but keeping the two other clusters opposite to each other. Additionally, when we add Gaussian noise to the images, the models struggle more to separate the digits, but KomplexNet with feedback remains able to affect opposite values to the digits (the clusters just show more variance).
observe that KomplexNets find solution for
26

---

Published in Transactions on Machine Learning Research (06/2025)
In distribution
Overlap
Noise
0.7
0.94
Test accuracy
0.92
0.60
0.6
0.5
0.90
0.55
0.4
0.88
0.50
0.3
0.86
10
10
15
10
15
Timesteps
Timesteps
Timesteps
Random phases model Ideal phases model
KomplexNet with feedback Real model
KomplexNet
VIT model
Figure 12: Extended Benchmark. We report the tost accuracy of two additional basclines: a real-valued baseline accounting for the additional parameters of KomplexNet due the coupling kernel (dotee blue line) and a ViT extend the benchmark to different architecture families (brown line). We evaluate these new basclines the in-distribution test set, overlapping digits and noisy images.
A.5 Untrained coupling kernel.
While phase synchronization in KomplexNet is driven by end-to-end learning, it primarily emerges from the Kuramoto dynamics independently of gradient-based optimization. Specifically, to demonstrate this, we tested a variant KomplexNet in which the coupling kernel is defined as a fixed, spatially-local Gaussian and not updated during training. This statie, sliding kernel leverages principles of proximity and good continuity, encouraging local phase alignment and desynchronization across more distant locations. As shown Figure 16 even without learning the kernel, this version of KomplexNet already exhibits meaningful improvements in both test accuracy (Panel A) and phase synchrony (Panel B) over time. However, performance plateaus below that of the fully trained model, highlighting the benefit of learning the coupling kernel jointly with the rest of the network. This underscores the mutually reinforcing relationship between task-driven optimization and synchronization dynamics: synchronization helps learning, and learning sharpens synchronization To further understand the effects of this Exed-kernel version, we visualize phase distributions and feature activations across layers Figure 17 The polar plots illustrate the evolution of phase scparation from Layer to Layer 3, where color-coded clusters correspond to different objects in the input image. The bottom rows show corresponding feature activations. While phase separation still emerges with the fixed Gaussian kernel, it is less distinct compared to the fully trained version. Together, these results demonstrate that the Kuramoto dynamics alone, when combined with well-structured coupling kernel, can provide useful inductive bias for perceptual grouping. Nevertheless, full end-to-end learning yields stronger and more stable synchrony, reinforcing the value of optimizing coupling weights in tandem with task objectives.
27

---

Published in Transactions on Machine Learning Research (06/2025)
A
In distribution
Overiap
Noise
1.00
0.7
0.95
0.60
0.6
Test accuracy
Test accuracy
0.5
0.90
0.55
0.4
0.85
0.3
0.50
0.80
10
5
10
5
15
Timesteps
Timesteps
Timesteps
B
1.00
In distribution
Overlap
Noise
0.95
Test accuracy
Test accuracy
0.60
0.6
0.90
0.55
0.85
0.50
0.2
0.80
0.45
5
10
15
10
15
5
10
15
Timesteps
Timesteps
Timesteps
Real model
KomplexNet with feedback from KomplexNet with feedback from 13
Kuramoto phases model
Random phases model
Kuramoto phases model with feedback from 12,3,4
Ideal phases model
KomplexNet with feedback from
Figure 13: Performance of Komplexnet with various types of feedback. We report the average performance of KomplexNet (rod) and KomplexNet with feodback (purple) over time along with the standard deviation for 50 repetitions. We additionally show the performance of KomplexNet with feedback from a single layer (L2 in green, L3 in light blue, and 4 in yellow). We compare the models with the usual baselines (real model in dark blue, random phase model in dark green, and idcal phase model in orange). Panel A represents the average and standard deviations over 50 different initializations and Panel B reports the test accuracy of the best initialization on the validation set.
A.6 Additional experiments
We finally show the results corresponding the additional experiments detailed the main text with variants in the datasets to show different uses of KomplexNet.
CIFAR10 images in the background. We create an additional dataset with the same digits but with the background filled with RGB content, namely images from the CIFAR10 dataset (see examples in Figure 18 We retrain the models on the new images (the task remains unchanged: 2-digit classification) and report the cluster synchrony loss and accuracy on the test set in Figure 18 Compared to the previous datasets (with a uniform background), the models achieve lower performance. Indeed, the task is now harder due to less salient information to extract. This version is particularly harder for the Kuramoto model: the propagation of phase synchrony is enhanced by the activated background, even though the information is irrelevant. For this reason, the cluster synchrony is much higher than before and very lar from the ideal scenario. As a result, the accuracy is also further from the ideal case. However, KomplexNets are still better than the baselines, confirming that the Kuramoto dynamic remains helpful on RGB images. More specifically, the foedback connections show clear advantage on the cluster synchrony loss compared KomplexNet without feodback, resulting in slight. increase in test accuracy.
28

---

Published in Transactions on Machine Learning Research (06/2025)
Trained on 2 objects
Trained on 3 objects
0.8
0.8
Test accuracy
0.6
0.6
0.4
0.4
2
4
6
8
2
4
6
8
Number of digits
Number of digits
KomplexNet
Random phases model
KomplexNet with feedback Real model
Ideal phases model
Figure 14: Results on multi-MNIST with more digits. We report the average performance of KomplexNet (red) and KomplexNet with feedback (purple) over time along with the standard deviation for 50 repetitions. We compare the models with the usual baselines (real model dark blue, random phase model dark green, and ideal phase model in orange). The left plot shows the test performance of the models trained on 2 digits, and the right plot is for the models trained 3 digits.
Moving digits. The second variant in the dataset to convert static images into videos with both digits moving across frames. With this version, we aim to evaluate whether we can use the Kuramoto dynamic along with the phase information a memory mechanism to help resolve ambiguous cases (overlap between digits in this case). To test such a hypothesis, overlapping (with a maximum of 25% of the active pixels) in the center of the image. We then generate a random trajectory for the first digit and use the opposite trajectory for the second. We let the objects move along these trajectories for 15 frames (making them bounce on the border of the image to prevent them from disappearing and controlling for the amount overlap at each frame) and use these frames as the first half of the video. We take the opposite trajectories and apply the same procedure to generate the 15 other frames (other half) of the video. In other words, the resulting videos start with both digits a random location, then slowly move closer to each other, reaching maximum amount of overlap in the middle before moving away from each other. We are interested in the performance of the model around the middle frame of maximum overlap (10 frames before and after). We use the first frames to let the Kuramoto model converge to a clean phase separation. We evaluate KomplexNet with and without feedback on the videos, as well as the same models tested on each frame separately. For the models tested on the videos, the task has the additional difficulty of adapting the phase information moving information: each frame corresponds single Kuramoto step, potentially leading to noisy artifacts in the phase information because the models were trained static images. However, the models tested on each frame separately, despite having the
generate vidcos of 30 frames, starting from the two digits
29

---

Published in Transactions on Machine Learning Research (06/2025)
A
Overlap
B
Noise
Random phases
KomplexNet with feeback
Random phases
KomplexNet with feeback
KomplexNet
Ideal phases
KomplexNet
ideal phases
Figure 15: Robustness on synchrony visualizations. As Figure we show the phases of KomplexNet and KomplexNet with foedback, the last timestep, compared to the two complex basclines (random phases the left, and ideal phases on the right) represenlative examples of overlapping digits (panel A) and additive Gaussian noise (panel B).
time to converge clean phase separation, do not have access to frames with less overlap between digits. We show in Figure 19 (left panel) the raw performance 10 frames before and after reaching the maximum overlap (denoted frame 0) for KomplexNet with (purple) and without feedback (red) given the two types of input (static in dashed lines and videos in plain lines). We report the performance of the real model (tested on static images only because of the absence of temporal dynamic in the model) confirm the benefit of KomplexNet on this version as well. We present the videos from Frame 0 to Frame 30 as well as from Frame 30 to Frame 0 to correct for potential bias in the generation of the dataset. On the left Panel, observe that the models which were presented the moving digits are outperformed by the models tested on single images at the first timesteps. This is explained by the fact that the digits do not overlap (or barely do) 10 frames before Frame 0. Therefore, given several timesteps to converge on the frame, the "static" models reach a cleaner phase separation leading to better accuracy. However, as we get closer to the maximum overlap, the "static" models show a drop in performance, compared to the "dynamic" models, suggesting that the latter manage make use of the phase separation information from previous frames when the digits did not yet overlap. Finally, the digits move away from each other, the "static" models recover their performance, outperforming again after few frames the dynamic model. This result is shown differently on the center panel. We show here the difference in the accuracy of each model with videos running from Frame 0 to Frame 30 relative to the accuracy with videos running backward, from Frame 30 to Frame 0. Every "static" model has a null difference because the dataset was symmetrized. However, the 'dynamic' models show a positive difference before Frame and a negative difference after, suggesting that they use the phase information from the previous steps to maintain their phase separation when the digits overlap. However, they take a few steps to recover from the phase corruption induced by the high overlap between digits at the middle frame. Finally, we show the right panel the difference in performance between static and dynamic models. We can observe maximum difference at Frame ( in favor of dynamic models, outperformed by their static real-valued baseline when the amount of overlap is reduced (around frames -10 and 10). These results confirm the possible use of the Kuramoto dynamics as a mechanism of memory, helping resolve extremely overlapping cases and being compatible with dynamical inputs.
30

---

Published in Transactions on Machine Learning Research (06/2025)
A
In distribution
Overlap
Noise
0.7
0.94
Test Accuracy
0.60
0.5
0.90
0.55
0.4
0.88
0.50
0.3
0.45
8
limesteps
Timesteps
Timesteps
Cluster synchrony loss
0.6
0.6
0.6
0.4
0.4
5
15
10
10
15
Timesteps
Timesteps
Timesteps
Random phoses model
KomplexNet
Ideal phases model
KomplexNet with Gaussian kernel
KomplexNet with feedback
Figure 16: Results with untrained Gaussian coupling kernel. We report the Test Accuracy (A) and Cluster synchrony Loss (B) of KomplexNet with untrained Gaussian coupling kernel (pink), KomplexNet (red), and KomplexNet with feedback (purple) over time for 50 repetitions (mean and standard deviation). We compare it with a real-valued baseline (blue), a complex model with random phase initialization (green), and the ideal phase cluster synchrony (orange).
Layer 00*
Layer
Layer a0*
Layer
Input image
6o
ap*
180
180
180
180
or
270r
270
200r
270r
Figure 17: Visualizations of synchrony in KomplexNet with untrained Gaussian coupling kernel. As in Figure 4 we show the phases of KomplexNet with an untrained Gaussian coupling kernel, at the last timestep given an input image from the "in-distribution" lest set.
31

---

Published in Transactions on Machine Learning Research (06/2025)
0.7
Cluster synchrony loss
0.6
Test Acouracy
0.5
0.4
0.4
0.3
0.2
0.2
2
4
8
10
4
6
10
Timesteps
Timesteps
Cluster synchrony loss
0.7
0.7
0.6
Test Accuracy
0.6
0.5
0.4
0.4
0.3
0.3
0.2
0.2
2
10
Timesteps
Timesteps
Random phases model
KomplexNet Real model
Ideal phases model
KomplexNet with feedback
Figure 18: Results on multi-MNIST with CIFAR in the background. We provide examples of the stimuli exhibiting multi-mnist digits with a CIFAR image in the background. We report the cluster synchrony loss (first column) and performance (second column) of KomplexNet (red) and KomplexNet with feedback (purple) over time for 50 repetitions (mean and standard deviation in the first row, and best model the validation set in the second row). We compare it with real-valued baseline (blue), complex model with random phase initialization (green), and the ideal phase cluster synchrony (orange).
32

---

Published in Transactions on Machine Learning Research (06/2025)
Frame
Frame 6
Frame 12
Frame 18
Frame 24
Frame 30
Example
3
3
3
Example
78
7g
7
7
0.03
0.04
max ovarlsp
0.03
0.02
DIT: moving static
0.02
0.01
0.00
Text
-0.01
-0.01
-0.02
-0.02
0.50
-0.03
-0.03
-0.04
-10
-5
10
-10
-10
Frames 10
Frames
Fromes
Reel model
KomplexNet with feedback
KomplexNet whith foodback images
KomplexNet
KomplexNet- images
Figure 19: Results on moving digits. We provide visualizations of some frames of two example videos. We evenly subsample 6 frames out of the 30 for the sake of visualization. Frame indexing on top is indicated before the normalization with respect to the frame with maximum overlap. We evaluate KomplexNet with (purple) and without feedback (red), as well as real model (blue) given moving digits and evaluate KomplexNets on static frames (dashed line) versus dynamic videos (plain line). The left panel shows the test accuracy of each model around the frame with the maximum overlap between digits (Frame 0). The middle panel represents the difference in accuracy when tested from Frame 0 to Frame 30 reversed. The right panel shows the accuracy of the dynamic models versus their static real-valued baseline.
33


Reviews:
[{"review_id": "aF5RvwBE27", "reviewer": "Reviewer_tgUR", "summary": "", "questions": "", "limitations": "", "rating": null, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "## Strengths \n\n- Recently, Kuramoto-type oscillations have gathered quite interest in computer vision, as also noted by the authors. Similarly, on the neuroscience side, the advent of new technologies (e.g., voltage imaging) has enabled studies of traveling waves across brain regions. In that sense, this work is quite timely. Hence, this work is of interest to the TMLR audience.\n\n- Claims are well balanced and the existing literature well cited (though not listed in evaluation)\n\n## Weaknesses\n\n- To my knowledge, Gestalt principle is an outdated concept and its connection to what the networks learn remains largely speculative. Its heavy use in this work is not necessarily providing motivation, rather distracting away from the core contributions. \n\n- The experiments mainly use different variations of the same model, whereas the reader is often left wondering whether how regularly used models in this field (in which I am not an immediate expert) could fit into the picture.", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "Yes", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "paper_topic_and_main_contributions": "", "excitement": null, "reproducibility": null, "ethical_concerns": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "summary_of_contributions": "Authors utilize synchronization across neurons (via Kuramoto model) to design a complex-valued convolutional neural network (with feedback). With ablation experiments (using CNN models as baselines), they show that all three aspects of the model, synchronization, feedback, and complex validness, contribute to the success of the model, i.e., overall test set performance, robustness in the case of perturbed images, and OOD generalization.", "claims_and_evidence_yn": "Yes", "claims_explanation": "", "audience_yn": "Yes", "audience_explanation": "", "requested_changes": "## Major points\n\n- My main concern with this work is the framing of the proposed approach in terms of the Gestalt principle. The use of terms like proximity and similarity may provide intuition for the learned coupling kernels, but this analogy should not be over-interpreted. The claim would be stronger if grounded in contemporary computational models of visual grouping or feature binding; or simply by omitting this association altogether. \n\n- I believe the benchmarking experiments are interesting and convincing, but to my understanding, benchmarked algorithms are all variations of CNN. As such, it remains unclear whether the gains from Kuramoto-based synchronization surpass those achievable with other established approaches. Could you add some models representing traditional baselines as well?\n\n## Minor points\n\nHere are some low level suggestions that could help make improve the presentation \n\n- There is a clear use of jargon throughout the paper. I think authors should aim to define central concepts the first time they come up. For instance, abstract refers to several undefined concepts: object binding, phase alignment, top-down information. \n\n- Could you please comment on the concerns with complex-valued neural networks? I recall there were some issues related to the complex differentiability of loss functions under standard nonlinearities? I think this discussion could be part of the related work section, and I am for once interested in understanding how authors' approach solved existing problems on complex-valued NNs.\n\n- I think the following work could be of interest to include in the discussion: https://arxiv.org/abs/2502.06034? There seems to be some interesting connections between the results of the two papers that would strengthen the appeal of this manuscript to neuroscientists.\n\n- To me, it makes sense that the implementation of the feedback improves the model; which is quite consistent with the predictive coding paradigm in systems neuroscience. Moreover, there is also now clear evidence of feedback received in early brain regions, like V1, once few hundred ms has passed after the first forward pass of the visual information. I would recommend the authors to consider adding a few paragraphs to the discussion about these two topics.\n\n- In Fig. 5A (and later on), when you say \"cluster synchrony\" decreases, you actually mean loss function values decrease. The synchrony is actually increasing. Could you please present this in a less confusing manner?", "broader_impact_concerns": "NA.", "additional_comments": "", "extra_scores": {}, "extra_text": {}}, {"review_id": "76QUXg5rnd", "reviewer": "Reviewer_QqNF", "summary": "", "questions": "", "limitations": "", "rating": null, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "Strengths:\n\nClearly written\n\nThe comparisons with and without feedback show an important benefit of those top-down connections\n\nWeaknesses:\n\nThe main weakness is that the real-valued network is not a proper comparison to the KomplexNet. In order to call the real-valued network a 'counterpart' to the KomplexNet, it would need to have access to the same training information. As far as I can tell, KomlexNet gets to train its lateral kernel using spatial masks of the digits. The real-valued net does not get such beneficial information and does not have any lateral connectivity at all. In this way it is also not clear how the real-valued network has the same number of parameters as KomplexNet (what about the parameters of the coupling kernel?). There are ways to build real-valued networks that get to make use of spatial masks and lateral interactions, and that would form a more proper comparison. With the results as they are, the authors cannot make a very precise claim about the benefits of their specific model. \n\nA secondary weakness is of course that this is all done on MNIST and it is unclear to what extent this would be useful in any more complex setting. Many proofs of concepts are done on MNIST and then never followed through with in larger networks, raising the question of what they aim to show us in the first place. \n\n I didn't understand this methodological choice: \"In this image, the area where the\ndigits are close and almost touching is assigned a phase value in-between the two clusters; this seems a\nreasonable solution because the coupling kernel around this region will tend to synchronize the phases across\nthe two digits.\" In the psychology literature the main benefit of something like binding is that it allows you to represent objects separately and cohesively even if they are overlapping. How important is this choice for the model results?", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "Yes", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "paper_topic_and_main_contributions": "", "excitement": null, "reproducibility": null, "ethical_concerns": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "summary_of_contributions": "This paper builds on past work using synchronizing neural units and building CNNs with oscillating activity to create a small CNN that uses phase synchronization to segment digits and classify them. This shows the potential value of having a second channel (i.e. the phase) for representing and sharing information across spatial locations. The authors also show that this model can generalize to different numbers of digits than it was trained on, as well as to images with Gaussian noise.", "claims_and_evidence_yn": "Yes", "claims_explanation": "", "audience_yn": "Yes", "audience_explanation": "", "requested_changes": "The authors must address the issue with the real-valued comparison. They can do this either by testing out a more equivalent real-valued network, or by changing the language throughout the text to make it clear that this is not meant to be a real-valued equivalent to KomplexNet, but is just a standard baseline to contextualize the performance. \n\nIt would also be good if the authors remarked on the extent to which they think this will translate to larger networks needing to perform more complex object recognition. \n\nPlease clarify if in Eqn 3 it is the same weights applied to real and imaginary values. \n\nEqn 4 is poorly explained. Please use the actual terms from the equation when describing what it does. \n\nPlease include example inputs in Fig 15 and 16", "broader_impact_concerns": "none", "additional_comments": "", "extra_scores": {}, "extra_text": {}}, {"review_id": "7clUdZDek5", "reviewer": "Reviewer_HCx7", "summary": "", "questions": "", "limitations": "", "rating": null, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "### Strengths\n1.  The integration of Kuramoto dynamics with complex-valued neural networks represents a genuinely innovative approach to the binding problem in artificial neural networks. This cross-disciplinary approach effectively bridges computational neuroscience and deep learning.\n2. The paper establishes strong connections to neuroscientific principles, particularly the binding by synchrony theory, providing a biologically-inspired framework for addressing feature binding challenges.\n3. The authors conduct thorough evaluations across multiple experimental settings, including in-distribution testing, robustness to noise and overlap, and generalization to varying numbers of objects, demonstrating the versatility of their approach.\n4. The visualization and analysis of phase synchronization patterns provide valuable insights into how the model organizes visual information, clearly illustrating the emergence of object-specific phase clusters.\n\n### Weaknesses\n1. While the paper demonstrates successful synchronization and classification, it lacks deeper analysis of how the representations learned through phase synchronization differ fundamentally from those in traditional deep learning models. Are these representations more semantically disentangled or compositional?\n2. One of the challenge in deep learning involves bridging perceptual features with abstract concepts. The paper does not adequately address whether phase synchronization alone can address more complex conceptual binding beyond simple object segregation.\n3. There is limited investigation into how Kuramoto dynamics interact with the learning process itself. How does the model adapt its synchronization strategy during training to accommodate different visual scenes, and how does phase synchronization emerge as a property that interacts with gradient-based learning?", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "Yes", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "paper_topic_and_main_contributions": "", "excitement": null, "reproducibility": null, "ethical_concerns": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "summary_of_contributions": "This paper presents KomplexNet, an innovative architecture that combines complex-valued neural network representations with Kuramoto synchronization dynamics to enhance the performance of deep learning models on multi-object visual scenes. The authors propose a method where the amplitude component of complex-valued neurons maintains standard CNN functionality, while the phase component facilitates feature binding and scene organization through synchronization. Drawing inspiration from neuroscience's \"binding by synchrony\" theory, the authors design a system where Kuramoto dynamics drive the phase alignment of features belonging to the same object. The paper evaluates two architectural variants: a feedforward model and a model with feedback connections that further refines phase synchronization through top-down information flow. Through extensive experimentation, the authors demonstrate that both models outperform real-valued counterparts and complex-valued models without Kuramoto synchronization on various tasks including overlapping digit classification, noisy input processing, and out-of-distribution generalization.", "claims_and_evidence_yn": "Yes", "claims_explanation": "", "audience_yn": "Yes", "audience_explanation": "", "requested_changes": "- The authors can expand the discussion section to analyze how representations formed through phase synchronization differ conceptually from traditional deep learning representations. Include a theoretical analysis of whether phase-synchronized features may naturally afford better semantic disentanglement or compositional properties, referencing existing visualization results rather than conducting new experiments.\n\n- The authors can add a subsection in the discussion that addresses the limitations and potential of phase synchronization for handling more complex conceptual binding problems beyond object segregation. Consider theoretical connections to symbolic reasoning and discuss whether phase synchronization could provide a bridge between perceptual features and abstract concepts.", "broader_impact_concerns": "N/A.", "additional_comments": "", "extra_scores": {}, "extra_text": {}}]

Author rebuttal:

Meta-review: The main concerns raised in the initial reviews were about the framing of this work on Gestalt principles rather than on more contemporary wave-based neuroscience concepts, lack of non-CNN baselines, the real-valued network baseline not matching the parameter count and use of spatial masks in the proposed KomplexNet, experimental validation in only simple settings, need for deeper analysis of the new representations, and a need to discuss how phase synchronization may facilitate conceptual binding.

The authors have satisfactorily responded to these issues in the rebuttal and the revised paper. The AE thanks the authors and reviewers for their productive discussions that have significantly improved the manuscript.
Decision: Accept (poster)