An information-theoretic quantification of the content of communication between brain regions
Authors: Marco Celotto
Jan Bím
Alejandro Tlaie
Vito De Feo
Alessandro Toso
Stefan M Lemke
Daniel Chicharro
Hamed Nili
Malte Bieler
Ileana Livia Hanganu-Opatz
Tobias H. Donner
Andrea Brovelli
Stefano Panzeri
Venue: NeurIPS 2023 poster (2023)
Keywords: Information transmission; Brain data analysis; Sensory processing; Partial information decomposition
TL;DR: We developed a new information-theoretic measure that quantifies the amount, content and direction of information transmitted between brain regions.

Abstract: Quantifying the amount, content and direction of communication between brain regions is key to understanding brain function. Traditional methods to analyze brain activity based on the Wiener-Granger causality principle quantify the overall information propagated by neural activity between simultaneously recorded brain regions, but do not reveal the information flow about specific features of interest (such as sensory stimuli). Here, we develop a new information theoretic measure termed Feature-specific Information Transfer (FIT), quantifying how much information about a specific feature flows between two regions. FIT merges the Wiener-Granger causality principle with information-content specificity. We first derive FIT and prove analytically its key properties. We then illustrate and test them with simulations of neural activity, demonstrating that FIT identifies, within the total information propagated between regions, the information that is transmitted about specific features. We then analyze three neural datasets obtained with different recording methods, magneto- and electro-encephalography, and spiking activity, to demonstrate the ability of FIT to uncover the content and direction of information flow between brain regions beyond what can be discerned with traditional analytical methods. FIT can improve our understanding of how brain regions communicate by uncovering previously unaddressed feature-specific information flow.

An information-theoretic quantification of the content of communication between brain regions
Marco Celotto
Jan Bim Datamole, Prague
Alejandro Tlaie Istituto Italiano di Tecnologia
University Medical Center Hamburg- Eppendorf Istituto Italiano di Tecnologia
University of Bologna
marco celotto@iit.it
Vito De Feo University of Essex
Alessandro Toso University Medical Center
Stefan M. Lemke University of North Carolina
Hamburg-Eppenen Eppendorf
Daniel Chicharro City, University of London
Hamed Nili University Medical Center Eprcourorr
Malte Bieler University College Kristiania
Tobias H. Donner University Medical Center
Ileana L. Hanganu-Opatz University Medical Center
Andrea Brovelli Aix Marseille Université
Heimburg-Eppendorr
CNRS
Stefano Panzeri
University Medical Center Cranburg-Eppendoon Istituto Italiano di Tecnologia s panzeri @uke. de
Abstract
Quantifying the amount, content and direction of communication between brain regions is key to understanding brain function. Traditional methods analyze brain activity based on the Wiener-Granger causality principle quantify the overall information propagated by neural activity between simultaneously recorded brain regions, but do not reveal the information flow about specific features of interest (such as sensory stimuli). Here, we develop a new information thcoretic mea- sure termed Seature-specinfe Information Transfer (FIT), quantifying how much information about a specific feature flows between two regions. FIT merges the Viener-Grange causality principle with information-content specificity. We first derive FIT and prove analytically its key properties. We then illustrate and test them with simulations of neural activity, demonstrating that FIT identifies, within the total information propagated between regions, the information that is transmit- ted about specific features. We then analyze three neural datasets obtained with different recording methods, magneto- and electro-encephalograa activity, demonstrate the ability of FIT uncover the content and direction of information flow between brain regions beyond what can be discerned with tradi- tional analytical methods. FIT can improve our understanding of how brain regions communicate by uncovering previously unaddressed feature-specific information flow.
and spiking
37th Conference on Neural Information Processing Systems (NcurIPS 2023).

---

Introduction
Cognitive functions, such as perception and action, emerge from the processing and routing of information across brain regions TO, 48 56 57 41]. Methods to study within-brain communication
[2 51 are often based on the Wiener- Wiener-Granger causality principle, which identifies propagation of information between simultaneously recorded brain regions as the ability to predict the current activity of a putative receiving region from the past activity of a putative sending region, discounting the self- prediction from the past activity of the receiving region (11 [1]. While early measures implementing this principle, such as Granger causality [51], capture only linear interactions, successive information theoretic measures (the closely-related Directed Information 35 and Transfer Entropy (50)) capable of capturing both linear and nonlinear time-lagged interactions between brain regions Using such measures has advanced our understanding of brain communication
66
58)
31
44]; however, they are designed to capture only the overall information propagated across regions, and are insensitive the content of information flow. Assessing the content of information flow, not only its presence, would be invaluable to understand how complex brain functions, involving distributed processing and flow of different types of information, arise.
54
55
59
Here, we leverage recent progress in Partial Information Decomposition (PID; new non-negative measure (Feature-speeific Information Transfer; FIT) that quantifies the directed flow of information about a specific feature of interest between neural populations (Fig- [A]. The PID decomposes the total information that set of source variables encodes about specific target variable into components representing shared (redundant) encoding between the variables, unique encoding by some of the variables, or synergistic encoding in the combination of different variables. FIT isolates features-specific information flowing from one region to another by identifying the part of the feature information encoded in the current activity of the receiving region that shared (redundant) with information present in the past activity of the sending region (because a piece of transmitted information is first found in the sender and then in the receiver) and that new and unique with respect to the information encoded in the past activity of the receiver (because information already encoded would not have come from the sender).
62 32) to develop a
We first mathematically derive a definition of FIT based on PID. We then use to demonstrate, on simulated data, that it is specifically sensitive the flow of information about specific features, correctly discarding feature-unrelated transmission. We then demonstrate that FIT is able to track the feature-specific content and direction of information flow using three different types of simultaneous EEG, magnetoencephalographe
multi-region brain recordings (electroenceehaalggaahy and spiking activity). We also address how introducing appropriate null hypotheses and defining conditioned versions of FIT can deal with potential confounding factors. such as the time-lagged encoding of information in two regions without actual communication between them.
MEG,
2 Defining and Computing Feature-specific Information Transfer (FIT)
We consider two time-series of neural activity X and Y simultaneously recorded from two brain regions over several experimental trials. X and Y might carry information about feature S varying from trial to trial, e.g. a feature of a sensory stimulus or a certain action. The activity measured in each region, X and Y, may be any type of brain signal, e.g. the spiking activity of single or multiple neurons, or the aggregate activity of neural populations, such as EEG or MEG. We call Y Ypres the activity of Y the present time point I. and X past and Y Ypast the past activity of X and Y respectively (Fig- [p. Established information theoretic measures such as TE (50) use the Wiener-Granger principle to quantify the overall information propagated from a putative sender X to a putative receiver Y as the mutual information / between the receiver's 's present neural activity Ypres and the sender's past activity X Xpost, conditioned on the receiver's past activity Ypast (Fig. D::
TE(X + Y) I(Xpast; Y Ypres Ypast)
(see Supplementary Material, SM1.1 for how TE depends on probabilities of past and present activity). TE captures the overall information propagated across regions but lacks the ability to isolate information flow about specific external variables. To overcome this limitation, here we define FIT, which quantifies the flow of information specifically about feature S from putative sending area X a putative receiving area Y (Fig. [A). We define FIT using the PID 662. PID decomposes the joint mutual information ((S; X), that set of N source variables X (21,X2 .... Xx) carries
2

---

about target variable S, into non-negative components called information atoms (see SM1.2). For N 2, PID breaks down the joint mutual information [(S; X2) into four atoms: the Shared (or redundant) Information ST(S X1, X2) that both X, and X2 encode about S; the two pieces of Unique Information about S, USS X1 X2) and UT(S X2 X1), provided by one source variable but not by the other and the Complementary (synergistic) information about S, CI(S X1, X2), encoded in the combination of X1 and X2. Several measures have been proposed to quantify information atoms [62, 5 18 (3). Here we use the measure minn originally defined in which guarantees non-negative values for information atoms for any (see SM1.2).
62
Using Imin, the Shared Information that X1 and X2 carry about S is defined as follows:
SI(S: x X2)
Σp(5) p(s) min sES XxE(X1
I(S s; X;)
where I(S 8; X;) is the specific information that source X; carries about specific outcome of the target variable E S, and is defined as:
p(s|r.) p(s)
I(S s; X.)
E p(az)s) x;E,,
log
Intuitively, the shared information computed in eq. 2 quantifiie redundancy the similarity between X1 and X₂ in discriminating individual values of the feature S. In the general case of N source variables, information atoms are hierarchically ordered in lattice structure, and miin can be used to quantify any atom in the decomposition (including the Unique and Complementary information atoms introduced above for the case N 2: see SM1.2).
A
Reature-specifee Information Transfer (FIT)
B
Neural activity
Feature information
TE
con condidonedd on!
FIT
unique to
stimulus
X
past
pres
pest
pres
feature
WV Mim mullual Informatioon"
Transfer Entropy (TE)
neural-
Overall information propagation
activiy
TE
computed with Information Thoory
post
Partial Information Decompasiion
computed
FIT
Feature
Information flow
X festure
informative
Y
time
time
activity
Figure 1: Sketch of FIT and TE. (A) TE is the established information-theoree measure quantify the overall information propagated between two simultancously recorded brain regions X (sender) and Y (receiver). FIT measures the information flowing from X to about the stimulus feature S. (B) TE and FIT incorporate content-unspecific and content-specific versions of the Wiener-Grang causality principle. TE is the mutual information between the past activity of X and the present activity of Y conditioned on the past of Y. FIT is the feature information in the present of Y shared with the past information of X and unique with respect the past information of Y.
We wanted FIT to measure the directed flow of information about S between and Y, rather than the overall propagation of information measured by TE (Fig. [A). We thus isolated the information about feature in the past of the sender X that Y receives at time t. Because of the Wiener- Granger causality principle, such information should not have been present in the past activity of the receiver Y. Therefore, we performed the PID in the space of four variables S, X Xpast- Ypast, and Ypres compute information atoms that combine Shared, Unique and Complementary Information carried by three sources about one target (62]. One natural candidate atom to measure FIT the information about that X Xpast. shares with Ypres and is unique with respect to Ypast: SUT(S: X past, Ypres \ Ypast) (Fig. [B: Fig. SIB). This atom is defined as the difference between the shared information that the two source variables X Xpast and Ypres carry about S, and the shared information that the three source variables X Xpast, Ypres and Y past carry about S. Redundancy
3

---

can only decrease when adding more sources. Hence by removing the information that is also redundant with ymsst. SUI(S : X ppssts Ypres \ (ypsst) quantifies non-negative component of shared information between X past and Y pres about S that is unique with respect to Y past- Importantly, using unique information to remove the feature information in yesst is more conservative than conditioning on Y paat as in TE [27] SUT(S Xppst, Y pree \ Y post)) intuitively captures what we are interested in, and satisfies two desirable mathematical properties: it is upper bounded by the feature information encoded in the past of X (I(S; ([(s))past) Xpast) and in the present of Y (I(S; Y Ypres)). )). This is because the PID defines redundancy between source variables as sub-components of the information about the target carried by each of the sources (see SM1.3.1). However, the information atom SUI(S : Xpast, Ypres Ypast) has two undesirable properties. The first is that its value can exceed the total amount of information propagated from X to Y (TE). This can happen since the unique information in the PID decomposition is a component of the conditional mutual information about the target. However, the target in SU T(S X past: Y Ypres Ypust) is the feature S, which means that this atom is not constrained to he smaller than the TE, which is independent of S (see eq. aand SM1.3.4 3.44. This property is undesirable, because the overall information propagation must be an upper bound to the information transmitted about a specific feature. The second is that by construction (see SMI.3.1) this atom depends on Xpast, Ypres, S only through the pairwise marginal distributions P(X paxt S) and P(Ypres, S), but not through the marginal distribution P P(Xpost, Y Ypres), which implies that this atom by itself cannot identify confounding scenarios where both sender and receiver encode feature information at different times with no transmission taking place (see SM1.3.1).
To address these limitations, following 42 considered the alternative PID taking S, Y Ypast and X Xpast as source variables and Ypres as a target. In this second PID (Fig. S1B), the atom that intuitively relates to FIT is SUT -
Xx past, S Yp the information about Y pres that X past shares with S that is unique with respect to ypast- While being intuitively similar to SUT(S: X xastt Y prees Ypast). SU SUI(Y Xpest, 5s) Y Ypast) has Y prees as target variable and hence is upper bounded by TE (but not by I(S; ((S;Xpast)) and depends on the pairwise marginal distribution P(X Ypres) (see SM1.3.2). Thus, this second atom has useful properties that complement those of the first atom. Importantly, Shannon information quantities impose constraints that relate PID atoms across decompositions with different targets. We [42 demonstrated that, for PID with N = 2 sources, these constraints reveal the existence of finer information components shared between similar atoms of different decompositions. Here, we extended this approach (see SM1.3.3) to N sources and demonstrated that the second atom is the only one in the second PID that has pairwise algebraic relationship with the first atom, indicating that these atoms share common, finer information component. Therefore we defined FIT by selecting this finer common component by taking the minimum between these two atoms:
FIT- min(SU Xpast, Y pres \ \Y (p SUI(Y
pres X XXpss, S Ypnst)]
(4)
With this definition, FIT is upper bounded by I(S; X past), by ((S:Yprea) pres) and by TE(X- + Y). That FIT satisfies such bounds is essential to interpret it as transmitted information. FIT could be larger than the feature information encoded by sender X or receiver Y, or than the total information transmitted (TE(X- + Y)), then FIT could not be interpreted as feature information transmitted from X to Y. Additionally, FIT depends the joint distribution P(S,Xpast: Xpast: Ypree) through all the pairwise marginals P(S, Xpast). P(S, Ypree), and P(Xpaet, Xpree). implying that it can rule out, using appropriate permutation tests, stimulus independently with temporal lag, without any within-trial transmission (see SM1.3.4).
scenarios in which X and Y encode the
Note that the definition of FIT holds when defining present and/or past activity as multidimensional variables, potentially spanning several time points. However, use of multidimensional neural re- sponses requires significantly more data for accurate computation of information. For this reason, following 7 39 38), in all computations TE and FIT we computed the present of Y at a single time point / and the past of X and of Y at individual time points lagged by a delay d: Xppst X.-s and Y Ypast = Y--5- Note also that in all calculations of FIT and TE, we estimated probabilities from empirical occurrences after discretizing both features and neural activities. SM1.6 reports details of the procedure and Table SI the number of bins used for each analysis. Simulations of accuracy of these estimates as function of the data size are reported in SM2.5 and Fig. S6.
3 Validation of FIT on simulated data
To test the ability of FIT to measure feature-specific information flow between brain regions, we performed simulations in scenarios of feature-related and feature-unrelated information transfer.

---

We performed (Fig. 2A-B) simulation (details in 1M2.1) in which the encoded and transmitted stimulus feature S was a camulus-intensinn integer value (1 to 4) The activity of the sender X was two-dimensional variable with one uninformative component Nnoise- The localized stimulus- deppedeet activity from 200 to 250ms and had multiplicative Gaussian noise (similar results were found with additive noise, see SM2.1 and Fig. S3). The stimulus-unrelated component was, any time point, zero-mean Gaussian noise. The activity of the receiver Y was the weighted sum of X stim and Xnoise with a delay 6, plus Gaussian noise The delay was chosen averaged randomly in each simulation repetition in the range 40-60ms. Here and in all simulations, information values across simulation repetitions we determined their significance via non non-parametric permutation tests [33 7 19 22]] For TE, we permuted X across all trials to test for the presence of significant within-trial transmission between X and Y 7 333 For FIT, we conducted two different permutation tests: one for the presence of feature information in X and Y (shuffling S across trials), and another for the contribution of within-trial correlations between X and Y to the transmission of S (shuffling X across trials at fixed stimulus). We set the threshold for FIT significance the 99th percentile of the element- wwie maximum between the two permuted distributions (see SM1.7).
Xstim and one stimulus- dimension had temporally-
W
A
S
X
Temporal localization of stimulus-related transmission
FIT
TE
W moiis
bits
0.021
Sig. time points Ground fruth time
0-4
of stim. transter
0.1
TE
O.
0.
0.2
0.1
200
300
0.5
time [ms]
W
noose
W
E
directionality with
Feature info encoding format
Feature info timacourses
0.16
Neurel sctivity
FIT [bits]
informtton
Sig.
FIT
0.05
8lim. valuw
Stin. Valua
8tm. Valon
time
Lime
0.2
044
SNR (5mn)
6.6
0.8
Figure 2: Testing FIT on simulated data. (A) FIT and TE as function of stimulus-featuur-rrllaedd (Wstim) ) and -unrelated (Wneise) transmission strength. & indicate significant values (p < 0.01, permutation test) for the considered parameter set. (B) Dynamics of FIT and TE in a simulation with time-localized caatuluu-feauur-infommaaa feature-related information transfer. Results plot mean (lines) and SEM (shaded area) across 50 simulations (2000 trials each). (C) Different neural encoding functions used for the simulations in panels D-E. ó: separation of responses to different features; a: Gaussian noise SD. (D) Sketch of simultaneous stimulus feature information profiles. Different types of information content are color-coded. (E) FIT in the X + Y (cyan) and Y + XX (grey) directions as function of SNR 5 o/o (plot in log scale). Results plot mean (lines) and SEM (shaded area) across 100 simulations (2000 trials each). Yellow dots in B, E show points with significant FIT (p 0.01, permutation test).
transmission. Red area shows the window of stimulus-
We investigated how FIT and TE from X to Y depended on the amount of Hiimulu--eattue--elad transmission (increased by increasing Wstim) ) and of -unrelated transmission (increased by increasing Wnoise). We report values at the first time point in which information in Y was received from X, but similar results hold for later time points. Both FIT and TE increased when increasing w Watim (Fig, (2)). However, TE increased with Wnoise (Fig. 2 expected from measure that captures the overall information propagation. In contrast, FIT decreased when increasing Wnoise. indicating that FIT specifically captures the flow of information about the considered feature.
We then investigated how well TE and FIT temporally localize the stimulus- -eattss-fetteeeeeteeeeeee infor- mation transmitted from X to Y (Fig. BB). We simulated a case in which himulus-feature feature-related related information was transmitted from X to Y only in a specific window (2400, 310 and computed FIT and TE at each time point (see SM2.1 for details). FIT was significant only in the time window in which Y received the stimulus information from X. In contrast, TE was significant at any time point, reflecting that noise transmitted from X to Y throughout the whole simulation time.
5

---

Importantly FIT can detect reature-speciffe information flow even when information is encoded in the sender and receiver with an overlapping timecourse (see SM2.2 for details). To illustrate this, we simulated the activity of two regions X and Y encoding an integer stimulus feature S with the same time course of stimulus-feature information (Fig. [)), but with feature specific transmission taking place only from X to Y. Because FIT could correctly detect that the format of information representation of S in the present of Y was equal to that of the past of X but different to that of the past of Y (Fig. 2P), it could correctly detect that feature information flows from X to Y (Fig. 2
We also performed simulations to investigate whether the non- non-parametric permutation test described above can correctly rule out as non-sinnificant feature-specifie transmission the scenario in which X and Y independently encode S without actual communication occurring between them. We simulated a scenario in which feature information was encoded with a temporal lag in X and Y, with no transmission from X to Y. We found that the resulting values were always non-significant (see SM2.6.1 1 and Fig. S7C) when tested against surrogate null-hypothesis distribution (pairing X and Y in randomly permuted trials with the same feature) that destroy the within-trial communication between X and Y without changing the feature information encoded in X and Y (sce SM1.7). Importantly, this null hypothesis also ruled out false communication scenarios where the measured FIT and TE were only due to the presence of instantaneous mixing of sources (see SM 2.7).
Finally, we addressed how to remove the confounding effect of transmission of feature information to Y not from X but from a third region Z. In Granger causality or TE analyses. this is addressed conditioning the measures on Z IT] 37]. In an analogous way, we developed a conditioned version of FIT, called cFIT (see SM1.4) .4), which measures the feature information transmitted from X to Y that is unique with respect to the past activity of a third region Z. We tested its performance in simulations in which both X and Z transmitted feature information to Y and found that cFIT reliably estimated the unique contribution of X in transmitting feature information to Y, beyond what was transmitted by Z (see S.2.6.2 and Fig. S7D).
4 Analysis of real neural data
We assessed how well FIT detects direction and specificity of information transfer in real neural data.
4.1 Flow of stimulus and choice information across the human visual system
We analyzed a previously published dataset (63), see also SM3.1 for details) of source-level MEG data recorded while human participants performed visual decision- makinn task. At the beginning of each trial, a reference stimulus was presented (contrast 50%), followed by a test stimulus that consisted of a sequence of 10 visual samples with variable contrasts (Fig. A After the test stimulus sequence, participants reported their choice of whether the average contrast of the samples was greater or smaller than the reference contrast. The previous study on these data (63)) analyzed the encoding of stimulus and choice signals in individual areas, but did not study information transfer. We focused on gamma-band activity (defined as the instantancous power of the 40-75Hz frequency band), because it is the most prominent band for visual contrast information encoding (24] 45 [7]
and information propagation 7 in the visual system. Previous work has demonstrated that gamma- band transmission is stronger in the feedforward (from lower to higher in the visual cortical hierarchy) than in the feedback (from higher to lower in the visual cortical hierarchy) direction [55] B [6].
suggesting that gamma is a privileged frequency channel for transmitting feedforward information. However, these previous studies did not determine the content of the information being transmitted.
To address this question, we quantified FIT in a network of three visual cortical areas (Fig. 3 B) that we selected because they encoded high amounts of stimulus information and because they were sufficiently far apart (2 2.8cm) to minimize lcakage in source reconstruction (see SM Fig. S9) The areas, listed in order of position, from lower to higher, in the cortical hierarchy were: primary visual cortex (V1), area V3A, and area LO3. Because participants made errors (behavioral performance was 75% correct), in each trial the stimulus presented could differ from the participant's choice. We thus assessed the content of the information flow by computing FIT about either the sensory stimulus (FITs; using as feature the mean contrast across all 10 visual samples) or the reported choice (FITc), in each instant of time in the [- 1000, 500]ms ms peri-stimulus time window (because stimulus information was higher in the first 500ms post-stimulus, see SM3. 1.4 and Fig. S9) and across a range of putative inter-area delays 8. In Fig. 3C we show the resulting FITss
663 2

---

time-delay information maps for the example pair of regions VI and V3A. A cluster-permute permutation analysis [4 revealed significant feedforward stimulus- information transmission from VI to V3A (but no significant feedback from V3A to VI) localized 200-400ms after the stimulus onset, with an inter-area communication delay between 65 and 250ms (see SM3. and Fig. S9).
A
Tast stronger or weaker than reference?
B
datay [mq] (eel
alm. info
Sumple
Sample
Sample
100
vig
300
V3A
V1 - V3A
Raforence
(10 KoTT
LO3
[Jtg]] dalay [ms]]
100
Crading
commus.
report "
V1
V3A V1
beedback
Daiey
Dava
anterior
801
VSA xlem.
400
Peri-stiukka time [ms]
Content
Directionality
Behavioral relevance
D
Feedfonward
Feedback
1,5,c07
TE
FITs
TE
FIT
A**
3.6
(otts]
FITs
FITc
FIT:
FITC
0.7
Fwd
Fhk
0
Fwd
FUk
Cor
Er
Corr
Figure 3: Information flow across the human visual hierarchy with MEG. (A) Sketch of task. (B)
Cortical surface map of the location of the three considered visual regions. (C) Temporal profiles of stimulus information and time-delay stimulus FIT maps for an example regions pair (V1, V3A).
Top to bottom:
stimulus information in VI; time-delay FIT map in the feedforward (V1 - V3A) direction; time-delay FIT map in the feedback (V3A - V1) direction; stimulus information in
V3A. (D) Comparison between FIT about stimulus (F (Ty)) and FIT about choice (FITc) in the visual network in the feedforward (left) and feedback (right) directions.
(E) Comparison between feedforward and feedback transmission in the network for TE (left) and stimulus FIT (right). (F) Same as E but for feedforward transmission on correct vs error trials. In all panels, lines and image plots show averages and errorbars SEM across participants, experimental sessions and regions pairs (in case of FIT and TE) or regions (in case of mutual information).
p<0.05, **: p<0.01, ***. p<0.001. information-theorett quantities were computed from the gamma band (140-75]Hz) power of source-level MEG, first computed separately for the left and right hemisphere and then averaged.
We compared properties of overall information propagation (computed with TB) and feature-specific information flow (computed with FIT) across all pairs of areas within the considered visual cortical network. To determine the prevalent content of information flow in the network, we compared F FITs and FITe transmitted in the feedforward and in the feedback directions (Fig. 3D). Hammaa-band transmitted more information about the stimulus than about choice (i.e. FITs FITc) in both the feedforward (p < 10 two-tailed paired t-test) and in the feedback (p < 0.01 two-tailed paired t-test) direction, with larger difference for the feedforward direction. This result supported by simulations where we show that, in presence of multiple simultaneously transmitted features, FIT ranks correctly the features about which most information transmitted (see SM2.3 and Fig. S4). Thus, we focused stimulus-specific information flow in the following FIT analyses. We then studied the leading direction of information flow. Both the total amount of information propagation (TF) and the coinuuuus-speciffe information flow (FITs) were larger in the feedforward than in the feedback direction (Fig. 3 E), but with larger effect for FITss (p < 10 two-tailed paired t-test) compared to TE (p < 0.05 two-tailed paired t-test). Together, these results show that gamma-band activity in the visual system carries principally information about the stimulus (rather than choice)
and propagates it more feedforward than feedback.
We next assessed the behavioral relevance of the feedforward stimulus information transmitted by the gamma band. A previous study showed that the overall (feature- -uspprieumsppcciiic) strength of feedforward gamma band information propagation negatively correlates with reaction times, indicating that stronger feedforward gamma activity propagation favors faster decisions [46). However, no study has addressed whether stimulus information transmitted forward in the gamma band promotes decision accuracy. We addressed this question by comparing how F FIT's varied between trials when
7

---

participants made correct or incorrect choice (Fig. FF. We matched the number of correct and error trials to avoid data size confounds 40 FIT's in the feedforward direction was significantly
lower in error than in correct trials (Fig. 3 right; p 0.001 two-tailed paired t-test), while TE did not vary between correct and error trials (Fig. 33, left; p = 0.38 two-tailed paired t-test). Feedback information transmission (both in terms of overall information propagation, TE, and stimulus specific information flow, FlTs), did not vary between correct and incorrect trials. This indicates that the feedforward flow of stimulus information, rather than the overall information propagation, is key for forming correct choices based on sensory evidence.
These results provide the new discovery that the gamma band transmits feedfoward stimulus informa- tion of behavioral relevance, and highlight the power of FIT in revealing the content and direction of information flow between brain areas.
4.2 Eye-specific interhemispheric information flow during face detection
We next tested the ability of FIT to detect feature-specific information flow between brain hemispheres. We analyzed a published EEG dataset recorded from human participants detecting the presence of either face
random texture from image covered by bubble mask randomly generated in each trial (147); see SM3.2.1 for details). Previous analysis of these data [26] showed that eye visibility in the image (defined as the proportion of image pixels in the eye region visible through the mask) is the most relevant image feature for successful face discrimination. It then showed that eye-specific information appears first at 1010~110mm 120ms post-image presentation in the Occipito-Temporal (OT) region of the hemisphere contra-lateral with respect to the position of the eye, and then appears 20-40ms later in the lpsi-lateral OT region (Fig. 4 However, this study did not determine if the eye information in the ipsi-later hemisphere is received from the contra-lateral hemisphere. To address this issue, we computed FIT transmission of eye-specific information between the Left OT (LOT) and Right OT (ROT) regions (using the electrodes within these regions that had most information as in (26). see SM3.2.2). Left Eye (LE) FIT from the contra- the ipsi-lateral OT (ROT to LOT) peaked between 150 to 190ms after image onset with transfer delays of 20-80ms (Fig. 4B). Right eye (RE) FIT from the contra- to the ipsi-lateral OT (LOT ROT) peaked with similar times and delays (Fig. 4C). Both cuntra-o-iissi-laere LE and RE had statistically significant FIT peaks in the dime- maps Alluster-permutationn analysis, p < 0.01; see SM3.2.2 and Fig. S10). Thus, FIT determined the communication window for contra-lateral flow of eye-specific information with high precision.
A
D
TE
xto"
LIT A*
FIT RE
LE
RE
0.08
0.45
(bils)
0.04
0.02
LOT
ROT
LE L-
LEL-R
Ri
LEL LEL-R
RE Red
RE
RE
B
LE contralateral (ROT LOT)
RE contralateral (LOT to ROT)
(bits)
0.00
sender
(late)
RR info sender
xto
0.00
Geiny (mi))
20
(bits))
deley (mi))
20
60
(bits)
100
100
(bite)
receiver
(mits)
0.07
receiver
100
200
300
100
200
300
Peri-stimulus time (ms)
Peri deri-stimulus time (ms)
Figure 4: Inter-hemispheric eye-specific information flow during face detection using human EEG. (A) Schematic of the putative information flow. LOT (ROT) denote Left (Right) occipito-temport regions. LE (RE) denote the Left (Right) Eye visibility feature. (B) Information (lines) carried by the EEG in each region, and FIT (image plot) about LE contra-lateral transfer. (C) Same as B for RE. (D) Contra- to lati-lateral vs ipsi- contra-latera transfers for TE and FIT for both LE and RE. Dots and images plot averages and errorbars plot SEM across participants (N=15).
To gain further insight about the directionality and feature-speciffcity of the information flow across hemispheres, we compared FIT and TE across transfer directions and/or eye-specific visibility
8

---

conditions (Fig. AD, middle and right). Right-to-left LE FIT was significantly larger than left-to-right LE (p- 0.001 two-tailed paired t-test) or right-to-left RE FIT (p < 0.01 two-tailed paired t-test). Left-to-right RE FIT was significantly larger than right-to-left RE FIT (p < 0.05 two-tailed paired 1-test) or left-to-right LE FIT (p- < 0.05 two-tailed paired t-test). contrast, we found no significant difference between directions for the overall propagated information (TE). Fig- Fp. left). Thus, the use of FIT revealed a temporally localized flow of eye information across hemispheres that was feature- selective (i.e. about mainly the contra-lateral eye) and direction-specifte (contra-to-ipsi--ateen) without direction specificity the overall information propagation (TE) across hemispheres.
Finally, to more tightly localize the origin of eye-specific contra-lateral information flow, we asked whether the contra-lateral OT electrodes selected in our analyses were the sole senders of inter- hemispheric eye-specific information. We used the conditioned version of FIT. cFIT, to compute the amount of transfer of eye information from the contra- to the ipsi-lateral OT after removing the effect of eye-specific information possibly routed through alternative sending locations (see SM3.4). We found (Fig. S12A) that the effect we measured with FIT was robust even when conservatively removing with cFIT the information that could have been routed through other locations.
4.3 Stimulus-specific information flow in thalamocortical network
We finally used FIT to measure the feature- and directtin-speccffictty of information flow in the thalamocortical somatosensory and visual pathways. We analyzed a published dataset in which multi-unit spiking activity was simultaneously recorded in anaesthetized rats from the primary visual and somatosensory cortices, and from first-order visual and somatosensory thalamic nuclei (8), see S I for details), during either unimodal visual, unimodal tactile, or bimodal (visual and tactile) stimulation. This analysis tests FIT on another major type of brain recordings (spiking activity). Moreover, due to the wealth of knowledge about the thalamocortical network [53] [6], we can validate FIT against the highly-credible credible predictions that information about basic sensory features flows from thalamus to cortex. and that somatosensory and visual pathways primarily transmit tactile and visual information, respectively. Using FIT, we found (see SM3.3.3 and Fig. S11) that sensory information flowed primarily from thalamus to cortex, rather than from cortex to thalamus. We also found that the feedforward somatosensory pathway transmits more information about tactile- than about visually-discrine discrmmitiieee features, and that the feedforward visual pathway transmits more information about visually- than nettile-disrimmnative features. Importantly, TE was similarly strong in both directions, and when considering tactile- or vistally-discriminattve features. This confirms the power of FIT for uncovering stimulus-specific information transfer, and indicates a partial dissociation between overall information propagation and neural transfer of specific information.
5 Comparison with previously published measures
We finally examine how FIT differs from alternative methods for identifying components of the flow of information about specific features. We focus on measures that implement the Wiener- Granger discounting of the information present in the past activity of the sender. Other methods, that do not implement this (and thus just correlate past information of the sender with present information of the receiver), erroneously identify information already encoded in the past activity of the receiver as information transmitted from a sender (see SM4.3).
A possible simple proxy for identifying feature-specific information flow is quantifying how the total amount of transmitted information (TE) is modulated by the feature 77. For the case of two feature values, this amounts to the difference of TE computed for each individual value. We show in SM4.1, using simulations, that this measure can fail in capturing feature- information flow even in simple scenarios of feature information transmission. Additionally, when tested on MEG data, it could not assess the directionality of information transmission within brain networks (see SM4.
A previous study 255 defined a measure, Directed Feature Information (DFI), which computes feature- specific information redundant between the present activity of the receiver and the past activity of the sender, conditioned on the past activity of the receiver. However, DFI used measure of redundancy that conflated the effects of redundancy and synergy (see SM1.5). Because of this, DFI is, both on real and on simulated data, often negative and thus not interpretable as measure of information flow (see SM4.2). In contrast, FIT is non-negative and uses PID to consider only redundant information between sender and receiver, as appropriate to identify transmission of information. Moreover,

---

because DFI discounts only past activity of the sender rather than its ceature-speciie information, it was less precise, conservative and sensitive localizing direction and timing of feature- speciffc information flow (as shown in SM4.2 and Fig. S15 with simulated and real data).
Finally, study defined feature-specific information using PID in the space of four variables S, X pasts Ypost. and ypres [4. However, this measure was not upper bounded by either feature information encoded in the past of the sending region or the total information flowing between regions.
6 Discussion
We developed and validated FIT, an information theoretic measure of the feature-specific information transfer between a sender X and a receiver Y. FIT combines the PID concepts of redundancy and uniqueness of information [62] with the Wiener-Grane Grannerr causality principle [TT] to isolate, within the overall transmitted information (TE), the flow of information specifically related to feature S.
The strengths and limitations of FIT as a neural data analysis tool stem from those of information theory for studying neural information processing. Information theory has led to major advances to neural coding because of its ability to capture linear and non-linear interactions at all orders making little assumptions 43 15]. This is important because deviations from linearity and order of interactions vary in often unknown ways between brain areas, stimulus types and recording modalities [3 28 20). Using such general formalism avoids potentially biasing results with wrong assumptions. However, the price to pay for the fact that information theory includes full probability distributions is that it is data hungry. While our definitions of FIT and cFIT are straightforwardly valid for multivariate analyses including conditioning on the information of multiple regions (7 (as in cFIT) or obtaining more conservative estimates of information transmission on which information in the receiver Y is requested to be unique with respect to the information of the sender and receiver at multiple past time points [58], for data sampling reasons in practice in real data these analyses In future work, we
are confined to conditioning to one region
single past time point 7
39 38
aim to make FIT applicable to analyses of multiple regions or time points coupling it with advanced non-parametric [49] methods to robustly estimate its multivariate probability distributions.
The generality of our approach lends itself to further developments. Importantly, we defined FIT directly at the level of PID atoms. This means that, although here we implemented FIT using the original definition of redundancy in PID (22 because it has the advantage of being non-negative for all information atoms, FIT can be easily implemented also using other PID redundancy measures 22 2 18 30
with complementary advantages and disadvantages (see S.M1.2).
We individuate two directions for improvement. First, even though the surrogate permutation test we developed assess FIT significance provided reasonable results real data and worked work well also with artefacts due to instantaneous mixing of sources (see SM2.7), further research is needed to generate more refined surrogate data generation techniques to rule out more conservatively false feature-specific communication scenarios [52). Second, how best to select the time of past activity to compute FIT, an issue of significance in Wiener-Granger measures [60] remains to be determined.
To demonstrate the properties of FIT, we performed numerical simulations in different communication scenarios and compared FIT against TE (Fig. 2). These simulations confirmed that TE effectively detected the overall propagation of information, but it did not detect the flow of feature-specific information. FIT, in contrast, reliably detected feature- and direction-specifie information flow with high temporal sensitivity. We confirmed the utility of FIT in applications to neural data. In three brain datasets spanning the range of electrophysiological recordings (spiking activity, MBG and EEG), FIT credibly determined the directionality and feature specificity of information flow. Importantly, in most of these datasets this happened in the absence of variations in the overall information propagation between the same brain regions (measured with TE). The partial dissociation between overall activity flow and feature-specific flow found consistently in simulations and data has important implications. First, it highlights the need of introducing a specific measure of feature information transfer such as FIT, as it resolves question unaddressed by content- uunseecii measures. Second, establishes that measuring feature-speciff, components of information flow between brain regions is critical to go beyond the measurement of overall neural activity propagation and uncover aspects of cross-area communication relevant for ongoing behavior. Thus, as methods to record from multiple brain regions rapidly advance, FIT is well suited to uncover fundamental principles in how brain regions communicate.
10

---

7 Acknowledgements
This research has received funding from the European Union's Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3), from the NIH Brain Initiative (grants U19 NS107464, R01 NS109961, RO1 NS108410), and from the Simons Foundation (SFARI Human Cognitive and Behavioral Science grant 982347). We thank G. Bondanelli and G.M. Lorenz for useful discussion and feedback on the manuseript.
References
[1] L. Barnett and A. K. Seth. The MVGC multivariate Granger causality toolbox: A new approach to Granger-causal inference. Journal of Neuroscience Methods, 223:50-63 68, 2014.
[2] A. B. Barrett. Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems. Physical Review E, 91(5)05280,, 2015.
[3] A. M. Bastos, J. Vezoli, C. A. Bosman, J.-M. Schoffelen, R. Oostenveld, J. R. Dowdall, P. D. Weerd, H. Kennedy, and Fries. Visual areas exert foodforward and feedback influences through distinct frequeney channels. Neuron, 85(2):390-401, 2015.
[4] R. D. Beer and P. L. Williams. Information processing and dynamics in minimally cognitive agents. Cognitive Science, 39)-1333,, 2015.
[5] N. Bertschinger, J. Rauh, F. Olbrich, J. Jost, and N. Ay. Quantifying unique information. Entropy, 16(4): 2161-2183, 2014.
[6] M. Besserve, B. Schölkopf, N. Logothetis, and S. Panzeri. Causal relationships between frequency bands of extracellular signals in visual cortex revealed by information theoretic analysis. Comput Neurosci, 29(3):447 566, 2010.
[7] M. Besserve, S. C. Lowe, N. K. Logothetis, B. Schölkopf. and S. Panzeri. Shifts of gamma phase across primary visual cortical sites reflect dynamic stimulus-modulltted information transfer. PLOS Biology. 13 10)e100257, 2015.
[8] M. Bieler, X. Xu, A. Marquardt, and I. L. Hanganu- Opatz. Multisensory integration in rodent tactile but not visual thalamus. Scientific Reports, 8(1):16684, 2018.
[9] C. A. Bosman, J.-M. Schoffelen, N. Brunet, R. Oostenveld, A. M. Bastos, T. Womelsdorf, B. Rubehn, T. Stieglitz, P. D. Weerd, and P. Fries. Attentional stimulus selection through selective synchronization between monkey visual areas. Neuron, 75(5):875-888, 2012.
[10] S. L. Bressler and V. Menon. Large-scale brain networks in cognition: emerging methods and principles. Trends in cognitive sciences, 14(6))277-290, 2010.
[11] S. L. Bressler and A. K. Seth. Wiener-Granger causality: A well-established methodology. Neurolmage, 58(2):323 3299,,3222222 2011.
[12] A. Brovelli, M. Ding. A. Ledberg, Y. Chen, R. Nakamura, and S. L. Bressler. Beta oscillations in a large- scale sensorimotor cortical network: directional influences revealed by Granger causality. Proceedings of the National Academy of Sciences, 101(26):944-9885 2004.
[13] M. I. Chelaru, S. Fagleman, A. R. Andrei, R. Milton, N. Kharas, and V. Dragoi. High-order interactions explain the collective behavior of cortical populations in executive but not sensory areas. Newron, 109(24); 3954-3961, 2021.
[14] E. Combrisson, M. Allegra, R. Basanisi, R. A. A. Ince, B. L. Giordano, J. Bastin, and A. Brovelli. Group--evel inference of information based measures for the analyses of cognitive brain networks from neurophysiological data. Neurolmage, 258: 19347, 2022.
[15] R. R. de Ruyter van Steveninck, G. D. Lewen. S. P. Strong, R. Koberle, and W. Bialek. Reproducibility and variability in neural spike trains. Science, 275 -800888888888 1997.
[16] M. F. Diamond, M. Armstrong-James, and F. E. Ebner. Somatic sensory responses in the rostral sector of the posterior group (POm) and in the ventral posterior medial nucleus (VPM) of the rat thalamus. The Journal of Comparative Neurology, 318(4):462-47, 1992.
[17] T. H. Donner and M. Siegel. A framework for local cortical oscillation patterns. Trends in Cognitive Sciences, 15(5).11-1199 2011.
11

---

[18] C. Finn and J. T. Lizier. Pointwise partial information decomposition using the specificity and ambiguity lattices. Entropy, 20(4):297, 2018
[19] N. A. Francis, S. Mukherjee. L. Koçillari, S. Panzeri, B. Babadi, and P. O. Kanold. Sequential transmission of task-relevant information in cortical neuronal networks. Cell Reports, 39(9): 10878, 2022.
[20] E. Ganmor, R. Segev, and E. Schneidman. Sparse low-order interaction network underlies highly correlated and Icarnable neural population code. Proceedings of the National Academy of Sciences, 108 (23):9679-9684) 2011.
[21] C. W. Granger. Investigating causal relations by econometric models and cross-spectral methods. Econo- metrica, 37(3):424 438, 1969.
[22] V. Griffith and C. Koch. Quantifying synergistic mutual information. In Guided Self-Orgunization: Inception, pages 159- 190. Springer, Berlin, Heidelberg. 2014.
[23] J. Gross, L. Timmermann, J. Kujala, R. Salmelin, and A. Schnitzler. Properties of MEG tomographic maps obtained with spatial filtering. Neuroimage, 19(4): 1(44::329-1333) 1329-1336, 2003.
[24] A. Hadjipapas, E. Lowet, M. Roberts, A. Peter, and P. D. Weerd. Parametric variation of gamma frequency and power with luminance contrast: A comparative study human MEG and monkey LFP and spike responses. Neurolmage, 12:327-340, 2015.
[25] R. A. A. Ince, N. J. W. Van Rijsbergen. G. Thut, G. A. Rousselet, J. Gross, S. Panzeri, and P. G. Schyns. Tracing the flow of perceptual features in an algorithmic brain network. Scientific Reports, 5:17681, 2015.
[26] R. A. A. Ince, K. Jaworska, J. Gross, S. Panzeri, N. J. W. Van Rijsbergen, G. A. Rousselet, and P. G. Schyns. The deceptively simple N170 reflects network information processing mechanisms involving visual feature coding and transfer across hemispheres. Cerebral Cortex, 26(11):4123-41)) 2016.
[27] R. G. James, N. Barnett, and J. Crutchfield. Information flows? A critique of transfer entropies. Physical Review Letters, 116623)2238701, 2016.
[28] C. Kayser, K. Körding, and P. König. Processing of complex stimuli and natural scenes in the visual cortex. Current Opinion in Neurobiology, 14(4):468 473, 2004.
[29] I.. Koçillari, M. Celotto, N. A. Francis, S. Mukherjee, B. Babadi, P. O. Kanold, and S. Panzeri. Mcasuring stimulus-rclated redundant and synergistic functional connectivity with single cell resolution in auditory cortex. In BI 2023, Lecture Notes in Computer Science, volume 1 13974, pages 45-56, Cham, 2023, Springer Nature Switzerland.
[30] A. Kolchinsky. A novel approach the partial information decomposition. Entropy, 24(3):403, 2022.
[31] M. Li, Y. Han, M. Aburn, M. Breakspear. R. A. Poldrack, J. M. Shine, and J. T. Lizier. Transitions in information processing dynamies at whole-brain brain network level are driven by alterations neural gain. PLoS computational biology, 15(10)ec 1 1066957, 2019.
[32] J. T. Lizier, N. Bertschinger, J. Jost, and M. Wibral. Information decomposition of target effects from multi-source interactions: Perspectives on previous, current and future work. Entropy, 20(4):307, 2018.
[33] C. Magri, K. Whittingstall, V. Singh, N. K. Logothetis, and S. Panzeri. A toolbox for the fast information analysis of multiple-site LFP, EEG and spike train recordings. BMC Neuroscience, 10(81), 2009.
[34] E. Maris and R. Oostenveld. Nonparametric statistical testing of EEG- and MEG-data. Journal of neuroscience methods, 164(1):177-190, 2007.
[35] J. L. Massey, Causality, feedback and directed information. In Proc. Int. Symp. Inf. Theory Applic. (1S7TA-90), 1990.
[36] G. Michalareas, J. Vezoli, S. van Pelt, J.-M. Schoffelen, H. Kennedy, and P. Fries. Alpha-beta and gamma rhythms subserve feedhack and feedforward influences among human visual cortical areas. Neuron, 89(2): 384-397, 2016.
[37] A. Montalto, L. Faes, and D. Marinazzo, MuTE: A MATLAB toolbox to compare established and novel estimators of the multivariate transfer entropy. PLoS ONE, 910); 109462, 2014.
[38] S. T. Oever, A. T. Sack. C. R. Oehun, and N. Axmacher. An engram of intentionally forgotten information. Nature Communications, 12(1),4433, 2021.
12

---

[39] A. Palmigiano, T. Geisel, F. Wolf, and D. Battaglia. Flexible information routing by transient synchrony. Nature Neuroscience, 20<7):0014-0022, 2017.
[40] S. Panzeri, R. Senatore, M. A. Montemurro, and R. S. Petersen. Correcting for the sampling bias problem in spike train information measures. Journal of Newrophysiology, 98(3):1064 1072, 2007.
[41] S. Panzeri, M. Moroni, H. Safaai, and C. Harvey. The structures and functions of correlations in neural population codes. Nature Reviews Neuroscience, 23(9):551 -57777, 2022.
[42] G. Pica, F. Piasini, D. Chicharro, and S. Panzeri. Invariant components synergy, redundancy, and unique information among three variables. Entropy, 19(9)451, 2017.
[43] R. Q. Quiroga and S. Panzeri. Extracting information from neuronal populations: information theory and decoding approaches. Nature Reviews Neuroxcience, 10(3):73--885, 2009.
[44] J. F. Ramirez- Villegas, M. Besserve, Y. Murayama, H. C. Evrard, A. Oeltermann, and N. K. Logothetis. Coupling of hippocampal theta and ripples with pontogeniculooccipiaal waves. Nature, 589(7840):66 102, Nov. 2021.
[45] S. Ray and J. H. R. Maunsell. Differences in gamma frequencies across visual cortex restrict their possible use computation. Neuron, 67(5):885-88) 896, 2010.
[46] G. Rohenkohl, C. A. Bosman, and P. Fries. Gamma synchronization between VI and V4 improves behavioral performance. Neuron, 100(4):953-900 02033996,22222 2018.
[47] G. A. Rousselet, R. A. A. Ince, N. J. W. van Rijsbergen, and G. Schyns. Eye coding mechanisms in early human face event-specific potentials. Journal of vision, 14(13):7, 2014.
[48] C. A. Runyan, F. Piasini, S. Panzeri, and C. D. Harvey. Distinct timescales of population coding across cortex. Nature, 548(7665):22-96, 2017.
[49] H. Safaai, A. Onken, C. Harvey, and S. Panzeri. Information estimation using nonparametric copulas. Physical Review E, 98(5)0053322, 2018
[50] T. Schreiber. Measuring information transfer. Physical Review Letters, 85(2):461-44 -644, 2000.
[51] A. K. Seth, A. B. Barrett, and L. Barnett. Granger causality analysis in neuroscience and neuroimaging. Journal of Neuroscience, 35(8):3293-322 3297, 2015.
[52] F. Shahbazi, A. Fwald, Ziehe, and G. Nolte. Constructing surrogate data to control for artifacts of volume conduction for functional connectivity measures. 17th International Conference on Riomagnetism Advances in Biomagnerism - Biomag2010, volume 28 of IFMBE Proceedings, pages 207-210, 2010.
[53] S. M. Sherman and R. W. Guillery. The role of the thalamus in the flow of information to the cortex. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 357((428): 1695 1708, 2002.
[54] S. Stramaglia, I.. Angelini, G. R. Wu, J. M. Cortes, I., Facs, and D. Marinazzo. Synergetic and redundant information flow detected by unnormalized Granger causality: Application to resting state fMRL. IEFE Transactions on Biomedical Engineering, (3(12):2518-2)) 18-2244, 2016.
[55] T. Van Kerkoerle, M. W. Self, B. Dagnino, M.-A. Gariel-Mathis, Poort, C. Van Der Togt, and P. Roelfsema. Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex. Proceedings of the National Academy of Sciences, (I(40))14332 14341, 2014.
[56] B. Van Vugt, B. Dagnino, D. Vartak. H. Safaai, S. Panzeri, S. Dehaene, and P. R. Roelfsema. The threshold for conscious report: Signal loss and response bias in visual and frontal cortex. Science, 360(6388); 537-542, 2018.
[57] F. Varela, J.PP. Lachaux, F. Rodriguez, and J. Martinerie. The brainweh: Phase synchronization and large-scale integration. Nature Reviews Neuroscience, 2(4):229-239, 2001.
[58] R. Vicente, M. Wibral, M. Lindner, and G. Pipa. Transfer entropy-a model-free measure of effective connectivity for the neurosciences. Journal of computational neuroscience, 30(1):45-67, 2011.
[59] M. Vinck, L. Huurdeman, C. A. Bosman, P. Fries, F. P. Battaglia, C. M. A. Pennartz, and P. H. Tiesinga. How to detect the Granger-causal flow direction in the presence of additive noise? Neurolmage, 108: 501-318 38,, 2015.
13

---

[60] M. Wibral. N. Pampu, V. Priesemann. F. Siebenhühner, H. Seiwert, M. Lindner, J. T. Lizier, and R. Vicente. Measuring informeaiion-rranseerr delays. PLaS ONE, 8()):e5809, 2013.
[61] N. Wiener. The theory of prediction. In Modern Mathematics for Engineers, E. E. Beckenbach, New York: McGraw-Hil Hill, 1956.
[62] P. L.. Williams and R. D. Beer. Nonnegative decomposition of multivariate information. arXivv/004.2515, 2010.
[63] N. Wilming, P. R. Murphy, F. Meyniel, and T. H. Donner. Large-scale dynamics of perceptual decision information across human cortex. Nature Communications, 11(1):5109, 2020.
14

---

Supplementary Material for An information-theoretie quantification of the content of communication between brain regions
SM1
Definitions, derivations, and properties of the information theoretic quantities
In this section, we first define the basic information theoretic quantities that we use in the paper. We next introduce basic concepts of the PID theory needed for derivations. We then these concepts to derive a mathematical definition of FIT and then prove some of its key mathematical properties.
SML1 Definition of the Shannon information quantities used in this study
In the following we describe and provide analytical expression for the quantities of Shannon's information theory that used in this paper. These are the mutual information between the stimulus and the neural activity, and the Transfer Entropy (TE), which are estimated based on the probabilities of activities of neural signals X and Y and of stimulus features S.
The mutual information [(S; Xpres) between the stimulus feature S and the neural activity Xpres of X at the present time is a non parametreiec measure that quantifies the full single-trial statistical relationship between S and Xpres. captures the effect of all linear and nonlinear interactions between these variables. It is defined as follows [35
p(., Fpees)
TSS:Xprec) Xpres)
Σ 8,Sppex
p(8, Tpres) (opres)log log
(S1)
p( p(s)p(Ippes)
where p(s, Fpres) is the joint probability, sampled across experimental trials, of observing in a given trial the joint occurrence of stimulus feature value s E S, and activity Zpres E Xxpes- The sum spans all possible events. I(S; Xpres) non-negative, and is zero if and only S and X xres are independent. Similar expressions and properties hold for the information 7(S; Xpast). I(S; Y past) between the stimulus and the past activity X pastt Ypest of X and respectively.
TE 34] is an information theoretic measure that utilizes the Granger principle to quantify the overall propagation information by neural activity from putative sender to a putative receiver Y as the mutual information between the present neural activity of the receiver Ypres and the past activity of the sender Xpast, conditioned upon the past activity of the receiver Ypast. The expression of TE as a function of the joint probability distribution P(X past, Ypres, Y past) is as follows: Y
TE(X -Y = I(X Y Ypres Ypast)
Plppast Uprea: Upast) log plEpasts Uprex Uprex)Upast) Upast)
(S2)
p(Ipoat (ppaet }p( (ppres 3past)
where p(Ipaet> Uprea: Upast) is the joint probability, sampled across experimental trials, of observing the joint occurrence of Tpast E Xpasts Upres E Ypress and ypast Y Ypest, and the sum spans all possible events. Importantly, TE does not depend on the stimulus feature and thus cannot tell how much of the overall information being transmitted from X to Y is about S about other factors unrelated to S.
37th Conference on Neural Information Processing Systems (NcurIPS 2023).

---

SM1.2 Elements of the PID theory
PID was introduced first in Ref (38) and is a very active field of research [2]] To make our paper self-standing, here we briefly summarize the basic concepts of PID that are most needed for our reasoning and derivations.
In the general case of N source variables X = (Xi,.... XN), PID dissects the joint mutual information that the source variables jointly carry about target variable T, T(X; T), into non- overlapping pieces of redundant, unique, and synergistic information. Let A1,-... AM be all the non-empty and potentially overlapping subsets of X. that we call sources in the following. PID considers the collections of sources a E Pi (X)), where (X) denotes the set of all non-empty subsets of X. That is, collection a corresponds non-empty subset of non-empty subsets of source variables. In the following, for brevity, we will call collections the collections of sources. Collections a are indicated using bracketed notation (e.g., a = (X,XX) (x1X3)). Importantly, pieces of unique and synergistic information can be defined and computed algorithmically once the redundant information is identified and computed. Thus, in what follows we focus principally on defining and computing redundancies. For each a, PID defines the amount of information about T that is redundant between all sources in the collection: (T; o:). Conceptually, the redundancy of any collection a for which a source A; E a is a subset of another source A, a (i A j) should be equal to the redundancy of the same collection after removing the superset Aj [3S. Therefore, the collections of interest to compute (n;T; a) are only those for which no source is superset of any other, and hence removing any source A a could potentially reduce the redundancy. These collections form a domain called A(X):
non-empty subset of sources, namely to
represents the collection of the two overlapping sources {.1 } and
A(X) {a E (X)( VA, A E a, A4 $ A
(S3)
It is possible to define a partial order over the collections of A(X). A collection a precedes another collection /3 if for each source B in / it exists source a that is a subset of B, formally:
Va, B E (a = B + VB E 333 E a A C B)
(S4)
Applying the order relationship in eq. S4 to the elements of A(X) produces redundancy lattices, in which collection that succeeds a provides at least as much redundant information about T as a (38 (see Fig. [SIA.B for the lattices for N = 2 and N = 3 source variables). PID allows quantifying the amount of redundant information (T;;; a) that a specific collection a contributes to the joint mutual information about T, and that is not already redundant in any collections preceding a (in the following, we will call [T; a) the information atom provided by collection a). (T a) is implicitly defined by the following relationship [38]
(T; = E1o(T:
(S5)
3<a
Due to the so-called self-redundancy axiom of the PID theory 38 if an individual source A, appears in collection a, the redundancy computed collection is equal to the mutual information between all source variables in A; and the target variable T:
In (T: a) (T; (A,)) I[T:
(S6)
By combining eqs. $5 and S6 we can write Shannon information theoretic quantities the sum of partial information atoms:
I(T: = Σ IT
(S7)
B:SA:
Eq. S7 will be fundamental to provide upper bounds for FIT terms of Shannon information quantities. When applied to the trivariate system (S, X1, X2), taking S as target and (X1,X, as source variables, eq. SS7 provides the decomposition of the joint mutual information T(S; X, Y) that we discussed in the main text:
I(S; X2) =
(S8)
= where in the main text we called Ta(S; = [))
ToS: (x1) UT(S
X1 \ (2)), (S; (X2)) = UI(S: :
to improve clarity
2

---

for readers not familiar with PID. SI is shorthand for Shared (that is, redundant) Information; UT is short-hand for Unique information; CI is shorthand for Complementary (that is, synergistic) information.
Thus far covered elements of PID theory that hold for generic redundancy measure In. but did not discuss how to compute 4n (T'; a) for specific collection a. Several measures of redundant information have been proposed 3 20), in this work we use the original measure Imin from Williams and Beer [38] as it has the fundamental property of being non-negative for any information atoms for any number N of source variables (not only for N 2) (for proof, see Appendix D of Ref (8).. The redundant information min for a collection a is defined as follows:
min (T;a)= =Ee() min [(T = =; Ac)
=
(S9)
ArEa
IET
where I(T = 1; A,) is the specific information that source A, carries about specific outcome of the target variable E T. and is defined as:
p(tla) p(t)
= = 1; Σ p(alt) log
(S10)
Intuitively, Imin quantifies redundancy as the overlap between the sources in the distributions of specific information across individual values of target variable. This corresponds to quantifying the degree to which all sources in collection a are similarly discriminative about individual values the target. We decided to use min because of its advantages in terms of being defined for an arbitrary number of source variables N (something that needed because FIT defined in terms of N = source variables and cFIT in terms of N 4 source variables) and being non-negative for all atoms (which is important to guarantee that FIT is interpretable as a measure of information transmission). Importantly, similarly to other redundancy measures 20)). mmi satisfies the pairwise marginals property, meaning that min (T; a)) only depends on the pairwise marginals distributions p(T, A,) between the target T and each source A, E a.
Alternative redundancy measures proposed so far are either not straightforward to generalize beyond N = 2 source variables [3] 16 or can provide negative information atoms [[]] However, these alter- native measures have complementary advantages with respect to min. such as satisfying the identity property [x, Y: (X, y)) T(X; Y) which guarantees that, in a system made of two independent variables, the two variables cannot carry redundant information about the whole system. Despite not satisfying this property, the Imin measure has been applied to study information processing in simulated neural networks providing insightful and interpretable results.
SM1.3 Derivation of FIT
In this subsection, we derive the definition of FIT. In the main text, we used the notation SUI(S: X Xpast; Ypres Ypast) to denote the atom of information that is shared by variables X Xpast and Ypres about target S but is unique with respect to third variable Y Ypast- Using the bracketed notation introduced in Section[SM1.2 to Io(S; {X [xpssr] [ J). From eq. [S5] this atom is the difference between the information that X Xpast. and Y Ypres share about S minus the information that Xpmst. Ypmst and Ypres share about S (see also eq. [14). In the PID literature, information redundant in set of sources about target that is not redundant with information from another set, has been termed shared unique information 23). Therefore, using the bracketed notation to denote the two atoms of shared unique information SUI(S X past, Xpree Ypast) and SU SU pres Xpast, S \ Ypast), we can write the definition of FIT as:
denote information atoms, SUI(( : Xpast- ypres (ypst)) corresponds
(S11) We first discuss the mathematical properties of [o(S; (Xpast] [YYres>)) the first atom appear- ing in FIT definition. We then discuss the complementary mathematical properties met by (Ypress (S))) the second atom appearing in FIT definition. To keep our reasoning as general as possible, we discuss properties of the atoms that are valid when the atom is computed using any of the redundancy measures that satisfy the pairwise marginal property (which include the I Imin redundancy measure that we implemented here). We then demonstrate that specific pairwise
FIT min[Lo(S; ( (Xpast | HYpres H), [Y(presi
presi (Xpast(SS)
3

---

A
PID for source variables
Synergy (X.Y)
I(S:X.))
(X.Y)
((S:X,Y
[x}
(
(XY)
X
M
Unique
Unique
(XM
Redundancy
B
PID for 3 source variables and FIT definition
I(S; Y, X ()
I(Y; S, X y,)
S target
MXX
Y, target
(Sx
I(s: Y)
I(S: ()S:X)
YY
X
(5X,)
[9
XXII Y.
(SX,19 YJ
KEYXKYY YX
(Y)
(S)
(S XXX,XXX YJIS
(SWX
(XXX
DUJY
(B]OK
JSKY
BKAY
FIT = min between the two
(XKKYY
(S,X,X))
Figure $1: Schematic of the concepts of PID. (A) The information T(S: x,Y) Y) that two source variables X, carry about target variable S can be decomposed into four PID atoms. Left: set-theoretic diagram of the decomposition. Shared information {X {YY,, darkest shade of blue; unique information {X) and {Y). lighter shade of blue; synergistic information {X, YJ. lightest blue. Right: the same decomposition plotted as lattice. A link between two regions symbolizes the ordering relationship of eq. S4 (B) FIT is defined on two PID lattices with three sources and one target. Left: The PID lattice with S as target and (Xpuet. Ypost. Ypres) as sources. Right: the PID with Y Spres as target and (S, Xpaet Ypest) as sources. FIT the minimum between the two atoms highlighted in red. Classical Shannon information theoretic quantities are mapped on the two lattices with different colors (i.e. the sum of all the atoms bounded by given color is equal to classical enformation-theoretie quantity). 7(5; Ypres) is mapped using blue, T(S; X past) using purple, TEX- + Y) using yellow, and 1 (Xppstt Y, Xprea) using green. The p and subscript in the Figure is shorthand for past and pres respectively.
algebraic relationship exists between these two atoms. This relationship is derived from the Shan- non information theoretic quantities that relate atoms in the two decompositions. Importantly, this relationship uncovers the presence of a more refined information component that shared between the two atoms. Finally, we discuss how taking the minimum between these two atoms ensures that FIT fulfills simultaneously a series of fundamental properties, including being upper bounded the same time by the feature information encoded in the past activity of the sender X, I(S; X past), and

---

in the present activity of the receiver Y, [(; Ypres), and by the total information flowing from X to Y. namely TE(X- + Y).
SM1.3.1 Properties of the first atom in the FIT definition
Our intuitive definition is that FIT should be the information shared between the past activity of a sender region Xpast and the present activity of a receiver region Y Xpres about S that is unique with respect to the past activity of the receiver yast.. Thus, within PID of the 1S,Xppac Yprea, ypsst) system the most natural candidate is the first atom in eq. SII (Lo {-Xpstt ( (Xprea))) coming from the decompisition taking (Xpast, Ypast, Ypres) as source variable and S as target variable. Using eq. SS] we show that the two Shannon information quantities [(S; xpast) and T(S; Ypres) (i.e., the
feature information encoded in the past values of the sender X and of the receiver Y, respectively) set an upper bound on (S; passtt J (Y as the sum of information atoms appearing on the lattice having S as target:
(ypres)). )). Indeed, [(; post)) and [(S; Ypres) can be written
[S: X post) Io(S; {X past) HY pree (Y 3) + Ia(S; (paaeeYyasse
+ +lo (5; {X poott (Y ((re)))))))))))))())()))))))(( + [s(5; {Xpast (apastt
(S12)
(S; {Xpast) }) (S; {X paptt HY
I(S; ()S)))sss))))))))))) = (5: {Xpast pYpres pastt)) + Io(S; CarreaHymass +la(S; { (Xpottpps)) HY (e))) + (s; {Y (Ypres)] { (Y ppat))
(S13)
+So(S; {x (Xre=))) 2 [S; (Xpatt(Xprre
which proves that [S;;; (X past) {Y (prees) }) is upper bounded by both quantities (see Fig. ST B for graphical depiction of [S; Y pres)), in blue, and ((S:Xpess) in purple, upper bound the first atom). However, eq. [57 does not establish any relationship between (a( past)) (Ypre=))
3) and Shannon
information between the source variables of the decomposition, including TE(X + Y). Therefore, the value of the first atom can exceed the total amount of information transmitted from X Y
TEXX Y).
Next we prove that, when computed using a redundancy measure that satisfies the pairwise marginals property (see Section SSM.22). [S {Xpast } (Ypres]) only depends on the probability distribution P(S, prres) through the pairwise marginal distributions P(S, X xpast) and P(S,Y Y press). and does not depend explicitly on P(Xpsst: ).res). Indeed, using eq. [S5 we can express Ta(S; (X (Xpast) (Y ))res)) as the difference between the redundancy about S computed on collection (Xpast) (Ypres) minus the redundancy computed on collection (Xpast) } (Ypres) (Ypast):
(S; {X HY = (n(;; papt [Y (Xpr=> }) - (S; (-xpast (Y H (aastt) (S14)
If In satisfies the pairwise marginals property, then the right-hand side of eq. SS14 only depends on the full probability distribution P(S, Xpost, Ypast, Yprea) through the pairwise marginal distributions between the target S and the individual sources Xpatt) P(S, Y past)) and P(S, Y Xpres), but not through the pairwise marginals between the sources, including P(Ypreat X xp This implies that if we partially disrupt the dependency structure of our data to create surrogate data, where the individual dependencies of X and of on S are preserved (i.e., the pairwise marginals P(S,XQ Xpast) and P(S. Ypres) do not change) and the within-trial correlations a fixed stimulus are disrupted (i.e., the conditional distribution P(Xpres, Ypaee 5S) changes), this atom will retain the same value it had in the original data. Therefore, this atom alone cannot rule out confounding scenarios where X and y encode S independently with a temporal lag, with no information transfer at fixed stimulus value.
SM1.3.2 Properties of the second atom in the FIT definition
1s(S; satisfying mathematical properties that are complementary to the ones of exist on the decomposition with Y. as target. On this decomposi- tion one atom that intuitively captures feature-specific information flow is Jo(Ypres: (Xpas) ) {S}). ie. the information that the past activity of the sender X and the feature S share about the present activity of the receiver Y that is unique with respect the past activity of the receiver Y. We first prove that this atom is upper bounded by the value of TE{X + Y), and then that this atom depends on P(Y press X Xpast).
Atoms
To prove that the value of TE(X- + Y) sets an upper bound to Ta(Pprss; (Xpast } (S)), we first use the information thhooreticct chain rule (9. to write the conditioned mutual information in eq. S2 as
5

---

the difference between the joint mutual information that X past and Y past carry about Ypres minus the mutual information between Y Ypres and ypest. Then, we use eq. /7 to write the two information quantities as the sum of non-negative information atoms, including Ta() (Y pres: (X (xpst) {8}):
TE(X- V) T(Y presi X pasts Ypast) - (Ypress) Ypast)
= -ollY presi {S} past 1) + (Sast)) +Io(Y pres: {S} (X past Y pastt) }) + To(Ypres: (Xpast)) ))
(Xpast ( HMS postt))
(S15)
+ Io(epresi presi pX S} (X past past }) + ls (Y (a (X past pastt past))
{x past pas (x past passt))
+ +Ia(Y
+ +Ia(Y presi : papsttYpue ypast))) 2 pyrrrt (S)X pppst))
which proves that IY presi past HS}) is upper bounded by TE(X + Y) (see Fig. SIB for a graphical depiction of the mapping of TE(X - Y). in yellow, on the lattice to which this second atom belongs).
Similarly to the first atom, this second atom is also upper bounded by I(S: I(S:Ypres) (not proven, but see the blue quantity in Fig. STB for a graphical depiction of this property), however is not upper bounded by Shannon information quantities between the source variables of the decomposition with Ypres as target, and in particular by T(S; past)- This is important because it proves that neither the second atom alone satisfies all the properties that we require for measure of feature-specific information transfer.
We then prove that the second atom depends on P(Ypresy X pm a property which makes it suited to rule out confounding scenarios where and independently encode the but no communication occurs between the two. To do so, we eq. S5 to write the second atom as the difference between two redundancy terms:
(Yprrss (Xpast)S) = (Yresi {X (Xpast - In {X HS] (ppsst))
(S16)
If In satisfies the pairwise marginals property, then the right-hand side. of eq. S14 dependds on the full probability distribution P(S, X pastt Yastt, Ypres) through the marginal distributions between the target Yree and the individual sources P(Y P(Ypres: X..xxxxxeer pass)). P(Y S), and P(y )aat)) This implies that if we partially disrupt the dependency structure of our data and create surrogate data where the individual dependencies of X and of Y on S are preserved (i.e., the pairwise marginals P(S, X Xpost) and P(S, Y Ypres) do not change) and the within-trial correlations at a fixed stimulus are disrupted (i.e., the conditional distribution P(Xpres: Ypaet] SS) changes), the value of the referenced atom may differ from its original value. This change occurs because this operation generally disrupts P(Xpres Xpaet). Therefore, this atom can rule out confounding scenarios where X and Y encode S independently with temporal lag, with no information transfer fixed stimulus value.
SM1.3.3 The two atoms in the FIT definition are related by Shannon Information theoretic quantities
This Section is structured as follows. First, we present some basic findings from Ref. where, the authors showed that atoms from different decompositions are algebraically constrained by Shannon's information theooretc quantities and used these constraints to identify. specifically for a trivariate system, reduced set of finer information components which could describe all atoms across different decompositions. Next, we express the algebraic constraints between two decompositions as a homogeneous linear system of equations. We demonstrate that the reduced set of information components derived for two decompositions in Ref. [27] can be obtained as solutions to this homogeneous system. Finally, we derive the analogous homogencous system in the case of four variables. One solution to this system relates specifically the two atoms appearing in the FIT definition.
Ref [27] showed that atoms belonging to different decompositions are algebraically constrained by information-theoreti quantities. These constraints derive from fundamental axioms of PID theory, specifically the fact that in the system
we can use eq. S7 to express the mutual information between two variables X; and X, (conditioned on up to N - 2 other variables) as the sum of information atoms from both the decomposition with X; and the decomposition with Xj as target variable. For the trivariate system X, Shannon information quantities

---

impose two linear constraints between the 4 atoms of information having S as target and the 4 atoms of information having Y as target (all atoms are: (S; (M): (a(:: Ta(Y; (S)), (0: Ta(Y; (XS))):
Ta(:; (XY]), Ta(:
((S;Y) = To(: (X))) Ias; (Y) [X(;; + {s)) T(S;YIX) = Ias
Io(5; (7) Ta(;; (S))
Ia(Y;
(S17)
Combining the two equations in the system of cqs. [e7jeass an equality among the differences in the amount of information carried by pairs of similar atoms (the two redundancies (S; (YY) and Ta(Y; (X))), the two synergies (a(:; (XY)) and (Y; (XS)), and the two unique information Ta (S}) and (a (Y))):
(S (XS{(X)))))))))) IoYY; (x()
(S18)
Ia(Y: - Io(:: (V}) = (XY]) TY:::
Therefore, 6 atoms of the 8 atoms belonging to the two decompositions (those appearing in eq S17 are not independent, while (S; {X]) and [Y: are independent from all other atoms. In Ref. [27] the authors showed that, due to the two constraints of eq. S17 the 8 atoms can be described by finer independent information components (that they called information subutoms). In Ref.
27 they quantify these 6 subatoms as follows: three subatoms are the minimum between pairs of similar atoms belonging to the two decomposition (i.c., the two redundancies (a(S; (XY))) and Is(Y; (X)S)) the two synergies (S;;; (XY)) and lY(;; {X55)) and the two unique information 1s(S; {Y}) and (Y; {S])); one subatom is equal to the difference between the maximum and the minimum in each of the above pairs (which is equal for the three pairs, see eq. S188; ; two subatoms are equal to the unconstrained atoms not appearing in eq. S17 (S: (X}) and YY;;; (X})).
A novel perspective on the relationships between the amounts of information carried by specific sets of atoms from different decompositions to conceptualize the eight atoms as forming an eight-dimensional vector space, V. We can represent a generic column vector in V as g and the 2 x 8 matrix of constraints imposed by Shannon information quantities relating the atoms of the two decompositions B. With these definitions, we can express the system of eqs. SS7 homogencous linear system:
By=Q = Q
(S19)
Specifically, the coefficients of B are obtained by taking the difference between the middle- and Ordering the dimensions of V as (Ty(S; (X) (s(:; (Y)), 1s(S; (X)), (s; (XY)), a (X)S)) Is(Y; (S)), LY; (X)), (XS)). B has the
the right-term in the two eqs. S17
following form:
B
0
1
1
0
0
11
0
0
-1
(S20)
can easily be verified that, for instance. Io(S; (XHY)) IY::: (XHS)) is a solution of the homogencous system in eq. SS9 for the matrix B defined as in eq. S20 Consider a matrix multi-
plication between B and the vector Usr, whose only non-zero components are I (X)()) and (X (i.c., Est = (La(S:(XXX) (X))))))))))) O, 0, 0, 4o (X)S)))0,000)) 0)). This ma- trix multiplication is equivalent to multiplying the coefficients in columns and of B by the two atoms, respectively, and doing the element-wise sum of the two resulting vectors. This sum is zero if and only if (S; (X)()) = (Y; (S))) Put simply, columns of B with element-wise opposite coefficients correspond to pairs (or triplets) of atoms that form a solution of eq. (S19 when they have equal value. As a result, the following are all nontrivial solutions of the homogeneous system in eq. S19 or equivalently, they belong to the null space of B: 1s(S; (XHY)) = Ia(Y; (S))), IalS: (
Is(Y: (S)), (s(S; (XY) LY(Y; (XS)). 1s(S; [x]), (X);; and la(s: (X)() = La(S; (X(()(X)) (XY]) = (Y (S)). These solutions uncover specific relationships between pairs triplets of atoms across different decompositions. Importantly, considering that the eight atoms are not independent and can be represented by six finer, independent quantities, these solutions lend support to the notion that these finer components of information are shared among the atoms linked by a single solution. Remarkably, the atoms identified as related by solution precisely correspond to the six subatoms previously defined in Ref (27).
Similar to the case of N source variables, for N 3 source variables, there are 36 information atoms (18 per lattice) that belong to two decompositions with different targets. Shannon information
7

---

quantities impose constraints relating these 36 atoms, implying the existence of finer information components (or subatoms) that can describe the two decompositions even when there are N source variables. Our goal here is not to uncover the complete set of components that describe all atoms belonging to the two decompositions. Rather, we aim to demonstrate that specific algebraic relationship, similar to the ones discussed above, exists between the two atoms present in the FIT definition. To do this, we generalize the homogeneous linear system in eq. t1 the four-variable case (S, Xpast, Xpasts ). ). In this scenario, the two decompositions that have S and Ypres their respective targets (represented by the two lattices in Fig. (STB) are constrained by the following four Shannon information quantities:
I(S; Xpres)
[(; yrrea Xpast)
(S21)
[(5; yprea (past)
T(S; ((es Y past: Xpost)
eq. S7 to express the 4 quantities in eq. S2I as sums of atoms either belonging to the decomposition with S as target, or the one with Ypres as target. As an example, in Fig. B, we demonstrate that T(S; Yrres) is the of atoms belonging both decompositions. which together consist of 36 atoms (18 per decomposition). In general, each quantity in eq. [S21 imposes constraints between two sets of many atoms from the two decompositions.
Similarly to eq. [S17]
To numerically study the solutions ST for these 36 atoms, we wrote a MATLAB script named FIT_nullB.m. This script computes the Tour quantities in eq. [S2 as the sum of atoms from either the decomposition with S or Ypres as target. It then constructs the 4 x 36 matrix B (Fig. S2) in a similar way to how we derived the 2 8 matrix in eq. fr00 the eqs. in S17 From Fig. S2 it clear that in this four-variable case, some atoms, such as La( prees i {-ppstt { past F), are not constrained by B and can vary independently (analogously to how for N = 2 the two terms (a(S; (X)) and (Y; (x))) were unconstrained). However, there are also pairs of atoms that not independent when considered individually, but that are specifically related by eq. (i.e the equality between the two atoms in the pair is solution of eq. (T9). A notable example of these pairwise solutions is made by the pair of atoms appearing in the FIT definition: Ta(S: (X past (Y 3) = Ta (Xpast } {S)). This relationship can be easily verified from Fig. S2] where the first and the second atom are highlighted in red and white, respectively. Indeed, drawing from the intuition developed in the N = 2 source variables case, these two atoms belong to columns of / with element-wise opposite coefficients. This solution (Fig. (S2 reveals a specific pairwise relationship between the two atoms appearing in the FIT definition and supports the existence of a finer component of information shared by these two atoms. It is actually apparent from the plot in Fig. that that this is the only pairwise relationship involving any of the two atoms. We quantify this finer component of information by taking the minimum between the two related atoms.
SM1.3.4 Proofs and summary of the main mathematical properties of FIT
Here we prove that FIT defined as in eq. STT satisfies the two following properties:
1. FIT is simultancously upper bounded by [(S; X1Set)) I(S; 11S:)yrres,, and TE(X- + Y).
2. FIT depends on P(S,Xpust: Xpust. Ypre=) through all the pairwise marginal distributions P(S,Xpaed) P(S, Y prees), and P(Xpast: Yprea). Thus, FIT can rule out confounding sce- narios where X and Y independently encode S with a temporal lag in absence of within-trial correlations between X and Y at fixed stimulus.
To prove that FIT is simultancously upper bounded by I ((; Xpost), I (S; Ypree), and TE(X- + Y). it is sufficient to note that FIT is simultancously upper bounded by all quantities that set upper bound to the two atoms appearing in its definition. This can be seen from eqs. S12, S13 and S15) which show:
FIT I Ia(S; (Xpast (Ypres) 1) I I(S; X xpatt) FIT < To(S; (Xpast) } (Ypres) 1) E T(S; ypres) FIT (Ypres: [Xmstt HS}) < TE(X +)
(S22)
particularly important consequence of the upper bound set by TEXX - Y) is that if X and Y are independent, then FIT O. Indeed, if X is independent of Y, then X Xpost is independent of
8

---

Matrix of constraints between the two decompositions having S and Yt targets
(S)XoKYP) Yt
(SXXp)
(SHYp) Yt
(XpXYp) Yt
(SHYp
[XpXS Yp) Yt
Yt
(YpSS Xp)
(S] Yt
Xp) Yt
[Pp]
(S XpxS Yp Xp) YI
Information atoms
(S YpKS Xp)
Matrix coefficients
(S XpH XD) Yt
(S Yp Xp)
Xp) Yt
(S Yp) Yt
(Xp Yo)
Yp) Yt
(Y))Xp)\)) Yt
(Yt]Xp)
(Yt)(PP)
(XpHYp)
(YH
(Xp)Yt Yp)
(Yp)YL Xp)
(YC)
(Xp)
(Yp)
(Yp YXYY Xp)Yt Xo)
(Yp YIJYt Xo)
Xp)(Yt Xp)
(Yp YHHYp Xo)
(Yt Xp)
(YL Yp)
(Xp Yp)
(Yt Xp Yp)
I(S:Y pres
past
past
I(S:Y prom pair pana
I(S:Y pres IX
I(S:Y IV pres
IX
Shannon information constraints
Figure S2: Matrix of constraints imposed by Shannon information -tteoortiic quantities relating the PID having (rpee Xpast, pastt) as source variables and S as target variable the PID hav- ing (S, past,
past; past) as source variables and Ypres as target variable. For brevity, we used the notation Y, Ypres: Xp passt, Y, = Ypast and denoted each atom (y axis) directly with the collection it is computed on, with a subscript indicating the target variable of the decomposition [S: {X (Xppet) (Ypres)) 1)). For better visibility, we plotted the transpose of the 4 x 36 matrix appearing in eq. [S19 The red dashed line highlights the first atom appearing in FIT definition (S; pXpstt ( (YYreesss (ppres)) F), the white line highlights second atom in FIT definition To TY presi {X past {.)). Importantly, only atom highlighted in red has coefficients that are opposite to the ones the atom highlighted white.
(e.g. {X,, (Xp)Y
Kpasts Xpres), and therefore (Xpasti i Y Ypasts Ypres) = 0. By applying the information theoretic chain rule [9] to I 1(X pasts Ypast: (pres), we obtain:
1(Xposti Ypasts Yprea) 1 (XXpasti Y Ypres pastt) + 1(Xpasti Xpazt)
(S23)
2 I(Xpasti Y Ypres Y Ypsat) 2 FIT
Proving that, if X and Y are independent, then FIT = 0. Another important point is that none of the 36 atoms belonging to either decomposition with or decomposition with yrees as target satisfies the first property. Indeed eq. SS does not establish any relationship between atoms of the decomposition with S as target Shannon information between the sources the decomposition, including TE(X - Y) (see Fig. SI left), nor between atoms of the decomposition with Y pres as

---

target and Shannon information between the sources of the decomposition, including [[S; Xpast) (see Fig. STBB right). Therefore is necessary to simultancously consider atoms belonging to different decompositions to obtain quantity that satisfies the first property.
To prove that FIT depends P(S, X pasts Y pres)) through all the pairwise marginal distributions P(S, ppost), P(S, Y Ypres), and P(X past, Y Xpres) we also leveraged on the simultaneous depen- dence of FIT on (S: [Xpast] HY [Yprea) 3) and on Ia press pX (S)). Ly(S; popost) H prea)) J) and Ia(Y {X [Xpast] H {{}) depend of P(S, X Xpres, Xpast) through the marginals P(S, X Krrea) and P(S.tpast)) fore:
past)), ), and P(Y P(Yyres: Xprex) and P(S, Y pastt), respectively (see SM1.3.1 and SM1.3.2). There-
FIT = J(P(S y)ast)) Xpast) P(S, Y Xrres), P(X Y Xpres))
(S24)
This implies that if we partially disrupt the dependency structure of our data and create surrogate data where the individual dependencies of X and of Y on S are preserved (i.e., the pairwise marginals P(S, post) and (pre)) do not change) and the within-trial correlations at a fixed stimulus are disrupted (i.e., the conditional distribution P(Xyres ppsse(s) changes), the value of the FIT can differ from its original value. This change occurs because this operation generally disrupts P(X paae)). Therefore, FIT can rule out confounding scenarios where X and Y encode S independently with a temporal lag, with no information transfer fixed stimulus value.
SM1.4
The conditional feature specific information cFIT
Here we discuss the definition and the properties of the conditioned version of FIT, termed cFIT.
SM144.1 Definition and derivation of cFIT
We defined conditioned version of FIT, to remove from the feature information transmitted from X to Y (that in this Section we term FITx) the information potentially routed through the past activity of a third region Z (Z can, in principle, also be the multivariate activity of a set of regions). To do so, we identified subcomponents of the two atoms in the FIT definition that quantified pieces of information that were also shared with the past of Z, and removed them from FIT.
In this subsection, we will be working with atoms computed on collections belonging to decomposi- tions with N = 3 and N = 4 source variables. To avoid any confusion, we will explicitly denote the number of source variables of each collection in the following discussion. For example, we will use the notation {XXpest } to indicate the collection on which the first atom in the FIT definition computed. This collection refers the PID with N 3 source variables (X (Xpasts Ypres Y past) and target variable S.
Previous studies showed that, using eq. S7 atoms the PID with target T and N source variables X,= = (X,...., XN) can be written as the sum of finer atoms belonging to the PID with same target and an additional source variable X 1
(X1,..., Xx. X x [77) Importantly, collections present in the PID with N source variables, denoted as a(N), also exist in the PID with + source variables, denoted ((N+1), since XN C XN+1- However, the opposite does not necessarily hold.
The atom (T'; (C())) is the sum of atoms (T';; B(N+))) where B(N+1) simultaneously pre- cedes ((1+1) in the PID with N + 1 source variables (as per the ordering relationship of eq. SS4] in which precedence includes equality), but does not precede any collections ((N+1) such )
that "(N) precedes ((NN) (7]. For example, the collection
present in the PID with N = 3 source variables (Xpast: Ypast, Ypres) and target S, is preceded only by the collec- tion (Xpast) (Y (ypres) ) (Ypast) 133) (i.e., the information that all source variables (Xpast: Y past,, Ypres) share about 5) and by itself (see Fig left). When adding Zpast to the set of source variables, the collection (Xmst) [Y (Ymrea J(4) is preceded by four collections (additionally to it- self): {Xpast HY pres HY (Yppas)(a) {Xpast] HYpres HY HZ {Xpost) (Xpast)yy HYpres) HZpast (aa) and (Xpast } (Y pres H (Zpast y "ast hattta (4) (see S7g A, right). Collection {X (Xpast (Y pres) HY past h(a). which was not preceded by any collection apart from itself in the PID with N 3 variables, is preceded also by (Xpast } HYpres Hy past) H Zmastt H(j). Therefore:
(Y
la(S: {X Xpattt HYpres HY
(S25)
= =Ig(S; (X (ppsst(( (Ypres) (o (Ymoot) (4)) + IS( (X (Xpast] } (Y (Ypres) (Ymoet (2pae)(4))
10

---

which intuitively means that, when considering also the past of a third region Z. the information that (Xpast; Y yasts pres)) share about S breaks down into component that also shared with Zpast and a component that is unique with respect to Apast:
The other two collections (Xpast) ) pres) papstt (1)) and (Xpast) ) (rres) } (Z Y past ) (4)) pre-
cede (Xpast) } HYpsstHyress (Xpres)(4) but do not precede past) H (yres past (4)) (Fig S7 A). Therefore:
(S [Xpost H (Ypres ((3)) = (S; pXpest H (())
(S26)
+Ta(S; papt pres) (Y past pastt ((o) + (S;; (Xpast) (Ypres H (7pst)
which shows how the first atom in FIT definition (eq. SSIT breaks down into three components in the PID with (Xpast, Yores, Ypest, 2pstt as source variables and S as target variable (one component that is unique with respect to Y past but shared with Zpast, one that is unique with respect to both Y past and past but shared with (Y (ppstt? ? ). and one that is also unique with respect to (ypst 2 )) One of these atoms the information that X Xposts Ypres: and Zpast share about S, i.c. the component of the first FIT atom that is also shared with Zpast: La(S; {X [Xpost] {Y (Yprea J {
Similarly, the second atom appearing in the FIT definition, is the sum of finer atoms belonging the PID with (X past: S, ypast Zpast) ) as source variables and Ypres as target variable:
Lo(Ypr pxpast } (s) = Lo (XpastHSS(()) +Ta(Y paastt {S} (Y past ppstt ((a)) ) + (Yres: (apstt) (a))tt)a))
(S27)
One of these atoms is the information that X Xpast, S. and Zpast share about Y Yprea, i.e. the component of the second FIT atom that is also shared with Zpast: Is( la(Ypres: presi (Xpast J (past) ((a))
To remove from FIT the information that is also shared with Zpast we defined the conditional FIT (cFIT) from X to Y conditioned to Z as:
cFITx|z min(Ia(S: papstt) (Xpres) (Yrprss (Xpast) (S)) -min[[a(S; [Xpast] HY pree (Zpast ((4), prres {Xpast] (patt
(S28)
Therefore eF xF is equal to FIT from X to Y (cf. eq. STT minus term that is the minimum between two similar information atoms (both quantifying intuntively the feature information about S that both the past of X and the past of Z share with the present of Y. but is unique with respect the past of Y) on the two PID having S and having Y ypres as target variables, respectively.
SM1.42 Properties of cFIT
In this Section we prove two properties of eFIT, under the assumption that we compute PID atoms using a redundancy measure (such as min) that is non-negative for each atom. The first property we prove (i) is that cF FIIxx is upper bounded by FITx and lower bounded by the maximum between 0 and FITx FITz (where we denote as FITx the feature information transmitted from X to Y and FITz the one transmitted from Z to Y). The second property that we prove (ii) is that S + Zpast + prees is Markov chain (i.e. P(S;Y ypres 1prsssZpaast)
P(S) Zast)) PYprrss 2past) )) then cFITx = O. This second property is important because it means that if the present of received all its feature information from the past of recorded region Z, then there is no residual FIT through X once any contribution from Z is climinated.
We start by proving property (i). From eq. $28 since we subtract from FIT the minimum between two non-negatie negatvgae quantities, it immediately follows that cF FX < FITx. This proves that cFITx12
is upper bounded by FITx. Then, since from eqs. S26 and S27 we have that
TS (Xpatt] (V (Ypres }(a)) 2 To(5; (X paptt H ) ())
(S29)
(Y (rpees {Xpaet H (Ypres) (33) 2 Ja(Ypres) {Xpaet HZ (4)
from which it follows that:
min[Ta(S: {Xpast H Zpust (Ypres Jo (Xpast H Z ) {S)
(S30)
< min [ (S; {Xpast } (Y ) Is (X (Ypresi (Xpast) 3 [))]
Eq. 530 that the term that we subtract from the right-hand side in eq. the first one, proving that cF cFITx 2 0.
S28 is lower or equal to
11

---

Finally, we prove that cFITXIZ 2 FIITX - FITz. We do so by proving that the term we subtract
from FITx in the definition of cFITxIz (eq. (528] (eq) is smaller than FITz. FITz is defined on the
two decompositions having (Y prpre X ppstt Zpast) as sources and S as target variable, and the one having (S, Y yastt Zpast) ) as sources and Y Ypres as target variable:
FITz min[Ta(S (a (Free)) (a)); (Ypres: (astt (3)
(S31)
Similarly to eqs. S26 and S27 the two atoms in S31 break down into the sum of finer information
atoms when adding variable X Xpsst to the respective sets of source variables (in Fig/S7A we show graphical depiction of the decomposition of the first atom in FITz definition, depicted in light blue):
Ta(S; ( ) (Y ((3) = (5; ( past } (Yprest(a))
(S32)
+la(S; past HY (Ypres HYpast-
past X Xpast I(4)) + la(s; (2 past (Ypres H (xpestt(s))
Io presi {X past ({))a)) = Io press {x papstt MaasttSS (()) + +Io pYrrss { passt } {S} pastt pastt [(4)) + prree:: [Xpast) { {{}{ (ppstt(t(a)
(S33)
S33 it follows that To(S; { (ppstt ) (Ypres Is [Zmart) ) {X past i prea)(a)) (i.c. the information the past of Z and the present of Y share about S is larger than the information that they both share also with the past of X about S) and Io presi (Eppst(SS]p
From eqs.
S32 and
2 Ia [past {X xapst {S)((a) Thus:
FITz& 2 man[Io(S; (Zaae) HY HX ) (4)), Ioppressi {Xpast HSunet ((4)]
(S34)
The above proves that eFITxiz 2 FITxx - FITz. This is important because it assures that the component that we subtract from FITx when removing from it any contribution potentially due to Zppst cannot exceed the feature information transmitted from to Y (if we only remove the FITz that is shared with F.Tx). ). To summarize, we proved that cF zz S FITx, that cF xFITx|z 2 0 and that cFITx 2 FITx- - FITz, meaning that cFITxxz is upper bounded by FITx and is lower bounded by max (0, FITT F]
We now prove property (ii): S + Zmst + ypres is a Markov chain (i.e. I(S; Y prees (past) 0) then cF =FITxx2=
0). If S + Zpast + Ypres Markov chain, that is P(S;Y Y pres Zpast)
P(S) Z P(Y pres ppstt), then (S: ( = 0 [9]. Using the coormatioonthhorette chain
rule (9]
we can write:
I(S; Y Ypreal Zpast) = I(S: pres: Zpast) - I(S; Zpast) = 1(Y S, 4past) (Y Lpast)
(S35)
Therefore I(S; Ypreal Spast) = O implies I I(S: Yprea Zpast) I(S; Zyast) (meaning that all PID atoms that are a subpart of I(S; Ypres: Zpast). but not of [(5; Zmstt). are zero) and also I(Ypres; S, Zpast) = I(Ypresi Zpast) (meaning that all PID atoms that are subpart of I(Ypres: S, (past), but not of [(Ypresi Zpast), ), are zero). In particular, in eqs. S26 all atoms computed on collections preceding (according to eq. [S4) collection (Y Zpsts ing that, due to eq. [S7] they are all a subcomponent of these atoms, only the collection in (S;; {Xpast) (ress H (ppst ((4) precedes collection [Zpast] on this decomposition and, therefore, is a subcomponent of I(S; Zyret). Since in our case I(S; Y ppres, Zpast) = [(; Zpast), ), the other two atoms on the right-hand side of S1662 are zero. Thus, S + Upast + Ypres is a Markov chain, the following identity holds for the first atom in FIT definition Ia: {Xpast ((prees)(0)) = [S: {Xpast {Y Ypree ((ppatt(4)). Similarly, in eqs. S27 all atoms are computed on collections preceding collection (SZpast) (meaning that, they are suhcomponent of T(Y pres: S. ). However, among these atoms, only Ta Ta(Ypres: (X past) } {S) )(p))t(()) precedes collection [Zpast} J on this decomposition and, therefore, is a subcomponent of T( (Ypres: Zpast). Since in our case (Ypress:S) S. Zpast) = I(Ypres:: Zpast), the other two atoms on the r.h.s. of S2 are zero. Thus, if S + past + Y pres is a Markov chain, the following identity holds for the second atom in FIT definition 1o(Ypres) {Xpost](()) (3)) = Ia(Ypresi (Xpost (S) } Altogether, we found that, if S + Zpast + Ypres is a Markov chain, the two atoms appearing in FIT definition (eq. STT are exactly equal to the two atoms between which we minmmize to remove the effect of Z from FITx x in eq. S28 proving that in this scenario cF eFITxIz = 0.
past), }. mean- Zpast). However, among
12

---

SM1.5 PID decomposition of DFI
We next use PID to examine a previously introduced measure of the information about a specific stimulus feature S flowing from X to Y, called Directed Feature Information (DFI) [17].
This measure was defined by reasoning to first consider TE between X and Y measure of the overall information transmitted from X to Y and then to subtract out from it the information that is not due to changes in the value of the stimulus feature. The latter was estimated as T FX YJS), the value of TE conditioned on the stimulus feature, that is the expected value of the TE when it is conditioned on the value of a particular stimulus feature. The reasoning of (17) is that the conditioning removes information not related to variations of the stimulus feature, and that thus TE(X + Y|S) quantifies the amount of information transferred from X to Y that is not related to the variations in the stimulus feature. With this reasoning. the authors of [77 defined the DFI to measure stimulus-feature specific information transfer by subtracting out from the total information their estimate of the one that is not related to variations in stimulus features [77:
DFI(X - Y) = TE(X -Y- - TE(X - YIS)
(S36)
The authors of Ref [17] showed that DFI is equivalent the difference between the sum of the information about S that each of Xpast and Y Ypres individually carry, minus the information about S jointly carried by X past and Y press, with all the information quantities conditioned on Y yast!
DFI(X - Y)= = I(S; X xpast(Ypatt) ) + I(S; Y15;Ypralh (pressyaspp)) - [(S; XX5;xpun Xpast, Y YpreslYpasi past)
(S37)
The difference between information individually carried and information jointly carried is often referred to as co-information (8 This measure of co-information has been used in the literature as a measure of the net effect of redundancy and synergy and it indicates prevalent redundancy when positive and prevalent synergy when negative (33 30]. In this rewriting, DFI has some similarities with FIT, in that it uses measure of redundancy (although conflating synergy and redundancy) between stimulus information in the past of X and in the present of Y, as well as a discounting, by conditioning, of the past activity of Y.
Previous work on PID has shown that co-information can be expressed as the difference between two non-negative pieces of information which properly quantify synergy and redundancy [38] B] Therefore simple difference between DFI and FIT is that DFI possibly also includes terms of synergy between X past and Ypres than should not be included in a definition of transmission of feature information from X to Y. Moreover, given that DFI conditions the past activity of Y rather requiring uniqueness with respect to the past feature information of Y (as in FIT), it does not isolate information in the present activity of Y that has not been present before in Y. To understand better the consequences of these facts in terms of the difference between DFI and FIT, we reformulated DFI as sum of the partial information terms from the PID, follows:
DFIx-W = T(S; X Seaselypust. + T(S; (pressYpast past)
-1 I((S; Ypres: Ypasts Xpast) + I(S; Ypast)
= =1s(S; (Xpasts Ypast MpastHy HY pres, Ypast))
(S38)
+To(S; (Xpast; Ypast) (Ypres, "past] (Xpasts Ypres))
+Ta(S; (X (Xpast) HY (Ypres () + Io(S; (Y pres) H (X (Xpast, Y Ypast)) 3)
+Ia(S: (Xpast) } (Ypres)) (S;;; (5; (Xpast, Ypres)) (S; (X Xpasts Y Ypast, Ypres) 1)
Note that in the above expression all terms involving pieces of redundant information are positive and those only involving synergistic information are negative. Thus this decomposition of DFI demonstrates that it is the linear combination of (mostly) redundant information terms appearing with a positive sign and synergistic information terms appearing with a negative sign. This explains why, as result of not separating redundancy from synergy, DFI can be negative and difficult to interpret as information about a stimulus feature transmitted from X to Y.
The fact that DFI can become negative also shows that using TE(X- + Y|5) to remove from the total transmitted information the one not about the stimulus feature S (as done DFI, see [17) is incorrect. This is because TE(X + YJS) does not really quantify the information from X to Y which is not about S, as conceptualized Ref [17. It actually quantifies the information transmitted on average within each feature condition. This can overestimate the information from X
13

---

to Y which is not about S. In simple terms, when using data from the same feature conditions, some information sent from X to Y this subset of data could about the specific value of the feature in the considered set of trials. When the strength of communication about S between X and Y varies from one feature value to another, this overestimation may become even more severe, because in this case additional information about S is encoded synergistically within the network of X ad Y by their feature-dependent relationship [3
SM1.6 Numerical computation of FIT and other information quantities
FTT and all other information theoretic quantities were computed from both simulated and real data by plugging into the corresponding equations the numerical evaluation of the response probabilities from the data. We computed the response probabilities by discretizing neural activity into a number R of equipopulated bins 22 and then computing empirically the frequency of occurrence of each binned response across available trials.
In Table ST we summarize the number of bins we used to discretize neural activity for each figure in the paper. In Section [SM..5 we study the accuracy of the FIT and TE estimates with the number of available trials and we show that the estimates of FIT and TE are accurate and unbiased for the number of bins and number of trials used for all analyses. However, in the code we provide to compute FIT and TE, we also implemented limited-sampling bias correction routines that can be used obtain more accurate estimates when data are more scarce (see Section SM2.5).
Number of bins
2
3
4
Fig.3
Fig.2A.B.E
Fig.S8
Fig.S3
Fig.2C
Fig.S9
Sig.
Fig.4
Fig.S11
Fig.S5
Figures
Fig.S10
Fig.S12B
Fig.S7
Fig.S12A
Fig.S13B
Fig.S13A
Fig.S15C
Fig.$14B
Fig.S14A
Fig.S15D-E
Fig.S15A-B
Table S1: Number of bins used to discretize neural activity for information-theorett analyses of simulated and real data, for each main text and SM figure
SM1.7 Permutation-bart non-parametric null hypotheses for FIT and TE
To test for significance of the information theoretic quantities, used non-parametric permutation tests, described below.
To test for the significance of mutual information values about the feature of interest, we used established non- pon-aaramaettiic procedures 88 12 19 We constructed surrogate datasets in which we destroyed any feature information by randomly permuting across trials the values of S, and then we recomputed information on the surrogate data obtain null-hypothesis distribution of null
information values.
To test for the significance of FIT, developed permutation test in which created surrogate data in which we preserve the feature information in the past of X and the present Y while destroying the communication of this information between X and Y. We shuffled X within trials with the same value of the feature S, destroying any within-trial statistical relationship between the activity of X and the activity of Y fixed values of S, and recomputed FIT on the surrogate data. This data shuffling preserves the marginal distributions between the feature and the past activity of X and between the stimulus and the present activity of Y, thereby preserving the information about the stimulus that each carries. However, it destroys the within- trial statistical relationship at fixed stimulus between X and Y that would be present X sends stimulus information to Y. Because FIT depends on P(X past; Ypres) (see mathematical proof in Section (MtiionSSMM.. SM1.3.44, the values of FIT on the permuted data will smaller than the ones on the original data whenever there is direct within-trial communication of stimulus information between X and Y, but will be similar to the value of the original data when
14

---

there is no such direct within-trial communication. As shown by numerical simulations (see Section 6M2.6) the so generated null hypothesis distribution of FIT values when X and Y encode but do not communicate stimulus feature information is more conservative (see Fig. (SC)) than the simpler one that would be obtained by a permutation test destroying all information about S in X and Y by randomly permuting S across all trials, as for the mutual information quantities above. (This permutation test would implement the idea that no stimulus-featee be transmitted). However, in limiting cases in which the stimulus information in the neural data is absent, we found it numerically better to perform this second random permutation of the label of S across trials (because more possible independent data permutation permutation, which therefore may have some advantages in the case of zero or negligible stimulus information, see Fig. (S To reduce the probability of false positives in such cases of no information present in the network, we computed and then intersected the two above describe possible permuted distributions by taking the element-wise maximum between the two distributions, and obtained a null distribution for FIT. (In practice, in real data and simulations with stimulus information present, the maximum of the two permuted values coincided in all simulations with the maximum of the first permutation. This is exemplified in Fig. SS7C. in which for higher value of the parameter Wzy some information about the stimulus is created in both X and Y in absence of communication between X and Y. the null hypothesis for FIT taking the maximum between the first and second permutation has values not only larger than the FIT value measures in the simulation, but also much larger values then the ones based on only shuffling S. In simulations with null information, the maximum value of the permuted data in each simulation could instead belong to either permutation.)
information is present, it cannot
available in this second
An identical procedure was applied to test for the significance of DFL. For TE, since by design the measure captures the total amount of information flowing from X to Y, we permuted the neural activity of the sender X across all trials.
Since in all simulations and real data analyses we wanted to test for the significance of the infor- mation values averaged either across simulations or participants, we computed the average over simulations and participants of the information values in each realization of the random permutation and we used this distribution of null hypothesis of averaged values for testing the significance of the averaged information value. (To compute the null-hypothesis distribution, generated 500 different realizations of the permuted average information for each test we conducted.)
In some analyses (e.g. Fig. 3C and 4B,C) we had to identify the cluster of post-stimulus times and transmission delays for which FIT or TE were significantly different from zero (shown, e.g., in Figs. A.).. We individuated these clusters of points in the time-delay space using cluster-based permutation test [24; 8l using as null hypothesis values those obtained from the permutation test described above. We computed the cluster forming threshold as the 99th percentile of information values in the surrogate data. We created information clusters in the original and shuffled datasets by summing together all adjacent information values above the cluster forming threshold. We then determined a null distribution for information clusters using the maximum cluster value from each shuffled dataset. Finally, we assigned significance to clusters in the original dataset if their value was larger than the 99th percentile of the clusters null distribution (p < 0.01).
SM2 Details of simulations and and additional analyses of simulated data
SM2.1
Simulations of FIT and TE as a function of signal and noise transmission
This section pertains to the description of Fig. 2A-B of the main text.
The goal of the first simulation (whose results are reported in Fig. 2A) was to evaluate the dependence of FIT and TE on Himmllu--eature-rellee and -unrelated transmission. The goal of the second simulation (whose results are reported Fig. 2B) was to test the ability of FIT and TE to localize in time the dimmulus-eaatur--ellaa identical and is described in the following.
information transmission. The setting of both simulations was
We simulated 500ms of activity of activity of X and Y, in time steps of 10ms. The sending region X encoded stimulus 5 over time and transmitted receiver Y with a given temporal lag 8. The stimulus feature S being encoded by X and transmitted to Y was an integer (between and 4) drawn independently and uniformly in each trial (500 trials per stimulus for each of the 50 simulations). The activity of the sender was two-dimensional
featrerree and -unrelated activity to the
15

---

Xatim and one cnttuurr-uuiiffomaiiiie component Noosee The variable with one dimension had a camporally-localizee feature-dependent bump in the cettluus-eaatu-inffrrmne activity (from 200 to 250ms) and multiplicative Gaussian noise
X (t) = S(t) + (00 Tatim))
(S39)
where S(t) was a function equal to the value of the stimulus E [1, 4] during the time window [200, 250Jms and was zero outside of this window, The presence of noise in (t) stim was needed to test for the impact of within-trial encoding of S in X on the within-trial encoding of S in Y, at fixed values of S (i.e., when X encodes S incorrectly, also Y encodes S in a similar way). If X() stim encoded the stimulus perfectly (no noise in X X(f)stsm therefore X (t) = 5 for t E [200. 250 ms). receiving stimulus information from X or directly
it would be impossible determine whether from S. We choose the noise in the stimulus-fcature ceature-informatvv dimension to be multiplicative because it made it more challenging scenario for FIT. In fact using multiplicative noise X developed a siiuulus-deeendee leads to stimulus- dependdent within-trial correlations between X and Y. which potentially induces synergies in the encoding of S in X and Y 30) Since FIT computes information transmission by identifying a component of redundant information between the past of X and the present of Y, using simulations that have both redundancy between X and Y induced by information transmission and synergy between X and Y induced by stimulus-dependent amount of noise encoded and transmitted (using this kind of multiplicative noise), makes it potentially harder for measure of reature-specifer information transmission to separate out the redundant information that was transmitted. In fact, we will see that measures that do not separate well redundancy and synergy, such DFI, will suffer under such conditions (leading to negative values of transmitted information (Fig. [SIJA), whereas FIT seems work well even under this condition because it uses PID) to only include redundant time-lagged information about S in X and Y, discarding synergy. (However, we found similar results for TE and FIT by replacing the multiplicative noise with additive noise in Eq. [S39 (Fig. (3) The stimulus-feature-nnrelh (()nnisse = (0, o). The activity of the receiver Y was the weighted sum of Xstim and Xnoise with a delay 6. plus a Gaussian noise: (1) = Wstim Xstim (1 6) + W Wwnnise-Xooii.. (t- 5) + (O o). The delay 6 was chosen randomly in each repetition from a uniform distribution in the range between 40ms and 60ms, in steps of 10ms. Therefore, across repetitions of the simulation, Y received information from X only in the time window [240, 310mms. In all simulations we set a standard deviation α = 2 for the additive Gaussian noise in Xnoise and Y, and a standard deviation Jstim = a/5 0.4 for the multiplicative Gaussian noise in Xstim-
noise in the encoding of S. The stimulus-dependen noise in the encoding of S
component was, at any time point, a zero-mean Gaussian noise
In the first simulation, we computed FIT and TE at the first time instant in which Y received information from X (t = 200ms + 5), and at the ground truth delay 8, for all combinations of W stim and W Wosise in the range between 0 and I, in steps of 1. In the second simulation we set Wstin = 0.5 and W Wnoise- = 1 and computed FIT and TE at all time points, in a rage of communication delays between and 100ms, and averaged their values over delays to obtain temporal profiles of transmitted information.
SM2.2 FIT can detect feature specific information flow even with overlapping time courses of stimulus information
This section pertains to the description of Fig, 2C-E of the main text.
One often used method infer hierarchical flow of information across ares is to consider the timing of neural activation or of stimulus selectivity of activity across brain regions (32] However, this method neither necessary nor sufficient determine real communication. On the one hand time lagged information selectivity between two regions may arise in absence of communication for example if the two regions received a partly shared input signal with a different delay (see also Section (SM4.3) On the other hand, as we will exemplify in this section, real Seatures-Speciffr communication between two brain regions could take place even without detectable differences timing of information across the considered regions. The purpose of this subsection is to illustrate that this can happen and also to show that in such case FIT has power to discriminate between cases in which feature-specific information flow does or does not take place. We will show that this is because FIT can assess that in cases of real communication the format of information encoding the same in the past activity of the sender and in the present activity of the receiver.
16

---

W
A
S
X
Y
B
Temporal localization of stimutus-relatted transmission
FIT
TE
Whoise
FIT
bits
0.02
points Ground truth time
D114
stim. transfer
100
200
300
400
Wa
011
time [ms]
0.5
0.5
TE
0.2
0
0
W
0.6
200
time [ms]
300
Figure S3: Further tests of FIT on simulated data with additive noise in X. This figure is similar to Fig. 2 of the main text except that the results are obtained with additive (rather than multiplicative) noise in X. (A) FIT and TE as function of Siimlus-feature-relle
(Watim) and -unrelated noiss) transmission strength. * indicate significant values (p 0.01, permutation test) for the considered parameter set. (B) Dynamics of FIT and TE in a simulation with time-localized stimulus-feature- information transmission. The red area shows the window of simulus-feature-relln
information transfer. Yellow dots show time points with significant information (p < 0.01, permutation test).
Results plot mean (lines) and SEM (shaded area) across 50 simulations (2000 trials each).
We simulated scenario where a sending regions encodes and transmits receiving region Y information about an integer stimulus-fcature S (ranging between I and 4). Importantly, the past of Y and the present of X carry the same amount of feature information of the past of and the present of Y, but encode the information with different formats.
The feature encoding format of each region determined by the encoding function f(S) controlling the average response of each region to individual stimulus values = [1, 3, 4). We simulated responses with three different encoding functions:
Si(S) + 800,
f2(5) = + 8[1, 0,2,3
(S40)
Ja(S) + 1,3,2)
where 8 is a parameter controlling the separation of the average responses to different stimuli, and therefore the amount of feature information carried by each region a specific time point. We set 8 = 1 in all simulations. The three encoding functions (S), fz()). fS(S) are depicted in Fig.2C in blue, green and red, respectively. The encoding function determined the feature values that each region preferentially encodes at each specific time point. Specifically, due to the presence of additive Gaussian noise, regions were most informative (according to Eq. SSO) about stimulus values for which the response was either minimum (i.e. equal to in eq. S40 or maximum (i.e. equal to 1 + 35 in eq. (S40). Indeed, activity distributions response to these stimulus values were less overlapped with activity in response to other stimuli. For example, regions encoding the stimulus as (S) would carry high specific information about stimulus values 1 and 4, and low specific information about stimulus values 2 and 3. On the other hand, regions encoding the stimulus as f2(S) would carry high specific information about stimulus values 2 and 4, and low specific information about stimulus values I and 3. Therefore, since the min measure quantifies redundancy as the overlap in the distributions of specific information across individual values of target variable, the responses of two regions X and Y would be maximally redundant if they encoded the feature with the same encoding format (e.g.. (S) = (S) = (i)). partially redundant if they both carried high specific information about one stimulus value (e.g.. (S) (S) and (S) == fz(S)) minimally redundant if they carried high specific information about different pairs of stimulus values (e.g.. fx = fz( and (S) fz(S)).
In our simulation, X and activity at different time points was described by the following set of equations:
17

---

xpast = fi(S) + Fr
Y Ypres X past
(S41)
past = f2((5) + Eg
X press (5( Fiz
where E,, E2, and E& are additive Gaussian noise with standard deviation equal to σ. Importantly, real feature transfer only occurs in the X + Y direction, causing the past of the sender and the present of the receiver to encode the feature with the same format. Since a was equal for all noise terms eq. S41 both X and Y carried the same amount of stimulus-feature information the past and in the present, removing any contribution to FIT due to time-lagged information levels in the sender and the receiver region. We measured FIT the two directions (X Y and Y - X) for different levels of noise a. By changing 0, we controlled the SN R 8/o in both past and present activity X and Y. We repeated the simulation 100 times for each S R value ranging between 0.05 and I with precision of 0.05. We measured the FIT significance in the two directions using the permutation test described section SMM.7
We found that, because FIT could correctly detect that the format of information representation of S in the present of was equal that of the past of but different to that of the past of Y (Fig.2D), and that feature information flowed from X to Y (Fig.2E).
SM2.3 Simultaneous transfer of information about more than one feature
We performed simulated study of how FIT performs when studying neural system that encode and transmit more than one feature (Fig. S4).
We simulated two independent features (e.g. of sensory stimulus) S1,S2 simultaneously encoded in a brain region X and transmitted to a brain region Y. In the simulation, S1 is more strongly and encoded and transmitted than S2. The equation for simulating the data are as follows:
x= + DS2 + E..
(S42)
where S1, S2 are independent binary variables (values equal to +1), Fg is Gaussian noise with standard deviation equal to and Y equals X with time lag, plus independent Gaussian noise with standard deviation equal to 1.
We simulated the system with different values of D (the strength of encoding and transmission of S2 relative to S1). We found (Fig. (5) that FIT identifies correctly that both features are transmitted, and ranks correctly the features about which most information is transmitted. FIT also identified correctly the limiting case (D 1) in which both features are encoded and transmitted with equal strength.
Simult. features transfer
0.5
FIT
S1
FIT
FIT,
[bits]
0
0
0.2
0.4
0.6
0.8 1
D
Figure $4: Simulation of system that encodes independently two features S1 and S2 in the activity
of brain region X and transmits them to another brain region Y. We compute FIT about each the
two stimulus features $1, S2 or their combination S (S1, S2) function of the parameter D describing the strength of encoding and transmission S2 with respect to Sr. We plot mean + SEM over 50 simulations
18

---

SM2.4 Simulations of bidirectional transmission between X and Y
Here we describe the simulations whose results are presented in Fig. S5
To further investigate the ability of FIT to determine the direction of stimulus-feature information flow, simulated scenario with bidirectional (back and forth) communication between X and Y with stimulus-featun feature-related transfer from X and stimulus-eeauur--unrlaedd transfer from Y to X (Fig. (5AA).
In brief, both X and Y received information directly from a feature-information-sennd The region X received stimulus information from S early on (between 50 and 90 ms) and Y received stimulus information from S at a later time (between 110 and 150 ms). X sent its entire activity to Y (therefore communicating its stimulus information when it became available). Y instead only sent to Y a part of its activity that did not carry stimulus information. The details of how this was achieved reported below.
region S.
We simulated 180ms of activity of X and Y. in steps of Ims. The stimulus feature S being encoded and transmitted from stimulus region S to X and Y was an integer (between 0 and 3) drawn independently and uniformly in each trial. The activity of X was one-dimensional. The activity of Y was two-dimensional. Both dimensions of Y (Y+ and Y-) were generated with Poisson process whose mean was modulated over time by a Gaussian bump (whose amplitude was equal to the stimulus- feature value S) in the time window [110, 150 plus an additive Gaussian noise and time- time-lagged readout of X activity (with a X to Y transmission delay 6zy- 10ms). Importantly, Y+ encoded the stimulus positive Gaussian bump and Y- encoded the stimulus negative Gaussian bump. Therefore, the entire activity of Y, i.e. the sum of the two components, Ynoise = Y- + Y- carried information about the stimulus, and the difference of the two components sttim =Y+-V, carried all the stimulus information in Y. X was a Poisson process whose mean was positively modulated over time by Gaussian bump- whose amplitude the time window [50, m0] plus an additive Gaussian noise and time-lagged readout of the entire activity of Y Y Ynoise (with a Y to X transmission delay 6gm 15ms).
modulated by the stimulus in
We measured FIT at each time step of the simulation over a range of communication delays and averaged the resulting information values over delays to obtain temporal profiles of information transmission. We found that FIT correctly captured the flow of information about between X and Y that put by design into these simulated data. FIT revealed that there was a significant dhimulas-eeauur--rlateee information transmission from X to Y, that was temporally localized in the actual gground-truth"" [60, 100]ms window in which Y received stimulus information, and no significant stimulus-feature feeture-informattinn transmitted from Y to X (Fig. B)
We also used these simulations to test the performance of the Directed Feature Information, DFI [7 using the same analysis pipeline described here for FIT. Results are discussed in Section SM4.2
SM2.5 Limited-sampling bias of FIT and TE
Information -eformation-thhooetiic quantities are know to suffer from systematic error (called limited sampling bias) when the probabilities used to compute them are estimated from a limited number of experi- mental trials (26). While the limited bias of Shannon information quantities such TE have been studied well and has been shown to be inversely proportional to the number of available trials and directly proportional to the number of bins used to discretize the data [? J. those of FIT remain to be investigated.
Therefore here we simulated simple scenario study how FIT and TE scale with the number of trials available in the dataset and the number of bins of the discretized activity. In these simulations X encoded binary feature S with additive Gaussian noise. Y was equal to X with time lag of I plus independent Gaussian noise (standard deviation of noise = 0.5).
We found (Fig. Sop that FIT behaved much better than TE with the data size and number of bins. The correct value of FIT, which can be estimated from large numbers of trials, was achieved already with smaller number of trials than for TE. We found that accurate calculations of FIT are possible with the number of trials available in empirical datasets (Fig. (6): for comparison FIT calculations with real and simulated data in this paper were done with 2-4 discretization bins, see Table (SI). Our understanding is that the better scaling and sampling properties of FIT with respect to Shannon Information quantities arise because FIT considers PID part of the total information which has
19

---

A
Bidirectional
B
FIT
C
DFI
transfer
X x10
10
0
X
(biss)
(bits)
S
0
-1.5
stimulus transfer noise transfer
50
100
150
50
100
150
x x10
Sig. points
x 10
Y Y-X
2
(bits)
(bits)
1.5
50
100
150
50
100 150
Time (ms)
Time (ms)
Figure S5: Simulations of performance FIT and other measures in a case transfer of stimulus- feature-related and stimulus-unrelated information in different directions. (A) Schematic of the simulation. A stimulus node S provides partly complementary information about stimulus feature to X (in the 50-90ms interval) and Y (in the 1 100-550ms interval). X transmits stimulus information to Y. Y instead has different components of activity and it projects to X only the component of its activity that is from X to Y and noise transfer from Y to X). (B) Results of the analyses of this simulated activity using FIT (left panels) and DFI (right panels). Gray lines plot the value of these quantities Yellow dots plot time points in which the measure was significantly different from null (permutation test of Section SMI.7 p<0.01)
In other words, we have
transfer
lesser bias compared to other parts of the total information. Given that the PID atoms FIT do not contain synergistic terms, this is in line with previous work (25) showing that synergistic components of information have much larger limited sampling bias, and that information quantities that do not include synergistic components have much better sampling properties than full multivariate Shannon information quantities. Thus, FIT can be computed from the datasets which Shannon information measures typically applied to neural data. We applied widely used bias correction technique, called the Quadratic Extrapolation 37 [26]. This method is based on subtracting the bias estimated from second-order polynomial fitting of the dependence of the estimated quantity on sub-samples of the available data. We found (Fig. (S6) that this bias subtraction technique was helpful in further improving the estimate of information (reducing the limited sampling bias) in cases of very low numbers of trials available. This bias correction technique is made available in the software we provide for both FIT and TE.
SM2.6 Simulation tests of the significance of FIT and cFTT
In this Section describe the simulations and results presented in Fig. S7
In this set of simulations, we first evaluated the effectiveness of the permutation-bn based non non-paramttric tests for FIT in difficult scenario in which X and Y independently encode stimulus-feature information with a temporal lag, but no actual communication occurs between them. We then evaluated the performance of cFIT in measuring the unique contribution of X in sending feature information to Y in presence of an alternative information route through a third node Z sending information to Y.
We addressed both questions using a the following simulation setup. We performed a simulation in which two senders (X and Z) both transmitted stimulus-feature information to Y (Fig. SSB)). X encoded the stimulus-feature linearly and non-linearly so that they carried partially different information about S. This is important because good measure quantifying the unique contribution of (but not 7) the transmission of information Y should capture that, even if the total amount of feature information transmitted from Z to Y is stronger than the one transmitted from X to
20

---

2 bins
3 bins
4 bins
8 bins
0.6
0.6
TE QE
TE plugin
0.6
[bits]
MEG Splkes
FIT plugin
EEG
Sim.
QE
500
1000
1500
2000
500
1000
1500
2000
500
1000
1500
2000
500
1000
1500
2000
num. trials
num. trials
num. trials
num. trials
Figure $6: FIT and TE as function of the number of simulated trials used to compute them. Vertical lines: number of trials used for the analyses of real and simulated brain data in this paper. "Plugin": plugging empirical probability histograms into FIT, TE eqs. "QE": adding Quadratic Extrapolation bias correction. For all analyses in the rest of the paper we used 2-4 discretization bins (see Table TTb Results in each panel ploted mean + SEM over 100 simulations
Y, there can still be a different component of information that is uniquely transmitted by X and not by Z. We simulated 500ms of activity, in time steps of 10ms. The encoded and transmitted stimulus feature S was a stimulus-intensity integer value (0 to 3) drawn independently and uniformly in each trial (500 trials per stimulus). The activity of X had a temporally-localizee square bump between 200 to 250ms whose amplitude depended linearly on S, with multiplicative Gaussian noise. Activity of Z had a temporally-localle localized square bump (from 200 to 250ms) encoded with a different format with respect to X, and multiplicative Gaussian noise. Specifically, X encoded the stimulus feature = (0, 1, 2, 3) with the encoding function while encoded 5 with the encoding function S = (1, 2). In this way, X carries more specific information than Z (see eq sq() about S = 0,3 and Z carries more specific information than X about = 1, 2, therefore both X and Z carry some unique information about S. Activity of Y was the weighted sum of X and Z with a temporal lag, plus additive Gaussian noise: Y (t) = W Xt - 8) + 2 transmission of information from X to Y was chosen in each repetition of the simulation randomly from a uniform distribution in the range between 40ms and 60ms. We computed FIT and cFIT at the first time instant in which information in Y was received from X and Z (t 200ms + 8) using to define past activity the ground-truth delay actually used in that simulation. We set a standard deviation 2 for the additive Gaussian noise in Y, and a standard deviation 2stim o/5 0.4 for the multiplicative Gaussian noise in X and Z.
Z( (t - 8) + (0 o). The delay in the
SM2.6.1
Tests of significance of FIT accounting for the possible existence of encoded feature information in the absence of transfer of it across regions
We first addressed the first question, that is how to deal with confounding scenarios where X and Y independently encode feature information with temporal lag, but no actual communication occurs between them.
We studied how the FIT from X to Y depended on the strength of feature-related transmission from Z to Y Way when no citmullu-faauur--nfoomattee
was transmitted from X to Y (Way = 0). We found that FIT from X to Y increased with W.y. since X and Y carried redundant information about S with a temporal lag. However, FIT was always oonniignit (Fig. S7C) using the permutation test described in Section (MM17 since there were no within-trial correlations between the encoding of S in X and the time-lagged encoding of Y. This proves that, even Z was not measured, the permutation test we provided for FIT can correctly rule out confounding scenarios where X and Y encode S with a temporal lag but with no actual communication occurring between X and Y (see
Section SML.7 and SM2.6).
21

---

SM2.6.2 Simulations testing cFIT in the presence of information transfer through an alternative route involving a third region Z
We next addressed the second question, that is how to evaluate the unique contribution of X in sending feature information to Y in presence of an alternative information route through a third node Z sending information to Y. We studied how FIT from X to Y and cFIT from X to Y conditioned on the feature information in Z depended on the simultaneous transmission of feature information from X to Y and from Z to Y. To do this, we computed FIT and cFTT for all combinations of Way and way in the range between 0 and I, in steps of 0.1. We found that FIT grew both as a function of Way and of Way and was significant as soon as some information was transmitted from X to Y (Wa,) my 0; Fig. I57D, left). On the contrary, cFIT increased only as a function of Way and decreased with W zy. correctly removing from the FIT from X to Y the feature information that was routed to Y through Z (Fig. (sp. right). Crucially, cFIT did not simply subtract from FIT through X the FIT through Z. but it only removed the amount of feature information that was redundantly transmitted by X and by Z to Y. Indeed, since X and Z transmitted partially different feature information to Y, we have that cFIT was still significant for many combinations of parameters where Wa, > Way (Fig. S right) and, therefore, FIT through X was larger than FTT through (not shown).
SM2.7 Simulation studies of how FIT and TE are affected by the mixing of sources
In real electrophysiological recordings, it is possible that that separation and reconstruction of the underlying neural sources is imperfect, due issues such for example field spread common referencing. As a result, electrophysiological recordings from different brain regions may contain, with different weights, mixture of sources. It has been proposed that such source mixing may affect measures of communication between brain areas [I. Here, we examine the effect of this source mixing in FIT and TE measures.
We simulated source mixing in different proportions in the sender X and the receiver Y. In our simulations we assumed that (as it is expected to be the case in real brain data) the mixing is instantaneous (i.c. sources are mixed with zero lag) and with a proportion of source sharing in X.Y that is stable across time.
We first simulated a "null model" scenario in which source Z (informative about stimulus feature S) is shared between X and Y with a different proportion A:
X = ((s) + Ex Y AZ(s) Eyy
(S43)
with Ev., E. being independent Gaussian noise. The stimulus feature S' was a binary value extracted independently in each trial. The source Z encoded the feature with additive Gaussian noise. The amount of stimulus-feature information encoded in Z increased linearly over time. We controlled the SNR of X and Y by changing A (which sets the relative level of stimulus-feature signal in X,Y) and fixing noise standard deviation to 1. On this model FIT and TE had spurious positive values (Fig. S8 ). We used the permutation test introduced in Section SMI.7] testing for spurious values induced by X,Y covariations due to feature-signa sharing. We found that this test correctly ruled out as non- signifiiia FIT and TE values generated only by source sharing with no real transmission (Fig. 3) Importantly, analysis of this model also showed that with instantaneous source mixing (and notably under the assumption that recording noise is constant over the time of the trial) the ratio between drimulus-feature info in X and Y is constant in time (Fig. (8A). This gives a useful heuristic: while the finding that the feature information time courses of two individual regions that overlap in time cannot be used to rule in out communication of information about the feature between the two areas (see SM2.2 and Fig 2D-E), different timecourses of stimulus-featuus info in X vs Y cannot be easily explained by instantancous source mixing. We measured all real-data FIT in cases with delay in stimulus- feature info latencies between X and Y (X to Y info latencies: MEG: 17-35ms between VI and higher areas, Fig. S.B. EEG: 25ms across hemispheres (Fig 4B). Spike data: 20ms from thalamus to cortex, Fig. SiIj. Overall, these findings speaks against dominant mixing of a feature-informative source in our analyses.
Finally, we simulated the case with real FIT between two "pure" signals Z and Zz that are unevenly mixed in the measured X.Y:
22

---

A
Definition of cFIT
B
Parallel information transfer scenario
Target S
FIT,
FIT,
X
FITx
FITz
WxY
dFIT
S
Z
cFITxz
YOYUP3
War
E
No transfer from X to Y (W,= 0)
FIT and cFIT dependence on W XY
and
FIT null distributions in absence of stimulus info
FIT from X
ZY
0.06
Measured
FIT
CFIT
Measured
0.04
Mex null
S-shuff null
0.26
0.5
0.08
Number of samples
200
S-ahuff nut
S S-fxxd nul
bils
0.4
100
0.02
0.1
0.26
0.02
0.5 W,y
0.2 0.4
0.6
0.2
11
FIT value (bits)
Figure S7: Simulation tests of the significance of FIT and cFTT. (A) Schematic of the cFTT definition. Left: intuitive definition with set-theoretic diagrams. Right: breakdown of FITx (in red) and FITz (in light blue) into finer information atoms considered in the definition of ef cFITxx/ (atom that can be part of cF FITTxzz are indicated in yellow). Only atoms of FITx. FITz and cf cF1Txx x belonging to the PID having S as target variable are shown. FITx is the feature information transmitted from X to Y, FITz is the one transmitted from Z to Y. cF information of Z. (B) Schematic of the scenario implemented in the simulations: both X and Z transmit feature information to Y. (C) FIT dependence on the amount of stimulus- feature information transmitted from Z to Y (W WyY even when simulating a case (WxY = 0) in which there is always non significant using the permutation null hypothesis described in Section SM1.7 The dashed green line shows the 99th percentile of the FIT null hypothesis distribution described in Section SM1.7 For comparison, the dashed gray line shows the 99th percentile of the null-hypothesis distribution that would have been obtained simply shuffling S across all trials. The fact that the latter remains so low across all values of Wey highlights the need of using a shuffling procedure that preserves the stimulus-feet feature information described in Section SMI.7 (D) FIT and cFIT as function of fcature-related transmission from X to Y (Wxy) and from Z to Y (Wzy). * indicate significant values (p- < 0.01, permutation test) for the considered parameter set. In Panels C.D, results plot mean across 50 simulations (2000 trials each). (E) Example of shuffled distributions in a case in which there is not stimulus-feane
is the cFIT from X to Y conditioned on
the
within triain transmission from X to Y. FIT grows with WZY, but its value
the individual nodes, as we did in this paper and
information in Y. While the null hypothesis values of permuting X at fixed S give much more conservative and effective null hypothesis values when the analyzed network has stimulus-feature information across the nodes (see panel C), in specific cases of no feature information in parts of the network it may be safer to consider also the permutation of S across trials, as this has more available independent permutations form the data and thus gives wider distributions. The example is with the simulations performed in Fig. 2A, for the set of parameters (W Wrssm- = 0, W Wnoise 0.6).
X = Zi + AZ₂ + E,
(S44)
y Zz + B7 + Fy
channel (Z₁ to Y and Zg to X) increases the stimulus-featur information in X.Y, we set the standard deviation of independent Gaussian noise E,.Ey to equalize SNR of X and Y across the simulated parameters space. We found (Fig. (Tgg that mixing (A, 0)
Since adding new
reduced FIT and TE compared to the pure case (A = B 0). However, the correct direction of information transfer was always detected for all mixtures. Thus, FIT reasonably conservative and robust this mixing.
23

---

One shared source
Two shared communicating sources
B
C
(S over time 0.15
FIT eeth
FIT messured
FIT(X->Y)
TE(X->Y)
FIT(Y->X)
TE(Y->X)
measured
0.15
0.4
pro
Mixed source
Real communication
0.2
0.4
0.6
0.8
B
10
B 0
B
B
Figure S8: Simulated tests of FIT and TE in the presence of source mixing. A-B: results of the null model with unequal sharing of one feature-informative source Z. (A) Proportion of stimulus-feature info with only the null model (blue line, described in SM2.7 and eq. (S4) and with real transmission of feature information X + Y added to (red line). (B) FIT and TE of null model (solid lines; see eq. S43) fall below the permutation's 's test 99th percentile (dashed lines) for any proportion of sharing A. (C) FIT and TE computed from model with two stimulus-feature informative sources Z1, Z2 communicating Z1 + Zy and mixed into X and Y, vs mixing proportions A, B in X and Y (see eq.
S44
All panels plot results averaged over 50 simulations.
SM3
Details and further analyses of experimental data
SM3.1
MEG data
SM3.1.1
Behavioral task and MEG recordings
We analyzed publicly available MEG dataset 339 with cource-reconstruuted data available at hhttps://doi.oom /rgg:///oooog/////oo 10.6084/m9 10.soae//f..igsharee (esshare.12770366) 12770366). Full details (including details of approval from responsible ethical review board) reported in the original publication and are briefly summarized here. The MEG data were recorded from 15 participants performing a visual contrast comparison making task. Each participant performed four experimental sessions with on average 429 trials per session. At the beginming of each trial. reference stimulus was shown. The reference stimulus was a circular, expanding or contracting (randomized across trials) grating with a fixed contrast of 50% and duration of 400 ms. The reference was followed by a test sequence made up of ten sample gratings (100ms duration each). The contrast of each sample in the sequence was drawn from Gaussian distribution, the mean of which was either larger or smaller than 50% (randomly selected per trial). At the end of each trial, participants reported whether the average contrast of the sample gratings was higher or lower than the reference contrast. A staircase procedure was used to adjust the mean the Gaussian distribution setting the average contrast of the 10 samples in each trial, by making decisions harder (mean of the Gaussian closer to 50%) casier (mean of the Gaussian further from 50%) depending on the behavioral performance of the participant until that moment in the experimental session. The staircase was set to obtain a behavioral performance of approximately 75% correct on each session. The Regions Of Interest (ROIs) in MEG source space used to identify signal from the considered brain areas were defined based on the atlas from Glasser and colleagues All ROIS were co- regissteed to individual structural Magnetic Resonance Imaging (MRI) data. Source reconstruction was performed using linearly constrained minimum variance (LCMV) beamforming, by combining leadfield matrices and data covariance matrices (CMs) into a spatial filter for each source position (i.e., vertex) that applied the sensor-level data to compute the source estimate. To this end, the leadfield matrices were computed from 3-layer boundary element head-modee (conductivity 0.3, 0.3, 0.006 S/m for scalp. brain, skull respectively) based on the individual structural MRIs. CMs were computed for the interval Os to 1.35s from stimulus onset from the pre-processes and artifact-cleaned [3) broadband MEG data (275x275 sensors) with a regularization of 5% of CM. The source space was constrained to the cortical sheet (4096 vertices per hemisphere), and source orientations were chosen to maximize the power at each vertex. To illustrate the spatial resolution of source reconstruction, in Fig. S we plotted the correlation between LCMV spatial filters of neighboring sources vs their distance, finding a very small correlation (< 0.02) at distances larger than 2.5cm (as expected from theoretical considerations [15). To compute FIT and TE, the time-frequent frequueu representation of sensor data was projected into source space and averaged over vertices within the ROI (80.20,10 vertices for V1, V3A, LO3, respectively). All FIT analyses
24

---

presented in this paper focused on three visual cortical ROIs that were all more than 2.8cm apart from one another (i.e., minimizing spatial filter leakage) and encoded large stimulus information: primary visual cortex (V1), area V3A (which carried maximal stimulus information in the "Dorsal Stream Visual Cortex" group [3). and area L.33 (which carried high stimulus information in the "MT+ and Neighboring Visual Areas" group 13
SM3.1.2 Parameters and details of the Information theoretic analyses
For the analysis of FIT and TE we used gamma-band instantaneous power obtained by computing the time-frequency representations of single-trial data via the multi-taper method and then averaging the obtained powers in the [40- 75] Hz band, exactly as described in the original publication [39]. To estimate the joint probability distributions of the neural activity and the stimulus (or the choice) used to compute the information theoretic quantities, we binned the MEG gamma power from each ROI into 2 equally populated bins and then computed empirically the frequency of occurrence of each response bin across all available trials. The stimulus features used for the information analyses was the average contrast of the 10 samples presented on each trial, discretized into two values. (We coded 0 the average contrast if was below the reference contrast and the average contrast if it was above the reference contrast). The choice feature used for the information analyses was the binary choice reported by the participant in each trial, with the choice "average contrast stronger than reference" coded as and the choice "average contrast weaker than reference" coded as O. We computed the information quantities for both the feedforward and the feedback direction for the left and the right hemisphere separately and then averaged the two.
Unless otherwise stated, we computed information quantities using all available trials (correct and еπгоr trials). For the specific set of information analyses comparing correct and error trials (Fig. 3G,H), we randomly subsampled correct trials so that the number of correct and error trials used to compute the information quantities was the same for each session. In this way, the information values for correct and error trials can be compared fairly because their difference cannot reflect possible differences in fimited-sappling biases due to different data numerosity [26].
SM3.1.3 Statistical analyses
We established significance of the information measures in the time-delay space using cluster-based nonparametric statistical test described in Section SMI.7 see [24
To provide quantification values of TE and FIT across participants, sessions and network links (Fig. 3D.F.H), we selected a rectangular region in the time-delay domain to select the TE and FIT values for the across sessions statistics, centered around the FIT significant cluster (FIT-specific region). We computed the average over delays and then picked the maximum over time within this region. This gave one single TE and one single FIT value for each hemisphere in each session. The comparisons of values across participants, subjects and links was performed using two-tailed paired t-tests.
SM3.1.4 Additional results
Here we list the results of a number of additional analyses that could not be inserted in the main text due to lack of space but that are helpful to better understand and support the conclusions presented in the main text.
The first set of results regards the encoding of information in individual regions of the visual network, rather than the transmission across regions of information about the stimulus. We reported temporal profiles of stimulus information in the three selected ROIs in Fig. 599.. Instantaneous information profiles showed a clear lag in the onset of stimulus information that could not be explained by instantancous source mixing (see Section (SM2.7) The amount of mutual information about the stimulus carried by the power of the gamma band in the visual cortical network is larger in the first half of the presentation of the stimulus ([0-500]mm peri-stimulus, denoted as 'early") than in second half of the presentation of the stimulus ([500-1000)ml peri-stimulus, denoted as 'late') within the trial (Fig. c left). This is why we concentrated the FIT analyses on the first part the trial (the early window). In the early part of the trial, the gamma band activity in the visual cortical network carries more stimulus than choice information (Fig. (S9C, middle) and this information is higher in correct compared to error trials (Fig. 59 right). These results are useful to confirm that stimulus
25

---

information coding is of more prominent importance in the visual network and that the presence of this information is key to perform accurate perceptual discriminations.
The second set of results regards additional findings about the transmission across regions of in- formation about the stimulus. We produced network representation showing the relative strength of individual TE and stimulus FIT links contributing to the observed differences in directionality (Fig. S9D, compare with Fig.3D) and feedforward behavioral relevance (Fig. S9E, compare with Fig.3E) of information transmission. We found no difference of FIT stimulus nor TE in the feedback direction between correct and error trials (Fig. S9F). For the example pair VI-V3A we identified a significant cluster of stimulus FIT feedforward (VI to V3A) but not feedback (V3A to V1) in the time-delay domain (Fig. [S9;; cluster statisties, p<0.01). These results suggest that feedforward propagation of stimulus information, but not feedback propagation, is specifically key for correct
behavior.
In the main text we indicated that the time delay region in which FTT about the stimulus was significant was the interval 200 400ms after the stimulus onset, with an inter-area communication delay between 65 and 250ms. This statement is supported by the plot in Fig. S9G of the time-delay map points that are significant according the cluster permutation test.
Finally, we performed a control analysis to quantify TE in a time-delay region around which TE
was maximal. This is of interest because in the main text analyses (Figure3E-H)
compared FIT
and TE using a time-delay region around the peak of FIT. The TE panel (Fig. (SH)) shows that TE peaks in different time-delay region with respect stimulus FIT (Fig. 3C). Taking DI-specific
box centered around the TE peak in time-delay to select information values we could not assess the direction nor the behavioral relevance of information transmission (Fig. (S9).
SM3.2
EEG data
SM3.2.1 Behavioral task and EEG recordings
We next analyzed a publicly available EEG dataset 31 Data are available at https::/datadryaa..rrg/// otgg/stsss//aatatst/ooo..
Full details (including details of approvals from Ethical Committees) are reported in the original publication. Here we summarize them briefly. The EEG data were recorded while participants (N=16) performed a face detection task. Participants were presented with an image hidden behind a bubble mask that was randomly generated in each trial. The presented image was image of a face in half of the trials and a random texture in the other half of the trials. Participants were instructed to report whether a face was present or not. In our analyses, we only considered correct trials where the face was correctly detected by the participants (approximately 1000 trials per subject). Following the recommendations of the original publications analysing these data [31 18], we excluded one participant from the analysis due to a poor EEG signal that did not contain significant eye visibility information in any of the electrodes. All analyses in our paper are based on the N=15 selected participants. EEGs were recorded by fitting participants with a Biosemi head cap comprising 128 EEG electrodes. EEG data were re-referenced offline to average reference, band-pass filtered between Hz and 30 Hz using fourth order Butterworth filter, down-sampled to 500 Hz sampling rate and baseline corrected using the average activity between 300ms pre-stimulus and stimulus presentation. ICA was performed to reduce blink and eye- movement artifacts, as implemented in the infomax algorithm from EEGLAB [0]. Components representing blinks and eye movements were identified by visual inspection of their topographies, time courses, and amplitude spectra.
SM3.2.2 Details of the information theoretic analyses and additional results
For the analyses of TE and FIT, we selected the EEG electrodes in the left and the right Occipito- Temporal regions that had the highest mutual information about the visibility of the contra-lateral eye, exactly as done in previous papers (18). (Specifically, in Ref. [88. the authors used the following criteria to select one electrode in LOT and one in ROT for each participant, see Fig. STT For LOT they selected the electrode with maximum right eye MI from electrodes on the radial axes of PO7, P7, and TP7, excluding midline Oz and neighboring O1 radial axes. On the right hemisphere, for ROT the author selected the EEG electrode with maximum left eye information from sensors on the radial axes of PO8, P8, TPS, excluding midline Oz and neighboring 02 radial axes). We computed the first derivatives of the EEG signal for both Occipito Oecipito-Temporal sensors and used both its absolute values
26

---

Comparison temporal peaks of info the visuai network
A
Spatial correlation
B
Sim early choice (early) Correct vs error (sart)
Stimulus info over time
0.05.
0.03.
0,012
V1
A.A
Cor.
[bts]
V3A
LO3
(bits)
0.02
i
0.02
1
0.04
i
0.01
0.01
0.02
0.1
0.2
Distance [om]
Time [s]
Early
Choice
Con
Etr
D
TE
E
TE
F
Feedback info transfer correct vs error
V1
V3A
LO3
V1
V3A
LO3
TE
1g
FIT
0.032
0.26
0.51
feedforward feedback
FITg
FITs
correct fwd fwd
(bits)
f
0.028
V1
V3A
L03
V1
V3A
* LO3
1
0.02
Corr
Err
Corr
Err
Significant FIT, time-delay maps
H
TE comparisons in a TE-specific box
TE
V3A
Diectionalty
Feadforward cor vs art
dakay
x10
0.01
VBA
(bits) delay [ms)
100
(b15)
0.77
500
(bits)
100
V3A -
800
I
200
0
200
400
Time [ms]
Fwd
Fbk
Carr
Time [ms)
0.01
0.025
Figure S9: Additional analyses of the MEG dataset. (A) Correlation between LCMV spatial filters of neighboring sources as a function of their distance. (B) Time course of stimulus information in each ROI (C) Properties of mutual information between stimulus and MEG activity. Left: Peak values of stimulus information over time in the first (early time window, from 0 to 500ms post-stimulus onset) and second half (late time window, 500 to 1000ms after stimulus onset) of the stimulus presentation window. Middle: Peak of stimulus and choice information carried by MEG gamma activity in the early window. Right: Peak of stimulus information values encoded by MEG gamma activity in the early window in correct and incorrect trials, respectively. (D) Graphs representing the strength of feedforward (yellow) and feedback (orange) information transmission in the network for TE (top) and stimulus FIT (bottom). Links are weighted proportionally to the communication strength between each pair. The arrows on the bottom points toward the dominant direction of overall transmission, and are weighted proportionally to the difference between feedforward and feedback transmission. (E) Same as D but for feedforward transmission in correct (green) vs error (gray) trials. (F) Values of TE (left) and of FIT about the stimulus (right) computed in the feedback direction separately in correct and in error trials. (G) Plot of the points with significant values of the stimulus FIT between VI and V3A (top) and V3A and V1 (bottom) according to cluster permutation test. Only points that are significant are colored. Color scale is the same as the Fig. 3C. (H) TE time-delay map in the V1 to V3A direction. (I) Values of TE using time-delay box centered around the TE peak in the time-delay map. In all panels, lines and image plots show averages and errorbars SEM across participants, experimental sessions and regions pairs (in case of FIT and TE) or regions (in case of mutual information). *: p<0.05, **. p<0.01, ***; p<0,001. All information-theore computed from power time courses of source-level MEG signals in the gamma-band (140-75)Hz)) first computed separately for left and right hemisphere and then averaged.
quantities were
and first derivatives to compute the information quantities, for consistency with the information- encoding analyses performed in a previous study [AS stimulus feature for the computation of mutual information and FIT, we used the visibility of an eye (defined as the fraction of pixels within the eye region that were not hidden by the bubble mask). This feature was discretized using 2 equipopulated bins. We computed the information quantities for all combinations of directionality of flow across hemispheres (left to right, right to left) and eye identity (left or right eye). We computed significance of FIT the time-delay using the cluster-based permutation test described Section SM1.7 This analysis revealed significant cluster of FIT about the left eye in the right-to-left
27

---

A
Significant LE FIT (ROT to LOT)
B
Significant RE FIT (LOT to ROT)
x10
delay (ms)
20
dalay (ms)
20
1.5
60
80
[bits)
100
100
0
100
200 Time (ms)
300
100
200 Time (ms)
300
Figure S10: (A) Plot of the points with significant values of the left-eye (LE) visibility FIT from the EEG of Right Occipito-Temporal (ROT) to Left Occipito-Tempone (LOT) electrodes, according to a cluster permutation test. Only points that are significant
colored. (B) Same A but for the Right- Eye (RE) visibility FIT from the EEG of Left Occipito-Tente TTmppral (LOT) to Right Occipito-Tenne -emppoal (ROT) electrodes. The color scale of panel A and B is the same the corresponding plots in Figure 3B and C, respectively.
direction (Fig, (STOA) and about the right eye in the left-to-right direction (Fig. (TgB). To provide a quantification values of TE and FIT across participants (Fig. 4D), we selected rectangular region in the time-delay domain to select the TE and FIT values for the across participants statistics, centered around the contra-lateral FIT significant cluster (same for both eyes, as they were significant in very similar time-delay regions). We computed the average over delays and then picked the maximum over time within this region. This gave one single TE and one single FIT value for each subjeet. The comparisons of values across participants was performed using two-tailed paired t-tests.
SM3.3
Analysis of spiking activity a thalamocortical network
SM3.3.1 Electrophsyyological experiments
We analysed previously published (5] recordings of multi-unit spiking activity simultancously ob- tained from electrodes placed in the primary visual cortex (VI), primary somatosensory cortex (S1), first-order visual thalamus (the lateral geniculate nucleus, LGN), and the first-order somatosensory thalamus (the ventral posteromedial nucleus, VPM) of anaesthetized rats (Fig. 3A). Data are made available with this NeurIPS submission Supplemental Material. Full details (including details of approvals from Ethical Committees and Local Authorities) are reported in the original publication. Here summarize them briefly.
These data were recorded from N=6 rats (using one-shank Silicon Michigan probes, Neuronexus Technologies; 100-pm intersite spacing) in three stimulation conditions: visual stimulation, whiskers tactile stimulation and bimodal stimulation (simultaneous visual and tactile). All experiments were conducted under urethane anesthesia. The visual stimuli consisted of light flash (50-ms-long LED light flashes at 300 lux). The unimodal somatosensory stimulus consisted of a whisker deflection. For bimodal stimulation, whisker deflection and light flashes were applied in the same hemifield. Stimuli were randomly presented across trials. In our analysis, we considered only stimulation contra- to the recorded brain areas. Each type of stimulus eye was covered with an aluminum foil patch. Neural activity was recorded at a sampling rate of 32 kHz, bandpass filtered (0.1 Hz and kHz) then down-sampled to 8 kHz. In the current work, used the recordings from infragranular layers of S1 and V1 and from VPM and L.N. Multi-unit spike times were first detected from the band-passed (400-3,000 Hz, fourth-order IIR Butterworth Filter) extracellular potential in each electrode by threshold crossing (>-3 SD). A spikes train was obtained for all channels using a temporal binning of 0. ms (1/8kHz). For each brain region, spiking activity was then pooled together using all recorded spikes form all electrodes related to that region.
presented 100 times. The non-stimulated
SM3.3.2 Parameters and details of the information analyses
To compute mutual information and FIT, we defined two different stimulus set of interest. To measure information related to tactile discrimination, we used a "aactilediiscrmminatve set" made of the unimodal visual and the bimodal visual-tactile stimulus (the two stimuii in the set are discriminated by the presence or absence of a tactile stimulus). Similarly, to measure information related to visual discrimination, we used a "visual-discriminatii set" made of unimodal tactile and the bimodal
28

---

visual-tactile stimulus (the two stimuli in the set are discriminated by the presence or absence of visual stimulus).
As stimulus feature for the computation of mutual information and FIT for the tactile (visual) discriminative set, we used binary value indicating either the delivery of visual (tactile) unimodal or a bimodal stimulation. We computed the information quantities for all combinations of directionality of flow across the visual (LGN VI and VI to LGN) and somatosensory (VPM SI and S1 to VPM) thalamo-cortica pathways and sümulus-discrimin quantification values of 'E and FIT across animals (Fig. S...E, we selected a rectangular region in the deeey domain to select the TE and FIT values for the across animals statistics, centered around the FIT peaks about the tactile stimulus in the VPM to SI direction (for the somatosensory pathway) and about the visual stimulus in the LGN to VI direction (for the visual pathway). We computed the average over delays and then picked the maximum over time within this region. This gave us one single TE and one single FIT value for each animal. The comparisons of values across animals was performed using two-tailed paired t-tests.
sets (visual or tactile). To provide a
A
FIT VPM-S1 pathway
C
FIT LGN-V1 pathway
VPM
LGN
Ubtate E off) X
0.005
Tactie, 51 0.002
tactline (on.off)
Tactle VPM
Vicol LON
visuel [0.1]
LGN
20
40
60
80
100
Time (ms)
Time (ms)
tachie [0.1]
D
Time-delay FIT maps
E
D Directionality
F
Content
Tactile set
Visual set
Tactie set
VPM
FIT VPM to S1
wender
TE
FIT
TE
FIT
002
50P
0.01
0.01
0.21
80
100
vmt.
Vit--677
St
Twotle
Visaa
Time (ms)
Time (ms)
G
H
Visual
FIT
TE
FIT LGN to V1
601
20
40
80
100
60
80
100
Lobort
LGK
Jn
Tootl
Houll
(me)
(me)
Figure S11: Sensory related info transfer carried by multi unit actity (MUA). (A) Schematic of the experimental setup. MUA was recorded in rats from the Ventral Posteromedial nucleus (VPM) of the thalamus, the Lateral Geniculate Nucleus (LGN) of the thalamus, the primary somatosensory (S1) and visual (V1) cortex simultaneously. During the recording either a unimodal tactile, a unimodal visual, bimodal (visual and tactile) stimulus was presented.
(B) FIT values averaged across delays for all combinations of transfer direction and stimulation type on the somatosensory pathway (VPM-S1). (C) Same B but for the visual pathway. (D) FIT from VPM to S1 (mean across subjects) for each value of delay and post-stimulus time. Line plots above and below show Mutual Information (MI) between the presented stimulus and the recorded MUA in the VPM and S1, respectively. Width of shaded errorbars show the SEM of the measure across subjects. The left panel reports values of information and FIT for the aectile-iisrimmnativv set, whereas the right panels report values of information and FIT about the visual stimulus set. (E) Directional sensitivity for TE (left) and FIT (right) between VPM and S1, for the Tactile stimulus-set. (F) Comparisons between tactile- and iisual-discrmminati set, for the TE (left) and the FIT (right) from VPM to S1. (G) Same as panel D but from LGN to V1. (H) Same as panel E but between LGN and VI, for the Visual stimulus-set. (I) Same as panel F but for TE and FIT from LGN to V1.
29

---

SM3.3.3 Further details about the information-theorde results
We first focused on the somatosensory pathway (VPM and SI). We found that, on this pathway, the tactile FIT in the VPM to S1 direction was visibly higher than the visual FIT in the same direction and both tactile and visual FIT in the S1 to VPM direction (Fig. (SIBB) We found that the timing of tactile FIT from VPM to S1 was consistent with the one of tactile information in neural activity, that was present in the 5-30ms and 15-30ms post-stimulut intervals in VPM and SI, respectively left, top and bottom lines). We found that FIT revealed the directionality of tactile information flow, which was significantly larger in the feedforward (VPM S1) compared to the feedback (S1 1 to VPM) direction (Fig. STTTE right, p 0.0065). On the contrary, TE computed for the tactile set was not significantly different in the two directions (Fig. STTE left, p p= 0.13). FIT also revealed the content of communication from VPM to SI, being significantly larger for the tactile set than for the visual set (Fig. E right; p = 0. 0.0084), while TE from VPM SI was not significantly different in the two directions (Fig. S left; p 0.12).
ISTI
Complementary results were found in the visual pathway (LGN and V1). On this pathway, the visual FIT in the LGN to V1 direction was visibly higher than the tactile FIT in the same direction and both tactile and visual FIT in the V1 to LGGN direction Prig(SSTCC FIT for the disriniiscri set in the LGN to V1 direction peaked in a time interval of approximately 45 to 65ms after stimulus-onset and with transfer delay of approximately 10-25ms Fig. STTG). The visual FIT values were larger in the feedforward than in the feedback direction (Fig. HH right; p 0.033), while TE was not sensitive the directionality of visual information (Fig. SI left; p 0.15). Moreover, visual FIT values were significantly larger than the tactile ones from LGN to V1 (Fig. (TT) right; p= 0.013), while TE did not capture these sensory mrodalit-sppecffe differences (Fig. [ST], left; == 0.4). Taken together, these results highlight the power of the FIT in revealing feature- and direction- specific transfers of information with high temporal precision, beyond what is achievable using methods that measure the total propagation of neural activity such as TE.
SM3.4 Applications of cFIT to real neural data
We tested the effectiveness of the conditional FIT (cFIT) in the analysis of neurophysiological data by applying it to perform further analyses on the EEG and the MUA datasets (Fig. S12). For simplicity, when computing cFIT from X to Y conditioned on the stimulus information of 2, we always considered the same communication delay (that is, the time difference between the present and past activity used to compute the information theoretic measures) for the past activity of the sender X and the past activity of the third region Z. However the definition of conditional FIT holds for an arbitrary representation of past. potentially including multiple time points or a communication delay that is different from the one of X Xpost-
We first applied cFIT to the EEG dataset. We investigated whether the contra-lateral Occipito- Temporal electrodes used to compute TE and FIT in Figure 4 where the sole senders of eye-specific information across hemispheres. We selected two different sets of putative alternative senders of eye-specific information and used cFIT remove the contribution of the putative alternative senders from the contra-lateral FIT that we measured. Namely, we selected the third location to be conditioned upon from either set of weak or set of strong alternative senders for both the left and for the right eye (Fig. (S13). For each participant, we defined the two weak alternative sender locations (one for the left an one for the right eye) as those electrodes carrying the lowest amount of stimulus information about the left or the right eye, respectively, in the frontal lobe of the brain. The expectation was that removing the contribution of these electrodes using cFTT would not change appreciably the results obtained with the contra-lateral unconditional FIT reported in Figure 4.
For each participant, we defined the strong alternative senders locations (one for the left an one for the right eyc) as those electrodes carrying the woronddllrgess amount of information about the left eye in ROT or about the right eye in LOT (ROT and LOT defined in Ref (T8). We found that FIT conditioned on the contra-lateral orange lines in Fig. (SI2A) did not reduce FIT, as the cFIT was virtually equal the unconditional FIT (the blue trends in Fig. STZA). However, FIT conditioned on the contra-lateree Iateral-aaaaa-eeee eye information of one of the strong alternative senders (the green trends in Fig. S12A) was lower than unconditional FIT. However, both cFIT given the weak and the strong alternative senders were significant (cluster statistics over time, p<0.01). The fact that cFTT was lower than FIT when conditioning on informative electrodes but not when conditioning weakly informative electrodes suggests that cFIT is effective
information of one of the weak alternative senders (the
30

---

at removing influences related to similar feature-specine (but not un-specific) information present already in the past activity other regions. The fact that the inter-hemisperic Eccipito-Tempone controlateral-ey--specfff cFI'T is still highly significant and is only marginally smaller than the original unconditional FTT suggests that most eye-specific information flows across hemispheres through the contra-lateral Decipito-Temporc electrodes selected in [18].
Next, we analyzed the spiking activity dataset. We examined vectie-diisrimminativ information flowing through the somatosensory pathway, and the visual-diseriminatiee information flowing though the visual pathway.
We first used cFIT to test whether the hactil-diierimminativ FIT from the somatosensory thalamus VPM to the somatosensory cortex SI could have actually been relayed through the visual thalamus LGN. The neurophysiological expectation is that all tactile-disermminatie information flows within the somatosensory pathway, without contributions from visual stations. Consistent with this expectation, we found that the soetileddicrimmiaaive cFIT from VPM to S1 conditioned on the visaul thalamus LGN was equal the unconditional vettil-diserminative FIT from VPM to S1.
We then used cFIT to test whether the visually-discrimintii FIT from the visual thalamus LGN to the visual cortex VI could have actually been relayed through the somatosensory thalamus. The neurophysiological expectation is that all visual distrimiiiii information flows within the visual pathway, without contributions from somatosensory stations. Consistent with this expectation, found that the visually- disually-discrime discriminative cFIT from LGN to V1 conditioned on the somatosensory thalamus VPM was equal unconditional risually-disrrmmnng
FIT from LGN to VI.
Together, these results suggest that cFTT useful to remove contributions from alternative pathways specifically with regard to the transmission of cature-specific information.
SM4 Comparison with other possible or previously published measures
We examine how FIT differs with respect to other possible or previously published algorithms that were designed to identify the information flow across regions about behavioral or stimulus features of interest. We first consider two measures that implement the Wiener-Grange discounting of the information present in the past activity of the sender. We then consider two other methods, that did not implement this principle.
SM4.1 Comparison with variations in transfer entropy ATE
As mentioned in the main text, one simple-minded proxy for identifying feature-specific information flow could be quantifying how the total amount of transmitted information (TE) is modulated by the ciimulus-fcature 4 For the case of two stimuli, this amounts to the difference of TE computed for each stimulus- feature value.
We now show, using simulations, that this measure can fail in capturing feature-related information flow. We performed simulations in a scenario having variable degrees of both feature-specific and
information transfer. The encoded and transmitted stimulus feature S was ttimulus-intensity integer value (1 or 2). The activity of the sender X was two-dimensional variable with one
X Xstim and one stimulus-nninformatie component X noosee The feature-informativ dimension had a temporally-localizn the activity (from 200 to 250ms) and additive Gaussian noise. The stimulu-unnrelate component was, at any time point, a zero-meat Gaussian noise. The activity of the receiver Y was the weighted sum of X Xatim and Xnoise with delay 8. plus Gaussian noise. The delay 8 was chosen randomly in each simulation repetition (N=50) in the range 40-60ms. We tested whether ATE across simulation repetitions was significantly different from zero using two-tailed t-test.
coimuluu-ddeendenn bump in
As we did in Figs. and S for FIT and TE, we studied the behavior of ATE as a function of the simulation parameters Watim (which increases the amount of information transferred about the stimulus feature) and W Wnoise (which increases the amount of feature-unspecifie information that transferred from X to Y). We found (S4AA) that ATE E had almost no relationship with the values of W stim and W Woise: unlike FIT which individuated stimulus- fimuula-feauure-ppeeffe transfer correctly because it increased with W Watim but not with W Wnoiee (Fig. S3A).
31

---

A
cFIT profiles for different confounders sets
x10
LE contralateral
x10
RE contralateral
8
Sky lime poins (Fifstronn
chomatee sond Sq time pains
time
50
100
150
200
50
100
150
200
Time from stimulus onset [ms]
Time from stimulus onset [ms]
B
FITx
FITz
Tactile stimulus
Visual stimulus
dF xp
VPM - S1
110
LGN - V1
10
Delay [ms]
Original FIT
25
Delay
[bite]
[bl
20
80
20
40
60
80
Time [ms]
Time [ms]
LGN S1 confounder
x10
VPM V1 confounder
x10
Intersection with confounder's FIT
Deley [mg]
25
Delay [ms]
25
DniS
5
80
40
Time [ms]
Time [ms)
VPM S1 LGN
x10
LGN V1 VPM
x10
Delay (ms]
85
cFIT given the confounder
Delay
20
40
60
80
Time [ms]
[ms]
Figure S12: Application of cFIT to experimental data. (A) cFIT application to the EEG data. We conditioned the contra-lateral FIT about the left and the right eye (see Fig. 4) the activity of two either weak or strong alternative eye-visibility information senders. Temporal profiles of unconditional FIT (in blue) for about the left eye from ROT LOT (left) and about the right eye from LOT to ROT (right). cFIT temporal profiles when conditioning on weak alternative senders (in orange) and strong alternative senders (in green). The points where the measures were significant are indicated with a circular marker (p<0.01, cluster statistics). (B) cFIT applied to MUA data. We conditioned tactile- (visual-) discriminative FIT through the somatosensory (visual) pathway (first row) to the activity of the visual (somatosensory) thalamus. The amount of unconditional FIT that was shared with the FIT through the alternative sender (second row) was subtracted from the original FIT to obtain cFTT (third row). The left column shows results for the disiiieeiicriminaiive set, the right column for the disual-iiccrminatte set.
Note that we performed also simulations (that were exactly like those of Fig. 2, except that we had 2 rather than 4 stimulus intensity values) in which the noise in X was multiplicative rather than additive. In this case (results not shown) ATE increased with both Watim and W Wnoise- Thus, ATE had limited capabilities of identifying some stimulus-feature-speee specific case, but it dot reflect in general.
information transfer in some
The reason that ATE cannot capture feature-specific information flow is. in our view, that ATE is measure of variation information strength across stimulus-feate feature conditions rather than measure of stimulus-feature-sn feature-specife information transfer.
32

---

A
Original electrodes in ROT
Original electrodes in LOT
8
Electrodes per site
-ii u2 +22 nss t2
000
Electrodes per site
4
6
D17
016
3
5
4
3
038
2
A20
010
A3
A1B
A17
A29
PCS
PC2
02
A12
A24
A26
A1s
Strong alternative senders (LE) Strong alternative senders (RE)
022
3
D20
Dia
A2
B
8
C72
819
B18
006 D07
7
Electrodes per site
D29
Electrodes site
6
Px
5
A38
D32
PO8
A16
3
+22
A14
A11
Weak alternative senders (LE)
Weak alternative senders (RE)
C
ATR
CH
14
96
94
319
00
10
06
1
100
2
01
Electrodes per site
Electrodes per site
2
3
Figure S13: Sets of electrodes used in the EEG data analysis. (A) Electrodes used to measure FIT and TE and for all the analyses in Fig.4, same electrodes used in [8]. (B) Set of 'strong alternative senders', selected as the electrodes carrying the second maximum amount of information about the left eye in the ROT (left panel) and about the right eye in the LOT (right panel). (C) Sets of 'weak alternative senders', selected as the electrodes in the frontal lobe carrying the minimal amount of information about the left eye (left panel) and about the right eye (right panel).
Additionally, we tested ATE on MEG data. We first binarized the stimulus feature into two classes (average contrast either greater, S=1, or lower, S=0, than the reference contrast). We computed TE for all pairs of visual regions in the visual cortical network separately in trials with the same value of the binary stimulus we and computed the difference ATE between these values. Fig. SS44 shows that ATE in the visual cortical network had the same strength in the feedforward and feedback direction, unlike FIT that showed a clear directionality of communication of stimulus information (stronger in the feedforward than in the feedback direction). Finally. when computing TE on the spiking activity data of the rat thalamocortical network, we found that TE from thalamus to cortex did not vary between the dixtiil-discimiaative and iisuall-discriminan stimuli set (sce Fig. SITE-I).
33

---

W stim Y
A
S
X
B
ATE directionality in the visual network
W noise
0.32
ATE
0.01
0.015
0.01
0.005
W stim
0
0.005
0.5
-0.005
-0.01
-0.015
0
0.5 W
Fwd
Fbk
noise
Figure S14: Performance of the Transfer Entropy Difference across stimuli (ATE) on simulated and real MEG data. (A) Simulated data. Values (mean across 50 simulations) of ATE from X to Y computed on the same simulated data used in Fig- S3A function of the simulation parameters Wstsm (which increases the amount of information transferred about the stimulus feature) and W Wnoise (which increases the amount of feature-unspecife found that ATE had almost no relationship with the values W stim and Wnoises unlike FIT which increases only with W Wstim- All ATE values not significantly different from zero (two sided t-test across 50 simulations, significance threshold at = 0.01). (B) Real MEG data. Average across participants, sessions and pairs of regions of the values of ATE (reported values were obtained laking the average over delays and then the maximum over time in the same time-delay region used for the results in Fig. 3D.E.F).
unspecific information that is transferred from X to Y). We
In contrast, on the same data FIT could distinguish tactile-diseriminatie from visually-discriminatie information flow from thalamus to cortex (see Fig. --I.
SM4.2 Comparisons with Directed Feature Information (DFI)
previous study [17 defined measure, Directed Feature Information (DFI), which computes fcature-specific information redundant between the present activity of the receiver and the past activity of the sender, conditioned on the past activity of the receiver. However, DFI used measure of redundancy that actually conflated the effects of redundancy and synergy (see Section SML.5 where we consider in detail its definition and its PID decomposition). Because of this, DFI can be negative and thus not interpretable as measure of information flow. Moreover, because DFI discounts only past activity of the sender rather than its -peciff information, it less precise and less conservative in localizing direction and timing of feature-specifi information flow.
The above properties expected from theoretical considerations but also demonstrated by us the following numerical simulations. We computed DFT in the two simulations described in Section SM2.1 (Fig. S15). We found that, in general, DFI had a trend similar FIT, increasing with transfer from X to Y (W Watim) and decreasing with the amount
the amount of of stimulu--ureeltedd transfer (W noise). However, DFI had several false positives (cases when there was no transmission in the ground truth of the simulated data but it was detected significant by the algorithm) and also had several false negatives (cases when there was transmission the ground truth of the simulated data but it resulted as non significant by the algorithm). In comparison, FIT under the same conditions and same simulations had none, see Fig. 2A). More importantly, as consequence of its inability to include only redundancy and discard synergy, DFI values were very often negative, and could be negative over time both baseline and during cemmuuus-eatuu--relaaee transmission (Fig. S15B).
34

---

The limitations of DFI for individuating directed well time-resolved flow of information about specific stimulus features were further tested with the bidirectional information transfer simulations described in detail in Section SM2.4 We remind briefly that in these simulations we simulated a scenario with bidirectional communication between X and Y with dimulus-feature-res
transfer from X and stimulus-unrelated transfer from Y to X (Fig. (5A)). ). In brief, both X and Y received information directly from a on (between 50 and 90 ms) and Y received feature information from S at a later time (between 110 and 150 ms). X sent its entire activity to Y (therefore communicating its feature information when it became available). Y instead only sent to Y part of its activity that did not carry feature information. We found that while DFI had a significant positive bump from X to Y in the [60, 100 time window, it also had a significant negative bump from Y to X in the time window in which X encoded the feature [50, ms. Crucially, the presence of significant DFI from Y to X preceding in time the DFI from X to Y would be interpreted that there is a bidirectional flow of stimulus-feane feature information, occurring first from Y to X and then from X to Y. Therefore, DFI could not capture correctly neither the directionality nor the timing of the stimulus-feature information flow that we put in the simulations.
inn-iiiatioonsenninnn node S. XX received feature information from S early
For FIT, which is non-negative measure, we always used one-tailed tests to determine whether the measured values were significantly larger than the 99th percentile of the null hypothesis distribution obtained as described in Section [SM17
For DFI, which is an unsigned measure, we implemented a two-tailed test. Analogous to our method for FIT, we computed two null hypothesis distributions: one by shuffling S across all trials, and one by shuffling X for fixed values of S. We then tested whether DFI was either above the 99.5th percentile of the element- wise maximum or below the 0.5th percentile of the element-wise minimum of these two null hypothesis distributions. If one of these conditions was met, we assigned significance to DFI.
Lastly, we computed DFI on the three real datasets (MEG, EEG and spiking activity) presented in the main text. We found (Fig. (S5C-E) that the problems with DFI predicted by mathematics (see Section (MI.5) and encountered simulations are also found in the neural datasets, On real data, DFI was very often negative and it did not detect directionality or feature specificity in cases in which we would expect from previous literature that specificity or directionality should exist.
In the MEG dataset (Fig. S5 (5D)), D), DFI had negative values and thus not interpretable as measure of information transfer. Unlike FIT, DFI could not detect that (as predicted by previous studies) stimulus information is stronger in the feedforward than in the feedback direction, and DFI could not detect that feedforward stimulus information is stronger in correct than error trials (an important result found by FIT).
In the EEG dataset (Fig. $5
DFI was negative and thus not interpretable measure of information transfer. The comparison of the DFI results between eye visibility features and directionally of cross- hemispheric transfer could not support the conclusion (predicted by findings in previous literature and confirmed by the FIT analysis) that across- hhoosse information transfer is directional from contra- to ipsi-lateral (DFI does not detected leading direction of RE information transfer) and is feature specific (DFI does not detected a difference between LE and RE information in the R to hemisphere communication).
In the thalamocortical spikes data (Fig. S5
E). DFI has mostly positive values which are thus inter- pretable in terms of information transmitted. DFI confirms (though with lower statistical power) the FIT results than in both the somatosensory and visual corticothalamic pathway more information is transmitted feedforward about the corresponding sensory modality (more visual than somatosensory information transmitted from visual thalamus to visual cortex, and more somatosensory than visual information transmitted from somatosensory thalamus to somatosensory cortex). However, DFI failed to demonstrate that, as expected from well-established neurophysiological findings, more information about such simple stimulus features is transmitted from thalamus cortex than from cortex to thalamus.
In sum, our results lead us to conclude that the definition of redundancy used in DFI that, unlike the more refined one arising from PID, conflates synergistic and redundant effects, leads to major problems predieted by theory and confirmed by simulation and in real data. Our results suggest that DFI is not robust or refined enough to be applied generally and systematically to brain data, and that
35

---

the advances provided by FIT with respect to DFI are important not only conceptually but also for the analysis of empirical datasets.
W stim Y
A
S
X
B
W noise
DFI
Temporal localization of stimulus-related transmission
0.06
DFI
0.04
Sig. time points
stim
Ground truth time of stim. transfer
0.02
-0.04
0.5
300
400
-0.02
time [ms]
-0.04
W
noise
EEG
MEG
E
Spikes
Content fwd
DFI, direction Carr fvdd
Tactile Set
VPM SS
Visual Set
LGN-V1
x 10
x 10
x 10
0.015
0.55
DFI [baa]
0.18
DF Dana)]
0.58
0.26
DF
0.89
0
-0 0.03
LE LE
LaR
LSR
RE RioL
DF1, DFI.
Iwd
Tok
Corr Err
VPM--8 St VPM
Taatil
Visual
LGN V1
V1-LLON
Tactle
Visuii
Figure S15: DFI tested on simulated and real brain data. In Panels A,B DFI is tested on the same simulations used for Fig 2A-B. Panel C-E report DFI results on real brain data. (A) DFI as function of stimulus-feature reeatue-rellaed (W (Wttmm)& and -unrelated (Wnoise) transmission strength. * indicate significant values (p < 0.01, permutation test) for the considered parameter set. (B) Dynamics of DFI in simulation with time-localized feature-information transmission. Red area shows the window of feature-related information transfer. Yellow dots show time points with significant information (p < 0.01, permutation test). Results plot mean (lines) and SEM (shaded area) across 50 simulations (2000 trials each). (C) EEG DFI between L, R hemisphere about L and eye visibility (cf with FIT in 4i main paper). (D) MEG DFI about stimulus or choice feedback or feedforward and in correct error trials (cf with FIT in Fig. 3D-F). (E) Spikes DFI for the thalamocortical pathway and tactile- or visual-disces disualdiscrimiiative stimulus set (cf with FIT in FigS8E-I). P-values: 2-tailed paired t-test. *; p<0.05, **; p<0.01.
SM4.3 Comparison with measures not discounting past information in the receiver as in the Wiener-Granger Causality principle
We finally consider the suitability for identifying flow of information about specific features of possible alternative measures that, although have relevance feature information coding across areas, do not implement the Wiener-Granger discounting of the information present in the past activity of the sender. In brief, methods that do not implement this (and thus just correlate past information of the sender with present information of the receiver), erroneously identify information already encoded in the past activity of the receiver as information transmitted from a sender. This concern would apply in general all measures that compute time-lagged cross-correlations of activity across areas [1] In the following, we consider briefly some possible methods that have been used to infer feature-specifi information transfer but that do not consider the Wiener-Granger Causality principle.
One possibility would to measure the presence and timing of feature information (using mutual information between the feature and the activity of the individual area at each instant of time, as Eq. (5T) and then inferring transfer of feature information from to if information about arises first in X and Y. Inferring processing hierarchies on the basis of response selectivity latencies
36

---

is a Long-establisher practice in neuroscience [32] 36 39]. information two areas does not mean that the information in the second area comes from the first area. Indeed, in the simulations to test FIT we created several such simulated scenarios of information present in each area with a different timing but without actual communication between the areas (Fig. (S7C, Section (MM2.6), and we created non-parametric tests to rule out this possibility based on FIT measures (Section SM1.7). Thus, differential response latencies can be used to hypothesize the presence of processing hierarchies but not to prove transfer of information between specific nodes of the putative information processing network.
However, the presence of time-lagged
Another possibility would be to use PID to measure the presence of shared (or redundant) feature information encoded in both and Y different temporal lags. PID can specifically isolate only the information about feature that is the same, e.g., redundantly encoded, in X and Y. Thus, measuring time-lagged shared information goes beyond computing simple time-lagged correlation between the amount of reach-ts to grasp information in X and Y, which would not consider whether the time-lagged information content the same. However, this measure would not discount the presence of the same information in the past activity of Y. and it would thus be prone detecting false communications in case the information was already present in the past of and thus could not have come from X. (In other words, it would erroneously identify information already encoded in the past activity of the receiver as information transmitted from a sender.) These types of problems of not discounting the past have been illustrated and discussed extensively in the Caauslliy literature. These considerations apply to a previous study [29] which used PID to attempt to define feature-specific information transmission using the so-called Intersection Information (28), computing information shared between the past activity of the sender and present activity of the receiver (not considering the information already present in the past activity of the receiver).
SM5 Computational resources
Each of the simulations in Figures S3, S4, S6, S7, S8, S14, and S15 ran in approximately 30 minutes on a personal computer equipped with an Intel 17-10510U processor (4x 1,80GHz CPUs) and 16Gb of RAM, rumning Windows 10, using MATLAB R2021a. Simulations in Fig. S5 took approximately 3 hours on the same machine.
Real neural dataset analyses ran on a server with an AMD Ryzen Threadripper 3970X processor (32x 3.7GHz CPUs) and 256Gb of RAM, running Ubuntu 18.04, using MATLAB R2019b. The EEG and MEG analyses ran in parallel (using the Parallel Computing Toolbox) over participants links in the visual cortical network, respectively. Each analysis the full real datasets (across all participants and experimental sessions) took 12-28 hours depending the usage of the server.
Our MATLAB codes to compute Feature-specific Information Transfer are provided with this submission and are released under the MIT license. The routines to compute FIT, TE and cFIT are also available at httpss//giiuub..co//meeeeo
Info Transfer].
References
[1] A. M. Bastos and J.-M. Schoffelen. A tutorial review of functional connectivity analysis methods and their interpretational pitfalls. Front Syst Neurosci, 9:175, 2016.
[2] R. D. Beer and P. L. Williams. Information processing and dynamics in minimally cognitive agents. Cognitive Science, 39(1):138, 2015.
[3] N. Bertschinger, Rauh, E. Olbrich, J. Jost, and N. Ay. Quantifying unique information. Entropy, 16(4): 2161-2183, 2014.
[4] M. Besserve, S. C. Lowe, N. K. Logothetis, B. Schölkopf. and S. Panzeri. Shifts of gamma phase across primary visual cortical sites reflect dynamic 10022552 2015.
information transfer. PLOS Biology. 13
[5] Bieler, X. Xu, A. Marquardt, and I. L. Hanganu-Oper Multisensory integration in rodent tactile but not visual thalamus. Scientific Reports, 8(1 8(1):15684 2018.
[6] D. Chicharro. Quantiflying multivariate redundancy with maximum entropy decompositions of mutual information. arXiv:1708.0 03845, 2017.
37

---

[7] D. Chicharro and S. Panzeri. Synergy and redundancy in dual decompositions of mutual information gain and information loss. Entropy, 19(2):71, 2017.
[8] E. Combrisson, M. Allegra, R. Basanisi, R. A. A. Ince, B. L. Giordano, J. Bastin, and A. Brovelli. Group-level inference of information-based measures for the analyses of cognitive brain networks from neurophysiological data, Neurolmage, 19347, 2022.
[9] T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley & Sons, Hoboken, New Jersey, 2006.
[10] A. Delorme and S. Makeig, EEGLAB: an open source toolbox for amalysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1):9 21, 2004.
[11] C. Finn and J. T. Lizier. Pointwise partial information decompasition using the specificity and ambiguity lattices. Entropy, 20(4):297, 2018.
[12] N. A. Francis, S. Mukherjee, L. Koçillari, S. Panzeri, B. Babadi, and P. O. Kanold. Sequential transmission of task-relevant information in cortical neuronal networks, Cell Reports, 39(9): 10878, 2022.
[13] M. F. Glasser, T. S. Coalson, E. C. Robinson, C. D. Hacker, J. Harwell, E. Yacoub, K. Ugurbil, J. Andersson, C. F. Beckmann, M. Jenkinson, S. M. Smith, and D. C. V. Essen, A multi-modal parcellation of human cerebral cortex. Nature, 536(7615):1111177. 2016.
[14] E. Gokcen, A. L. Jasper, J. D. Semedo, A. Zandvakili, A. Kohn, C. K. Machens, and B. M. Yu. Disentangling the flow of signals between populations of neurons, Nature Computational Science, 2:512-525, 2022.
[15] Gross, L.. Timmermann, J. Kujala, R. Salmelin, and A. Schnitzler. Properties MEG tomographic maps obtained with spatial filtering. Neuroimage, 19(4): 1329-1336, 2003.
[16] M. Harder, C. Salge, and D. Polani, Bivariate measure redundant information, Physical Review E, 87 (1):012130, 2013.
[17] R. A. A. Ince, N. J. W. Van Rijsbergen, G. Thut, G. A. Rousselet, J. Gross, S. Panzeri, and G. Schyns. Tracing the flow of perceptual features in an algorithmic brain network. Scientific Reports, 5:17681, 2015.
[18] R. A. A. Ince, K. Jaworska, J. Gross, S. Panzeri, J. W. Van Rijshergen, G. A. Rousselet, and P. G. Schyns. The deceptively simple N170 reflects network information processing mechanisms invalving visual feature coding and transfer across hemispheres. Cerebral Cortex, 26(11):4123 4135, 2016.
[19] L. Koçillari, M. Celotto, N. A. Francis, Mukherjee, Babadi, P. O. Kanold, and S. Panzeri. Mcasuring stimulus-re related redundant and synergistic functional connectivity with single cell resolution in auditory cortex. In B/ 2023. Lecture Notes in Computer Science, volume 13974, pages 45-56, Cham, 2023. Springer Nature Switzerland.
[20] A. Kolchinsky. A novel approach to the partial information decomposition. Entropy, 24(3):403, 2022.
[21] T. Lizier, N. Bertschinger, Jost, and M. Wibral. Information decomposition target effects from multi-source interactions: Perspectives on previous, current and future work. Entropy, 20(4):307, 2018.
[22] C. Magri, K. Whittingstall, V. Singh, N. K. Logothetis, and S. Panzeri. A toolhox for the fast information analysis of multiple-site LFP, EEG and spike train recordings. BMC Neumosiencce, 10(81), 2009.
[23] A. Makkeh, D. Chicharro, D. O. Theis, and R. Vicente. MAXENT3D PID: An estimator for the maximum- entropy trivariate partial information decomposition. Entropy, 2669)862, 2019.
[24] F. Maris and R. Oostenveld. Nonparametric statistical testing of EEG- and MEG-data. Journal of neuroscience methods, 164(1):177-190, 2007.
[25] M. A. Montemurro, R. Senatore, and S. Panzeri. Tight data-robust bounds to mutual information combining shuffling and model selection techniques. Neural Compur, 19(11):2913 2112)))9912297,,., 2007.
[26] S. Panzeri, R. Senatore, M. A. Montemurro, and R. S. Petersen. Correcting for the sampling bias problem in spike train information measures. Journal of Neurophysiology, 98(3):
2007.
[27] G. Pica, F. Piasini, D. Chicharro, and S. Panzeri. Invariant components of synergy, redundancy, and unique information among three variables. Entropy, 19(9)451,, 2017.
[28] G. Pica, E. Piasini, H. Safaai, C. Runyan, C. D. Harvey, M. Diamond, C. Kayser, T. Fellin, and S. Panzeri. Quantifying how much sensory information in neural code is relevant for behavior. In Advances in Neural Information Processing Systems, volume 30, pages (689-3699 2017.
38

---

[29] G. Pica. M. Soltanipour, and S. Panzeri. Using intersection information to map stimulus information transfer within neural networks. BioSystems, 185:104028, 2019.
[30] G. Pola, A. Thiele, K.-P. Hoffmann, and S. Panzeri. An exact method to quantify the information transmittedd by different mechanisms of correlational coding. Network: Computation in Neural Systems, 14(1):35-60, 2003.
[31] G. A. Rousselet, A. A. Ince, N. J. W. Rijsbergen, and G. Schyns. Eye coding mechanisms in early human face event-specific potentials. Journal of vision, 14(13):7, 2014.
[32] M. T. Schmolesky, Y. Wang, D. P. Hanes, K. G. Thompson, S. Leutgeb, J. D. Schall, and A. G. Leventhal. Signal timing across the macaque visual system. Journal of Neurephysiology, 79(6):3272-3278, 1998.
[33] E. Schneidman, W. Bialek, and J. Berry II. Synergy, redundancy, and independence in population codes. Journal of Neuroscience, 23(37):11539 11553, 2003.
[34] T. Schreiber. Measuring information transfer. Physical Review Letters, 85(2):661-464, 2000.
[35] C. Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27:379-423,
1948.
[36] J. H. Siegle, X. Jia, and S. D. et al. Survey of spiking in the mouse visual system reveals functional hierarchy. Nature, 592(7852):8--22,20 2021.
[37] S. P. Strong, R. Koberle, R. De Ruyter Van Steveninck, and W. Bialck. Entropy and information in neural spike trains. Physical Review Letters, 80(1):197, 1998.
[38] P. L. Williams and R. D. Beer. Nonnegative decomposition of multivariate information. arXiv:1004.2515. 2010.
[39] N. Wilming, P. R. Murphy, F. Meyniel, and T. H. Donner. Large-scale dynamics of perceptual decision information across human cortex. Nature Communications, 11(1):5109, 2020.
39


Reviews:
[{"review_id": "lx66TBVYma", "reviewer": "Reviewer_LrX8", "summary": "The submission proposes a measure called Feature-specific Information Transfer (FIT) which can be used to partial out information transmitted from a sender to a receiver (in this case, two brain regions) about a specific feature (another variable) in a casual way (i.e. it is not present in the history of the receiver. It does so using Partial Information Decomposition (PID), a new way of decomposing mutual information into shared, unique and synergistic components. Basic properties of the measure are established and validated theoretically and by simulation, and it is then applied to analyze three neural datasets of varying modalities, yielding both some recovered sanity checks and novel analysis results. ", "questions": "Can you explain in more detail why $SUI(S: \\{X_{past}, Y_{pres}\\setminus Y_{past}\\})$ can be higher than TE, motivating the definition in expr. 2? The paper makes the claim around line 93 and makes a reference to the bottom of Fig1A. I imagine it is true algebraically if one works it out but I'm not sure I see where in the figure this is explained or why it should be true intuitively. ", "limitations": "The paper does a good job to discuss the computational limitations of actually computing FIT and how it limits the applicability to small numbers of regions and time points. ", "rating": 7, "confidence": 3, "soundness": 4, "presentation": 3, "contribution": 3, "strengths": "The paper leads with a very strong exposition, which explains exactly what it is doing and why. The overall reasoning about the desiderata of FIT are likewise clear and come at the right pacing in the paper. The simulation and experimental results are comprehensive and show strong benefits over the prior TE approach. ", "weaknesses": "I think that the paper shunts too much important content to the appendix. PID and related concepts are likely to be less familiar to the NeurIPS audience, and the paper does not give much intuition on why various claims hold beyond a reference to the extensive supplement. Given the audience, I suspect that pushing more detail on the neuroscience data and experiments to the supplement in favor of bringing more theoretical meat to the main text would make for a stronger paper. Even if much of the detail remains in the supplement, papers such as this can benefit from providing at least intuitions or sketches as to why some properties might hold. \n\nI also found minor typos: \n* l40 features-specific -> feature-specific?\n* l102 what is $Y_t$? Is it intended to be $Y_{pres}$, or am I misunderstanding something here? ", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "The paper shunts too much important content to the appendix.\n \nWe agree that it would be better to bring to the main text more theoretical details about the PID used to compute FIT. In case of acceptance, we will use the extra page allowed by NeurIPS to include more PID theoretical details about FIT derivation and properties. This will include spelling out the definition of shared information, and moving to main text the Figure with the PID lattices, currently Fig S1 (useful to provide immediate intuition of why the upper bound properties of FIT hold). \nIf needed to free up sufficient space, as suggested by the reviewer we will push more details about the neuroscience data analysis validation on the SI (e.g. moving current Fig 4 to the SM).\n\nMinor typos.\n\n“l40 features-specific -> feature-specific?.” Thanks, we will correct it. \n“l102 what is $Y_{t}$? Is it intended to be $Y_{pres}$?”. This was a misprint. We intended to write $Y_{pres}$, as the Reviewer correctly guessed. We will correct the misprint in revision.\n\nWhy $SUI(S:X_{past},Y_{pres} \\backslash Y_{past})$ can be higher than TE, motivating the definition in expr. 2.\n\nWe agree that the reference to the bottom of Fig 1A contained in line 93 of the first submission was unclear. In the revision we will remove this and we will reference to Fig S1 (which will be moved to the main text, as mentioned in the reply above).\nThe fact that the first PID atom $SUI(S:X_{past},Y_{pres} \\backslash Y_{past})$ can be larger than TE was derived formally from the algebra of Eq. S7. In the PID decomposition by construction the unique information is conceptually defined to be a component of (and hence equal or smaller than) the conditional mutual information about the target. However, the target in $SUI(S:X_{past},Y_{pres} \\backslash Y_{past})$ is the stimulus feature S, which means that this atom is not constrained to be smaller than the Transfer Entropy $I(X_{past}; Y_{pres}| Y_{past})$, which is not defined in terms of S. Fig S1C illustrates the absence of a relationship between the PID atom $SUI(S:X_{past},Y_{pres} \\backslash Y_{past})$ and TE, in which the yellow quantity TE cannot be mapped on the left lattice having S as a target. This was briefly explained in the SM after eq. S23 of the original submission and will be emphasized more in the revised paper, in case of acceptance.\n\nThe issue of redundancy about a target potentially exceeding the information between the sources is discussed in the PID literature (Harder et al, Phys Rev E 2013; Pica et al, Entropy 2017). The intuition of why this can happen is because the mechanisms connecting the target with the sources can induce a non-zero component of redundancy (known as mechanistic redundancy), independently of the correlations between the sources. That is, redundancy is created due to the similarity in the mechanisms linking the target and the sources, even for independent sources. Pica et al (Entropy 2017) developed a formalism relating PID atoms with different targets to quantify mechanistic redundancy and isolate the component of redundancy that is already manifested in the mutual information between the sources (termed source redundancy). We built on this formalism to guarantee that FIT only considers a component of source redundancy about S carried by $X_{past}$ and $Y_{pres}$ that is unique with respect to $Y_{past}$. \n"}, {"review_id": "N6aM8d3cNG", "reviewer": "Reviewer_sTPd", "summary": "This paper proposes a novel non-parametric method aimed to quantify the amount of brain communication between (time series representing the activity of) brain regions using information theoretic measures. Concretely, the authors’ method builds on the framework of partial information decomposition of the transfer entropy (TE), which is the mutual information between the past of a presumed sending signal X and the present of a presumed receiving signal Y conditioned on its on past. This can be interpreted as the amount of predictive information the past of X contains about the present of Y that goes beyond the information contained in the past of Y itself. TE can therefore be interpreted as an operationalization of the Wiener-Granger causality principle for general non-linear/non-Gaussian data. Based on quantities defined in this framework, the authors now go one step further to quantify only that part of the directed information flow from X to Y (analogous to TE) that contains information of an external content variable S, which could for example be a stimulus in a cognitive neuroscience experiment. Another extension, conditionining the measure on a fourth, potentially confounding variable, is also presented. The authors provide extensive theoretical derivations of their metrics in a long supplement and prove several of its properties. Moreover, the method is demonstrated in a set of simulations as well as on two real electrophysiological neuroimaging experiments. ", "questions": "-\tHow were the information theoretic quantities calculated? Was this done by constructing histograms? What were the dimensions of the different distributions? How many bins were used and can the authors comment whether the amount of available data was sufficient to estimate these quantities? Or were some kinds of parametric distributions fitted and the information theoretic measures were evaluated analytically? \n-\tWhat were the parameters of the source reconstruction in the MEG/EEG examples? Which inverse methods were used, what regularization parameters? How were the forward models calculated? Was source reconstruction done with free orientation dipolar sources or orientation fixed perpendicular to the cortex? How many source dipoles were modeled? How were sources aggregated into regional time series. How many time series per region? What was the dimensionality of the data in each step of the processing chain?\n-\tLine 318: the study [4] seems to be relevant but is almost not discussed. Why is it so important that the metrics “should be upper bounded by either feature information encoded in the past of the sending region or the total information flowing between regions.” What is the practical disadvantage if this is not the case?\n-\tWhat is the relevance of the theoretical properties of FIT shown in the supplement ( in sections SM1.3.4ff)? What would be the practical implications if some of these properties would not hold?\n-\tP195ff: What are the references for these statements (e.g. “area V3A (carrying maximal stimulus information in the dorsal stream visual cortex)”) ?\n\n", "limitations": "Despite the comprehensive theoretical content the paper is lacking some technical details which should be provided in a revision. \nThe main limitation for me is the unclear behavior of the proposed methods in the presence of mixed signals. While the paper is overall of high quality, I see a necessity to reduce my score if the issue is not adequately addressed/discussed in a revision. \n", "rating": 6, "confidence": 4, "soundness": 3, "presentation": 3, "contribution": 4, "strengths": "The paper contains an enormous amount of work, which is signified by a 34page supplement. The mathematical derivations appear to be solid and comprehensive. As far as I can tell, the proposed methods are mathematically sound and the mathematical results provide a good fundament for understanding the properties of the methods.  The paper and supplement are well written, and the paper is well organized. The density of the information contained in the paper is very high, and often the reader is referred to the supplement for key information, which is something to reconsider. The paper contains somewhat comprehensive simulations and two applications to real data. The figures are of very high quality.", "weaknesses": "Presentation-wise I do not consider it not so helpful to put all technical details in the supplement. Quantities like shared information and FIT itself are not defined in the main body, which makes it difficult to follow the theoretical arguments. Other technical details seem to be missing completely, at least I could not find them. This concerns the calculations of the various information theoretic metrics themselves.\nMy main objection is that the proposed metrics are affected if the measured data are mixtures of underlying sources. This is known to be the case for electrophysiological recordings like MEG and EEG. Mixing occurs due to the propagation and superposition of electrical currents and magnetic fields through the head from the brain sources to the sensors. It is most highly pronounced when analyzing data on the M/EEG sensor level (as apparently done in the section on “Eye-specific interhemisperic information flow during face detection”). Also invasive electrophysiological recordings can exhibit strong artifacts of source mixing, if different channels are recorded relative to a common electrical references. This can lead to spurious estimates of information transfer for measures based on the concept of Granger causality (GC). A simple example to illustrate this is a single brain source activity that is measured in two channels due to source mixing. That alone would not cause Granger causality. However, if both recorded channels are affected by (to some extent) independent noise, (spurious) GC emerges, the reason for this being that past of both channels together contains more information about the present than the past of any single channel alone, since noise can be better averaged out by combining channels. Not that this behavior is neither overcome by GC’s property to model time-delayed interaction nor by conditioning on the past of the receiver.\nIn the presence of source mixing, GC is mainly driven by asymmetries in the mixing proportions of different signals and not so much about their interactions. These mixing proportions depend on factors such as the choice of the reference electrode. \nThe authors are aware of the issue as they mention: “because they were sufficiently far apart to avoid leakage in source reconstruction [57].”. However, it is hard to validate this claim, and I consider it rather unlikely that different sources in the visual system are sufficiently far apart (if that is even possible). Such assessment would also depend on certain parameter choices of the inverse model, which are currently not provided. \nI strongly urge the authors to provide some theoretical and empirical evidence for the behavior of their methods in mixed signal or mixed signal settings. Specifically suggest to study the null case of only one source with independent noise: X = Z + E1 ; Y = Z + C*E2 with coefficient  parameter C and independent noise E1 and E2. As well as the case of two interacting signals Z1 and Z2 with FIT(Z1 -> Z2) > 0, where instead of Z1/2 mixed signals X = Z1 + A*Z2 and Y = B*Z1 + B. I suggest to study this case as a function of the parameters A and B with |A| < 1 and |B| < 1. \nLanguage-wise I found it slightly odd to put some parts of the methods description into past tense (lines 80ff for example). Also some sentences seem to be rather long, see for example line 335ff.\n", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Asymmetric source mixing.\nWe simulated source mixing in different proportions in X and Y due to field spread/ common reference. Such source mixing in real cases is (and is assumed to be in our simulations) instantaneous (i.e. zero lag) and with a stable (across time) proportion of source sharing in X,Y.\nWe simulated a source Z (informative about a stimulus feature S) shared between X and Y with a different proportion A: \n\nX= Z(s) + Ex ; Y=A*Z(s)+ Ey\n\nwith Ex, Ey indep. Gauss. noise. This is the “null model” proposed by the Referee, but we controlled the SNR of X,Y by changing A (which sets the relative level of stimulus signal in X,Y) and fixing noise SD to 1. As predicted, on this model FIT and TE had spurious positive values (Fig R1B). In the submitted paper, we used a null-hypothesis test (randomly permuting trials with the same stimulus feature value) for spurious values induced by X,Y covariations due to stimulus-signal sharing. Here, this test correctly rules out that the from the null model’s FIT and TE are generated only by source sharing with no real transmission (Fig R1B). We already reported in the submitted paper that the real-data FIT were statistically significant with this test. \nImportantly, analysis of the null model also shows that with instantaneous source mixing the ratio between stimulus info in X and Y is constant in time (Fig R1A). This gives a useful heuristic: different timecourses of stimulus info in X vs Y cannot be explained by instantaneous source mixing. We measured all real-data FIT in cases with a delay in stimulus info latencies between X and Y (X to Y info latencies: MEG: 17-35ms between V1 and higher areas, Fig R2C. EEG: 25ms across hemispheres (Fig 4B). In spike data: 20ms from thalamus to cortex, Fig S8). Overall, these findings speaks against dominant mixing of a stimulus-informative source in our analyses. \n\nFinally, as suggested we simulated the case with real FIT between two “pure” signals Z1 and Z2 that are unevenly mixed in the measured X,Y:\n\nX = Z1 + AZ2 + Ex;   Y = Z2 + BZ1 + Ey\n\nSince adding a new stimulus-informative channel (Z1 to Y and Z2 to X) increases the stimulus information in X,Y, we set SD of indep. Gauss. Noise Ex,Ey to equalize SNR of X and Y across the simulated parameters space. We found (Fig R1C) that mixing (A,B>0) reduced FIT and TE compared to the pure case (A=B=0). However, the correct directionality of info transfer was always detected for all mixtures. Thus, FIT is reasonably conservative and robust to this mixing. \n\nInfo computation details. \nWe will bring into the main text more theory details about PID and FIT. See General and Ref. LrX8 rebuttal for our plan. \nInformation was computed by discretizing neural activity into equipopulated bins (3 bins for simulations, see ll 137-8; 2-4 bins for real data, SM p. 21-24). These discretized estimators are widely used in neuroscience and PID was developed mostly for discrete distributions. Apologies if this was unclear. We will add to SM a dedicated Methods section and a Table with the number of bins used for each figure panel. \nWe now show in a new simulation that the number of trials we used in simulations and real data analyses is enough for good estimates (see Fig R4 and rebuttal to Ref. TXME). \n\nImportance that FIT satisfies proven info-theoretic bounds.\nThat FIT satisfies such bounds is essential to interpret FIT values as transmitted information. If FIT can be larger than the feature information encoded by sender X or receiver Y or than the total information transmitted (TE X→Y), then FIT cannot be interpreted as stimulus feature info transmitted X→Y. If e.g. FIT>I(S;X_past) then some of the stimulus feature info in FIT cannot have been transmitted X→Y. These bound also allow quantifying FIT in meaningful relative terms. They allow e.g. to interpret the ratio FIT(X→Y)/I(S;X_past) as the proportion of stimulus info encoded in past of X that gets transmitted to Y. This will be explained in the revised paper. \n\nSource mixing in MEG/EEG data.\nWe used published MEG/EEG data and we kept to the published preprocessing, to avoid introducing changes which confound comparison of FIT with published work. We referred to the original papers for full info, but we provide below (and will add to the SM) some details. \n\nFor MEG: \nSource reconstruction: LCMV beamformers based on: (i) leadfield matrices from 3-layer boundary element head-model (conductivity 0.3, 0.3, 0.006 S/m for scalp, brain, skull) based on individual MRIs; (ii) covariance matrix (CM) of broadband data (275x275 sensors); (iii) regularization of 5% of CM. Source space constrained to cortical sheet with 4096 vertices per hemisphere, and source orientations chosen to maximize power at each vertex. To illustrate spatial resolution, we plot correlation between LCMV spatial filters of neighboring sources vs distance, finding <0.02 correlations at d>2.5cm (Fig R2B). To compute FIT & TE, time-frequency repr. of sensor data was projected into source space and averaged over vertices within the ROI (80,20,10 vert. for V1, V3A, LO3). Although our FIT/TE analyses were all correct, we identified an error in rendering ROIs in Fig 3B. Apologies. The correct visualization is in Fig R2A. We also apologize for the over-statement about no leakage, which we will rectify. Leakage of MEG source estimates drops greatly at >2cm for realistic SNR (Gross et al, Neuroimage 2003). We thus ran a more conservative analysis only on V1, V3A, LO3, visual ROIs with high stimulus info (Fig R2C) that are >2.8cm apart. Results (stronger feedforward stimulus transmission) are fully confirmed in this network (Fig R2D-F). Since here real-data analyses serve more for validation than for discovery, we would present the more conservative analysis in the revised paper. We appreciate feedback on this.\n\nFor EEG: \nWe used sensor data. Distance between electrodes LOT, ROT for computing inter-hemispheric transfer was >10 cm, suggesting that source mixing may be small."}, {"review_id": "74R0befYJW", "reviewer": "Reviewer_TXME", "summary": "Exploring the content and direction of communication between brain regions is key to understanding the brain. This paper proposes a method called Feature-specific Information Transfer (FIT) to investigate the feature-specific content and direction of information flow in multi-region brain recordings. To isolate feature-specific information, the authors use the Partial Information Decomposition (PID) concepts of redundancy and uniqueness of information and the Wiener-Granger causality principle to find the feature-related flow of information. The authors evaluate the ability of FIT to measure feature-specific information flow using synthetic datasets. They show that FIT performs well in both cases: (1) brain regions encode stimulus with communication; (2) brain regions encode stimulus independently without actual communication occurring between them. Finally, the authors compare FIT with Directed Feature Information (DFI) and evaluate the performance of FIT by three neural recordings spanning the range of electrophysiological recordings (spiking activity, MEG, and EEG).", "questions": "* What will happen if multiple feature-related information is transferred from sender $X$ to receiver $Y$ simultaneously? One may come from stimulus, but the other may come from hidden sources, e.g., other brain regions. Could FIT distinguish different types of information flows that occur simultaneously?\n* If possible, could you please discuss the stability of FIT over the increasing dimensionality of data? One major limitation of applying PID to neuroscience is the computational difficulty of estimating PID for high-dimensional neural data.", "limitations": "I have highlighted technical limitations and weaknesses above. I have nothing further to add here.", "rating": 7, "confidence": 3, "soundness": 3, "presentation": 3, "contribution": 3, "strengths": "* The problem formulation is clear, giving a clear definition and motivation of the problem the authors want to solve.\n* The authors' exposition of their method and experiments is straightforward and comprehensive.\n* The proposed method, FIT, can understand how the brain works with complex brain functions and the flow of different types of information. FIT would provide an essential set of contributions to the field.", "weaknesses": "* The authors should highlight and summarize the contributions of this work at the end of Section 1.\n* The comparison of FIT and Directed Feature Information (DFI) is only performed on simlulated dataset.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Compute DFI on real data. \nWe computed DFI on the 3 real-data sets (Fig. R3). \nIn the MEG dataset (Fig. R3B), DFI was negative values and thus not interpretable as measure of information transfer. Unlike FIT, DFI could not detect that (as predicted by previous studies) stimulus information is stronger in the feedforward than in the feedback direction, and DFI could not detect that feedforward stimulus information is stronger in correct than error trials (an important result found by FIT). \nIn the EEG dataset (Fig. R3A), DFI was negative and thus not interpretable as measure of information transfer. The comparison of the DFI results between eye visibility features and directionally of cross-hemispheric transfer couldn’t support the conclusion (predicted by findings in previous literature and confirmed by the FIT analysis) that across-hemisphere information transfer is directional from contra- to -ipsilateral (DFI does not detected a leading direction of RE information transfer) and is feature specific (DFI does not detected a difference between LE and RE information in the R to L hemisphere communication). \nIn the thalamocortical spikes data (Fig. R3C), DFI has mostly positive values which are thus interpretable in terms of information transmitted. DFI confirms (though with lower statistical power) the FIT results than in both the somatosensory and visual corticothalamic pathway more information is transmitted feedforward about the corresponding sensory modality (more visual than somatosensory information transmitted from visual thalamus to visual cortex, and more somatosensory than visual information transmitted from somatosensory thalamus to somatosensory cortex). However, DFI fails to demonstrate that, as expected from well-established neurophysiological findings, more information about such simple stimulus features is transmitted from thalamus to cortex than from cortex to thalamus.\nWe will add these results to SM4.2 where we report the properties of DFI.\nIn sum, we recognize that the idea behind DFI is sound. However, the imperfect definition of redundancy used in DFI (conflating synergistic and redundant effects) leads to problems which we have already understood mathematically and characterized by simulation in the previous version of our paper. These new analyses of real data, which we will add to the revision, show that the problems predicted by theory and confirmed by simulation are also found in real data, suggesting that DFI is not robust enough to be applied to brain data, and that the advances provided by FIT are important not only conceptually but also for the analysis of empirical datasets.\n\nStudy case of information about multiple features transferred simultaneously. \nIn the submitted paper we already showed that FIT can reveal encoding of multiple features. Simultaneous encoding of multiple features was indeed investigated in the analysis of all three datasets (MEG, EEG, spikes). In MEG, we found simultaneous encoding and transmission of stimulus and choice information. In EEG, we found simultaneous encoding and transmission of left-eye and right-eye information. We used the relative information values results to individuate the features most encoded and transmitted (visual contrast in the MEG dataset, left eye in the EEG dataset).\nWe now performed, as suggested, a simulated study of encoding and transmission of multiple features (Fig R4B). We simulated two independent features (e.g. of a sensory stimulus) S1,S2 simultaneously encoded and transmitted (S1 more strongly than S2): \n\nX=S1+D*S2+Ex \n\nwhere S1,S2 are independent binary variables (±1), Ex is Gaussian noise with SD=1, and Y equals X with a time lag plus independent Gaussian noise with SD=1. \nWe found (Fig R4B) that FIT identifies correctly that both features are transmitted, and ranks correctly the features about which most information is transmitted. These simulations will be added to the SM of the revised paper. \n\nScaling of FIT with data size and dimensionality. \nWe added simulations that study how FIT scales with the number of trials available in the dataset and with the dimensionality of neural activity (here, the number of bins of the discretized activity). We found (Fig R4A) that FIT behaves much better than Shannon information quantities (e.g. TE) with the data size and dimensionality. The correct value of FIT, computed from large data, is achieved already with smaller number of trials than for the Shannon information quantities. We found that accurate calculations of FIT are possible with the number of trials available in empirical datasets (Fig R4A); for comparison FIT calculations in the paper were done with R=2-4). Our understanding is that the better scaling and sampling properties of FIT w.r.t. to Shannon Information quantities arise because FIT considers a PID part of the total information which has lesser bias compared to other parts of the total information. Given that the PID atoms of FIT do not contain synergistic terms, this is in line with previous work (Montemurro et al, Neural Comput 2007) showing that synergistic components of information have much larger limited sampling bias, and that information quantities that do not include synergistic components have much better sampling properties than full multivariate Shannon information quantities. Thus, FIT can be computed from the datasets in which Shannon information measures typically applied to neural data. \nFor completeness, we also added to our code the implementation of information theoretic limited sampling bias corrections that slightly aid (Fig R4A) the calculation of information theoretic quantities from real data by subtracting an estimate of the bias computed with a quadratic extrapolation of the scaling of information when subsampling available data (Strong et al, Phys Rev Lett 1998; Panzeri et al J Neurophysiol 2007).\n\nWriting.\nWe will highlight and summarize more sharply the contributions of this work."}, {"review_id": "2tazzIbMEq", "reviewer": "Reviewer_bTa8", "summary": "In the present work, building on recent advances in Partial Information Decomposition or PID, the authors develop a novel information theoretic measure which they term Feature-specific Information Transfer (FIT) and that the authors claim can capture the feature-specific information transfer between brain regions. The authors validate FIT using synthetic and real world neural recordings. ", "questions": "What is the difference between feature and stimulus in this work? ", "limitations": "Limitations have been properly addressed by the authors.", "rating": 6, "confidence": 4, "soundness": 3, "presentation": 3, "contribution": 3, "strengths": "- Originality:  The authors introduce a new measure that even though is based on recent advances on PID is still a significant novel contribution.\n\n- Quality:  the theoretical derivations are solid and there are no obvious flaws that I can see. The introduction of the novel FIT measure is backed by sufficient experimental evidence both with simulated and real world data. \n\n- Clarity: The paper is very clearly written and the illustrations are very good. \n\n- Significance: I think the paper introduces an important measure that can help study stimulus-driven communication between brain areas.", "weaknesses": "I think that stating that the FIT measure is feature-specific can be a bit misleading. I would probably have called this measure stimulus-specific rather than feature-specific. I personally reserve the term \"feature\" to refer to internal neural representations that may be triggered by external stimuli. By that definition, features cannot be observed and it is very hard to attribute certain neural activity to a specific meaningful feature.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "We agree that the nomenclature of the new metric is important and should be chosen with care. We are thus grateful to the Reviewer for raising the issue of how best to name it. \n\nIn the present study, we consider as “feature” any variable of interest that is external to the considered neural network. This can be the feature defining an external sensory stimulus (color, contrast, etc) or the feature defining a behavioral output (choice made by the subject, motor or kinematic variable of the subject’s behavior). While some people reserve the use of “feature” for some specific quantification of neural activity (e.g. the timing of spikes, the spike rate, etc), many people especially in vision or hearing reserve the word feature for features of a sensory stimulus. We will better define in the paper’s revision what we mean by feature. We also agree that in the current version of the paper we used the words ‘stimulus’ and ‘feature’ somehow interchangeably, leading to confusion. We will revise the text to avoid any ambiguity between ‘stimulus’ and ‘feature’. E.g. we could replace the letter ‘S’ that we currently use to refer to the external feature in the maths with an ‘F’, we could formulate better sentences such as ‘shuffling X across trials at fixed stimulus’ and replace them with more precise wording such as ‘shuffling X across trials with the same value of the feature’.\n\nHowever, we would like also to consider and discuss alternatives. We like the suggestion of this referee to call the measure “Stimulus-information transmission” or “Stimulus—specific-information transmission”. However, we define the measure such that it can be applied to information contents that are more general than sensory stimuli (as explained above). In our paper, we applied FIT to compute transmission of information about behavioral choice (Fig 3) as well as applying it to compute transmission of information about sensory stimuli. Using the terminology “stimulus specific” could thus incorrectly suggest that the applicability is limited to sensory function. \n\nAnother possibility would be to use “content-specific” rather than “feature’-specific” and call the measure “Content-specific information transfer – CSIT”.\n\nWe would prefer to use the current terminology with better clarifications, as explained above. However, we are open to change if it is felt by the reviewers that a change would enhance the clarity about what the measure quantifies. We would warmly appreciate feedback from all reviewers about this issue. \n\nWe also hope that the Reviewer will appreciate the advances we presented in this rebuttal in response to the other Reviewer’s suggestions (simulation studies of source mixing, simulation studies of simultaneous encoding of multiple features, computation of DFI on real data, simulation studies scaling of FIT with data size and dimensionality, etc). "}]

Author rebuttal:
We are grateful to the Reviewers for their suggestions and insights. We feel that the new results we obtained in addressing their suggestions (Figs R1-4) significantly elevate the level of conceptual advance provided by our paper. These new results will be included in the revised paper in case of acceptance. 

The advances from the new work, and the changes we wish to make to the paper, are summarized below. More details can be found in the replies to the individual Reviewers. 

Methods development and validation:

Mixing of sources.
We developed new simulations to evaluate the effects of asymmetric mixing of sources (which can happen in real neural data because e.g. of field spread). First, we developed a simulation of the effect of mixing a stimulus-informative source with unequal proportions in the empirically measured signals X,Y. We found that in such case, as predicted, both FIT and TE can have spurious positive values (Fig R1B). However, we also found that the permutation test that we developed and used for FIT in the submitted paper (shuffling trials with the same value of the stimulus feature) to discount the effect of common covariations in X, Y due to stimulus-signal sharing can also be used to rule out this confounder of mixing a stimulus-informative source (Fig R1B). Importantly, all previously reported real-data and FIT values were already tested against this null-hypothesis, suggesting that our FIT results cannot be explained by this artefact. Our analysis also shows that with instantaneous source mixing the ratio between stimulus information in X and Y is constant in time (Fig R1A). This provides an important heuristic to accept empirical results: data with different time course of stimulus info in X vs Y cannot be explained by instantaneous source mixing. Importantly, all the FIT real-data results in the paper are obtained in presence of a latency difference of >10ms between encoding of stimulus information in the putative sender and putative receiver (e.g. Fig R1B), incompatible with dominant mixing of a stimulus-informative source.
Finally, we simulated the case in which there is real FIT between two “pure” signals Z1 and Z2, but Z1,Z2 are unevenly mixed in the measured X,Y. We found (Fig R1C) that mixing reduced FIT and TE compared to the pure case. However, the correct directionality of info transfer was always detected for all mixtures. Thus, FIT/TE seems conservative and robust to this mixing. To our knowledge, this case was not considered in previous GC/TE literature, so this extra analysis provides progress beyond FIT relevant for the TE literature. 

More conservative MEG analysis.
Models of source separation indicate that in MEG mixing becomes negligible at distances > 2cm. We thus run a more conservative MEG analysis in a network of visual areas that are > 2.8cm apart, reducing possible source mixing. All previously reported FIT results are fully confirmed in this more conservative analysis (Fig R2C-F). 
 
Scaling of FIT with data size and dimensionality. 
We computed how FIT scales with the size of the dataset and the dimensionality of neural activity, and compared it with the behavior of Shannon information quantities such as TE. We found that FIT behaves much better than TE (smaller limited-sampling bias, less data needed for the accurate estimations, more robust to the curse of dimensionality), see Fig R4A. This is because FIT does not include synergy terms which, according to previous literature, are the most biased and data-hungry ones. We also now implemented in the FIT numerical routine the limited-sampling bias corrections of the neural information theory literature, which further help.

Comparison with DFI on real data. 
We now computed DFI, a previously proposed measure of feature-specific information transmission, also on real data. We found (Fig R3) that the problems with DFI predicted in the previous version of our paper by mathematics and simulations are also found in the neural datasets. On real data, DFI was very often negative and it didn’t detect directionality or feature specificity in cases in which we expect from previous literature that specificity or directionality should exist.

Study information about multiple features transferred simultaneously. 
In the submitted paper we already showed on real data that FIT can reveal encoding of multiple features. Simultaneous encoding of multiple stimulus features was investigated in all three datasets (MEG, EEG, spikes) and was found in two datasets (MEG, EEG). However, in the submitted paper we did not demonstrated this property with simulations. We now performed a simulated study of encoding and transmission of multiple features (Fig R4B). We simulated two independent stimulus features simultaneously encoded and transmitted (one more and one less strongly). We found that FIT identifies correctly that both features are encoded and transmitted, and ranks correctly the features about which most information is transmitted. These simulations will be added to the SM of the revised paper. 

Writing and presentation:

We will bring more details of the FIT maths (shared and unique information definition, PID lattices, mathematical properties of FIT) from the SI to the main text. We will use the extra page allowed for the FIT camera-ready paper. If space is a problem, we will move the EEG analysis figure to the SM. 

We will be clearer on how we computed the information quantities (by discretizing data, computing histograms). This information was present yet not prominent or well organized in the submitted paper. 

We all add a SM section which explains this clearly and which contains a Table with the number of bins used for each (simulated or real) dataset and Figure panel. We will add to SM3.1 a description of the requested MEG source localization (summarized from the original data publication which reports full details). 

We will better define what we mean by “feature”.


Meta-review: This paper is a methodological and applied data analysis contribution that proposes and empirically tests a novel approach for quantifying the information content of communication between brain regions.
The resulting contribution received unanimously positive reviews, with reviewers praising the clarity of the exposition, the soundness of the mathematical derivation, and the completeness of the simulation and experimental results.
Reviewers also emphasized the contribution of this work by mentioning its potential impact in applied branches of neuroscience as a method that could help elucidate complex brain functions by teasing apart the flow of different types of information.
Decision: Accept (poster)