Convolution Monge Mapping Normalization for learning on sleep data
Authors: Theo Gnassounou
Rémi Flamary
Alexandre Gramfort
Venue: NeurIPS 2023 poster (2023)
Keywords: Neuroscience
Domain adaptation
Optimal Transport
TL;DR: We propose a test-time multi-source domain adaptation method that use optimal transport on signals to adapt to the spectral variability between domains on biosignals.

Abstract: In many machine learning applications on signals and biomedical data, especially electroencephalogram (EEG), one major challenge is the variability of the data across subjects, sessions, and hardware devices. In this work, we propose a new method called Convolutional Monge Mapping Normalization ($\texttt{CMMN}$), which consists in filtering the signals in order to adapt their power spectrum density (PSD) to a Wasserstein barycenter estimated on training data. $\texttt{CMMN}$ relies on novel closed-form solutions for optimal transport mappings and barycenters and provides individual test time adaptation to new data without needing to retrain a prediction model. Numerical experiments on sleep EEG data show that $\texttt{CMMN}$ leads to significant and consistent performance gains independent from the neural network architecture when adapting between subjects, sessions, and even datasets collected with different hardware. Notably our performance gain is on par with much more numerically intensive Domain Adaptation (DA) methods and can be used in conjunction with those for even better performances.

Convolutional Monge Mapping Normalization for learning on sleep data
Theo Gnassounou
Rémi Flamary
Université Paris-Saclay, Inria, CEA Palaiseau 91 120, France theo theo. wwt..gaaasooooo@nnia.ff.r
IP Paris, CMAP, UMR 7641
Palaiseau 91 120, France
remi www.laaarryllyyeceniiiooooooo edu
Alexandre Gramfort"
Université Paris-Saclay, Inria, CEA
Palaiseau 91 120, France
al exandre. gra.mf confforrtinia... fr
Abstract
In many machine learning applications signals and biomedical data, especially electreencepaalogran (EEG), one major challenge is the variability of the data across subjects, sessions, and hardware devices. In this work, propose new method called Convolutional Monge Mapping Normalization (CMMN), which consists in filtering the signals in order adapt their power spectrum density (PSD) to a Wasserstein barycenter estimated on training data. CMMN relies on novel closed-form solutions for optimal transport mappings and barycenters and provides individual test time adaptation to new data without needing to retrain a prediction model. Numerical experiments on sleep EEG data show that CMMN leads to significant and consistent performance gains independent from the neural network architecture when adapting between subjects, sessions, and even datasets collected with different hardware. Notably our performance gain is on par with much more numerically intensive Domain Adaptation (DA) methods and can be used in conjunction with those for even better performances.
Introduction
Data shift in biological signals Biological signals, such as electroenccephalograms (EEG), often exhibit significant degree of variability. This variability arises from various factors, including the recording setup (hardware specifications, number of electrodes), individual human subjects (variations in anatomies and brain activities), and the recording session itself (electrode impedance, positioning). this paper, we focus on the problem of sleep staging which consists measuring the activities of the brain and body during session (here session is done over night of sleep) with electroencephalograms (EEG), electrooculograms (EOG), and electromyograms (EMG) [1 to classify the sleep stages. Depending on the dataset, the populations studied may vary from healthy cohorts to cohorts suffering from disease 2 3.4 4. Different electrodes positioned in the front/back 3 or the side of the head [4] can be employed. Sleep staging is perfect problem for studying the need to adapt to this variability that is also commonly denoted as data shift between domains (that can be datasets, subjects, or even sessions).
Normalization for data shift A traditional approach in machine learning to address data shifts between domains is apply data normalization. Different approaches exist in the literature to
A. Gramfort joined Meta and can be reached at agramfort@meta.commmm com
37th Conference on Neural Information Processing Systems (NcurIPS 2023).

---

normalize data. One can normalize the data per Session which allows to keep more within-session variability in the data [S) If the variability during the session is too large, one can normalize independently each window of data (e.g., 30s on sleep HEG) G], denoted as Sample in the following. It is also possible not to normalize the data, and let a neural network learn to discard non-pertinent variabilities helped with batch normalization 7 g More recently, number of works have explored the possibility of learning a normalization layer that is domain specific in order to better adapt their specificities 19 TO 12 13 14 [5.. However, this line of work usually requires to have labeled data from all domains (subjects) for learning which might not be the case in practice when the objective is to automatically label new domain without expert.
Domain Adaptation (DA) for data shift Domain Adaptation is field in machine learning that aims at adapting predictor in the presence of data shift but in the absence of labeled data in the target domain. The goal of DA is to find estimator using the labeled source domains which generalizes well on the shifted target domain [16] In the context of biological signals, DA is especially relevant as it has the ability to fine-tune the predictor for each new target domain by leveraging unlabeled data. Modern DA methods, inspired by successes in computer vision, usually try to reduce the shift between the embeddings of domains learned by the feature extractor. To do that, majority of the methods try to minimize the divergence between the features of the source and the target data. Several divergences can be considered for this task such as correlation distance [77,, adversarial method [8] Maximum Mean Discrepancy (MMD) distance [19] or optimal transport (20 21] Another adaptation strategy consists in learning domain-specific batch normalization ( in the embedding. Interestingly those methods share an objective with the normalization methods: they aim to reduce the shift between datasets. To this end, DA learns complex invariant feature representation whereas normalization remains in the original data space. Finally, test-time DA aims at adapting predictor to the target data without access to the source data [22], which might not be available in practice due to privacy concerns or the memory limit of devices.
Contributions In this work we propose novel and efficient normalization approach that can compensate at test-time for the spectral variability of the domain signals. Our approach called Convolutional Monge Mapping Normalization (CMMN), illustrated in |Figure 1] uses a novel closed- form to estimate a meaningful barycenter from the source domains. Then CMMN uses a closed- form solution for the optimal transport Monge mapping between Gaussian random signals to align the power spectrum density of each domain (source and target) to the barycenter. We emphasize that CMMN is, to the best of our knowledge, the first approach that can adapt complex spectral shifts in the data without the need to access target datasets at training time or train a new estimator for each new domain (which are the limits of DA).
We first introduce in section 2 the problem of optimal transport (OT) between Gaussian distributions, and then propose novel closed-form solution for the Wasserstein barycenter for stationary Gaussian random signals. We then use this result to propose our convolutional normalization procedure in (section 3] where implementation details and related works are also discussed. Finally (section 4 reports a number of numerical experiments on sleep EEG data, demonstrating the interest of CMMN for adapting to new subjects, sessions, and even datasets, but also study its interaction with DA methods.
Vectors are denoted by small cap boldface letters (e.g., x), and matrices are denoted by large cap boldface letters (e.g., X). The element wise product is denoted by @. The element-wise power of n is denoted by .on [K] denotes the set {1, K}. |-| denotes the absolute value. The discrete convolution operator between two signals is denoted as *, Any parameters written with small & (e.g., X or x is related to the source domain l with 1 < k S K. Any parameters written
Notations
with small (e.g., X, or x{) is related to the target domain.
2 Signal adaptation with Optimal Transport
In this section, we first provide a short introduction to optimal transport between Gaussian Distri- butions, and then discuss how those solutions can be computed efficiently on stationary Gaussian signals, exhibiting new closed-form form solution for Wasserstein barycenters.

---

Train-Time
Test-Time
Compute Barycenter
Compute PSD
Compute Barponter
Compute
Compune
Normalize
Normalize
ftor
Compute
Nomolla data
Normalias
Mive MK
deca
Train classifeer
Inference
Classifer
Classifier
Temporal space
Frequincy space
Raw signal
signal
Leamable
Fixed
parameters
pansmeters
Figure I: Illustration of the CMNN approach. At train-time the Wasserstein barycenter is estimated from 3 subjects/domains. The model is learned on normalized data. At test time the same barycenter is used normalize test data and predict.
2.1 Optimal Transport between Gaussian distributions
Monge mapping for Gaussian distributions Let two Gaussian distributions μt, = -M,m,, E.) and 14 N (m,, Σt), where E, and E, are symmetric positive definite covariances matrices. OT between Gaussian distributions one of the rare cases where there exists a closed-form solution. The OT cost, also called the Bures- Wasserstein distance when using quadratic ground metric, is (23 24
W (Ue: Pc) ||m m2l12 + Σ, E, - (
where the second term is called the Bures metric [25] between positive definite matrices. The OT mapping, also called Monge mapping, can be expressed the following affine function
m(x) A(x m.) m. with A Σ Σ Σ.
AT
(2)
In practical applications, one can estimate empirically the means and covariances of the two distri- butions and plug them into the equations above. Interestingly, in this case, the concentration of the estimators has been shown to be in ONN-/ where N is the number of samples, for the divergence estimation (26) and for the mapping estimation (27]. This is partieularly interesting because optimal transport in the general case is known to be very sensitive to the curse of dimensionality with usual concentrations in (ON-1/D) where D is the dimensionality of the data 28
Wasserstein baryeenter between Gaussian distributions The Wasserstein barycenter that searches for an average distribution can also estimated between multiple Gaussian distributions μ4. This barycenter expressed as
1 K
p arg min
Σ w (H,
Interestingly, the barycenter is still Gaussian distribution jt (m,, Σ) (29]. Its mean m K Σ. m. can be computed as an average of the means of the Gaussians, yet there no closed-form for computing the covariance Σ. In practical applications, practitioners often use the following optimality condition from 29
1
1 K
E
Σ
S
K k=1
3

---

in fixed point algorithm that consists in updating the covariance [30 using equation 4 above until convergence. Similarly the distance estimation and mapping estimation, statistical estimation of the barycenter from sampled distribution has been shown have a concentration in O(N 1/2) [31]
2.2 Optimal Transport between Gaussian stationary signals
We now discuss the special case of OT between stationary Gaussian random signals. this case, the covariance matrices are Toeplitz matrices. A classical assumption in signal processing is that for a long enough signal, one can assume that the signal is periodic, and therefore the covariance matrix is a Toeplitz circulant matrix. The circulant matrix can be diagonalized by the Discrete Fourier Transform (DFT) Σ- = (piag(p)) with and F* the Fourier transform operator and its inverse, and p the Power Spectral Density (PSD) of the signal.
Welch PSD estimation As discussed above, there a direct relation between the correlation matrix of signal and its PSD. In practice, one has access to matrix X E RN*x containing N signals of length T that are samples of Gaussian random signals. In this case, the PSD of one random signal
can be estimated using the Welch periodogram method 322 with p N Σ the element-wise magnitude of the complex vector.
iimi Fx; [02 where is
Monge mapping between two Gaussian signals The optimal transport mapping between Gaus-
sian random signals can be computed from (2) and simplified by using the Fourier-based eigen- factorization of the covariance matrices. The mapping between two stationary Gaussian signals of PSD) respectively ps and pa be expressed with the following convolution
227
Ps --
m(x) = h x with h= F" Pr
(5)
Note that the bias terms and m, do not appear above because one can suppose in practice that the signals are centered (or have been high-pass filtered to centered), which means that the processes are zero-mean. The Monge mapping is a convolution with filter h that can be efficiently estimated from the PSD of the two signals. It was suggested in [27] as a Domain Adaptation method to compensate for convolutional shifts between datasets. For instance, it enables compensation for variations such as differing impedances, which can be physically modeled as convolutions [33]. Nevertheless, this paper focused theoretical results, and evaluation real signals is reported. Moreover, the method proposed in (27] cannot be used between multiple domains (as explored here). This is why in the following we propose novel closed-for form for estimating barycenter of Gaussian signals that we will use for the normalization of our CMMN method.
Wasserstein barycenter between Gaussian signals As discussed above, there is no known closed- form solution for a Wasserstein barycenter between Gaussian distributions. Nevertheless, in the case of stationary Gaussian signals, one can exploit the structure of the covariances to derive closed-form solution that we propose below.
Lemma Consider K centered stationary Gaussian signals of PSD P& with k E [K], the Wasser- stein barycenter of the K signals is a centered stationary Gaussian signal of PSD P with:
K
62
p
Ps
(6)
K
The proof is a direct application of the optimality condition (4) of the barycenter. The factorized covariances in (4) the matrix square root and the inverse can be simplified element-wise square root and inverse, recovering equation (T].. We provide a detailed proof in the appendix.
PROOF.
The closed-fome form solution is notable for several reasons. First, it is a novel closed-fome solution that avoids the need for iterative fixed-point algorithms and costly computations of matrix square roots. Secondly, the utilization of the Wasserstein space introduces an alternative approach to the conventional & averaging of Power Spectral Density (PSD). This approach involves employing the square root, like the Hellinger distance [4 potentially enhancing robustness to outliers. Note that while other estimators for PSD averaging could be used this choice is motivated here by the fact that use OT mappings and that the barycenter above is optimal w.r.t. those OT mappings.

---

3 Multi-source DA with Convolutional Monge Mapping Normalization
We now introduce the core contribution of the paper, that is an efficient method that allows to adapt to the specificities of multiple domains and train a predictor that can generalize to new domains at test time without the need to train a new model. We recall here that we have access to K labeled source domains (X&, Y&) We assume that each domain contains N& centered signals x of size T.
CMMN at train time The proposed approach, illustrated in Figure D and detailed in Algorithm consists of the following steps:
1. Compute the PSD Pa for each source domain and use them to estimate the barycenter p with
(TT).
Compute the convolutional mapping ha (5) between each source domain and the barycenter p.
3. Train predictor the normalized source data using the mappings hg:
K
No T. (Vt. xx))
min
k=
In order to keep notations simple, we consider here the case for a single sensor, but CMMN can be extended to multi-sensor data by computing independently the Monge mapping for each sensor. Note that steps and 2 can be seen as a pre-processing and are independent of the training of the final predictor, so CMMN can be used as pre-processing any already existing learning framework.
CMMN at test time At test time, one has access to a new unlabeled target domain (X₂) and the procedure, detailed in Algorithm 2 is very simple. One can es- timate the PSD p. from the target domain unlabeled data and compute the mapping h, to the barycen- ter p. Then the final predictor for the new domain is fxxx) = s(, x:), that is the composition of the domain-specific mapping to the barycenter of the training data, and the already trained predictor f. This is a very efficient test-time adaptation approach that only requires an estimation of the target domain PSD that can be done with few unlabeled target sam- ples. Yet, it allows for final predictor to adapt to the spectral specificities of new domains thanks to the convolutional Monge normalization.
Algorithm 1: Train- Time CMMN
Input: f, F, { {
for = + K do
Pk + Welch PSD estimation of Xx
end
P < Compute barycenter with III
for = + K do
h2 < Compute mapping from
end
f < Train on adapted data with return f. P
Algorithm 2: Test-Time CMMN
Input: f. p. X, P: Welch PSD estimation of X, h, + compute mapping from return y, fhb XX)
Numerical complexity and filter size The numer- ical complexity of the method is very low as it only requires to compute the PSD of the domains and the barycenter in O EK NgT log()) ). It is also im- portant note that in practice, the method allows for size of normalization filter F that is different (smaller) than the size T of the signals. This consists in practice in estimating the PSD using Welch periodogram signal windows of size F < T that can be extracted from the raw signal or from already extracted fixed sized source training samples. Indeed, if we use F = T then the estimated average PSD can be perfectly adapted by the mapping, yet using many parameters can lead to overfitting which can be limited using a smaller filter size F < T, In fact, it is interesting to note that the special case F = 1 boils down to scaling of the whole signal similar what is done with a simple z-score operation. This means that the filter size F is an hyperparameter that can be tuned on the data. From an implementation point of view, one can use the Fast Fourier Transform (FFT) to compute the convolution (for large filters) or the direct convolution, which both have very efficient implementation on modern hardware (CPU and GPU).
CMMN is a computationally efficient approach that benefits from wide array of recent results in optimal transport and domain adaptation. The idea of using optimal transport to adapt distributions was first proposed in [35.. The idea to compute a Wasserstein barycenter of distributions
Related Works
5

---

from multiple domains and use it for adaptation was introduced in [2]] Both of those approaches have shown encouraging performances but were strongly limited by the numerical complexity of solving the OT problems (mapping and barycenters) on large datasets (o{E K N log(N&s) or at least quadratie in N₂ for entropic OT). CMMN does not suffer from this limitation as it relies on both Gaussian and stationary signals assumptions that allow to estimate all the parameters for a complexity O N Iog(NN)) linear with the number of samples N2. and quasi-linear in dimensionality of the signals T' The use of Gaussian modeling and convolutional Monge mapping for DA was first proposed in [27] but the paper was mostly theoretical and only focused on the standard 2-domain DA problem whereas CMMN handles multi-source and provides test-time adaptation.
Finally, CMMN also bears resemblance with the convolutional normalization layer proposed in [[] that also uses the FFT for fast implementation. Yet, it needs be trained using labeled source and target data, which prevents its use on DA at test time new unseen domains.
4 Numerical experiments
In this section, we evaluate CMMN on the clinical application of sleep stage classification from EEG signals with 66 36] In the following one domain can be a session of one subject (i.e., the domain- specific experiment in Section 4.2) or one subject (i.e., all other experiments). We first compare CMMN to classical normalization methods and subject-specific normalizations. Next, we illustrate the behavior of CMMN when used with different neural network architectures, and study the effect of CMMN on low-performing subjects. Finally, we study the use of CMMN in conjunction with domain adaptation approaches. In order to promote research reproducibility, code is available on github 2 and the datasets used are publicly available.
4.1 Experimental setup
Sleep staging datasets We use three publicly available datasets: Physionet (a.k.a SleepEDF) B) SHHS 4 37 and MASS (2). On all datasets, we want to perform sleep staging from 2-channels EEG signals. The considered EEG channels are 2 bipolar channels, Fpz-Cz and Pz-Cz that have been known to provide discriminant information for sleep staging. Note that those channels were not available on the SHHS dataset, and we used the C3-A2 and C4-A1 instead. This brings another level of variability in the data. More details about the datasets are available as supplementary material.
Pre-processing For all experiments, we keep 60 subjects of each dataset and the two EEG channels. The same pre-processing is applied to all sensors. First, the recordings are low-pass filtered with 30 Hz cutoff frequency, then the signals are resampled to 100 Hz. Then we extract 30 s epochs having unique class. This pre-processing is common in the field 6 38) All the data extraction and the pre-processing steps are done with MNE-BIDS 33 and MNE--ytthn [40]
Neural network architectures and training Many neural network architectures dedicated to sleep In the following, we choose to focus on two architectures: For both architectures, we use the implementation from brain- decode [42). Chambon is an end-to-end neural network proposed to deal with multivariate time series and is composed of two convolutional layers with non-linear activation functions. DeepSleepNet is a more complex model with convolutional layers, non-linear activation functions, and a Bi-LSTM to model temporal sequences.
staging have been proposed 88
Chambon (6] and DeepSleepNet
We use the Adam optimizer with a learning rate of 10 30 for Chambon and 10-4 with a weight decay of 1 x 10-3 for DeepSleepNet. The batch size is set to 128 and the early stopping is done on a validation set corresponding to 20% of the subjects in the training set with patience of 10 epochs. For all methods, we optimize the cross entropy with class weight, which amounts to optimizing for the balanced accuracy (BACC).
Various metrics are commonly used in the field such as Cohen's kappa, Fl-score, or Balanced Accu- racy (BACC) [6 6. We report here the BACC score as it is metric well adapted to unbalanced classification tasks such as sleep staging. We also report in some experiments the gain the balanced accuracy, when using CMMN, of the 20% worst performing domains/subjects in the target domain denoted as A in the following.

---

BACC for SHHS
MASS
Duraias VNomm.
None B
Sempl=
G
Session
CPPN
None-
MASS -MSSS
T3.9
+
1.4
75.1
+ 1.0
76.0
2 2.4
76.2
+ 2.2
Plys - Phys.
88.8 + 2.8
69.2
+ 2.7
89.
1 3.0
71.7
: 2.4
SIIDS -SSS-- SUDs
55.1
12.5
61.2
3.8
80.8 1 2.6
64.3
1: 2.7
Sample-
MASS Phys
55.9
3.1
58.4
2.4
57.5 2.0
62.3
1.5
MASS SHHS
45.8 + 9.3
41.8
37.4 3.6
47.6
4.0
Plys -ASSS
63.8
+ 3.9
64.0 + 2.7
63.7 2.3
68.3
+ 2.5
Session
Plax SSHHS
2.1
47.9
1.8
SHHS MASS
S1IT1 1 Phys
48.7
4.2
55.0
67.0
2.7
2.8
$..4
51.8 6.4
64.5
58.3 1.7
2.8
CMMN
57.6
58.6
2.6
3.14
62.7 2.4
BACC
Table 1: Balanced accuracy (BACC) for different normalizations and different train/test dataset pairs (left). Boxplot for all normalization approaches on the specific pair SHHS *MASS (right). CMNN outperforms other normalizations.
Filter size and sensitivity analysis for CMMN Our method has a unique hyperparameter that the size of the filter F used. In experiments, we observed that, while this parameter has some impact, it is not critical and has quite a wide range of values ((8, 512)) that leads to systematic performance gains. We provide in supplementary material sensitivity analysis of the performance for different adaptation scenarios (pairs of datasets). It shows that the value = 128 a good trade-off that we used below for all experiments.
4.2 Comparison between different normalizations
We now evaluate the ability of CMMN to adapt to new subjects within and across datasets and also between two sessions of the same subject.
Classical normalizations We first compare CMMN to several classical normalization strategies. We compare the use of raw data (7 letting the neural network learn the normalization from the data (None), standard normalization of each samples (6) that discard global trend along the session (Sample) and finally normalization by session that consists in our case to perform normalization independently on each domain (Session) (5) We train the Chambon neural network on the source data of one datasct and evaluate on the target data of all other datasets for different splits. The BACC for all dataset pairs and normalization are presented in the Table I] The three classical normalizations have similar performances with slight edge for Sample approaches are outperformed by CMMN in out of 9 dataset pairs with an average gain of 4% w.r.t. the best performing Sample. This is also visible the Boxplot on the right where the BACC for all subjects/domains (i.e., points) is higher for CMMN. Since the very simple Sample normalization the best- test-performng competitor, used it baseline called No Adapt in the following.
average. All those
Domain specific normalization We have shown above that the CMMN approach allows to better cope with distribution shifts than standard data normalizations. This might be explained by the fact that CMMN normalization is domain/subject specific. This is why we now compare to several existing domain-specift normalizations. To do this we adapt the method of Liu et al. [1]] which was designed for image classification. We implemented domain-speciff convolution layers (Conv), batch normalization (Norm), or both (ConvNorm). In practice, we have one layer per domain that is trained (jointly with the predictor f') only on data from the corresponding domain. The limit of domain-specifie normalization is that all test domains must be represented in the training set. Otherwise, if a new domain arrives in the test set, no layer specific to that domain will have been trained.
To be able to compare these methods to CMMN, we use for this section the Physionet dataset for which two sessions are available for some subjects. The first sessions are considered as the training set where the domains are the subjects and the second sessions are split between the validation set (20%) and the test set (80%). The validation set is used to the early stopping, and validate the kernel size of the
convolution for Conv and ConvNorm.
We can see in Table 2 that for cross-session adaptation, the gain with CMMN is smaller than previous results (1 % BACC gain), which can be explained by the presence of subjects data in both domains resulting a smaller shift between distribution. However, CMMN outperforms all other subject-specific normalizations which are struggling to improve the results (i.e., around 4% of BACC loss).
7

---

BACC between session Physionet's subjects
No adapt
Normalization
BACC
Conv
**
No Adapt
73.7 + 0.7
Conv
67.5 + 2.7
Norm
69.4 + 1.6
ConvNorm
68.1 + 1.3
ConvNorm
CMMN
74.8 + 0.6
CMMN
0.8
BACC
Table 2: Balanced accuracy (BACC) for different subject-specifie normalizations and CMMN (left).
Boxplot for all normalization approaches (right). CMNN outperforms subject-speeific normalizations.
Architecture
Chambon
DeepSleeptlet
No Adapt
CMMN
No Adapt
CMMN
MASS -MASS
75.1 + 1.0
76.2 + 2.2
73.3 + 1.7
73.1
Phys.-Phys.
69.2 + 2.7
71.7 1 2.4
66.5 + 2.5
69.4 2.5
SHISS SHIIS
61.2 + 3.8
64.3 1 2.7
58.7 + 2.3
60.1 + 3.5
MASS +Phys.
2.4
62.3 + 1.5
50.1 2.4
5.2
MASS SSHHS
41.8
47.6 + 4.0
38.3
47.8 +
Phys.
2.77
68.3
1 2.5
59.5
62.1 1 1.9
Phys. Phys.++SHII +SHHS
45.6 2.1
51.6
1.8
4.2
48.6
1 1.6
SHISS -MASS
2.8
64.5
51.2
56.8
6.1
SHHS- Phys.
55.0 2.7
5
4.8
5..7
Mean
2.6
62.7
54.6 2.9
3.2
Table 3: Balanced accuracy (BACC) for different train/test dataset pairs and for different architectures (Chambon/DeeSSeeeplltt) CMMN works independently of the network architecture.
4.3 Study of the performance gain: neural architecture and human subjects
Previous experiments have shown the superiority of CMMN over all the other normalizations. this section, study the behavior of CMMN on different neural network architectures and study which subject gains the most performance gain.
Performance of CMMN with different architectures In addition to Chambon that was used in evaluate CMMN considering different network architecture:
the previous experiments, DeepSleepNet [7]. The results for both architectures are reported in (Table 3] where CMMN is consistently better for both architectures. Notably, the only configuration where the gain is limited is MASS MASS with DeepSleepNet because MASS is the easiest dataset with less variability than other pairs. Finally, were surprised see that DeepSleepNet does perform well as Chambon on cross-datased adaptation, probably due to overfitting caused by more complex architecture.
Performance gain on now-performing subjects In medical applications. it often more critical to have model that has a low failure mode, rather than the best average accuracy. As first step toward studying this, report two scatter plots reported Table 4 plotting the BACC for individual target subjects without adaptation as function of the BACC with CMMN, for different architectures and dataset pairs. First, the majority of the subjects are above the axis x y, which means that CMMN improves their score. But the most interesting finding is the large improvement for the low- low-performing subjects that can gain from 0.3 to 0.65 BACC.
We also provide in Table 4 the ABACC@ 20, that is the average BACC gain on the 20% lowest performing subjects without adaptation. On average, both architectures increase by the BACC on those subjects, when it is only increased by 4% for all subjects. Some ABACC @20 are even greater

---

BACC MASS Physionet
0.8
Arta
Charbon
Deup&looplee
7
0.7
-MSSS
3.3 8.6
1.8 3.8
0.6
CMMN
MASS -ASS-SSHHS
7.5 2.8
11.7
2.8
0.5
MMSS
6.9 2.8
3.6 1:6:22 2.1
Phys
5.0
6.9
4.5
4.5
SEIIS -MASS
15.0 5.3
9.5
0.4
0.3
6.5 3.4
9.9 6.3
SHISS- -
4.2
3.6 4.0
0.3
0.2
7.0
6.8
0.4
No adapt
No adapt
Table ABACC@20 for different train/test dataset pairs and for different architectures (ChamoonDDegSLeepplee)) (left). Scatter plot of balanced accuracy (BACC) with No Adapt as a fuction of BACC with CMMN and the dataset pair SHHS + MASS with Chambon (center) and on the dataset pair MASS Physionet with DeepSLeepNet (right). CMMN leads to big performance boost on the low-performing subjects.
BACC
2BACCW20
Adhpt
No Adapt
BANN
CM9
CNNN-DRMN
DANN
CMNN
CHNN-DAXN
MASS->Plyy
59.2
6.1
60.9 = 1.0
62.9 0.8
62.9
2.0 5.9
5.3 5.8
5.5 = 6.2
MASS-OSHHS
Phy--OMASS
63.3
0.7
68.9
69.1
PhyS-SSHHS
43.1
6.3
46.4
= 2.6
50.0
40.9
2.8
5.3
8.2 5.7
9.7 6.1
MHSSS
59.9
39.4
1.1
66.6 2.5
66.3
0.4
2144220 2.8
13.4
1..4=8.0
12.6
2.7
SHyS
5.1
1..
Mean
54.9
4.5
55.4
6..0
59.6
2.144
8.5.14.4
9.1 4.9
Table 5: Balanced accuracy (BACC) and ΔBACC@20 for different train/test dataset pairs and for different adaptation methods. CMMN outperforms DANN and CMMN+DANN on average on all subjects. Combining CMMN DANN improves the lower-performing subjects.
than 10% dataset pairs. These results show the consistency of the method on all subjects but also the huge impact on the more challenging ones.
4.4 Complementarity of CMMN with Domain Adaptation
We have shown in the previous experiments that CMMN is clearly the best normalization in many settings. But the main idea of CMMN is to adapt the raw signals common barycentric domain. Interestingly, many Domain Adaptation (DA) methods also try to reduce the discrepancies between datasets by learning a feature representation that is invariant to the domain. In this section, we compare the strategies and investigate if they complementary.
We implement the celebrated DA method DANN (18] that aims at learning a feature representation that invariant the domain using adversarial formulation. Note that this DA approach is much more complex than CMMN because it requires to have access to the target data during training and a model needs to be trained for each new target domain. The choice of hyperparameters for DA methods is not trivial in the absence of target labels. But since we have access to several target domains, we propose to select the weight parameters for DANN using validation
20% of the target subjects [43] Note that this is not a realistic setting since in real applications the target domains are usually labeled, yet it is way compare the two approaches in configuration favorable for DA. We focus on tross-dataset adaptation where many shifts are known to exist: different sensors (SHHS vs Physionet/MASS), doctor scoring criteria (SHHS/MASS vs Physionet), or brain activity (SHHS vs MASS vs Physionet).
We report in Table 5 the BACC and ABACC@20 for all dataset pairs and all combinations of CMMN and DANN with Chambon. First, we can see that the best approaches are clearly CMMN and CMMN+DANN, CMMN is better in BACC on 4/6 dataset pairs and CMMN-DANN better ABACC@ 20 on 4/6 dataset pairs. First, it is very impressive performance for CMMN that is much simpler than DANN and again does not use target data when learning the predictor f. But it also illustrates the interest of DMNN especially for perforrfrning subjects.

---

Table 6: BACC for different PSD targets for the mapping.
Target PSD
None
Barycenter
Powerlaw
Whitening
MASS-MAS
75.1 1.0
77.1 + 1.3
75.6 = 2.4
73.2 + 6,4
MASS PPhysiney
58.4
62.6 2.0
63.1 1.5
63.2 + 1.0
MASS SSHSS
41.8 3.6
50.4
51.9 3.0
52.4 + 2.4
-MSS
2.70
68.0 1.5 1.5
66.7 2.5
65.9
Physiontt-PPhysionet
2.7
72.3 + 1.8
66.9 16.5
71.3 1.9
Physionet--SHHHS
4.1
52.5
1.9
53.9 1.7
54.0 + 2.4
SHISS -MASS
2.8
65.9
3.2
59.0 = 13.9
59.0 + 13.8
SHISS Phhysoone
55.0
62.0 3.2
56.5
55.9 1 12.8
SHHS-SHHS
6.88
63.5 3.2
63.6
62.4 2.8
Mean
58.6 2.6
63.8 2.9
61.9 6.4
61.9 1 5.1
4.5
Different PSD targets
CMMN has shown a significant boost in performance for different adaptations in various settings. The method consists of learning barycenter, and mapping all domains to this barycenter to obtain a homogeneous frequency spectrum. Mapping to the barycenter is one way to achieve this, but it reasonable evaluate the optimality of this choice by comparing to alternatives. For example. the classical method called spectral whitening is equivalent to OT mapping towards uniform PSD, which is equivalent a white noise PSD. this part, we propose compare the mapping to different PSD) targets: barycenter (classic CMMN), white noise PSD (whitening), or non-uniform power-law. The last PSD) target mathematical distribution that describes functional relationship between frequency and magnitude, where magnitude is inversely proportional to the power of the frequency P()) ff Below we selected a 0.659 for the experiment.
The table Table 6 gives the BACC score of the mapping for the different PSD targets and shows the importance of the reference PSD. First, we can see that mapping to a PSD increases the score significantly w.r.t. raw data. Second, the mapping to the Wasserstein barycenter (i.e., CMMN) is not always the better performer (only 5/9), but overall, CMMN gives better results (2% higher) and with less variance. The robustness of the chosen PSD target, coupled with the fast computation of the barycenter, makes CMMN a strong and easy-to-compute normalization method for time series.
Conclusion
We proposed in this paper a novel approach for the normalization of bio-signals that can adapt the spectral specificities of each domain while being a test-time adaptation method that does not require retraining new model. The method builds on new closed-form solution for computing Wasserstein barycenters on stationary Gaussian random signals. We showed that this method leads to systematic performance gain on different configurations of data shift (between subjects, between sessions, and between datasets) and on different architectures. We also show that CMMN benefits greatly the subjects that had bad performances when trained jointly without sacrificing performance on well- peel-prrdicted subjects. Finally, we show that CMMN even outperforms DA methods and can be used in conjunction with DA for even better results.
Future work will investigate the use of CMMN for other biomedical applications and study the of the estimated filters h2 as vector representations of the subjects that can be used for interpretability. Finally, we believe that research direction worth investigating is the federated estimation of CMMN with the objective learning an unbiased estimator in the context differential privacy 44 45).
10

---

6 Acknowledgement
The authors thank Antoine Collas, Cédric Allain, and Nicolas Courty for their valuable comments on the manuscript, and Lina Dalibard for her help with Figure 1, Numerical computation was enabled by the scientific Python ecosystem: NumPy [46], SciPy [47], Matplotlib [48]. Seaborn [49], PyTorch [50), and MNE for EEG data processing 40). This work was partly supported by the grants de la recherche (ANR).
and ANR-20-IADI-OGE and ANR-23
from Agence nationale
References
[1] S. Stevens and G. Clark, "Chapter 6 polysomnography."] Sleep Medicine Secrets,
D. STEVENS, ed., pp. 45-63, Hanley & Belfus, 2004.
[2] C. O'Reilly, N. Gosselin, and J. Carrier, "Montreal archive of sleep studies: an open-access resource for instrument benchmarking and exploratory research," Journal of sleep research 23 (06, 2014)
[3] A. L. Goldberger, L. A. Amaral, L. Glass, J. M. Hausdorff. P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C.-K. Peng, and H. E. Stanley, "PhysioBank, PhosioToolkit, and PhysioNet: components of research resource for complex physiologic signals," circulation 101 no. 23, (2000) e215-e220.
[4] G.-Q. Zhang, I.. Cui, R. Mueller, S. Tao, M. Kim, M. Rueschman, S. Mariani, D. Mobley, and S. Redline, "The national sleep research resource: Towards sleep data commons," Journal of the American Medical Informatics Association (08, 2018) 572-572
[5] A. Apicella, F. Isgrò, A. Pollastro, and R. Prevete, "On the effects of data normalisation for domain adaptation EEG data," MarXiv:2211 01081 [cs.LG]]
[6] S. Chambon, M. Galtier, P. Aral, G. Wainrib, and A. Gramfort, "A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series,"
teXivv1700 03321
ML]
[7] A. Supratak, H. Dong, C. Wu, and Guo, "DeepSleepNet: A model for automatic sleep stage scoring based on raw single-channel EEG," TEEE Transactions on Neural Systems and Rehabilitation Engineering 25 no. 11, nov 1ww1998-200
[8] M. Perslev, S. Darkner, L. Kempfner, M. Nikolic, P. Jennum, and C. Igel, "U-Sleep: resilient high-frequency sleep staging," npj Digital Medicine 4 (04, 2021) 72
[9] Y. Li, N. Wang, J. Shi, J. Liu, and X. Hou, "Revisiting batch normalization for practical domain adaptation," " arXiv preprint arXiv:1603.000 044779 (2016).
[10] O. Chehab, A. Defossez, J.-C. Loiseau. A. Gramfort, and J.-R. King, "Deep recurrent encoder:
A scalable end-to-end network to model brain signals," serxiv:2103 02339 [q-bio.Nu NC]
[11] S. Liu, X. Li, Y. Zhai, C. You, Z. Zhu, C. Fernandez- Grmmandz-GGradd,, and Q. Qu, "Convolutional normalization: Improving deep convolutional network robustness and training." arXiv:2103. 00673 [cs.CV]
[12] X. Wei, A. A. Faisal, et al., "2021 BEETL competition: independence and heterogenous eeg data sets," Proceedings of the NeurlPS 202/ Competitions and Demonstrations Track, D. Kiela, M. Ciccone, and B. Caputo, eds., vol. 176 of Proceedings of Machine Learning Research, pp. 205 2299. PMLR, 06-14 dec, 2022.
Advancing transfer learning for subject
[13] R. Csaky, M. V. Es, O. Jones, and M. Woolrich, "Group-lvvel brain decoding with deep learning," arxiv 2205. 14102 LG]
[14] R. J. Kobler, J. ichiro Hirayama, Q. Zhao, and M. Kawanabe, "SPD domain-specinn batch normalization to crack interpretable unsupervised domain adaptation in EEG,"
arXiv:2209 22....1233.3.3 01323 LG]
[15] H. Phan, F. Heremans, O. Y. Chén, P. Koch, A. Mertins, and M. De Vos, "Improving automatic sleep staging via temporal smoothness regularization," in ICASSP 2023 2023 IEEE International Conference Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. 2023,

---

[16] J. Quinonero-Candee M. Sugiyama, A. Schwaighofer, and N. D. Lawrence, Dataset shift in machine learning. Mit Press, 2008.
[17] B. Sun and K. Saenko, "Deep CORAL: Correlation alignment for deep domain adaptation." "
1xXiv:1607.017:
[v]
[18] Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and training of neural networks," drxivv:105: 07818
V. Lempitsky,
[stat. ML]
[19] M. Long, Y. Cao. J. Wang, and M. I. Jordan, "Learning transferable features with deep adaptation networks," arXiv: 1502. 02791 [LG
[20] B. B. Damodaran, B. Kellenberger, R. Flamary, D. Tuia, and N. Courty, "DeepJDOT: Deep joint distribution optimal transport for unsupervised domain adaptation," arxiv: 1803. 10081 [cs.cV]
[21] E. F. Montesuma and F. M. N. Mboula, "Wasserstein barycenter for multi-source domain adaptation," " in Proceedings of the IEEE/CVE conference on computer vision and pattern recognition, pp. 16785-16793. 2021.
[22] D. Chen, D. Wang, T. Darrell, and Ebrahimi, "Contrastive test-time adaptation." arXiv: 2204. 10377 [cs.CV]
[23] R. Bhatia, T. Jain, and Y. Lim, "On the bures- distance between positive definite matrices," Expositiones Mathematicae 37 no. 2. (2019) 165-191.
[24] G. Peyré and M. Cuturi, "Computational optimal transport," arXiv: 1803. [stat. ML.]
[25] P. J. Forrester and M. Kieburg, "Relating the Bures measure the Cauchy two-matrix model," Communications in Mathematical Physics 342 no. 1, (Oct, 2015) 151-187
[26] K. Nadjahi, A. Durmus, P. E. Jacob, R. Badeau, and U. Simsekli, "Fast approximation of the distance using concentration of random projections," Advances in Neural Information Processing Systems 34 (2021) 12411-12424.
[27] R. Flamary, K. Lounici, and A. Ferrari, "Concentration bounds for linear Monge mapping estimation and optimal transport domain adaptation," "" arXiv: 1905. 10155 [etat.ML..
[28] N. Fournier and A. Guillin, "On the rate of convergence in wasserstein distance of the empirical measure," Probability theory and related fields 162 no. 3-4, (2015) 707-738.
[29] M. Aguch and G. Carlier, "Barycenters in the wasserstein space," SIAM Journal on Mathematical Analysis 43 no. 2, (2011) 924 https://doii org/ 10. 11..113/100005777777 1137/100805744
https://doi.or
[30] Y. Mrouch, "Wasserstein style transfer,"
ar0a:: transfet""arxiiv:1900
12828 [cs.
[31] A. Kroshnin, V. Spokoiny, and A. Suvorikova, "Statistical inference for Mures-Wasserstein barycenters," The Annals of Applied Probability 31 no. 3, (2021) 1264-1298.
[32] P. Welch, "The use of fast fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms, TEEE Transactions on Audio and Electroaconstiics 15 no. 2, (1967) 70-73
[33] A. V. Oppenheim,, A. S. Willsky, and S. H. Nawab, Signals & Systems (2nd Ed.). Prentice-Hall, Inc., USA, 1996.
[34] R. Bhatia, S. Gaubert, and T. Jain, "Matrix versions of the hellinger distance," Letters in Mathematical Physics 109 (2019) 1777-1804.
[35] N. Courty, R. Flamary, and D. Tuia, "Domain adaptation with regularized optimal transport," in Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2014, Nancy, France, September 15-19, 2014. Proceedings, Part I 14, pp. 274-289, Springer. 2014.
[36] H. Phan, O. Chen, M. C. Tran, Koch, A. Mertins, and M. D. Vos, "XSleepNet: Multi-view sequential model for automatic sleep staging." TEEE Transactions Puttern Analysis and Machine Intelligence 44 no. 09, (Sep. 2022) 5903-5915
[37] S. Quan, B. Howard, el al., "The sleep heart health study: Design, rationale, and methods," " Sleep 20 (01, 1998) 1077-85
12

---

[38] J. B. Stephansen, A. N. Olesen, et al., "Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy," Nature Communications no. I, (Dec, 2018)
[39] S. Appelhoff, M. Sanderson, al., "MNE-BIDS: Organizing electrophyssooooicaal data into the BIDS format and facilitating their analysis." Journal of Open Source Software 4 no. 44, (2019) 1896.
[40] A. Gramfort, M. Luessi, aL, "MEG and EEG data analysis with MNE-Python, Frontiers in Neuroscience no. 267, (2013) 1-13
[41] E. Eldele, Z. Chen, C. Liu, M. Wu, C.-K. Kwoh, Li, and C. Guan, "An attention-based deep learning approach for sleep stage classification with single-channel EEG," IEFE Transactions on Neural Systems and Rehabilitation Engineering 29 (2021) 809-818
[42] R. T. Schirrmeister, J. T. Springenberg, L.. D. J. Fiederer, M. Glasstetter, K. Eggensperger, M. Tangermann, F. Hutter, W. Burgard, and T. Ball, "Deep learning with convolutional neural networks for EEG decoding and visualization." Human Brain Mapping (Aug, 2017)
[43] T. Salvador, K. Fatras, I. Mitliagkas, and A. Oberman, "A reproducible and realistic evaluation of partial domain adaptation methods," arXiv 2210 01210 [cs.Cv]]
[44] K. Wei, J. Li, M. Ding, C. Ma, H. H. Yang. F. Farokhi, Jin, Q. Quek, and H. V. Poor, "Federated learning with differential privacy: Algorithms and performance analysis," /EEE Transactions on Information Forensics and Security (2020) 3454-3469.
[45] Kairouz, H. McMahan, et al., "Advances and open problems in federated learning."
Foundations and Trends@ in Machine Learning 14 no. 1 1-2, (2021) 1-210.
[46] C. R. Harris, K. Millman, et al., "Array programming with NumPy.". https:://vee wwwpw/.ttur...o.tm nature. Nature Publishing Croup.
020- Number: 7825 Publisher:
[47] Virtamen, R. Gommers, et al., "SciPy 1.0: fundamental a for scientific computing in
httboonn..ttttt////.e /ww::///wwwwwr/ nature. ctt.lurre.om//rttteeeeeeeee hwtp:///rrriiileeeess///21111-00
Number: 3
Publisher: Nature Publishing Group.
[48] D. Hunter, "Matplotlib: 2d graphics environment," Conference Name: Computing in Science & Engineering.
[49] M. L.. Waskom, "seaborn: statistical data visualization,"
htops://joss.theppe org. wwtp:/ppp.//1......... 21105/ 03021
[50] A. Paszke, S. Gross, al., "PyTorch: An imperative style, high high-performance deep learning
library," in Advances in Neural Information Processing Systems, vol. 32. Curran Associates, Inc. htttps:/ hadoe288eee1122225557777777700.0
[51] A. Hobson, "A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects: A. Rechtschaffen and A. Kales (editors). (public health service, u.s. government printing office, washington, d.c., 1968, p.. $4.00)," Eleetrreencepaalggrppyy and Clinical Newrophysiology 26 (1969) 644.
[52] C. Iber, S. Ancoli-Israel A. Chesson, and S. Quan, "The AASM manual for the scoring of sleep and associated events: Rules, terminology and technical specifications," Westchester, IL: American Academy of Sleep Medicine (01, 2007).
13

---

A Supplementary material
A.1 Proof of the convolutional Wasserstein barycenter
PROOF. Consider K centered stationary Gaussian signals of covariance En ps (respectively PSD P&) with & E [K], the Wasserstein barycenter of the signals is a centered stationary Gaussian signal of PSD p with:
k K
Σ
Σ
(8)
k=1
The signals are supposed to be stationary. Therefore the covariance matrix is a Toeplitz circulant matrix. The circulant matrix be diagonalized by the Discrete Fourier Transform (DFT) Σ Fd with F and F' the Fourier transform operator and its inverse, and p the Power Spectral Density (PSD) of the signal. The above equation becomes:
K
p
0o
Pk
K
The matrix square root and the inverse become clement- wise square root and inverse. The equation becomes easier, and the term be managed to isolate p.
0
p
p
K
k=
p
Pk
K
K
0
1
p
P
K 1=
K
62
p
K
k
k=1
PROOF A second possible proof is considering the optimization problem wes E:
-(<
Σ arg min
Tr Σ Σx
(10)
As mentioned above, it is possible to use the PSD) transform the equation into an element-wise problem as before:
-2(p pa O 00 ||
p Pk -2
p arg min
K
(11)
p = arg min
Σ
lp + Pk - 2p o + P 3
ll1
After derivation, the minimizing the optimization problem is given by:
62
p
1
Σ
P
to
(12)
K
14

---

A.2 Computation
The training is done on Tesla S-000DGXS-32GGG with Pytorch. We are considering the following train settings: Chambon architecture with learning rate of 1e for Adam optimizer and patience of 10 for the early stopping. The training for one dataset pair with ten different splits and seeds lasts approximately hour. The data processing time with the CMMN is insignificant compared to the network's computation time (a few minutes).
A.3 Dataset descriptions
The Sleep Heart Health Study is multi-center cohort study proposed by the National Heart Lung & Blood Institute 37 to help detect cardiovascular disease and sleep disorders. This large dataset comprises 6441 subjects (age 63.1 + 11.2) from 1995 to 1998. Five sensors are available for each subject: 2 EEGs from C3-A2 and C4-A1 channels, left and right EOGs, and one EMG. The EEGs have a sampling rate of 125 Hz. The hypnograms were scored according to the Rechtschaffen and Kales criteria 51
SHHS
The Montreal Archive of Sleep Studies comprised five different subsets of recordings. This paper focuses on the SS3 with recordings from 62 healthy subjects (age 42.5 + 18.9). For each subject, 20 EEGs, left and right EOGs, and 3 EMGs are available. We reduced the number of EEG channels to 2 bipolar channels, Fpz-Cz and Pz-Cz, obtained by montage reformatting. The EEGs have a sampling rate of 256 Hz. The MASS hypnograms were scored according to the AASM criteria 52
MASS
Physionet SIeepEDF This dataset comprises two subsets, for the age effect in healthy subjects (SC) and one for the Temazepam effect on sleep (ST). We focused on the SC subset where 78 subjects are available (age 28.7 +: 2.9). Each recording comprises 2 EEGs from Fpz-Cz and Pz-Cz channels, I EOG, and IEMG. The EEGs have a sampling rate of 100 Hz. Some of the subjects have two sessions of PSGs available. The hypnograms were scored according to the Rechtschaffen and Kales criteria [5T] The stages N3 and N4 have been merged for the following.
Ethical consideration All datasets used in our experiments are anonymized and public datasets that have already passed an ethics committee before recording.
A.4 Sensitivity analysis the filter size
Several adaptations across different dataset pairs are done to compare the effect of the filter size. The smallest filter size means no transformation, and the largest size corresponds to perfect transformation between the two signals. For each parameter, ten training are done over data from the source dataset and then tested over data from the target dataset.
To evaluate the benefit of the method, we measure the ABACC corresponding to the difference between the balanced accuracy score with monge mapping and the balanced accuracy score without monge mapping (i.e., using Sample normalization). The Figure 2/shows the evaluation of ABACC with filter size for different dataset pairs. The slightest improvement is for adaptation between the same dataset, which is logical because there is less difference to compensate between the subjects. And the best improvement is for the most challenging task, adaptation between datasets with different sensors (MASS/Physiones - SHHS). The mapping did not capture enough information for the smallest filter size to reduce the difference between distributions. On the other hand, the bigger the distribution gap between datasets, the bigger the filter size helps to adapt. Indeed, for an adaptation between the same dataset, having filter size close to the sample size decreases the performance (see MASS + MASS, Physionet > Physionet), while for an adaptation between two different or very different datasets, increasing the filter size causes the performance remain the same (MASS + Physionet) or even increases the scores considerably (MASS/Physionet - SHHS).
A.5 Boxplot of BACC for different data normalizations, different architectures, and different dataset pairs
As shown in the experimental section of the paper, CMMN outperforms standard normalization (Session Sample) for different architectures. Here we provide more boxplots for other dataset
15

---

Evolution of BACC with filter size for different adaptation
0.10
MASS-sPhysionet
MASS->SHIHS
0.08
Physionet=>MASS
Physionee=-hhysione
Physionet:>SHHH
0.06
Overall
A BACC
0.04
0.00
128
512
2048
Filter
Figure 2: Evolution the ABACC (BACC BACC without mapping) for different filter sizes for different adaptation problems
pairs than in the main article. For Chambon, the figure 31 shows again that CMMN outperforms other normalizations except with dataset SHHS in target. Indeed, if CMMN is still better than Sample and Session, using no normalization is better for this experimental setting. SHHS is the most different dataset since the sensors used differ from Physionet and MASS, which can explain this difference. Even when SHHS is in train, CMMN is better than None.
The results for DeepSleepNet in figure 4f are slightly different. If CMMN is still the better performer overall, the best standard normalization is None. Using no normalization better in 5/6 dataset pairs Sample and Seasion. These results paper proposing DeepSleepNet [7].
expected since no normalization
used in the
For the sake of simplicity, used Sample normalization before CMMN and also for the baseline No Adapt. even for DeepSleepNet.
A.6 Scatterplot for different architectures and different dataset pairs
One significant benefit of CMMN is to have massive impact on low- low-performing subjects. The scatter plots of balanced accuracy (BACC) with No Adapt as function of BACC with CMMN emphasize this effect. In this section, the plots in figure 5t and figure 6f show the increase in all subjects. For both architectures, the axis of the linear regression always above the axis x = y. The differences between the two axes generally higher for lower performances, which means that the worst the performance is, the higher the increase is. For the eccentric dots on the left (i.e., now-performing subjects), the increase is generally around 8% (see Table 4). When SHHS is the training MASS with Chambon, some
low- now-performing
subjects get a considerable boost. On the other hand, for Physionet < subjects lose accuracy, but it remains rare compared the average gain all subjects.
16

---

BACC for MASS
Physionet
BACC for MASS
SHHS
None
None
if
Sample
Sample
Session
Session
CMMN-
CMMN
0.2
0.4
0.6
0.8
0.2
0.4
BACC
BACC
(a)
(b)
BACC for SHHS Physionet
BACC for SHHS - MASS
None
None
Sample
Sample
Session
Session
CMMN
Hor wudd
CMMN
0.2
0.4
0.6
0.2
0.4
0.6
0.8
BACC
BACC
(c)
(d)
BACC for Physionet
MASS
BACC for Physionet
SHHS
None
None
Sample-
Sample
Session
Session
CMMN
CMMN
0.4
0.4
0.6
BACC
BACC
(e)
(I)
Figure 3: Boxplot of balanced accuracy (BACC) for different normalizations and different train/test dataset pairs with Chambon.
17

---

BACC for MASS
Physionet
BACC for MASS
SHHS
None
None
Sample
Sample
Session
Session
CMMN
top
ict
CMMN
+
Wed
0.2
0.4
0.6
0.2
0.4
0.6
BACC
BACC
(a)
(b)
BACC for SHHS Physionet
BACC for SHHS - MASS
None
None
Sample
Sample
Session
Session
CMMN
CMMN
0.2
0.4
0.6
0.2
0.4
0.6
0.8
BACC
BACC
(c)
(d)
BACC for Physionet
MASS
BACC for Physianet
SHHS
None
None
Sample-
Sample-
Session
Session
CMMN
CMMN
0.4
BACC
BACC
(e)
(I)
Figure 4: Boxplot of balanced accuracy (BACC) for different normalizations and different train/test dataset pairs with DeepSteepNet.
18

---

BACC for MASS Physionet
BACC for MASS SHHS
0.8
0.8
0.7
0.6
With CMMN
With CMMN
0.6
0.4
0.5
0.4
0.2
0.3
0.2
0.0
0.2
0.4
0.6
0.8
0.00
0.25
0.50
0.75
No adapt
No adapt
BACC for Physionet
MASS
BACC for Physionet SHHS
0.8
0.7
0.7
0.6
With CMMN
With CMMN
0.6
0.5
0.4
0.5
0.3
0.4
0.2
0.3
0.4
0.6
0.8
0.2
0.4
0.6
No adapt
No adapt
(c)
(d)
BACC for SHHS
MASS
BACC for SHHS + Physionet
0.8
0.7
0.7
With CMMN
With CMMN
0.6
0.6
0.5
0.5
0.4
0.4
0.3
0.3
0.4
0.6 No adapt
0.8
0.4
0.6
No adapt
(I)
Figure 5: Scatter plot of balanced accuracy (BACC) with No Adapt function of BACC with CMMN for different dataset pairs with Chambon.
19

---

BACC for MASS Physionet
BACC for MASS + SHHS
0.7
0.7
0.6
0.6
With CMMN
With CMMN
0.5
0.5
0.4
0.4
0.3
0.3
0.2
0.2
0.2
0.4
0.6
0.2
0.4
0.6
No adapt
No adapt
(b)
BACC for Physionet MASS
BACC for Physionet
SHHS
0.8
0.7
0.7
0.6
With CMMN
With CMMN
0.5
0.6
0.4
0.5
0.3
0.4
0.2
0.4
0.6
0.8
0.2
0.4
0.6
No adapt
No adapt
(c)
(d)
BACC for SHHS
MASS
BACC for SHHS + Physionet
0.8
0.8
0.7
With CMMN
0.6
With CMMN
0.6
0.5
0.4
0.4
0.2
0.3
0.2
0.25
0.50
0.75
0.2
0.4
0.6
0.8
No adapt
No adapt
(e)
(I)
Figure 6: Scatter plot of balanced accuracy (BACC) with No Adapt function of BACC with CMMN for different dataset pairs with DeepSLeepNet
20


Reviews:
[{"review_id": "quEjU5WsrB", "reviewer": "Reviewer_VNrC", "summary": "The paper proposes a normalization scheme for biological signals such that the model generalizes well to unseen domains which slightly deviate from the training data.\nThe approach is based on learning a normalization scheme from the training set in a heuristic manner and applying it at inference.", "questions": "- It's not clear how much of a divergence is tolerated by Monge mapping. More precisely, what happens if the test signal deviates more than a threshold from the source domains? Would forcing such normalization be harmful in that case?", "limitations": "N/A", "rating": 6, "confidence": 4, "soundness": 3, "presentation": 3, "contribution": 3, "strengths": "- Very intuitive and straight-forward method to handle distribution shifts.\n- The idea behind the paper is of great importance to the community as there is a trend towards building more robust models rather than just pushing state-of-the-art. This plays a noticeable role in the reviewer's score justification and the reviewer would be eager to adjust their score after the rebuttal properly addresses the weakness/questions below.", "weaknesses": "- The contribution is relatively mild compared to [27].\n- The proposed method, just like any other normalization scheme, has a failure threshold not explored by the authors. \n\nMinor:\n- Figure 1 is very difficult to read. The reader sees this figure without having any idea about what Eq. (5) and (6) are. Typically, the figure that appears at the 2nd page is a either a summary of the pipeline in a easy-to-follow format or a summary of the main result of the paper. Currently, Figure 1 serves no purpose but misleading and confusing the reader.\n- Line 133: It's either a proof or sketch of the proof, can't be both.\n\n", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "> The contribution is relatively mild compared to [27].\n> The proposed method, just like any other normalization scheme, has a failure threshold not explored by the authors.\n\nWe respectfully disagree with the reviewer w.r.t. the contribution compared to [27]. Reference [27] is mostly theoretical with statistical results on the convergence of the Monge mapping and domain adaptation bounds. The experiments are limited to toy examples and a particular case of MNIST. In our work, we indeed use the linear convolutional mapping from [27] but also propose a novel closed-form formula for the barycenter and extend the mapping/domain adaptation to the multi-source setting in a non-obvious way. Besides, our experiments are done in-depth on several large datasets in a challenging biomedical problem.\n\nWe discuss failure and limits below and report new studies about performance VS distance and kurtosis in the general reply.\n\n> Minor:\n> \n> Figure 1 is very difficult to read. The reader sees this figure without having any idea about what Eq. (5) and (6) are. Typically, the figure that appears at the 2nd page is a either a summary of the pipeline in a easy-to-follow format or a summary of the main result of the paper. Currently, Figure 1 serves no purpose but misleading and confusing the reader.\n\nThe idea of Fig. 1 was to illustrate the mapping and adaptation of the signal samples for each subject in the PSD space. We will amend the figure with the whole pipeline for the final version of the paper, which should be less confusing.\n\n\n> Line 133: It's either a proof or sketch of the proof, can't be both.\n\nIndeed we will correct that. Thanks for noticing.\n\n\n> Questions:\n> It's not clear how much of a divergence is tolerated by Monge mapping. More precisely, what happens if the test signal deviates more than a threshold from the source domains? Would forcing such normalization be harmful in that case?\n\nThat is an interesting question. To discuss it, we propose new plots showing the evolution of the BACC vs Bures-Wasserstein distance. This is discussed in more detail in the global response. \n"}, {"review_id": "u3eyaAY40Z", "reviewer": "Reviewer_crXL", "summary": "The paper presents a method for the spectral normalization of a training set of stationary time-series to their PSD barycenter under the Fréchet or Bures-Wasserstein divergence, which relies only on first and second moments. Spectral filtering is applied to normalize unseen time-series at test, which should improve performance of models trained on the normalized data. Results on sleep-stage classification using existing architectures and data show consistent improvement in performance indicating better generalization. ", "questions": "1. Would it work for different EEG tasks? If not what are the limitations (spectral normalization may not be as important for evoked responses in an odd-ball paradigm for example)? \n\n2. Would a power law target (including whitening) for the equalization perform as well in practice for EEG? I don't think there is any theoretically optimal reason that the barycenter should help downstream tasks, even though it minimizes the average divergence. \n\n3. Line 53 and 54 It is not clear the particular import of the statement about source data availability  \"which might not be available in practice due to privacy concerns or the memory limit of devices.\" Can this be further explained?\n", "limitations": "The paper's limitation are its application to only a specific task of EEG where relative frequency is known to be important. ", "rating": 4, "confidence": 4, "soundness": 2, "presentation": 2, "contribution": 2, "strengths": "The paper is fairly clear and the approach is very straightforward.\n\nThe paper's results are of practical importance. \n\nThe paper presents a method that could be seen as a common spectral filtering. Implying that the relative spectral power in a subject/session is better than absolute power in cases of sleep stage classification. This is an interesting conclusion. \n\nThe experiments go into detail to show that results are consistent across model architectures at both the session and subject level. ", "weaknesses": "My main concern is that the experimental results are only tested in sleep staging. It is intuitive that this normalization helps in tasks where the relative frequency content is important but that it may vary due to difference in setup. But it is not clear what other EEG analysis paradigms it would help with such as in the analysis of evoked potentials, steady-state evoked responses, motor imagery classification, etc. Likewise, it is not clear the spectral filtering would improve other non-EEG biosignals as mentioned in the title. EEGs are a special case as compared to ECG or other more structured biosignals. The claims are not backed by evidence. \n\nThe discussion could be improved by discussing the physical interpretation on differences of spectrum such as differences in impedance of the electrode setup between subjects or between sessions.\n\nThe importance of the barycenter as the target of the common normalization of the spectral filtering is not clear. A simple baseline would be to define a target PSD for the signal for each subject as a power law of the frequency across the frequency range of interest (~1 Hz to 30 Hz). This is not a barycenter but instead a fixed target that could also be implemented efficiently. Note that a power law with exponent of zero would be whitening the signal. \n\nThe paper could make it more clear that the equalization is done at the subject basis. It isn't stated directly and seems to allude to multiple choices. \n\nMinor points:\nLine 119 would be more precise by saying that the processes are zero mean. \n\nThe observation about the connection to Hellinger in line 140 is indirect. It is well known that for the Bures distance underlying the Fréchet distance that one can compute the distance directly in terms of the eigenvalues if the covariance matrices commute.\n", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "> My main concern is that the experimental results are only tested in sleep staging. It is intuitive that this normalization helps in tasks where the relative frequency content is important but that it may vary due to difference in setup. But it is not clear what other EEG analysis paradigms it would help with such as in the analysis of evoked potentials, steady-state evoked responses, motor imagery classification, etc. Likewise, it is not clear the spectral filtering would improve other non-EEG biosignals as mentioned in the title. EEGs are a special case as compared to ECG or other more structured biosignals. The claims are not backed by evidence.\n\n> Would it work for different EEG tasks? If not what are the limitations (spectral normalization may not be as important for evoked responses in an odd-ball paradigm for example)?\n\nThe focus on Sleep stage data is discussed in the global response. Indeed CMMN is focusing on frequency content in signals which is well adapted to sleep data that use few electrodes. Indeed it is likely not adapted to other EEG setups like motor imagery or ERP using many electrodes covering the full scalp surface.\n\nNevertheless we would like to emphasize that our results definitely show that CMMN improves on the state-of-the-art in some applications of EEG processing and we believe that it is already valuable for the community. Besides, our work integrates very well with existing deep learning methods with very small computational cost. In our experiments CMMN brings a systematic performance boost. The fact that our approach might be of limited use in other setups should not solely justify rejecting the paper. As discussed in the general reply we agree that the title could be changed to reflect the contribution better.\n\n> The discussion could be improved by discussing the physical interpretation on differences of spectrum such as differences in impedance of the electrode setup between subjects or between sessions.\n\nThank you for this suggestion. Using subject-dependent filters as in CMMN allows Indeed to compensate for different impedances that can be modeled physically by a convolution. We will add a discussion to the paper.\n\n> The importance of the barycenter as the target of the common normalization of the spectral filtering is not clear. A simple baseline would be to define a target PSD for the signal for each subject as a power law of the frequency across the frequency range of interest (~1 Hz to 30 Hz). This is not a barycenter but instead a fixed target that could also be implemented efficiently. Note that a power law with exponent of zero would be whitening the signal.\n\n> Would a power law target (including whitening) for the equalization perform as well in practice for EEG? I don't think there is any theoretically optimal reason that the barycenter should help downstream tasks, even though it minimizes the average divergence.\n\nThis is a very good point. We discuss in the global response new experiments that compare CMMN to whitening and  Power law target PSD. CMMN outperforms those target PSD in those experiments. Besides power law target and whitening lead to higher variance in across subjects results.\n\nAlso, note that our proposed barycenter is non-parametric (power law parameters need to be selected), and can be computed efficiently on the source data with the new closed-form we proposed.\n\n> The paper could make it more clear that the equalization is done at the subject basis. It isn't stated directly and seems to allude to multiple choices.\n\nIndeed, our paper proposes a method for multi-source problems that performs a different Monge filtering for each source and target domain. The sources are indexed by k in the equations. Depending on the experiments, a domain can be a session or a subject. We will clarify that we consider subjects as sources in the experiment for the final version.\n\n> Minor points: Line 119 would be more precise by saying that the processes are zero mean.\n\nAgreed. We will do that. Thanks.\n\n\n> The observation about the connection to Hellinger in line 140 is indirect. It is well known that for the Bures distance underlying the Fréchet distance that one can compute the distance directly in terms of the eigenvalues if the covariance matrices commute.\n\nNot sure what you mean. It is a known relation related to Frechet distance in the space of covariance, but we found it interesting. Let us know how you would suggest we rephrase or remove this observation.\n\n> Line 53 and 54 It is not clear the particular import of the statement about source data availability \"which might not be available in practice due to privacy concerns or the memory limit of devices.\" Can this be further explained?\n\nIn medical fields, data is private and hard to share because of privacy concerns. Moreover, hospitals can have limited computational resources (memory, GPUs ...). Our method can use pre-computed PSD and does not require further training. A new hospital can simply apply a trained model without the need to have access to the source data (only to the barycenter) which is a problematic requirement for many alternative domain adaptation methods.\n"}, {"review_id": "rYmy6FDKYh", "reviewer": "Reviewer_Dgon", "summary": "The paper introduces a new and efficient method to normalise biomedical signals, especially EEG. It experiments of an established benchmarking dataset frim sleep studies are used to give numerical evidence that this CMMN method leads to significant and consistent performance gains that are independent of the neural network architecture when adapting from a data collection device to another, data collection session to another, or even subject to another. These contributions form critical stepping stones in applying machine learning to health and medicine.", "questions": "What are the best/good practice workflows in sleep studies or other biomedical studies with EEG data to normalise and then, eg, classify or regress using neural networks?\n\nWhy is this study well positioned to, eg, machine learning researchers? What can a reader not working on EEG gain from the study?", "limitations": "As a minor comment, it would be good to add a small ethical considerations addressing, e.g., in the discussion section. This is because data from human subjects is in use in this paper, and hence, even if not mandatory, addressing human research ethics is important.", "rating": 6, "confidence": 3, "soundness": 3, "presentation": 3, "contribution": 3, "strengths": "The paper introduces a new and efficient method to normalise biomedical signals, especially EEG. It experiments of an established benchmarking dataset frim sleep studies are used to give numerical evidence that this CMMN method leads to significant and consistent performance gains that are independent of the neural network architecture when adapting from a data collection device to another, data collection session to another, or even subject to another. These contributions form critical stepping stones in applying machine learning to health and medicine.", "weaknesses": "The paper has quite lacking referencing of related methods to de-noise, normalise, and otherwise pre-process EEG data. For example, I was expecting to see HAPPE from Harvard mentioned. See https://www.sciencedirect.com/science/article/abs/pii/S1388245723000275?via%3Dihub for a recent study with such pointers to not only HAPPE but also the open challenges in EEG processing from neuroscience perspectives.\n\nI would the study be so specific and focesed on biomedical signal processing that its contributions to mechine learning are only fair. In addition to strengtening the articulation of methodological contributions to machine learning (currently this part is quote resticted, shallow, and repetative), the study calls for a more extensive discussion from machine learning perspective. Here, for example, the broader perspective of better abilities to adapt from data collection processes or subjects to others could be revisited, deepened, and connected with related studies, thereby releasing space in the beginning of the paper for making a more convincing case as a machine learning study.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "> The paper has quite lacking referencing of related methods to de-noise, normalise, and otherwise pre-process EEG data. For example, I was expecting to see HAPPE from Harvard mentioned. See https://www.sciencedirect.com/science/article/abs/pii/S1388245723000275?via%3Dihub for a recent study with such pointers to not only HAPPE but also the open challenges in EEG processing from neuroscience perspectives.\n\nThere are indeed several preprocessing pipelines that have been promoted for EEG. Interestingly we would like to refer to this recent work from Arnaud Delorme, “EEG is better left alone”, and to the methods compared in this work. As the RELAX paper suggested, this work is not machine learning as it has no prediction in mind. It evaluates effect size with ANOVA to compare two experimental conditions. Again it is not about prediction on unseen subjects and domains. Nonetheless, our approach should not be seen as a replacement of those pipelines but as an additional adaptation step that can be used jointly. Actually, our work is more a novel way to filter data in the time domain, which offers significant prediction performance boosts when combined with a deep learning approach to sleep data. We will discuss and clarify this in the final version of the manuscript and cite HAPPE, RELAX, and other works evaluated by Delorme.\n\n\n> I would the study be so specific and focesed on biomedical signal processing that its contributions to mechine learning are only fair. In addition to strengtening the articulation of methodological contributions to machine learning (currently this part is quote resticted, shallow, and repetative), the study calls for a more extensive discussion from machine learning perspective. Here, for example, the broader perspective of better abilities to adapt from data collection processes or subjects to others could be revisited, deepened, and connected with related studies, thereby releasing space in the beginning of the paper for making a more convincing case as a machine learning study.\n\nThis paper proposes a novel methodological approach (on Monge barycenter and subject-based mapping) and an in-depth evaluation of a challenging clinical task. We wanted to offer the necessary ML background while providing convincing experiments, thereby reaching a wider audience. We will happily add suggested references beyond the one already provided in the DA literature.\n\n\n> Questions:\n> What are the best/good practice workflows in sleep studies or other biomedical studies with EEG data to normalise and then, eg, classify or regress using neural networks?\n\nFor sleep staging, the usual practice is to do very little preprocessing. Some papers use (high and low pass) filtering and scaling, some others use only scaling. The idea is that deep learning is doing all the normalization automatically, provided it is trained with enough data. For example, DeepSleepNet (Supratak et al. 2017) does not suggest any data normalization. Works like HAPPE or RELAX have a strong focus on artifact rejection like blinks which are not adapted for sleep (actually, blinks are signals for REM sleep). Here we followed standard practice in sleep deep learning works.\n\n\n> Why is this study well positioned to, eg, machine learning researchers? What can a reader not working on EEG gain from the study?\n\nNote that the paper was submitted to the neuroscience track because we know that it will be mostly of interest in this field. On the other hand, the method is quite generic for any problem of supervised learning on time series and can be applied for multi-source time series problems. Besides this work details a novel mathematical result and algorithmic contribution in addition to an experimental study. Hence, we strongly believe that NeurIPS is a good venue for presenting it.\n\n\n> As a minor comment, it would be good to add a small ethical considerations addressing, e.g., in the discussion section. This is because data from human subjects is in use in this paper, and hence, even if not mandatory, addressing human research ethics is important.\n\nGood point. All datasets used in our experiments are anonymized and public datasets that have already passed an ethics committee before recording. Still, this kind of application raises questions about the personalization and personal data that will be used, so we will indeed add a discussion in the final version.\n"}, {"review_id": "HpYP0HVS6C", "reviewer": "Reviewer_uQaR", "summary": "The authors introduce an easily computable optimal transport method (Convolutional Monge Mapping Normalisation) for power spectral density data that can be assumed to originate from Gaussian and stationary data. These assumptions allows for a closed from analytical expression that uses the convolutions to reduce the data shifts caused by different measurement conditions.\n\nThe method is used for biological data (EEG) for classification of the stages of sleep, where the measurements are affected by individual physiological differences of the data subjects, different placements and number of the electrodes or different electrode impedances or even hardware used in the data acquisition.\n\nThe analytical normalisation method is compared with other normalisation schemes . The computational loads of different schemes is analysed . Different neural network architectures are studied to find out what are the benefits of the normalisation in practice - as well as the variation between different data sets.", "questions": "See the weakness part.", "limitations": "See the weakness part.", "rating": 8, "confidence": 5, "soundness": 4, "presentation": 4, "contribution": 3, "strengths": "The authors provide an excellent introduction of their low optimal transfer method. In comparisons their method is both simpler than others (in terms of the computational load) and perform better than the state of the art.\n\nThe manuscript studies thoroughly the benefits with respects to the architecture of the neural network, different available data sets showing advances in balanced accuracy.", "weaknesses": "I would have liked to have seen a discussion of the validity of the assumptions made in the derivation of the CMMN method. How far of the optimal transport CMMN is, if the data is not Gaussian (would kurtosis be a good enough indicator?), nor stationary? In independent component analysis (ICA) one is essentially searching for the non-Gaussian combination of the data to separating signals. ICA is extensively used in EEG signal analysis as the the signal is by its nature a summations of electric activations in brain.\n\nThis question could be analysed with synthetic data to introduce tests for generic data sets to pass in order to gain best benefits from CMMN. This would increase the impact and adoption of the normalisation method described in the submission.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "> I would have liked to have seen a discussion of the validity of the assumptions made in the derivation of the CMMN method. How far of the optimal transport CMMN is, if the data is not Gaussian (would kurtosis be a good enough indicator?), nor stationary? In independent component analysis (ICA) one is essentially searching for the non-Gaussian combination of the data to separating signals. ICA is extensively used in EEG signal analysis as the the signal is by its nature a summations of electric activations in brain.\n\nThis is a very interesting question. Note that if there exists a symmetric positive definite linear transformation between the two distributions, the Monge mapping will recover precisely the transformation even on non-gaussian data (Lemma 1 in [27], also see \"Linear OT mapping estimation\" 2D example in the POT toolbox documentation that maps between non-gaussian distributions with success). We align second-order moments so if the signal is a heavy tail with positive kurtosis, it will remain like this after CMMN, and the network learned on top can learn what to do with this.\n\n> This question could be analysed with synthetic data to introduce tests for generic data sets to pass in order to gain best benefits from CMMN. This would increase the impact and adoption of the normalisation method described in the submission.\n\nTo measure the non-gaussianity of the data and its impact on the performance we provide a new plot of the classification performance as a function of the kurtosis. This is detailed in the global response.\n"}]

Author rebuttal:
We want to thank all reviewers for their interesting questions and suggestions. We provide in the attached PDF new results (figures and tables) that we refer to in our detailed answers below. First, we make a few general comments that we believe are of interest to all reviewers.

### Focus on Sleep Staging data

We believe that the clinically-relevant problem of sleep staging is an ideal ML task for studying the question of subject-based domain adaptation on biosignals. Biosignals suffer from large intersubject variability that is reflected in sleep EEG data. Nowadays, sleep data are easy to access and come with abundant labels enabling convincing experimental evaluations. Again, this makes sleep staging from EEG a perfect setup to compare DA methods on biosignals. 

While there exist other applications of ML on EEG (BCI MI and ERP), they usually contain few subjects which leads to large error-bars when evaluating algorithms across subjects (SoTA Riemannian approaches on the reference BCI4a dataset gives a 10% error bars with 9 subjects). That greatly diminishes the interest and the statistical significance of results of multi-source DA. Sleep data with thousands of labels and hundreds of subjects are a better testbed for methods like CMMN. 

In addition, CMMN leverages spectral information and efficient FFT-based computations. Sleep EEG data do have a predictive spectral content.  In other biomedical applications on signals, the predictive power comes from spatial components which implies that many sensors are available at different locations. In sleep EEG we have here only 2 channels to keep the experimental setup simple in a clinical context. Future work will consist in extending CMMN to make use of spatial diversity in sensing.

Yet, we agree that the current title can be amended and we are OK to ask the PC/AC to slightly update the title to replace “biosignals” with “sleep EEG signals” to better reflect the experimental results.

### Effect of the distance between domains

Figure 1 shows a new visualization of the BACC versus the Bures-Wasserstein distance. As we can see, with no normalization, the BACC always decreases with the distance. CMMN reduces this effect drastically. In fact, for each adaptation between domains, the slope is reduced with CMMN and even canceled for SHHS to MASS. 

This study suggests that CMMN is less dependent on the distance of the domain to the barycenter and that the Monge mapping can compensate for even large shifts.

### Study of non-gaussianity

Figure 2 plots the BACC versus the kurtosis for no normalization and CMMN. These plots do not allow to detect any dependence between kurtosis (as a proxy for non-gaussianity) and performance either for CMMN or no normalization. This interesting result suggests that the gaussian/linear models in the methods do not limit the performances, maybe because higher order information that can be used by the CNN for classification is fully preserved.

### Interest of the OT barycenter

To demonstrate the importance of choosing the right target PSD when estimating CMMN mapping, we tested Monge mapping for different target PSD (power law with $a = 0.659$ and whitening). The results are shown in table 1.

As we can see, the suggested adaptations are interesting because some adaptations with whitening or power-law give good results (i.e., MASS->SHHS, Physionet->MASS, and SHHS->SHHS). However, on average, choosing the barycenter outperforms other target PSD (2% better in BACC and 1.5% better in $\Delta$BACC). Furthermore, for one of the hardest adaptations (SHHS -> MASS/Phys.) taking another target PSD leads to a very high variance in the scores (~ 13% of std). We will update the paper and thank the reviewer for suggesting this interesting new experimental result to strengthen our claims and paper. 


Meta-review: This paper introduce a novel OT-based method for domain (test-time) adaptation, targeting learning on biosignals. The work is motivated and presented well, thoroughly demonstrates its benefit empirically and reviewers consider the work of of practical importance to the community while highlighting the relative simplicity and efficiency of the approach.
Decision: Accept (poster)