I just noticed that the "or the length of the window for rolling window operations" tag should be added here, as described for the SUM aggregator.
This technically applies to all WeightedAggregator-s, so it goes for RMS as well.