Before revision:  Our idea is based on adapting the Nystr\"om method to approximate standard self-attention with O(n) complexity.
After revision:  Our idea is based on adapting the Nystr\"{o method to approximate standard self-attention with O(n) complexity.