Question: Is the proposed layer smaller in parameters than a Transformer?
Answer: No