Question: is batch normalization used in inference?
Answer: It means that during inference, the batch normalization acts as a simple linear transformation of what comes out of the previous layer, often a convolution. As a convolution is also a linear transformation, it also means that both operations can be merged into a single linear transformation!