There are 256 filters in conv2.

AlexNet paper splits conv2 into two GPU's, each with 128 filters.