Similar to horizontal centering, select "Align Vertical Centers" from the alignment options in the Options bar while your layer is selected or hold Shift while pressing both vertical and horizontal Align buttons.