Just select all the cells at the same time, then enter the formula normally as you would for the first cell. Then, when you're done, instead of pressing Enter, press Control + Enter. Excel will add the same formula to all cells in the selection, adjusting references as needed.