To close a Finder window, click on the red "X" button in the top left corner of the window or use the keyboard shortcut command + W.