To layer a puffer vest, start with a shirt or sweater as your base layer, followed by the vest, and top with a jacket or blazer. The key is to make sure the layers are not too bulky and fit comfortably.