If you live in a particularly windy climate, this can be difficult. The best option is often to store your outdoor pillows in a deck box when not in use. You can also add bows to your throw pillows, attaching them to the furniture in a more secure fashion.