To keep a the bottom of puff pastry crisp and butter, make sure to pre bake the puff pastry for 10 minutes. In addition, blot away any excess moisture from toppings to keep the pastry dry and crisp.