Our advice is always "drink it when you want to," but typically PX (Pedro Ximenez) sherry is enjoyed with dessert while oloroso, amontillado, and palo cortado can be served with main dishes.