Yes, please do! The bottle should be recycled, along with the wire muselet. The cork can be composted.