Yes, it's generally okay to push the cork into the wine bottle if you have no other way to open it. However, this method might cause small pieces of cork to float in the wine. Additionally, if the wine is not consumed in one sitting, storing the wine with the cork inside can make it more difficult to pour and may affect the wine's taste over time.