Under certain circumstances, it is possible to stop paying periodic alimony to your spouse. If you are providing periodic alimony payments and your ex-spouse remarries or enters into a civil union, you are no longer required to make payments, unless a prior agreement to the contrary was reached during the divorce proceedings.