You should definitely set up boundaries for your ex if you want to deny him any opportunity to control you. Standing up for yourself means you are also doing him a favor to correct himself.