Set :dependent => :delete_all option on the created association