When destructing the ruler only destruct the selected ruler