Refine search panel remove

@jonescc Was there any others that might be related to delete?