Revert "Add "Clear frequents" option to Contacts"

This reverts commit e6ce1b1734a1ced9ad6130ceec8b2b19080ea5ee.