Only refresh sent inbox when sync finishes or canceled