Delete keep alive file