backend: Only return defrag_state if possible