Avoid extra check for clean object

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>