Do not run finish rebase routines more than once

Signed-off-by: Sup Yut Sum <ch3cooli@gmail.com>