Remove local ivy folder on clean task

Fixes RM-2745