Cleanup 'get started' ribbon after really remove

Fixes #501