Cleanup 'get started' ribbon after really remove

Fixes #501

![really-remove](https://cloud.githubusercontent.com/assets/34726/3782450/388ecc16-19a2-11e4-9daf-c9739bfbb245.gif)