sidebar: Show a semi-transparent black border

This is a fix for a regression where we started to show an ugly looking
(especially at the top) border at the right side of sidebar.