Make devise a soft dependency.