Don't ever install nvidia drivers in the build-dep step.

I also removed libkate-dev, since it's automatically a dependency now, and this
way we can skip running apt-get if there's nothing to do.