Don't use apt-get.
Not using apt-get to install jenkins allows for better customization (no
JDK installed, custom install location, etc)