Don't add ~/.emacs.d/ to load-path