Set package-enable-at-startup to nil to prevent loading packages twice.