Don't remember install options

Work in progress for https://github.com/bundler/bundler-features/issues/26 here. But with some failing specs. Would appreciate a quick review.