That would force us to reinstall the pip requirements every time we build the container which kind of sucks (though is obviously a good idea to keep requirements in sync).

The mailgun guys are basically replacing requirements.txt with Dockerfiles.

I don't really like either solution a lot.