Reruns/cms server side LMS-11016

This PR is an updated version of this old one: https://github.com/edx/edx-platform/pull/4573
Do we not want to check that it's a valid course up here before trying to rerun it?