Disable private repos without subscriptions

There is currently an issue where private repos that were enabled before subscriptions were added cannot be disabled.
Sort?