Catch the RS API going down where we use it the most

Example error:
https://rundeck.corp.nextdoor.com/project/Luke/execution/show/55478

Change-Id: I3317e724771ec3798da313113e73b1776814d83f