Retry lsf job if 'LIM is down'

I don't expect that this is ready to be merged as is, I just wanted to get some discussion going.