only fetch inflation destination if present

surprise: if you hit refresh on the settings page, for some reason the
inflation destination isn't ever valid. Let's not make our federation
request in that case.