memory: don't fail if we can't query the balloon driver

It's unclear why we attempt to query the balloon driver -- this needs
more investigation.