I think it's almost equivalent ...
The reasons leading to fig objects without show method are backend-related. E.g. 'Agg' as used in tests will produce such objects while `plt.show` calls would just pass and do nothing.
The variant I proposed would allow us to learn about additional backends / constellations where this fails ... 
But I'm fine with going for attribute checking.