If those buildings are in the garden and grounds of the dwelling, then the use or suitable use of those other buildings is not relevant.
Os yw'r adeiladau hynny yng ngardd a thiroedd yr annedd, yna nid yw’r defnydd neu’r defnydd addas ar yr adeiladau eraill hynny’n berthnasol.