Don't emit withMeta calls for empty metadata maps