What's the meaning of "s32B" and "b79K" in CLIP-ViT-H-14-laion2B-s32B-b79K ?
#13
by
xieyang233
- opened
What's the meaning of "s32B" and "b79K" in CLIP-ViT-H-14-laion2B-s32B-b79K ?
s = samples seen, so approx 32 billion samples (image-text) pairs seen across the training.
b = batch size, so ~79,000k global batch size