text: 
  
  TITLE
  Support for larger XGLM models
  
  COMMENTS
  5
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  According to the official XGLM repo, https://github.com/pytorch/fairseq/tree/main/examples/xglm, there are five versions of XGLM out there. The architecture of the larger XGLM versions is same as the base XGLM, ; why doesn't HF provide support for larger XGLM versions?  It seems that currently HF provides support for the smallest one (546M parameters) only. 