text: 
  
  TITLE
  Bort (Amazon's reduced BERT)
  
  COMMENTS
  2
  
  REACTIONS
  +1: 36
  -1: 0
  laugh: 0
  hooray: 0
  heart: 1
  rocket: 0
  eyes: 5
  
  BODY
  # 🌟 New model addition
  
  ## Model description
  
  Amazon Alexa researchers extract an optimal subset of architectural parameters for the BERT architecture by applying recent breakthroughs in algorithms for neural architecture search. The proposed optimal subset, “Bort,” is just 5.5 percent the effective size of the original BERT-large architecture (not counting the embedding layer), and 16 percent of its net size.
  
  ## Open source status
  using mxnet and gluonnlp
  
  paper https://arxiv.org/pdf/2010.10499.pdf
  repo https://github.com/alexa/bort
  
  * [X] the model implementation is available: (give details)
  * [X] the model weights are available: (give details)
  * [@adewynter] who are the authors: (mention them, if possible by @gh-username)
  