Posts, articles, and discussions

Policy Gradient with PyTorch

By June 30, 2022

Transformer-based Encoder-Decoder Models

By October 10, 2020

Retrieval Augmented Generation (RAG)

By September 28, 2020

Block Sparse Matrices for Smaller and Faster Language Models

By Sep 10, 2020

The Reformer - Pushing the limits of language modeling

By July 3, 2020

Long Form Question Answering with ELI5

By June 17, 2020

How Big Should My Language Model Be?

By June 8, 2020

Zero Shot Topic Classification

By May 29, 2020

How to generate text: using different decoding methods for language generation with Transformers

How to train a new language model from scratch using Transformers and Tokenizers

By February 14, 2020

Community Events

Jun 15 to Jul 15, 2022 fastai X Hugging Face Group 2022 Share Vision and Text pre-trained fastai Learners with the community. Jun 22, 2022 Twitter Space with ONNX RunTime Join our live discussion with the ONNX RunTime team about accelerating Transformers with Optimum! Jun 22, 2022 Data2vec Reading Group Join us to talk about data2vec, a model that works across different modalities - text, audio, and images. Jun 15, 2022 Hugging Face VIP Party at the AI Summit London Come meet Hugging Face at the Skylight Bar on the roof of Tobacco Dock during AI Summit London! 6pm-9pm Jun 10, 2022 Masader Hackathon A sprint to add 125 Arabic NLP datasets to Masader, https://arbml.github.io/masader/, 5pm-7pm Saudi Arabia time. June 9, 2022 Introduction to Hugging Face Ecosystem at PyData Paris An extensive introduction to the open-source ecosystem in Hugging Face. June 8, 2022 Computer Vision with Hugging Face In this session, Niels Rogge walks us through the tools and architectures used to train computer vision models using Hugging Face. Jun 6, 2022 How to Teach Open-Source Machine Learning Tools Learn how the open-source ecosystem can be used in your machine learning and data science classes. Apr 13, 2022 Accelerate BERT Inference with Knowledge Distillation & AWS Inferentia Accelerate BERT Inference with knowledge distillation & compiling using Hugging Face Transformers, Amazon SageMaker & AWS Inferentia. Apr 5, 2022 Computer Vision Study Group Paper Reading Session on "How Do Vision Transformers Work?" Discussion on paper "How Do Vision Transformers Work?".