Top 5 Resources to Read and Watch about DALL-E 2
Tags: ai, machinelearning
Published: 2022-04-21 19:02:46

There has been a lot of excitement around OpenAI’s recent release of its groundbreaking model, DALLE-2 – and understandably so. Given just a short natural language input, the DALLE-2 model can generate totally original–and extremely impressive–images.

By now, you’ve probably already read OpenAI’s introduction to DALL-E 2 and browsed its sample images and examples, but you may want to dive deeper into how it works and why people are so worked up over its release. 

If so, check out these top resources to browse as you continue learning about DALL-E 2:

## 1. How Does DALL-E 2 Actually Work? YouTube Video


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/1eefilihzsnrpl2ggj80.png)

If you’re looking for a deeper understanding of DALL-E 2, this YouTube video by Misra Turp does a great job of breaking down exactly [how DALL-E 2 works](https://www.youtube.com/watch?v=F1X4fHzF4mQ&t=31s). The video is broken down into the following segments:

- Overview
- What can DALL-E do?
- Architecture Overview
- CLIP embeddings
- The Prior and why it’s needed
- The decoder
- How are variations created?
- Model evaluation
- Limitations and risks
- Benefits

Watch the entire ten minute video [here](https://www.youtube.com/watch?v=F1X4fHzF4mQ&t=31s). 

## 2. How DALL-E 2 Actually Works Blog Post


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/x7wiec9vnop71zsdtdjx.png)

In a similar vein, this [How DALL-E 2 Actually Works blog post](https://www.assemblyai.com/blog/how-dall-e-2-actually-works/) does a great job looking at the inner workings of the model. If you’re newer to Machine Learning, the author also spends a lot of time on pertinent background information and thorough explanations that are suitable for ML beginners to experts. 

Read the entire blog post [here](https://www.assemblyai.com/blog/how-dall-e-2-actually-works/). 

## 3. How DALL-E 2 Could Solve Major Computer Vision Challenges


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/weyie3y99t5tnxk1s39v.png)

_[Photo Source ](https://venturebeat.com/2022/04/16/how-dall-e-2-could-solve-major-computer-vision-challenges/)_

This [Venture Beat article](https://venturebeat.com/2022/04/16/how-dall-e-2-could-solve-major-computer-vision-challenges/) discusses some of the implications of DALLE-2, particularly how it could be used to solve some of today’s major computer vision challenges. 

The online news source recognizes that some of these potential achievements will be dependent on OpenAI’s policies and pricing surrounding DALLE-2, as well as some of its current limitations. However, regardless of these constraints, DALLE-2 is set to take image generation a huge leap forward. 

Read the entire article [here](https://venturebeat.com/2022/04/16/how-dall-e-2-could-solve-major-computer-vision-challenges/). 

## 4. OpenAI DALL-E: Creating Images from Text YouTube Video


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/jq0ttk231vwfc3vzr8x3.png)

In this [video by YouTuber Yannic Kilcher](https://www.youtube.com/watch?v=j4xgkjWlfL4), Yannic explores what DALL-E 2 is, briefly dives into how it works, and then spends a good portion of the almost hour long video showing examples of what DALLE-2 can do.

Video segments covered include:

- Comparison to GPT-3
- Experimental results
- DALL-E can’t count
- DALL-E is very good at texture
- DALL-E can do some reflections but not others
- DALL-E can generate logos
- DALL-E can combine unusual concepts
- DALL-E sometimes understands complicated prompts

And more. 

Watch the entire video [here](https://www.youtube.com/watch?v=j4xgkjWlfL4). 

## 5. How is It so Good? (DALL-E Explained Pt. 2)


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/2e2wjz6l7yp61julfxuu.png)

Berkeley’s Machine Learning blog also did a deep dive into DALLE-2, entitled: [How is it so good?](https://ml.berkeley.edu/blog/posts/dalle2/)

The blog post examines the big picture, practical problems, technical components, and limitations, concluding that DALL-E is a “big step towards true understanding because it directly connects language with the visual world.”

Read the entire blog post [here](https://ml.berkeley.edu/blog/posts/dalle2/).