How to control your 🚁 drone using #ChatGPT
Tags: englishpost, azureopenai, chatgpt, codesample
Published: 2023-08-02 14:47:49

---
title: How to control your 🚁 drone using #ChatGPT
published: true
date: 2023-07-28 15:14:18 UTC
tags: EnglishPost,AzureOpenAI,ChatGPT,CodeSample
canonical_url: 
---

## Coding4Fun Drone 🚁 posts

1. [Introduction to DJI Tello](https://elbruno.com/2020/02/03/coding4fun-how-to-control-your-drone-with-20-lines-of-code-1-n/)
2. [Analyzing Python samples code from the official SDK](https://elbruno.com/2020/02/04/coding4fun-how-to-control-your-drone-with-20-lines-of-code-2-n/)
3. [Drone Hello World ! Takeoff and land](https://elbruno.com/2020/02/10/coding4fun-how-to-control-your-drone-with-20-lines-of-code-3-n/)
4. [Tips to connect to Drone WiFi in Windows 10](https://elbruno.com/2020/02/11/coding4fun-how-to-control-your-drone-with-20-lines-of-code-4-n/)
5. [Reading data from the Drone, Get battery level](https://elbruno.com/?p=30977)
6. [Sample for real time data read, Get Accelerometer data](https://elbruno.com/?p=30984)
7. [How the drone camera video feed works, using FFMPEG to display the feed](https://elbruno.com/2020/02/17/coding4fun-how-to-control-your-drone-with-20-lines-of-code-7-n/)
8. [Open the drone camera video feed using OpenCV](https://elbruno.com/?p=31026)
9. [Performance and OpenCV, measuring FPS](https://elbruno.com/?p=31037)
10. [Detect faces using the drone camera](https://elbruno.com/?p=31119)
11. [Detect a banana and land!](https://elbruno.com/?p=31148)
12. [Flip when a face is detected!](https://elbruno.com/?p=31168)
13. [How to connect to Internet and to the drone at the same time](https://elbruno.com/?p=31305)
14. [Video with real time demo using the drone, Python and Visual Studio Code](https://elbruno.com/2020/04/10/coding4fun-how-to-control-your-drone-with-20-lines-of-code-14-n-globalaicommunity-virtual-tour-recorded-session/)
15. [Using custom vision to analyze drone camera images](https://elbruno.com/2020/04/24/coding4fun-how-to-control-your-drone-with-20-lines-of-code-15-n/)
16. [Drawing frames for detected objects in real-time in the drone camera feed](https://elbruno.com/?p=31380)
17. [Save detected objects to local files, images and JSON results](https://elbruno.com/?p=31396)
18. [Save the Drone camera feed into a local video file](https://elbruno.com/?p=31430)
19. [Overlay images into the Drone camera feed using OpenCV](https://elbruno.com/2020/05/07/coding4fun-how-to-control-your-drone-with-20-lines-of-code-19-n/)
20. [Instance Segmentation from the Drone Camera using OpenCV, TensorFlow and PixelLib](https://elbruno.com/2020/05/21/coding4fun-how-to-control-your-drone-with-20-lines-of-code-20-n/)
21. [Create a 3×3 grid on the camera frame to detect objects and calculate positions in the grid](https://elbruno.com/2020/06/05/coding4fun-how-to-control-your-drone-with-20-lines-of-code-21-n/)
22. [Create an Azure IoT Central Device Template to work with drone information](https://elbruno.com/2021/01/18/coding4fun-how-to-control-your-drone-%e2%9c%88-with-20-lines-of-code-22-n-azureiot/)
23. [Create a Drone Device for Azure IoT Central](https://elbruno.com/2021/01/19/coding4fun-how-to-control-your-drone-%e2%9c%88-with-20-lines-of-code-23-n-azureiot/)
24. [Send drone information to Azure IoT Central](https://elbruno.com/2021/01/20/coding4fun-how-to-control-your-drone-%e2%9c%88-with-20-lines-of-code-24-n-azureiot/)
25. [Using GPT models to generate code to control the drone. Using ChatGPT](https://elbruno.com/?p=36467)

Hi!

I’ve been doing live demos of how to use Azure OpenAI Services or OpenAI APIs to generate code to control the drone, so I think I may write about it to have it public for future references.

So, using the base code to send and read drone information, we can create a simple prompt like this one:

```

Use this python code as reference 

[CODE START]
# display battery level
sendReadCommand('battery?')
print(f'Battery: {battery} %')

# take off
sendCommand("takeoff") 

# flip the drone left
sendCommand("flip l") 

# move drone up 5 cms
sendCommand("up 5") 

# move drone left 5 cms
sendCommand("left 5") 

# rotate drone clock wise 90 degrees
sendCommand("cw 90") 

# land the drone
sendCommand("land") 

[CODE END]

Generate code to takeoff the drone, flip right, move down 30 centimeters and land

```

If we are working with GPT models, we can test this in ChatGPT.

![](https://brunocapuano.files.wordpress.com/2023/07/image-8.png?w=897)

GPT model completion is incredibly good. It generates the necessary commands, and it also infers new commands like flip right or move in a different direction.

If you have seen my demos, you remember me complaining about UDP. And knowing that this drone is a toy plus the UDP challenge, it may make sense to add a 5 second delay between commands.

ChatGPT updates the generated code, adding a time.sleep(5) instruction after each command.

![](https://brunocapuano.files.wordpress.com/2023/07/image-10.png?w=739)

So far, so good. We can copy the generated code and make our drone fly.

In the next post we will automate this code generation using Azure OpenAI Services or OpenAI APIs.

Happy coding!

Greetings

El Bruno

More posts in my blog [ElBruno.com](https://www.elbruno.com).

More info in [https://beacons.ai/elbruno](https://beacons.ai/elbruno)

* * *