​​Someone has created a twitter bot that can identify pictures of Ed Sheeran
Tags: ai, bot
Published: 2018-05-08 06:44:39

---
title: ​​Someone has created a twitter bot that can identify pictures of Ed Sheeran
published: true
description: The #vision_api hashtag can identify images as well as celebrities, and it is paticularly good at identifying Ed Sheeran.
tags: ai, bot
---

​​A developer named [Scott Cate](https://twitter.com/ScottCate) at Microsoft has built a bot that does image recognition, and, apparently Ed Sheeran recognition as well.
​​
​​Like any bot worth it’s salt, this one runs on Twitter and can be summoned using the #vision_api hashtag. After a slight delay (presumably because a computer in a cloud somewhere is examining the photo with a monocle), a reply is sent with a verbal description of the image.
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="und" dir="ltr"><a href="https://twitter.com/hashtag/vision_api?src=hash&amp;ref_src=twsrc%5Etfw">#vision_api</a> <a href="https://t.co/nblqbhI7NA">pic.twitter.com/nblqbhI7NA</a></p>&mdash; Scott Cate, Seattle #MSBuild (@ScottCate) <a href="https://twitter.com/ScottCate/status/981229827389829120?ref_src=twsrc%5Etfw">April 3, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​<blockquote class="twitter-tweet" data-lang="en"><p lang="it" dir="ltr">Confidence: 91.07 %<br><br>Vision API: a sofa in a room<br><br>Full API Result: <a href="https://t.co/BzV6Jh3BUi">https://t.co/BzV6Jh3BUi</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/981230111893737472?ref_src=twsrc%5Etfw">April 3, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
​​
​​The bot is pretty accurate as far as artificial intelligence goes. That monocle is doing it’s job. Most real-world objects seem to be readily identifiable. And of course it wouldn’t be a proper technological achievement without being able to correctly distinguish hot dogs from…..everything else.
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Another use of <a href="https://twitter.com/hashtag/vision_api?src=hash&amp;ref_src=twsrc%5Etfw">#vision_api</a> <a href="https://t.co/wmPMDFW6lD">pic.twitter.com/wmPMDFW6lD</a></p>&mdash; Scott Cate, Seattle #MSBuild (@ScottCate) <a href="https://twitter.com/ScottCate/status/981643668141559811?ref_src=twsrc%5Etfw">April 4, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 96.11 %<br><br>Caption: a hot dog on a bun<br><br>Tags: hot, dog, food, dish, sandwich, bun, hotdog, paper, fries, sitting, bread, plate, long, table, covered<br><br>Full API Result: <a href="https://t.co/0GVsvX0Fjy">https://t.co/0GVsvX0Fjy</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/981643755286605824?ref_src=twsrc%5Etfw">April 4, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
​​
​​People have been tagging their photos on Twitter for the bot, and the internet does not disappoint. If you’re going to be a bot on Twitter, you can’t half-ass it.
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="und" dir="ltr"><a href="https://twitter.com/hashtag/vision_api?src=hash&amp;ref_src=twsrc%5Etfw">#vision_api</a> <a href="https://t.co/nV2f42glgP">pic.twitter.com/nV2f42glgP</a></p>&mdash; Gabriel Robert (@kvlt_grobert) <a href="https://twitter.com/kvlt_grobert/status/979827859245228033?ref_src=twsrc%5Etfw">March 30, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 50.75 %<br><br>Vision API: a group of toy people<br><br>Full API Result: <a href="https://t.co/G3B4VKNEvw">https://t.co/G3B4VKNEvw</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/979827961628168194?ref_src=twsrc%5Etfw">March 30, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
​​
​​Not quite, bot, but good guess. I suppose “Cow Onesie” is a tad weird. What will the humans do next!?!
​​
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Hey <a href="https://twitter.com/vision_api?ref_src=twsrc%5Etfw">@vision_api</a> what is this?<br><br>My 5 year old said it&#39;s an Easter bunny dog. 🤣 <a href="https://t.co/VdO7qZL0Zs">pic.twitter.com/VdO7qZL0Zs</a></p>&mdash; René Schulte @ #MSBuild (@rschu) <a href="https://twitter.com/rschu/status/980758094371319809?ref_src=twsrc%5Etfw">April 2, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> ​​   
 
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 24.62 %<br><br>Vision API: a close up of a bird<br><br>Full API Result: <a href="https://t.co/8ASKa051PU">https://t.co/8ASKa051PU</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/980758250579791872?ref_src=twsrc%5Etfw">April 2, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​Uh, no. But to be fair, I have no idea what that is either. Is that supposed to be a rabbit? That is honestly terrifying.
​​
​​I happen to notice the trend and tagged a picture of a cheeky Ed Sheeran. I figured the bot would know that it was a man, but I did not expect that the bot would know WHICH man.

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">mom said you had to let me use the xbox <a href="https://t.co/jwBf2AEf1Q">pic.twitter.com/jwBf2AEf1Q</a></p>&mdash; dallas (@mixedhunty) <a href="https://twitter.com/mixedhunty/status/980551155297157126?ref_src=twsrc%5Etfw">April 1, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 86.74 %<br><br>Vision API: Ed Sheeran standing in a room<br><br>Full API Result: <a href="https://t.co/cjZrR3WvWv">https://t.co/cjZrR3WvWv</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/981526814257446912?ref_src=twsrc%5Etfw">April 4, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​THAT’S ED SHEERAN. Even the machines know. You can’t be artificially intelligent if you can’t identify the talent who once crooned out, "And I know you love Shrek / Because we've watched it 12 times."
​​
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">OMG! ED SHEERAN, AM I RIGHT? 😍 <a href="https://t.co/M7D6FyDqYs">pic.twitter.com/M7D6FyDqYs</a></p>&mdash; Bëłłä Îš Łø:śt (RT PINNED) (@Azzurioak) <a href="https://twitter.com/Azzurioak/status/983850709371244544?ref_src=twsrc%5Etfw">April 10, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​You are SO right!
​​
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 93.70 %<br><br>Caption: Ed Sheeran wearing a blue shirt<br><br>Tags: person, man, clothing, shirt, looking, sweater, holding, front, wearing, standing, hand, black, blue, using, young, phone<br><br>Full API Result: <a href="https://t.co/tQX3medXjX">https://t.co/tQX3medXjX</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/983874949785022466?ref_src=twsrc%5Etfw">April 11, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 
​​
​​Not to mention he’s “wearing, standing” and “holding”. You look great no matter what you do, Ed!
​​
​​As it turns out, the bot is not mutually exclusive to Ed. It can recognize most celebrities. Even the ones that you probably wish it wouldn’t.

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Martin Shkreli investor to recover losses <a href="https://t.co/ZRTK5O4yQs">https://t.co/ZRTK5O4yQs</a> <a href="https://t.co/4KyPg4m1HT">pic.twitter.com/4KyPg4m1HT</a></p>&mdash; Former SEC Branch Chief (@LisaBraganca) <a href="https://twitter.com/LisaBraganca/status/984101392234135553?ref_src=twsrc%5Etfw">April 11, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 84.31 %<br><br>Caption: a man standing in front of Martin Shkreli, Benjamin Brafman posing for the camera<br><br>Tags: person, man, suit, standing, outdoor, posing, holding, photo<br><br>Full API Result: <a href="https://t.co/R7gB77N04M">https://t.co/R7gB77N04M</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/984102447579914242?ref_src=twsrc%5Etfw">April 11, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​Although sometimes it does get confused, like when it mistook Scarlett Johansson for Elizabeth Olson in this Avengers poster. 
​​
<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Testing <a href="https://twitter.com/hashtag/vision_api?src=hash&amp;ref_src=twsrc%5Etfw">#vision_api</a> with an <a href="https://twitter.com/hashtag/Avengers?src=hash&amp;ref_src=twsrc%5Etfw">#Avengers</a> <a href="https://twitter.com/hashtag/InfinityWar?src=hash&amp;ref_src=twsrc%5Etfw">#InfinityWar</a> poster <a href="https://t.co/5u57N1g6FL">pic.twitter.com/5u57N1g6FL</a></p>&mdash; Shahed Chowdhuri @ Microsoft (@shahedC) <a href="https://twitter.com/shahedC/status/979204740256030720?ref_src=twsrc%5Etfw">March 29, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 31.95 %<br><br>Vision API: Elizabeth Olsen, Danai Gurira, Chris Hemsworth are posing for a picture<br><br>Full API Result: <a href="https://t.co/kgTEehykUT">https://t.co/kgTEehykUT</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/979205043550412800?ref_src=twsrc%5Etfw">March 29, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​Apparently Chris Hemsworth is unmistakable, even with one eye missing. But Elizabeth Olson For Scar Jo? Come on. They aren’t exactly identica……HOLY CRAP ELIZABETH OLSON IS IN THE PICTURE…

![](https://i.imgur.com/cEaopzI.png)

​​It can get things pretty wrong too. It seems to have trouble with identifying “spikey bracelets”…

<blockquote class="twitter-tweet" data-lang="en"><p lang="und" dir="ltr"><a href="https://twitter.com/hashtag/vision_api?src=hash&amp;ref_src=twsrc%5Etfw">#vision_api</a> <a href="https://t.co/MQFdrqA5cp">pic.twitter.com/MQFdrqA5cp</a></p>&mdash; Purple Puppy🐾 BLACK CAT D.VA (@PuppyOwO) <a href="https://twitter.com/PuppyOwO/status/982693946647343104?ref_src=twsrc%5Etfw">April 7, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 48.77 %<br><br>Maybe: a person sitting on a bed<br><br>Tags: person, indoor, sitting, man, looking, small, top, dog, table, bed, little, young, holding, woman, red, white<br><br>Full API Result: <a href="https://t.co/LkIqrAQlld">https://t.co/LkIqrAQlld</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/982694085344550912?ref_src=twsrc%5Etfw">April 7, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​​​Maybe. Or maybe just someone who needs to clean their room, but wants to look really good doing it.
​​
​​And it really has a problem with furries. Not an ideological problem, but definitely a problem.

<blockquote class="twitter-tweet" data-lang="en"><p lang="ja" dir="ltr">･ ｡<br> ☆∴｡　*<br>　･ﾟ*｡★･<br>　　･ *ﾟ｡　　 *<br>　 ･ ﾟ*｡･ﾟ★｡<br>　　　☆ﾟ･｡°*. ﾟ<br>*　　ﾟ｡·*･｡ ﾟ*<br>　　　ﾟ *.｡☆｡★　･<br>　　* ☆ ｡･ﾟ*.｡<br>　　　 *　★ ﾟ･｡ * ｡<br>　　　　･　　ﾟ☆ ｡ <a href="https://t.co/i9YUwZWFeK">pic.twitter.com/i9YUwZWFeK</a></p>&mdash; SwiftOnSecurity (@SwiftOnSecurity) <a href="https://twitter.com/SwiftOnSecurity/status/982676817466347521?ref_src=twsrc%5Etfw">April 7, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">Confidence: 46.07 %<br><br>Maybe: a dog sitting on a bicycle<br><br>Tags: bicycle, dog, sitting, black, cat, white, standing, brown, large, man<br><br>Full API Result: <a href="https://t.co/igqN0xGoSr">https://t.co/igqN0xGoSr</a></p>&mdash; #vision_api (@vision_api) <a href="https://twitter.com/vision_api/status/982677896375480320?ref_src=twsrc%5Etfw">April 7, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> 

​​This is all made possible by Microsoft’s [Computer Vision API](https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/), which says that it can “Extract rich information from images to categorize and process visual data.” Aside from being able to recognize celebrities and pharma bro’s, it can also recognize handwriting in images and popular landmarks as well. Microsoft says that it can recognize o”200K celebrities from business, politics, sports and entertainment.” as well as “9000 natural and man-made landmarks”.
​​
​​You can try out the bot yourself by adding the #vision_api hashtag to any tweet with an image. Now go and have fun seeing if the bot loves Shrek as much as Ed does.

<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">I simply adore donkey <a href="https://twitter.com/hashtag/Shrek?src=hash&amp;ref_src=twsrc%5Etfw">#Shrek</a> <a href="https://t.co/F1sawshXeQ">pic.twitter.com/F1sawshXeQ</a></p>&mdash; Sue Atkins (@SueAtkins) <a href="https://twitter.com/SueAtkins/status/980092921331494912?ref_src=twsrc%5Etfw">March 31, 2018</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>