# Presentation: 347525

## HUMAN COMPUTATION

**CARNEGIE MELLON UNIVERSITY**

## Verification technology developed in collaboration with Carnegie Mellon University

- Verification technology developed in collaboration with Carnegie Mellon University

## CAPTCHA

**A PROGRAM THAT CAN TELL WHETHER ITS USER IS A ****HUMAN OR A COMPUTER**

## CAPTCHA

**A.****	****MOST HUMANS CAN PASS**
**B.****	****CURRENT COMPUTER PROGRAMS CANNOT PASS**

**A ****PROGRAM**** THAT CAN GENERATE AND GRADE TESTS THAT:**

## EXAMPLE

## ...AND GENERATES A TEST:

**...****AND GENERATES A ****TEST****:**

**TYPE THE CHARACTERS THAT APPEAR IN THE IMAGE**

## (FROM WWW.SLASHDOT.ORG)

- QUICKVOTE

- Which is the best Computer Science Grad School in the US?

- CMU

- MIT

- vote

- Berkeley

- Stanford

- Cornell

- Washington

## APPLICATIONS

**FREE E-MAIL SERVICES**
**DATA COLLECTION**
**WORMS AND SPAM**
**PREVENTING DICTIONARY ATTACKS**

## CAPTCHA SWEAT SHOPS

**SPAM COMPANIES HIRE HUMANS TO SOLVE CAPTCHAS ****ALL DAY LONG**

**$2.50 PER HOUR FOR EACH HUMAN**

**720 CAPTCHAS PER HOUR PER HUMAN**

**1/3 CENT PER ACCOUNT**

## VOTE FOR

**VOTE FOR**
**LUIS**

## Free Nude Photos

- Type the word in the box if you want to see the next picture

## HUMAN COMPUTATION

- HUMAN COMPUTATION

## 9 BILLION HUMAN-HOURS OF SOLITAIRE WERE PLAYED IN 2003

**EMPIRE STATE BUILDING**

- PANAMA CANAL

- 7 MILLION HUMAN-HOURS
- (6.8 HOURS OF SOLITAIRE)

- 20 MILLION HUMAN-HOURS
- (LESS THAN A DAY OF SOLITAIRE)

## HUMAN COMPUTATION

- HUMAN COMPUTATION

## HUMAN COMPUTATION

- HUMAN COMPUTATION

## LABELING IMAGES WITH WORDS

**STILL AN ****OPEN PROBLEM**

## IMAGE SEARCH ON THE WEB

**USES FILENAMES AND HTML TEXT**

## ACCESSIBILITY

**LESS THAN 10% OF THE WEB IS ACCESSIBLE TO THE ****VISUALLY IMPAIRED**

## DESIDERATA

**A METHOD THAT CAN LABEL ALL IMAGES ON THE WEB **

**FAST AND CHEAP**

## USING HUMANS

**THE ESP GAME**** COULD LABEL ALL IMAGES ON GOOGLE IN A FEW WEEKS**

**THE ESP GAME**

- CLEVERLY

## THE ESP GAME

**PARTNERS DON’T KNOW EACH OTHER AND CAN’T COMMUNICATE**

**OBJECT OF THE GAME: **
**TYPE THE SAME WORD**

**ONLY THING IN COMMON IS **
**AN IMAGE**

- THE ESP GAME

## THE ESP GAME

**PLAYER 1**

**PLAYER 2**

- THE ESP GAME

## © 2004 Carnegie Mellon University, all rights reserved. Patent Pending.

**© 2004 Carnegie Mellon University, all rights reserved. Patent Pending.**

## THE ESP GAME IS FUN

- THE ESP GAME IS FUN

**THERE ARE MANY PEOPLE THAT PLAY ****OVER 20 HOURS A WEEK**

## LABELING THE ENTIRE WEB

**INDIVIDUAL GAMES IN YAHOO! AND MSN AVERAGE OVER 5,000 PLAYERS AT A TIME**

**5000 PEOPLE**** PLAYING SIMULTANEOUSLY CAN LABEL ALL IMAGES ON GOOGLE IN ****2 MONTHS****!**

## Slide 26

## SINGLE-PLAYER GAME

**A SINGLE PERSON CAN PLAY WITH ****PRE-RECORDED ****ACTIONS AS THEIR PARTNER**

**WHEN 2 PEOPLE PLAY, WE RECORD EVERY ACTION WITH TIMING INFORMATION**

**(0:12) CAR**
**(0:15) HAT**
**(0:21) KID**

**(0:08) BOY**
**(0:23) CAR**

**NOTICE THAT THIS DOESN’T STOP THE LABELING PROCESS!**

## ZERO-PLAYER GAME

- ZERO-PLAYER GAME

**WE CAN ALSO PAIR PRE-RECORDED GAMES WITH EACH OTHER!**

## WHAT ABOUT CHEATING?

- WHAT ABOUT CHEATING?

## SEARCH RESULTS

## SEARCH RESULTS

## SEARCH RESULTS

## SEARCH RESULTS

## Slide 34

## GOOOOOOGLE

## SAMPLE LABELS

## SAMPLE LABELS

- SAMPLE LABELS

## WHY DO PEOPLE LIKE THE ESP GAME?

## THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. 

**THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY.**** ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS.**** **

## “

**“**

**”**

**IT’S SO MUCH FUN TRYING TO GUESS WHAT OTHERS THINK. YOU HAVE TO STEP OUTSIDE OF YOURSELF TO MATCH**

**“**

**”**

## BLOGS

## “

**HOW IT USES A GAME STRUCTURE TO BUILD AN ****INDEX OF IMAGES**** ON THE WEB**

**WHAT ****WORDS BECOME TABOO**** FROM FREQUENT USE **

**HOW INTERESTING SOME OF THE ****IMAGES PULLED RANDOMLY**** FROM THE WEB ARE**

**“**

## Your partner has entered a guess

- © 2005 Carnegie Mellon University, all rights reserved. Patent Pending.

**Your partner has entered a guess**

## THE ESP GAME IS AN “ALGORITHM”

**INPUT:**** AN IMAGE**

**OUTPUT:**** SET OF KEYWORDS**

**RUNNING A COMPUTATION IN PEOPLE’S BRAINS INSTEAD OF SILICON PROCESSORS**

## OTHER GAMES WITH A PURPOSE

## LOCATING OBJECTS IN IMAGES

**ESP **
**GAME**

**MAN**

**SKY**

**WATER**

**PLANT**

**WOMAN**

## LOCATING OBJECTS IN IMAGES

**SUCH INFORMATION WOULD BE EXTREMELY USEFUL FOR ****COMPUTER VISION RESEARCH**

**MAN**

**SKY**

**WATER**

**PLANT**

**WOMAN**

## Slide 48

## Slide 49

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## Slide 55

## Slide 56

## Slide 57

## Slide 58

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## HINT

**HINT**

## Slide 64

## HINT

**HINT**

**“****PINGS”**

## Slide 66

## IS FUN!

**IS FUN!**

**27,000 ****PLAYERS **
**2,100,000**** PIECES OF DATA**

**MANY PLAYED OVER ****120 HOURS**** IN THE FIRST 10 DAYS!**

## 270 HOURS OF GAME-PLAY

**270 HOURS OF GAME-PLAY**

## RONALD

**RONALD**

## Slide 70

## + SEGMENTATION

**+ SEGMENTATION**

## Slide 72

## Slide 73

## THE POWER OF HUMAN CYCLES

**OPEN**
**PROBLEM**

**CAPTCHA**

**GAME**

## Slide 75

## WWW.PEEKABOOM.ORG

- WWW.ESPGAME.ORG

- WWW.CAPTCHA.NET

## WARDROBE PROVIDED BY

- THE GAP
- HAIRSTYLES
- ARNAUD SOME-FRENCH-LAST-NAME
- THIS WORK HAS BEEN
-  AND WILL BE PARTIALLY SUPPORTED BY
- THE NSF ALADDIN CENTER
- MICROSOFT RESEARCH
- GOOGLE, INC

- SLIDE DESIGN
- LUIS VON AHN
- CAPTCHA CREW
- LUIS VON AHN
- MANUEL BLUM
- NICHOLAS HOPPER
- JOHN LANGFORD
- THE ESP GAME CREW
- LUIS VON AHN
- LAURA DABBISH

- TAKEO KANADE
- STEVEN KATZ
- MIHIR KEDIA
- JOHN LANGFORD
- ROY LIU
- JITENDRA MALIK
- UDI MANBER
- MONI NAOR
- LENORE RAMM
- CHUCK ROSENBERG
- RONI ROSENFELD
- PUSH SINGH
- DAVID STORK
- LATANYA SWEENEY
- SHINGO UCHIHASHI
- MANUELA VELOSO

- SPECIAL THANKS TO
- ADITYA AKELLA
- JOSH BENALOH
- LENORE BLUM
- MANUEL BLUM
- ANDREW BORTZ
- SHUCHI CHAWLA
- LAURA DABBISH
- ALEXEI EFROS
- ALAN EUSTACE
- BILL GATES
- SHIRY GINOSAR
- BRIGHTEN GODFREY
- NICK HOPPER
- SUSAN HRISHENKO

- PEEKABOOM CREW
- LUIS VON AHN
- ROY LIU
- VERBOSITY CREW
- LUIS VON AHN
- MIHIR KEDIA
- MANUEL BLUM
- SPEAKER’S ENTERTAINMENT PROVIDED BY
- HOMESTARRUNNER.COM