# Presentation: 030742

## Robotic, human, and hybrid cognition 

-                                          **             ****	****	****	****	****	****                                        **

*Sidney Perkowitz*
*Charles Howard Candler *
*Professor of Physics*
*Emory University, Atlanta GA 30322 *
*physp@emory.edu*

## Digital People 

*Digital People*** **

## “Digital people” means different types

-  of artificial and hybrid beings
- An _automaton_ is a machine that appears to move spontaneously, although actually it moves “under conditions fixed for it, not by it.”
- A _robot_ is an autonomous or semi-autonomous machine made to function like a living entity. It may or not be humanoid.
- An _android _is similarly entirely artificial, but has been made to look human, like Commander Data of *Star Trek*.
- A _cyborg_ (_cyb_ernetic _org_anism) has a physically dominant machine portion under the mental direction of the natural part – essentially, a brain in a box.
- A _bionic_ (_bio_logical and electro_nic_) being is mainly natural, with a relatively small fraction made of implants or replacement parts such as a heart pacemaker or artificial limb.

## Two principles

- My book is mostly about embodied artificial beings, where the mind-body interaction is important, rather than about disembodied AI’s.
- My view is pragmatic; intelligence can be defined in terms of behavior, and if the being acts intelligently, it’s intelligent, without regard to its internal state; that is, without asking whether it’s “really” thinking or not.

##   There are lots of robots in the world

**Industrial Robot Population of the World**
**         ****(in thousands of units)**

|  | 1984 | 1988 | 2001 | 2002 | 2003 (c) | 2006 (c) |
| --- | --- | --- | --- | --- | --- | --- |
| Japan | 67 | 176 | 360 | 350 | 344 | 333 |
| USA | 13 | 33 | 97 | 104 | 111 | 135 |
| Europe | 17 | 53 | 231 | 244 | 259 | 316 |
| Asia/Australia (a) | 0.7 | 2 | 57 | 60 | 64 | 73 |
| Total (b) | 100 | 266 | 757 | 772 | 838 | 875  |
|  |  |  |  |  |  |  |

**(a) Excluding Japan**
**(b) If estimated uncounted units are included (for instance, for USSR/Russia), the total for 2002 probably exceeds 1,000,000 units**
**(c) Projections**
**Data for 1984, 1988: National Research Council. *****Approaches to Robotics in the United States and Japan: Report of a Bilateral Exchange*****, 1996. **_[http://books.nap.edu/books/NI000756/html/4.html](http://books.nap.edu/books/NI000756/html/4.html)_**.**
**Data for 2001 – 2006:  United Nations Economic Commission for Europe. *****World Robotics 2003*****, ISBN 92-1-101059-04****. **_[http://www.unece.org/press/pr2003/03stat_p01e.pdf](http://www.unece.org/press/pr2003/03stat_p01e.pdf)_

## The virtual history of artificial beings

**The virtual history of artificial beings**

| Story |       Year |    Name |    Type |
| --- | --- | --- | --- |
| Pygmalion, the sculptor                                          | Classical era | Galatea | Animated |
| Hephaestus, artificer to the Gods | Classical era | Talos | Mech. |
| Golem of Prague | 16th century | Golem | Animated |
| Frankenstein, Mary Shelley | 1818 | The Being | Animated |
| R. U. R., Karel Capek | 1921 | “Robots” | Android |
| Metropolis, film | 1927 | Maria |    Mech. |
| Frankenstein, film | 1931 | The Being | Animated |

## The virtual history of artificial beings

| Story |       Year |    Name |    Type |
| --- | --- | --- | --- |
| I, Robot, Isaac Asimov | 1950 | Varied  | Mech. |
| Day the Earth Stood Still, film | 1951 | Gort | Mech. |
| Forbidden Planet, film | 1956 | Robbie | Mech. |
| 2001, film | 1968 | HAL | AI |
| The Six Million Dollar Man, TV | 1973 -78 | Steve Austin | Bionic  |
| Blade Runner, film | 1982 | Roy Batty | Android |
| Terminator 1, 2, 3, film | 1984 - 2003 | Terminator | Android |
| RoboCop, film | 1987 | RoboCop | Cyborg |
| Star Trek: Next Generation, TV | 1987-1994 | Data | Android |
| A. I., film | 2001 | David | Android |
| I, Robot, film | 2004 | Sonny | Mech. |
|  |  |  |  |
|  |  |  |  |
|  |  |  |  |
|  |  |  |  |
|  |  |  |  |
|  |  |  |  |
|  |  |  |  |

## The virtual history of artificial beings

##     The real history of artificial beings 

**          **

| Background technology |        Year |
| --- | --- |
| Heron of Alexandria, Philon of Byzantium; weights & springs for power  | Classical era |
| Water clocks | Classical era |
| Roman military chariots; distance-counting mechanism  | Classical era |
| Abacus | 13th century |
| Gravity-powered clocks: Westminster Abbey | 13th century |
| Spring-powered clocks: Peter Henlein | 1502 |
| Mechanical calculators: Pascal, Leibniz, others | 17th century |
| Rene Descartes and the Enlightenment: humans as machines | 17th – 18th century |
| Luigi Galvani, animal electricity; Alessandro Volta, first battery  | 1780 – 1800 |

##     The real history of artificial beings 

**          **

| Background technology |        Year |
| --- | --- |
| Charles Babbage, Lady Lovelace: the Analytical Engine; conditional jump  | 1834 |
| George Boole: binary mathematics and logic | 1854 |
| The electric dog: a self-guided torpedo  | 1912 |
| Claude Shannon; computing with Boolean logic; binary numbers | 1938 |
| Neural nets, mental architecture | 1943 |
| John von Neumann; stored program.  | 1945 |
| ENIAC, first general purpose computer  | 1946 |
| Transistor invented | 1947 |
| Alan Turing: “Can machines think?”; the Turing test | 1950 |
| UNIVAC, first commercial computer | 1951 |
| First conference on artificial intelligence (AI) | 1956 |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |

##   The real history of artificial beings 

**             **

| The being  | Year |
| --- | --- |
| Heron of Alexandria: Nauplius, automaton theater | Classical era |
| Clockwork automata: figures that wrote, drew, played instruments | 1738-1800 |
| Vaucanson’s duck, more than 1,000 parts. Medical use. | 1738-1741 |
| Moving & talking electro-mechanical robot, “R. U. R.,” London  | 1928 |
| Moving & talking electro-mechanical robot, Elektro, Westinghouse Corp.  | 1939 |
| First industrial robot;  Devol and Engelberger, UNIMATE | 1954 |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |

##   The real history of artificial beings 

**             **

| The being  | Year |
| --- | --- |
| Animatronic entertainment robots, Disney, Star Wars | 1963  |
| Shakey, battlefield scouting and supply robot. “Top down AI.”  | 1968  |
| Genghis, walking robot, Rodney Brooks, Stanford. “Bottom up AI” | 1984 |
| COG, Rodney Brooks, MIT | 1990’s |
| Kismet, Cynthia Breazeal, MIT – human interaction | 1990’s |
| Robot toys: Sony AIBO, I-Cybie, My Real Baby | 1990’s |
| NurseBot, Sebastian Thrun, Carnegie-Mellon. Assisting the elderly. | 2000 |
| ASIMO, HONDA humanoid robot – walking, mental abilities | 1990’s - 2004 |
| QRIO, SONY humanoid robot –  additional mental abilities | 1990’s - 2004 |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |

## Robots used to be clunky

- Elektro and his dog Sparky. Made by the Westinghouse Corp.,
- for the New York World’s Fair, 1939 .
- Elektro could move forward and backward, dance, use
- a 20 word vocabulary, and smoke a cigarette.

**Robots used to be clunky**

## Now digital creatures are becoming          		more natural...                                 

**      **
** ****	****	**
**                   **

**Now digital creatures are becoming          ****	****	****more natural**...**                                 **

**Honda’s walking robot Asimo and friend. **
**ASIMO walks quite well, even negotiating**
**stairs.**

**“****Children React in New Ways to **
**Things that are ‘Almost Alive.’ ” **

## ...and smarter

**	****	****  ****	****            ****	****	**

**                   ****	****	****	****	****	****	****	****              ****QRIO, Sony **

**...****and smarter**

**Elektro & Sparky (1939)**

**Kismet, MIT**

**ASIMO, Honda**

- Then

- Now

**QRIO, Sony**

## Robodex 2003, Yokohama, Japan

**Robodex 2003, Yokohama, Japan**

## New capabilities: physical and sensory

**On the horizon**
**High speed object recognition and obstacle avoidance (DARPA, Daimler Chrysler)**
**Intelligent manipulation of objects (NASA Robonaut, surgical robots)**

**Walking (ASIMO, QRIO) **
**Climbing stairs (ASIMO)**
**Adjusting gait for walking surface (QRIO)**
**Avoiding obstacles (QRIO, robot explorers on Mars)**
**Recovering from falls (QRIO)**
**Dancing (QRIO) **
**Shaking hands, carrying objects (ASIMO)**
**Displaying facial expressions (Kismet)**

## Slide 18

## Slide 19

## Slide 20

## Slide 21

## New capabilities: mental

**Logical-mathematical**: capacity for logical analysis and mathematical operations
**Musical**: skill in recognizing and manipulating musical patterns
**Bodily-kinesthetic**: using one’s body or parts of it to solve problems
**Spatial**: recognizing and manipulating the patterns of space
**Interpersonal**: understanding the intentions and desires of other people and so working effectively with them
**Intrapersonal**: understanding oneself, creating an internal working model of oneself and using this to manage one’s own life

**Following Howard Gardner, *****Intelligence Reframed*****  (Basic Books, New York, 1999) there are seven facets to human intelligence.**

**New capabilities: mental**

## New capabilities: mental (continued)

**Six of these seven facets are now beginning to be emulated in artificial beings, even if only at rudimentary levels**
**Linguistic**: QRIO, 20,000 words, simple conversations; ASIMO, hand signals; AMTRAK, “Julie”
**Logical-mathematical**: virtually all robots could do arithmetic, higher math
**Musical**: QRIO, sings solo and harmony, dances
**Bodily-kinesthetic**: ASIMO and QRIO – underlies the physical abilities
**Spatial**: ASIMO and QRIO – underlies the physical abilities
**Interpersonal**: Kismet, reacts to people; QRIO, recognizes faces; ASIMO, shakes hands; others, analyze facial expression and voice for emotional cues
**Intrapersonal**:  – ??? controversial category; it relates to consciousness

## Body, mind, and experience I

-      In contrast to a “top-down” model of the world, this method of instilling intelligence is “bottom-up”...only low-level behavior is built in, with the expectation that more complex behavior will emerge...[This] approach is especially meaningful for a robot that physically interacts with the real world...
-     [The robot must deal] intelligently with its physical environment, where it has to move without collisions [and so on]...that interaction would constantly help the robotic brain develop on the basis of experience, just as we humans learn to function in the world by doing things in it.

**Body, mind, and experience I**

**Excerpt from *****Digital People*****:**

## Body, mind, and experience II

-      Some ideas from cognitive science support this. In their *Philosophy in the Flesh* (1999), George Lakoff and Mark Johnson postulate that higher level functions of mind begin as metaphors for how our bodies interact with the world. “The mind is inherently embodied,” they write, and add:
- 	...the very structure of reason [comes from] our embodiment.
- 	The same neural and cognitive mechanisms that allow us to
- 	perceive and move around also create our conceptual systems

**Body, mind, and experience II**

## Body, mind, and experience III

-      But...embodied intelligences have yet to demonstrate that they have developed higher functions of mind operating at abstract levels. Numerous questions remain...The pioneering AI researcher Marvin Minsky ...has called emphasis on robots “unproductive” and “bad taste on the part of my fellow scientists,” adding:
- 	in the 1950’s and '60’s ...we found, OK, you can build a robot
- 	and have it walk around the room and bump into things and
- 	learn not to, but we never got any profound knowledge out
- 	of those experiments.

**Body, mind, and experience III**

## As robots become more human, people become more artificial

**            **

**           ****	****   **

**   ****	****	**

**	****	****   ****	****	****	****    ****	****	****	****	****	**
**	****	****	****	****	****      **

**         **

- Cochlear implant

**       **

**  **

**Then**

**Now**

- Pegleg

- Prosthetic runner
- (12.4 s/100m)

- Cosmetic arm

- Artificial heart

- Retinal implant

- Cortical implant

## Developments in neural-machine interfaces

- Over 30,000 cochlear implants are in use, including
- some placed in deaf children 1 – 2 years old
- Research laboratories and corporations are pursuing
- retinal and cortical implantation for the blind
- DoD/DARPA have funded R & D in mind-machine interfaces,
- for such applications as direct mental control of aircraft
- Monkey brains have operated remote robotic arms,
- and a sea-lamprey brain has operated a wheeled robotic body
- At least one researcher is making “neurons on a chip”
- Electrodes implanted in the brain have allowed a fully paralyzed person to operate an external device, a computer, by mental control alone

## What’s the future for artificial and hybrid 

**       ****intelligence and cognition?**

**One motivator is the growing number of robots on and off the assembly line. These, especially the non-industrial models, will need ever-enhanced cognitive abilities.**
**     ****The population of industrial robots has grown 10 times in 20 years. **
**     ****(1984: 100K units       2002:  772K units    2006:  > 1,000K units)**
**     ****The population of household and entertainment robots is projected**
**     ****to grow four times in four years, until in 2006 it will exceed the**
**     ****population of industrial robots.**
**   ****	****                           ****(2002: 625 K units    2006: 2,200K units)**
**For hybrid cognition, a potentially huge impact will come from medical uses of robots and human-machine hybrids. These include surgical and care-taking units, replacement and even enhancement of human physical abilities, and eventually mental abilities as well. First on the horizon: direct neural control of prosthetic limbs.**

## Nonindustrial robot population of the world

|  Type | 2002 | 2006** |
| --- | --- | --- |
| Household (vacuum, lawn) | 50 | 500 |
| Professional services* | 19 | 49 |
| Entertainment | 545 | 1,500 |
| Total, all nonindustrial | 625 | 2,200 |
| Value (billions of $) | 3.6 | 6.0 |

- *surgical, underwater, surveillance, hazardous duty, assisting disabled people, etc.
- ** projected
**Data, UN Economic Commission for Europe. *****World Robotics 2003.***** ****http://www.unece.org/press/pr2003/03stat_p01e.pdf**

**Nonindustrial robot population of the world**
**          ****(in thousands of units)**

## Ethical Issues Around Cognitive Systems 

- What are our reasons for making cognitive systems? Some are made for warfare, some for direct human benefit. Where, if anywhere, should we make moral decisions about this technology?
- How do we treat machines with human qualities, and especially, people with machine qualities? A person with an artificial leg is no less a human, but how about someone with a neural prosthesis? What fraction of a person’s mind has to become artificial before he is no longer a person, if ever?
- Suppose someone develops a “smartness chip.” Should only the rich have access to this benefit; if not, how do we select the recipients?
- The Japanese, Italian, and German auto industries already have more than one robot per ten production workers. Will smarter artificial minds put humans out of work?

**	**

## Slide 32

| 
 |  |  |  |  |
| --- | --- | --- | --- | --- |

| First International Symposium on RoboethicsThe ethical, social, humanitarian and ecological aspects of Robotics30 - 31 January 2004, Villa Nobel, Sanremo, Italy  |
| --- |

|  |  |    |
| --- | --- | --- |

## Can we expect...

**	****	****	****	****	**

**Can we expect...**

**This...**

**this...**

**or this?**

**The end...and thank you**