It can be done by a very careful selection of patterns and intelligent design of random number generator which will be not completely random but will be controlled by both the grammar and the data base. This program will be next used by Centaur or by People-Bot guide in FAB building. Its variants will be used by talking heads. Write a Lisp program to communicate in English with a robotic arm such as Rhino. You type the text, robot responds by generating text and moving blocks.
Robot is blind, it just knows the initial positions of all colored boxes.
Next it always stores in mind which block is where. Analyze graphics and sound generation of this language. Connect a simple robotic arm controlled from parallel or serial port. Also, a new robot arm can be build using ideas from Robix WWW page. Next write a simple Golden Hill Common Lisp that will be interfaced with OGI tools.