Computer creativity

“What [the team] proves theoretically, and also confirms empirically, is that there is compositional generalization, meaning [LLMs] are able to put building blocks together that have never been put together,” he said. “This, to me, is the essence of creativity.” Arora adds that the work doesn’t say anything about the accuracy of what LLMs write. “In fact, it’s arguing for originality,” he said. “These things have never existed in the world’s training corpus. Nobody has ever written this. It has to hallucinate.”
-- Anil Ananthaswamy | January 22, 2024 | New Theory Suggests Chatbots Can Understand Text[ Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing. \
----
----
* computer; creativity
----