The Future of Knowledge Graphs in a World of Large Language Models
Channel: Denny Vrandečić
Date: 2023-05-23

Post-conference recording of the keynote for May 11 at the Knowledge Graph Conference 2023 in New York, NY.

How do Knowledge Graphs fit into the quickly changing world that large language models are shaping?

Some books and papers mentioned and further reading:
* Diffusion of Innovations https://en.wikipedia.org/wiki/Diffusion_of_innovations
* The Guardian: ChatGPT reaches 100 million users two months after launch https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million-users-open-ai-fastest-growing-app
* Knowledge Graphs and Their Role in the Knowledge Engineering of the 21st Century
 https://www.dagstuhl.de/en/seminars/seminar-calendar/seminar-details/22372
* Language Models are Few-Shot Learners (GPT-3 paper) https://arxiv.org/abs/2005.14165v4
* Getting and hosting your own copy of Wikidata https://wikidataworkshop.github.io/2022/papers/Wikidata_Workshop_2022_paper_4558.pdf
* Introducing GPT-4 in Azure OpenAI Service https://azure.microsoft.com/en-us/blog/introducing-gpt4-in-azure-openai-service/
* Ars Technica: ChatGPT-style search represents a 10x cost increase for Google, Microsoft https://arstechnica.com/gadgets/2023/02/chatgpt-style-search-represents-a-10x-cost-increase-for-google-microsoft/
* CNBC: ChatGPT and generative AI are booming, but the costs can be extraordinary https://www.cnbc.com/2023/03/13/chatgpt-and-generative-ai-are-booming-but-at-a-very-expensive-price.html
* Wired: OpenAI’s CEO Says the Age of Giant AI Models Is Already Over https://www.wired.com/story/openai-ceo-sam-altman-the-age-of-giant-ai-models-is-already-over/
* Introducing LLaMA: A foundational, 65-billion-parameter large language model https://ai.facebook.com/blog/large-language-model-llama-meta-ai/
* The place of birth of Ena Begović http://simia.net/wiki/The_place_of_birth_of_Ena_Begovi%C4%87
* Augmented Language Models: a Survey https://arxiv.org/abs/2302.07842
* Toolformer: Language Models Can Teach Themselves to Use Tools https://arxiv.org/abs/2302.04761
* Locating and Editing Factual Associations in GPT https://rome.baulab.info/
* Dissecting Recall of Factual Associations in Auto-Regressive Language Models https://arxiv.org/abs/2304.14767
* Stable Diffusion https://en.wikipedia.org/wiki/Stable_Diffusion
* Abstract Wikipedia https://meta.wikimedia.org/wiki/Abstract_Wikipedia
* Wikifunctions Beta https://wikifunctions.beta.wmflabs.org/