The digitally connected world has become a large, swirling sea of information stripped of context. Artificial Intelligence: Generative AI
Large language models (LLMs) are the first neural network machines capable of carrying on conversations with humans. They are trained on billions of words of text scraped from the internet. They generate text responses to text inputs. They have transformed the public awareness of artificial intelligence, bringing on reactions ranging from astonishment and awe to trepidation and horror. They have spurred massive investments in new tools for drafting texts, summarizing conversations, summarizing literature, generating images, coding simple programs, supporting education, and amusing humans. Experience with them has shown them likely to respond with fabrications (called "hallucinations") that severely undermine their trustworthiness and make them unsafe for critical applications. Here, we will examine the limitations of LLMs imposed by their design and function. These are not bugs but are inherent limitations of the technology. The same limitations make it unlikely that LLM machines will ever be capable of performing all human tasks at the skill levels of humans.
... Artificial Intelligence: Foundational Technologies of Artificial Intelligence
More than the 70 years since its emergence in the early 1950s, artificial intelligence (AI) is performing cognitive tasks traditionally considered the unique province of humans. This progress did not occur in a vacuum. AI emerged against a rich background of technologies from computer science and ideas about intelligence and learning from philosophy, psychology, logic, game theory, and cognitive science. We sketch out the enabling technologies for AI. They include search, reasoning, neural networks, natural language processing, signal processing and computer graphics, programming and conventional software engineering, human-computer interaction, communications, and specialized hardware that provides supercomputing power. Beyond these technologies is the notion of Artificial General Intelligence that has or exceeds the capabilities of the human brain. Currently this is completely aspirational and is not expected to be possible before 2025, if ever. Artificial Intelligence is based on a variety of technologies, none of which seek to emulate human intelligence.
...