
Artificial Intelligence: ChatGPT's Astonishing Fabrications About Percy Ludgate
Shortly after ChatGPT burst into the public spotlight in late 2022, Brian Coghlan, Brian Randell, and Noel O'Boyle were intrigued by the repeated claim that ChatGPT would excel at supporting historical research. They had done extensive research on Percy Ludgate, a little-known computer pioneer who designed an analytical engine in 1909. Coghlan et al. put ChatGPT 3.5 to the test. They were astonished at its alacrity in producing authoritative-sounding but false answers to questions about Ludgate—questions whose answers they already knew through their own research. They concluded that the hallucination problem was much deeper than suspected. As part of our Symposium on AI, the editors of Ubiquity are pleased to publish this full technical report (lightly edited and reformatted) so that you can see for yourself. And as a bonus, you can learn a little about this amazing pioneer of computing. ...