Oops! We Automated Bullshit

According to:

• MIT Professor of AI Rodney Brooks, ChatGPT "“just makes up stuff that sounds good"... where “sounds good” is an algorithm to imitate text found on the internet, while “makes up” is the basic randomness of relying on predictive text rather than logic or facts",
• Geoff Hinton: "the greatest risks is not that chatbots will become super-intelligent, but that they will generate text that is super-persuasive without being intelligent, in the manner of Donald Trump or Boris Johnson"
• Harry Frankfurt "explains that the bullshitter “does not reject the authority of truth, as the liar does […] He pays no attention to it ... bullshit is a greater enemy of the truth than lies are”"
• "Graeber’s famous analysis of Bullshit Jobs ... revealed that over 30% of British workers believe their own job contributes nothing of any value to society... writing pointless reports, relaying messages from one person to another, or listening to complaints they can do nothing about... [all] easily done by ChatGPT... we train people for bullshit jobs by training them to generate bullshit."

LLMs are trained using "huge archives of bullshit, alongside plenty of actual facts... But there is no algorithm in ChatGPT to check which parts are true. The output is literally bullshit... Just as Twitter encourages bullshitting politicians ... what they have said can be used to train automatic bullshit generators."