Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

highplainsdem

(60,632 posts)
15. This is a pretty clear explanation of how LLMs work, from a university in Australia:
Thu May 22, 2025, 12:20 AM
May 2025
https://teche.mq.edu.au/2023/02/why-does-chatgpt-generate-fake-references/

It is important to outline that ChatGPT is a ‘large language model’ designed to output human-like text based on the context of the user’s prompt. It uses a statistical model to guess, based on probability, the next word, sentence and paragraph to match the context provided by the user. The size of the source data for the language model is such that ‘compression’ was necessary and this resulted in a loss of fidelity in the final statistical model. This means that even if truthful statements were present in the original data, the ‘lossiness’ in the model produces a ‘fuzziness’ that results in the model instead producing the most ‘plausible’ statement. In short, the model has no ability to evaluate if the output it is producing equates to a truthful statement or not.


Anyway, this is why an AI-generated list of books to read this summer included books that don't exist: https://www.democraticunderground.com/10143462646

Another recent thread on how stupid chatbots are: https://www.democraticunderground.com/100220313020


Recommendations

0 members have recommended this reply (displayed in chronological order):

AI Vote4Kam May 2025 #1
Thank you for your opinion. SalamanderSleeps May 2025 #4
OH I get it Skittles May 2025 #9
Skittles, with generative AI like ChatGPT or an image generator like Midjourney, you can get an endless highplainsdem May 2025 #13
This is a pretty clear explanation of how LLMs work, from a university in Australia: highplainsdem May 2025 #15
Welcome to DU LetMyPeopleVote May 2025 #22
Wow... 'Guess he hasn't managed to get Elon or others to reprogram for his preferred "resullts" (lies) hlthe2b May 2025 #2
This message was self-deleted by its author DUMember24 May 2025 #3
Yes right, the list could go on forever. The man knows no sunshine. He hates himself like he loved his father. SalamanderSleeps May 2025 #6
A.I. is obviously more intelligent than a particularly stupid Republican... Jack Valentino May 2025 #5
Kinda curious what was the prompt you used? fujiyamasan May 2025 #7
What is wrong with Donald J. Trumps decisions since 2016....then I just followed the prompts. SalamanderSleeps May 2025 #10
Seems spot on here. Although 50% or so of country would disagree. Silent Type May 2025 #8
What's scary is anyone using ChatGPT as a source of information. highplainsdem May 2025 #11
Do you see any information that you believe is incorrect? Doodley May 2025 #12
Large Language Models are what they are. SalamanderSleeps May 2025 #17
If you think the unreliability of LLMs is a personal problem, you understand nothing about them. highplainsdem May 2025 #20
LLM's do not care about what you, or I, actually think. SalamanderSleeps May 2025 #21
As someone once said-- xuplate May 2025 #14
Ask about timms139 May 2025 #16
There's still hope. SalamanderSleeps May 2025 #19
Fantastic work BaronChocula May 2025 #18
I mean, okay. Tommy Carcetti May 2025 #23
Latest Discussions»General Discussion»So, I asked the ChatGPT w...»Reply #15