>>105596381The fact that LLMs are just very advanced word predictors has some obvious consequences that most people aren't aware of.
For example, suppose you ask ChatGPT a question, it gives you an answer, then you ask it to explain why it answered that way. It will come up with a reasonable-sounding answer that is in fact complete bullshit, because answering the question accurately is something the model is fundamentally incapable of.