>>513620292This. It predicts the next word by statistics... this means it's an autocomplete on steroid. When you talk to AI, internally it's fabricating a script with two characters, you and itself. The response is what AI would say if you had said what you've said. It's a guess based on massive statistical data.
The surprising thing is that logic, math, task solving, coherent responses became an emergent property. No one can explain why it's happening. They fed AI different languages, eventually it started translating and speaking fluently across languages. That wasn't programming, it occurred by effect of scaling up the model. Eventually AI began laughing at jokes where they were funny, and
So it's all very impressive. But never forget, it's predicting the next token. AI entire brain structure is a large token alphabet, about 50k depending on the model, it sees and understands the world through this alien alphabet.