>Bro, look at those benchmarks bro, it's so good at coding!
>LLMs are beating humans at coding competitions, bro!
And still they make mistakes in basic coding tasks that even Rajesh wouldn't make. Sometimes they even choose to ignore the instructions and decide to "optimize" completely unrelated code fragments, completely breaking it. Why are LLMs like this? Was LeCunny right?