LLMs are most useful as search engines. (in fact, LLMs are only useful as search engines but it's outside the scope of this post.)

search engines suck because search engine providers deliberately make them suck.

in effect, we're spending absurd amounts of money on electricity to run LLMs when search engines could provide the same information for like 1/1000th the cost.

how does it make any sense?

Be patient, LLMs will suck and be full of ads and sponsored responses too in a decade or less, so it will all make sense.