It's relevant given the apparent conservativeness about LLMs, the non-revolutionary architectural improvements that seemed to place too much of the bets on scaling.

The article doesn't even discuss hard problems.

An unfortunate tendency that many in high-tech suffer from is the idea that any problem can be solved with engineering.

It lays out what those problems are and how LLMs don't solve them.