I believe so. AIs are shockingly good at a lot of domains, but there's still a lot of pretty basic stuff they don't really "understand" at a conceptual level and (currently) they can't learn to get better at them.
(obviously it might take years for me to get good enough at something, or if you set the "arbitrary" task as something ridiculous, but lets work in good faith here and think of something the average human could do after learning about it)
If we progress to the point where an LLM instance can meaningfully learn to get better at something overtime without retraining, then I will accept that is basically AGI. Right now, they still seem to be pretty boxed into their training, even if you can prompt them to act differently.
Compared to 2016, it can do a lot of things, but it still fails for example with recommending a setup for my Raspberry Pi to have a 4G connection with some parameters (I want to use as a gateway between VoLTE calls and SMS, and my SIP server somewhere else). It failed miserably. I bought stuff according to its recommendation which was more or less a waste of money, twice. With miniscule knowledge compared to theirs, or even hobbyists', I could figure out all the details at the end, and order something which really works, but only after I sit down for 4 hours, and dig through exactly what I needed, because LLM lied flat out what Sixfab 3G/4G HAT can do. (Of course, not just LLMs lie, SixFab lied about something else too)
Of course, it's a moving goal post, because we have no clue what general intelligence is exactly. But it's definitely not general yet. Now the goalpost is to achieve that kind of level of thinking which I did in that 4 hours. When it reaches it, we will find something else it clearly lacks. Until we can't. Then, and only then we reached AGI. Until you see comments, reviews, etc about things which it cannot do, until then it's not general.
