To be honest, I’m not sure what we’re arguing - we both seem to have a sound understanding of what LLM is and what it is not.

I’m not trying to defend or market LLM, I’m just describing the usability of the current capabilities of typical LLMs.

It goes a tad bit beyond classical conditioning… LLM’a provides a much better semantic experience than any previous technology, and is great for relating input to meaningful content. Think of it as an improved search engine that gives you more relevant info / actions / tool-suggestions etc based on where and how you are using it.

Here’s a great article that gives some insight into the knowledge features embedded into a larger model: https://transformer-circuits.pub/2024/scaling-monosemanticity/

To be fair, I think he is mostly endorsing the concept of the implementation, lined out in his seven points, not the actual implementation since it isn’t available yet.

He sort of invented it, so you have to think he’s commenting on the concept here, not the implementation.

I have tried a lot of medium and small models, and there it just no good replacement for the larger ones for natural text output. And they won’t run on device.

Still, fine-tuning smaller models can do wonders, so my guess would be that Apple Intelligence is really 20+ small and fine tuned models that kick in based on which action you take.

https://en.m.wikipedia.org/wiki/Andrej_Karpathy

All my devices and networks are constantly on VPN, it’s just basic obscurity, and it’s such a hassle posting on Lemmy now - my activity is probably down 90%.

Could you please consider allowing basic text posts and / or comments from behind a VPN? You could even disallow all markdown - that’s a decent trade off for my sake.

But please don’t just block all VPN usage if there are options you have not explored yet.