You might be a few years behind. We have robots outpacing human performance in specific tasks using neural networks.

Might well be behind here, but to my knowledge we don’t have a single robot outpacing a single human in most tasks. They don’t do one-shot learning from their mistakes, they don’t learn new movements randomly. Because most basically just use static weights when operating, because you don’t really want an industrial robot to get ideas. But even test systems that can learn usually just have an equivalent to the movement model of a brain, maybe a vision model, just like an LLM is just a language model. You would need a system that has all of those, plus the other brain areas, especially a prefrontal cortex like model for integration.

I’m sure people are working on it, but I haven’t heard of anything successful yet. I imagine there might be a being like that in secret which is currently tortured in some billionaires tech dungeon. Poor thing.

Also, LLMs can perform on tasks they weren’t explicitly trained for. This line is not as well defined as you make it sound.

Yeah but that’s coincidental. It’s the model weights, prompt, and the RNG aligning. They can mock reasoning, because they do it by what they always do, predict more text, but it’s not like this has any effect on themselves. They aren’t really understanding a mistake when you point it out and growing neurons and synapses, i.e. they won’t have different model weights the next time you ask the same question. They can only really change when the powers that be release an update, which includes new training data, and hence model weights.

No they hallucinate because they lose context but are tasked to answer anyways.

Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size “hallucinate” because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other.

If you can’t see the difference between a compiler and a large language model

If you can’t see the difference between a given example and the underlying logic…

And if the entirety of your argument is a mystic “and all that stuff”

What, you want me to list the entirety of sciences downstream from physics that are involved in generating and predicting movement in mammals? Because that could, like, take a while…

That’s… the joke. The original proposition was that AI code bans can’t be enforced, a thought which I was leading ad absurdum.

I hate this attitude that if a rule or standard can’t be enforced perfectly, we shouldn’t strive for it.

“Murder bans may be impossible to enforce in the first place”

What do you mean? That’s exactly how LLMs work. That’s why they “hallucinate”.

I’m just a movement generator.

Which is way more complex than just predicting text, because you have to predict physics and all that stuff. There is a reason most robots controlled by neural nets have failed hilariously so far.

then you’ll have to acknowledge that some form of reasoning is going on, no?

By that logic you could say a compiler is reasoning. But the reasoning displayed was happening when the compiler (or LLM training material respectively) was written.

Well no actually, at least according to the guy himself (added note and emphasis):

Now I do not always do things just as the others want them done. I consider what the others probably believe, and then do the opposite on principle. So if Mr. Stalin expected that we would attack in the center [Moscow], I did not want to attack in the center, not only because Mr. Stalin probably believed I would, but because I didn’t care about it any more at all. But I wanted to come to the Volga, to a definite place, to a definite city. It accidentally bears the name of Stalin himself, but do not think that I went after it on that account.

Indeed, it could have an altogether different name. But only because it is an important point, that is, there 30 million tons of traffic can be cut off, including about 9 million of oil shipments. There all the wheat pours in from those enormous territories of the Ukraine, of the Kuban territory, then to be transported to the North. There the manganese ore was forwarded. A gigantic terminal was there; I wanted to take it.

Now you can of course question if the narrative given in a propaganda speech is accurate, but I have never really seen sources for Hitler wanting to attack because of the name. So it kind of seems like a persistent urban legend to me.