Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> The ground truth reality is that nobody and I mean nobody understands how LLMs work.

This is a really insane and untrue quote. I would, ironically, ask an LLM to explain how LLMs work. It's really not as complicated as it seems.



It's not an insane thing to say.

You can boil LLM's down to "next token predictor". But that's like boiling down the human brain to "synapses firing".

The point that OP is making I think, is that we don't understand how "next token prediction" leads to more emergent complexity.


The only thing we don't fully understand is how the ELIZA effect[0] has been known for 60 years yet people keep falling for it.

[0] https://en.wikipedia.org/wiki/ELIZA_effect


> The only thing we don't fully understand is

It seems clear you don't want to have a good faith discussion.

It's you claiming that we understand how LLM's work, while the researchers who built them say that we ultimately don't.


https://futurism.com/anthropic-ceo-admits-ai-ignorance

There’s tons more where that came from. Like I said lots of people are out of touch because the landscape is changing so fast.

What is baffling to me is that not only are you unaware of what I’m saying but you also think what I’m saying is batshit insane despite the fact that people in the center of it all who are creating these things SAY the same thing. Maybe it’s just terminology…understanding how t build an LLM is not the same as understanding why it works or how it works.

Either way I can literally provide tons and tons more of evidence to the contrary if you’re still not getting it: We do not understand how LLMs work.

Also you can prompt an LLM about whether or not we understand LLMs it should tell the same thing I’m saying along with explaining transformers to you.


That's a CEO of an AI company saying his product is really superintelligent and dangerous and nobody knows how it works and if you don't invest you're going to be left behind. That's a marketing piece, if you weren't aware.

Just because the restaurant says "World's Best Burgers" on its logo doesn't make it true.


Didn’t I say I have tons of evidence?

Here’s another: https://youtube.com/shorts/zKM-msksXq0?si=bVethH1vAneCq28v

Geoffrey Hinton father of AI who quit his job at Google to warn people about AI. What’s his motivation? Altruism.

Man it’s not even about people saying things. If you knew how transformers and LLMs work you would know even for the most basic model we do not understand how they work.


I mean at a minimum I understand how they work, even if you don't. So the claim that "nobody and I mean nobody understands how LLMs work" is verifiably false.


Did you not look at the evidence I posted? It’s not about you or I it’s about humanity. I have two on the ground people who are central to AI saying humanity doesn’t understand AI.

If you say you understand LLMs then my claim is then that you are lying. Nobody understands these things and people core to building these things are in absolute agreement with me.

I build LLMs for a living, btw. So it’s not just other experts saying these things.. I know what I’m talking about on a fundamental level.


Are you going to address a single point I or others have made? Or you gonna dodge everything with some dismissive remark? I think it’s clear you’re wrong.

You know one thing an LLM does better than me and many other people? It admits it’s wrong after it’s been proven wrong. Humans, including me have a hard time doing that but I’m not the one that’s wrong here. You are wrong, and that’s ok. Don’t know why people need to go radio silent or say stupid shit just to dodge the irrefutable reality of being completely and utterly wrong.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: