Oh No, It's Not a calculator, But it's still not AI

The way LLMs work is amazing, it's not a calculator at all, but it's still not intelligence, or is it really? We are still trying to find what it is. Currently, it's a blackbox, just like our brains. We know our brain has signals passing, some material/electrical, but how does consciousness arrive is something we still don't know.