I am not convinced there even is a missing piece. I mean, LLMs are being used very differently compared to how traditional AI programs were written. Combining both worlds might be all that is needed.

I would not be surprised that when we have general artificial intelligences, we will see, that advancing LLMs wasn't necessary.