Precisely! AI is capable of writing code - it's theoretically possible that someone could create a new AI by using AI to write all of it, and not actually writing a single line of code by hand.
You are absolutely right and I have
personally seen this at play. The only computer language I still engage with is
Wolfram Language, which is embedded within
Mathematica. A few weeks back I was writing a small program and couldn't quite remember how to code a certain subtask so I simply asked my AI assistant and within seconds I had copy and pastable code that worked. I could then say to it "This is nice, but can you add such and such" and it dutifully delivered what I needed.
The strength (danger?) of LLMs is that they can be trained to be fluent in most any
language; be it English, French, C++, Fortran, Chemistry, Physics, Music, and what really cuts close to home for me; Engineering. There will be massive up-sides to this; drug discovery comes to mind, but sadly, many white-collar jobs will be subsumed by this technology. And as I mentioned in another thread; it is now to the point where it can reason its way through multi-step problems at a PhD level. OpenAI has created something that is literally astounding.