> the list of people who write code, use high quality LLM agents (not chatbots) like Claude, and report not just having success with the tools but watching the tools change how they think about programming, continues to grow.
My company is basically writing blank cheques for "AI" (aka LLM, I hate the way we've poisoned AI as a term))tooling so that people can use any and all tooling they want and see what works and doesn't. This is a company with ~1500ish engineers, ranging from hardware engineers building POS devices to the junior frontenders building out our simplest UIs. There's also a whole lot more people who aren't technical, and they're also encouraged to use any and all AI tooling they can.
Despite the entire company trying to figure out how to use these effectively precisely because we're trying to look at things objectively and separate out the hype from the reality, the only people I've seen with any kind of praise so far (and this has been going on since the early ChatGPT days) have been people in Marketing and Sales, because for them it doesn't matter if the AI hallucinates some pure bullshit since that's 90% of their job anyway.
We have spent god knows how much time and resources trying to get these tools doing anything more useful than simple demos that get thrown out immediately, and it's just not there. No one is pushing 100x the code or features they were before, projects aren't finishing any faster than they were before, and nobody even bothers turning on the meeting transcription tools either anymore because more often than not it'll interpret things said in the meeting just plain wrong or even make up entire discussion points that were never had.
Just recently, like last week recently, we had some idiotic PR review bot from coderabbit or some other such company be activated. I've never seen so many people complain all at once on Slack, there was a thread with hundreds of individuals all saying how garbage it was and how much it was distracting from reviews. I didn't see a single person say they liked the tool, not 1 single person had anything good to say about it.
So as far as I'm concerned, it's just a MASSIVE fucking hype bubble that will ultimately spawn some tooling that is sorta useful for generating unimportant scripts, but little else.
never give an LLM to your junior engineers. The LLM itself is mostly like a junior engineer and will make a complete mess of things if not guided by someone with a lot of experience.
Basically if people are producing code or documentation that looks like an LLM wrote it, that's not really what I see as the model that makes these tools useful.
My company is basically writing blank cheques for "AI" (aka LLM, I hate the way we've poisoned AI as a term))tooling so that people can use any and all tooling they want and see what works and doesn't. This is a company with ~1500ish engineers, ranging from hardware engineers building POS devices to the junior frontenders building out our simplest UIs. There's also a whole lot more people who aren't technical, and they're also encouraged to use any and all AI tooling they can.
Despite the entire company trying to figure out how to use these effectively precisely because we're trying to look at things objectively and separate out the hype from the reality, the only people I've seen with any kind of praise so far (and this has been going on since the early ChatGPT days) have been people in Marketing and Sales, because for them it doesn't matter if the AI hallucinates some pure bullshit since that's 90% of their job anyway.
We have spent god knows how much time and resources trying to get these tools doing anything more useful than simple demos that get thrown out immediately, and it's just not there. No one is pushing 100x the code or features they were before, projects aren't finishing any faster than they were before, and nobody even bothers turning on the meeting transcription tools either anymore because more often than not it'll interpret things said in the meeting just plain wrong or even make up entire discussion points that were never had.
Just recently, like last week recently, we had some idiotic PR review bot from coderabbit or some other such company be activated. I've never seen so many people complain all at once on Slack, there was a thread with hundreds of individuals all saying how garbage it was and how much it was distracting from reviews. I didn't see a single person say they liked the tool, not 1 single person had anything good to say about it.
So as far as I'm concerned, it's just a MASSIVE fucking hype bubble that will ultimately spawn some tooling that is sorta useful for generating unimportant scripts, but little else.