LLMs can be a useful second opinion for a highly educated patient with good insight into their health and body, but this is not the average patient I see in an urban emergency department. Many patients can't give a cohesive history without a skilled clinician who can ask the right questions and read between the lines.
I am very skeptical of studies like this that don't adequately reflect real world conditions, but when I was a software engineer I probably wouldn't have understood what "real" medicine is like either.
You went from software to medicine? Pretty cool to discover I'm not alone in this world.
> LLMs can be a useful second opinion for a highly educated patient with good insight into their health and body
I have the same opinion. It's just like software in this regard. A person who's already knowledgeable can prompt well and give detailed context, and tell when the LLM is confidently bullshitting or just plain being lazy. That is not the reality of the average person.
I tried using Claude to help with some hard cases a couple of times and it was very prone to jumping to conclusions based on incomplete information. It was excellent as a research buddy though. I'm using it to great effect to keep myself up to date.
We don't really have a good way to measure whether something has consciousness. Heck, we have pretty limited ways of testing how "intelligent" non-human animals are (e.g. https://en.wikipedia.org/wiki/Theory_of_mind_in_animals).
With that said, just because we don't have a great way of measuring it doesn't mean that we should assume LLMs are intelligent. An LLM is code and a massive collection of training weights. It has no means of observing and reasoning about the world, doesn't store memories the same way that organic brains do (and is in fact quite limited in this aspect). It currently isn't able to solve a problem it hasn't encountered in its training data, or produce novel research on a topic without significant handholding. Furthermore, the frequent errors made by it suggests that it fundamentally does not understand the words that it spits out.
Not really sure what you mean by your anesthesiology comment. Being able to intubate and inject propofol does not make you more of an expert on consciousness than neuroscientists and neurologists.
I didn't say we should assume LLMs are intelligent.
In fact I always thought they weren't because they only "forward pass".
But then they came up with the whole "Reasoning model" paradigm and that contains obvious feedback loops. So now just throw my hands in the air because I think no one really knows or can tell for sure. We are all clueless here.
Or solve the problem by addressing the root causes of crime like other societies do. The American prison industrial complex is not a cure for a sick society. It's a profitable black hole that encourages recidivism at the expense of tax payers.
COVID almost certainly had something to do with it, but the US isn't the only country that faced lockdowns, nor is it the only country that experienced inflation. Why is it that most other countries' happiness scores have returned to near-baseline since then, while the US is still so much lower?
The USA really didn't have lockdowns, where people were actually forbidden to leave their homes. Apart from a handful of metro areas, what was actualy implemented were feeble 'stay at home suggestions' with tons of exceptions. It was entirely voluntary, and people broadly ignored them (again, outside a few areas). Around me, everyone was still out and about, eating at restaurants, buying their khakis, and basically ignoring that there was a deadly airborne disease being spread around. The only thing that seemed to be adequately enforced were school closures.
A lot of things it could be a direct reference to, but the obvious one is Palantir, which is named after the seeing stones used to spy on people by evil antagonists in Lord of the Rings.
Panic had a booth at Portland Retro Gaming Expo last year, they were super nice and the Playdates were a lot of fun to play with. Nice to see that people are continuing to enjoy the console, the production process seemed like a nightmare.
I am very skeptical of studies like this that don't adequately reflect real world conditions, but when I was a software engineer I probably wouldn't have understood what "real" medicine is like either.
reply