Australia’s peak regulator of medical practitioners, AHPRA, said clinicians must always check all output from an AI scribe for accuracy to ensure they meet their professional obligations.
Show me one single AI user that checks the output of their AI, and I will show you my unicorn
Thank you.
Not gunna get me with the ole “wanna see a unicorn” trick twice.
I just asked SlopGPT a question and checked the output. Can I see your unicorn?
(That was a lie. I just really want to see a unicorn.)
TL;DR: AI transcript said I’d been a smoker since the age of 11, never smoked a day in my life.
My doctor asked me if she could use AI transcription software because she had hand surgery and couldn’t type. I said yes and reviewed the statements and while it was fairly accurate, it did have one egregious error on it.
When asked if I had ever smoked, in person, I replied with a simple “no,” and did not proceed to have any follow up conversation until her next question. The AI transcript for mysterious reasons decided my answer was “yes, since the age of 11.” 💀💀💀
Had to message them to fix it and while they did fix it asap, my first instinct wasn’t to check the transcript and I only did so out of curiosity. I can’t imagine what other people’s experiences may be.
As far as I’m concerned, using AI of any sort inside of a doctor’s office is a grave violation of HIPAA
Ai transcription is everywhere. You cant get away from it
Speech-to-text (a type of AI) has been around for a fair good years, but now they’re being paired with generative AI. This is the kind of thing that shouldn’t be paired with a generative LLM. A language model to identify words? Yes. Generative? No.
Yes. It technically does improve accuracy (homophone correction, for example) but the occasional errors are worse and way less obvious.
Let me tell you about how medical transcriptionists used to do it: Sister in law was one, she didn’t seem to care about HIPAA too much, she and all her colleagues did lose their jobs about a 15-20 years ago when AI transcription software took over their jobs, but before that she was frequently given jobs because her predecessors made serious mistakes in their transcriptions.
If she didn’t care about HIPAA, I’m glad she lost the job lol.
If only we could fire AI too.
I’ve used AI for medical transcription before and it is absolutely incredible. It’s not just a word for word text, but a detailed clinical breakdown of everything discussed.
All you have to do is simply read the damn thing thoroughly and correct whatever minor errors pop up.
Takes 95% less time.
Exactly. It is a tool for professionals to use to speed up existing processes. It is not a replacement for people, regardless of what the marketers tell you so you buy their product. I don’t understand how there aren’t thousands of lawsuits against these AI companies for their blatantly false advertising.
AI keeps proving this day by day when people try to make it a replacement and have it blow up in their faces every day.
blatantly false advertising.
SEC is neutered, what makes you think anyone in charge of advertising rules hasn’t been replaced by a 17 year old called Goebbels Gobbler or something with a DOGE laptop.
SEC is neutered
This article is about an incident in Australia. The SEC has no bearing on what Australia can do.
The AI bubble is an American phenomenon and their SEC isn’t slowing down the insanity. Their lack of a functional SEC is everyones problem.
I’m unsure if there’s an ethical issue with putting patients medical records in the data machine.
Medical AI has guardrails out the wazoo. By the time it’s made available to a physician, it’s probably been reviewed by a council, vetted by IT, and negotiated heavily by Legal. If the data leaves the premises, it’ll be thoroughly protected and isolated.
That said, fuck AI. I’d give up medical transcription to get the environment, economy, and sanity back. Musk’s data center is running dozens of natural gas turbines in a low-income, primarily Black neighborhood 11 miles down the road from St. Jude Children’s Research Hospital. It’s positively ghoulish.
Horseshit. Medical AI is using Oracle services. Larry mother fucking Elison is storing and processing this data.
The medical industry seems so ignorant about this. They think the argument is just about AI. It’s also about the fact that I don’t trust the people you’re partnered with.
I get so pissed when the AI consent is baked into other paperwork with no opt out. I will leave.
Edit: https://www.oracle.com/customers/beacon-health/
Edit: they might not all be, but I’m not authorizing your arbitrary “AI use” clause. You might as well be, now or at some point down the road.
One Rich Asshole Called Larry Elison
All these articles, nobody posting error budgets or Delta’s with real doctors in this shit.
But we all know doctors are perfect with perfect notes every time and every nurse who gives you a dose 🤷♂️
God forbid that doctor take 2 minutes to confirm accuracy.
Ok, so be the change you want to see and you post the data.
Removed by mod
Blocked and reported.
Ohhhh no, me calling out your ignorance and heading to a power mod cause it hurts your internal fan fic 🤣
Classic Reddit.
I mean, they should, but they won’t. I’ll take human typos over LLM “hallucinations” most days.
👌👍
but it’s 90% accurate!
Ignoring that this means that one in every ten patients is getting inaccurate notes.
This will literally lead to people dying.
How accurate are the doctors? How accurate are they both in tandem? Are they higher than 90%?
Dual systems working on a decision could be significantly safer.
You can hold a doctor accountable.
Try to hold a machine accountable and you’re met with 🤷🏼.
👌👍🤡
Very much so.
It pleases me to see nerds screech the second anyone challenges their fan fiction going on in their head and the very obvious racism, inconsistent expectations based on class and race, and prejudices they display.
And if I can do it by bullying with the same punching down and judgement based on how they look or interact I’m even more than excited.
This is a stupid “science” and I’m happy I made someone feel bad for latching on and their shitty opinions on how effective they “think” (or don’t) an LLM they haven’t used, trained by doctors, might be.
Just say no.
We use a software to help us take notes is that okay? FUCK NO.
You have a single example of it going wrong.
Meanwhile, outside of fantasy land, mistake rates are going down as doctors use AI because it’s more accurate than humans. Things are better because technology is better.
I can tell you didn’t read the article if you think it only discusses a single incident. Odd how you can so enthusiastically claim that it’s just overblown nonsense without even reading it. Sounds exactly like the doctor here making claims about something they even didn’t read or verify.
An AI booster is too lazy or stupid to read and understand something they have very strong opinions about? Im shocked.
You’re blindly following propaganda and pretending you’re on the right side of history
