“Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said”
This is about Whisper, which I’ve heard praised in other contexts. 🙁
“Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.”
“medical centers [are using] Whisper-based tools to transcribe patients’ consultations with doctors”
“While most developers assume that transcription tools misspell words or make other errors, engineers and researchers said they had never seen another AI-powered transcription tool hallucinate as much as Whisper.”
Leave a Reply