Generative AI Lies

Examples of generative AI making stuff up

Category: Music

  • Wrong attribution

    ()

    I often forget to append “-ai” to the ends of my Google searches. I usually manage to avoid reading the “AI Overview,” but once in a while I do accidentally read it. And I think that every single time I’ve done that, the AI Overview has included at least one false statement.

    So I don’t generally bother to post them any more. But once in a while the falsehood is so utterly ridiculous and egregious that I figure it’s worth posting about.

    Here’s today’s:

    The line “Things would be so different / If they were not as they are!” is from the poem “The Waking” by American poet Theodore Roethke. It is a simple, yet profound statement about the nature of reality and the limitations of hypotheticals.

    […]

    In “The Waking,” the full quote appears as a standalone stanza:

    “Things would be so different / If they were not as they are!”

    The poem, which won the Pulitzer Prize for Poetry in 1954, is a meditation on mortality and the cycles of nature. It often uses paradoxical language, as seen in the line, “I wake to sleep, and take my waking slow.” The couplet “Things would be so different / If they were not as they are!” captures this sense of circularity and resignation.

    All of which is utterly false.

    The line in question is from an Anna Russell piece. It does not appear in the Roethke poem. It does not appear in any of the Roethke pages that Google Gemini links to in support of its claim. The only thing that the line and the Roethke poem have in common is that both date from 1953.

    I suppose one could claim that the Russell line is a “simple, yet profound statement about the nature of reality and the limitations of hypotheticals,” but really the line is a tautological joke.

    Remember: Don’t trust anything that generative AI tells you.

    (Original Facebook post.)


  • Album release date

    (, )

    Today I did a Google search for [“field of stars” mccutcheon] and I forgot to append “-AI” to leave out the AI Overview. When I forget to leave out the Overview, I normally try to not even look at the Overview; but this time the Overview caught my eye. It starts out:

    “Field of Stars is an album by American folk singer-songwriter John McCutcheon. The album was released on January 10, 2024.”

    McCutcheon had an online concert today to celebrate the release of the album, so I spent several seconds wondering why he waited 10+ months after its release to have the concert. And then I realized that of course the AI Overview is just wrong, once again. The album will be officially released on January 10, 2025. (But is available now in various pre-official-release contexts.)

    But this is one of the reasons that I usually try not to even look at the Overview, because they often read to me as so authoritative that even though I know they include false information, I still sometimes believe them.

    (Original Facebook post.)