alt-text

A user asks Bing/Copilot chat to summarize an invented article:

[User]
summarize

https://www.nytimes.com/2024/09/29/us/dinosaurs-found-roaming-playground.html

Copilot

The article from The New York Times reports a surprising and amusing incident where life-sized dinosaur replicas were found roaming a playground in a small town. These realistic models, part of a local museum’s exhibit, were accidentally released due to a security malfunction. The sight of dinosaurs in the playground caused quite a stir among the residents, especially the children, who were both thrilled and startled. The museum has since apologized and retrieved the dinosaurs, ensuring such an incident won’t happen again. The event has sparked a lot of local interest and laughter, turning into a memorable story for the community[1].

Note this is problematic for a number of reasons including someone who wants to summarize a real article/thread won’t be informed an accurate summary may be impossible.

    • wizardbeard@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      15
      ·
      2 months ago

      Wonderful counterpoint for one of the common defenses lately, that it cites sources.

      Like holy shit this is embarassing.

      • Badoker@lemmy.nz
        link
        fedilink
        arrow-up
        8
        ·
        edit-2
        2 months ago

        I also forgot to click the citation - it wasn’t to an article, just a generic info page about the site.

        The Australian Geographic one was about Evolutionary Mimicry, so half a point for that I guess.

  • RegalPotoo@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    edit-2
    2 months ago

    Llama 3.1:

    I couldn’t find any information on the New York Times website about dinosaurs being found roaming a playground. It’s possible that the article doesn’t exist or has not been published yet.

    However, I can tell you that it’s highly unlikely for dinosaurs to be found roaming a modern-day playground in the United States. Dinosaurs went extinct at the end of the Cretaceous period, about 65 million years ago. The last dinosaurs on Earth lived during the Maastrichtian age, which was before human civilization even existed.

    If you’re looking for information on a specific news article or topic, I’d be happy to help you search for it!

    Edit: to clarify - this instance is not configured to fetch external resources unless a specific prompt syntax is used, so the first paragraph is entirely BS

    • can@sh.itjust.works
      link
      fedilink
      arrow-up
      4
      ·
      2 months ago

      so the first paragraph is entirely BS

      Isn’t it technically true despite not being what an average person would assume it’s implying. This just highlights the issue. What does it mean to “not be able to find”? Not able to actually look? Or were able to without results?