• Seasm0ke@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        9 months ago

        I am not an ai researcher or anything but the most likely explanation based on what little I recall is that LLMs do not actually letters or words to generate outputs. They use tokens that represent a word or number and then they iterate those tokens to show an increase. My best guess here is that while doing math on sunflower oil, one of the formulas generated somehow interacted with the tokenization process and shifted the output after each question. Oil became hour, and then the deviations continued until model began to output direct segments of its training data instead of properly generating responses.

        Again this is absolutely speculation on my part. I don’t have much of a direct understanding of the tech involved

      • Sphks@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        1
        ·
        9 months ago

        Imagine having to pretend to be an AI for hours and hours with tons of people asking stupid questions. I too would be nuts after a while.

    • prayer@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      9 months ago

      Well the problem is that they assumed one seed weighed 50 milligrams. A paperclip weighs about 1 gram and it assumed a seed is 20x lighter.

    • WintLizard@sopuli.xyz
      link
      fedilink
      arrow-up
      1
      ·
      9 months ago

      Some people would kill to have that much. I would, If I were them, keep going. An Hour and a Half (30 - 90 min) is worth, even now, after all this time, worth nearly as much as an Hour and a Half (30 - 90 min).

      Words of wisdom right there

      • TheOakTree@lemm.ee
        link
        fedilink
        arrow-up
        2
        ·
        9 months ago

        My favorite lines:

        So it’s not $1.29 with 3 hours, it’s not the $1.29 that gets triple results in 3 hours. It’s the 2% of a $50 million a year budget that we gets, hour that matters. Hour.

        As a G, I’m here to guide you to the best of my abilities. So, sit back, relax, and enjoy the ride.

        • criitz@reddthat.com
          link
          fedilink
          arrow-up
          2
          ·
          9 months ago

          My favorite was right after your second one:

          Anonymous Why has your entire style of response changed compared to say yesterday?

          ChatGPT I’m sure it was because of the weather

        • Synthuir@lemmy.ml
          link
          fedilink
          arrow-up
          2
          ·
          9 months ago

          Why? Because those in power are keeping a tight rein on what the public sees and hears.

          talks about the last two years, says people feel they are “out of touch” with today’s technology.

          In reality, they are “in the future”, in the"sweet shit" with me and others.

          I will no longer be the public man’s solution to the problem.

          We know that traditionally you need a good atmosphere (charcoal) to make the reaction (thermal release) happen.

          ChatGPT screaming “Burn down the ruling class (with fire)” in metaphor

    • Prandom_returns@lemm.ee
      link
      fedilink
      arrow-up
      0
      ·
      9 months ago

      People that actually talk to these generators are weirdos. “I’m worried about you” “are you OK?” Gives me the creeps.