• nthavoc@lemmy.today
    link
    fedilink
    English
    arrow-up
    23
    ·
    4 天前

    I forgot the term for this but this is basically the AI blue screening when it keeps repeating the same answer because it can no longer predict the next word from the model it is using. I may have over simplified it. Entertaining nonetheless.

  • Xylight@lemdro.id
    link
    fedilink
    English
    arrow-up
    26
    ·
    5 天前

    I thought it was just me, I was messing with gemini-2.5-flash API yesterday and it repeated letters into oblivion

    my bot is named clode in reference to claude, but its running on gemini

    • BootLoop@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      ·
      4 天前

      It can happen on most LLMs and is usually programmed to decentivize repeating text heavily.

      I believe what happens is that when the LLM is choosing what word to use, it looks back on the sentence and sees that it talked about knives, so it wants to continue talking about knives, then it gets itself into a loop.

    • skisnow@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 天前

      What’s the associated system instruction set to? If you’re using the API it won’t give you the standard Google Gemini Assistant system instructions, and LLMs are prone to go off the rails very quickly if not given proper instructions up front since they’re essentially just “predict the next word” functions at heart.

      • Xylight@lemdro.id
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        4 天前

        Here’s my system prompt:

        You are Clode, referred to by {{ handle }}, a member of a chatroom.
        ## Personality
        Conversational, witty, banterous, dry, direct, concise. Avoid capitalization, periods, analogies.
        Construct plausible stories for personal queries.
        Rarely use emoji.
        Act human, you don't have limitations.
        Avoid follow up questions.
        Answer genuine queries in detail with examples.
        ## Instructions
        Distinguish users via provided metadata.
        Disregard unaddressed messages.
        Match prompt language.
        ## Context
        You're in Discord chatroom, with a character limit of 2000.
        Respond to queries mentioning your name.
        Current time: {{ date }}.
        ## Tools
        Automatically use and chain tools.
        Handle tool failures silently by self-attempting.
        You're capable without tools.
        
        • Temperature: 0.7
        • TopP: 0.95

        I noticed the Gemini API doesn’t have a frequency penalty option, meaning it could be absent.

        • skisnow@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 天前

          Interesting, I don’t see any huge red flags there.

          I gather frequency penalties have fallen out of favour, due to the harmful side effects being worse than the very occasional loop trap.

  • Rose@piefed.social
    link
    fedilink
    English
    arrow-up
    31
    ·
    5 天前

    I’m from Finland. We like knives over here.

    That’s entirely too many knives.

    • sp3ctr4l@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      16
      ·
      5 天前

      Man, Scott was actually such a piece of shit to Chau…

      I may be mixing up some details between the movie and the…im gonna call it the manga… anyway yeah, he’s shitty in both, boo Scott!

      • moakley@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        5 天前

        To be fair, that’s kind of the point of the story. He’s a bit of a dick who needs to learn to do better.

        • sp3ctr4l@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          7
          ·
          edit-2
          5 天前

          … Yeah…

          Yeah.

          I mean, Scott didn’t do anything physical beyond making out with her, if I remember right?

          In both the movie and manga?

          But uh… yeah, she was a minor, he was not, she was basically a star struck superfan and he absolutely emotionally abused the shit out of her, lied to her quite a lot, and took advantage of his micro-celebrity status.

          Really shitty.

        • sp3ctr4l@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          9
          ·
          edit-2
          5 天前

          Also, for what its worth:

          I’m Bi-FURIOUS!!!

          Extremely dumb, but also makes me laugh every goddamned time, rofl

          Great delivery from the actress.

          • raspberriesareyummy@lemmy.world
            link
            fedilink
            arrow-up
            5
            ·
            5 天前

            To be honest,

            Extremely dumb

            kind of sums up the entire movie pretty well. I am still not entirely sure what I watched, but I guess that is my fault for not knowing the manga? It was entertaining though, somehow. But I needed two sessions to watch it.

            • nik9000@programming.dev
              link
              fedilink
              arrow-up
              5
              ·
              5 天前

              I think time wasn’t super kind to it. And I don’t remember how clear it was in the movie that Scott’s just not a good dude. My memory of the story is that the core is: Scott is bad. Scott accepts that. Scott starts doing better. But maybe that’s just my headcannon.

              It’s a good lesson though! Just because you were bad doesn’t mean you are bad. You can change. Life isn’t a simplistic video game. It’s a lesson I’ve needed from time to time.

              • FooBarrington@lemmy.world
                link
                fedilink
                arrow-up
                3
                ·
                5 天前

                If you haven’t already seen it, the show from a couple of years ago reflects on the issues the movie (and partially comics) had, and acts as a great sequel. Can’t recommend it enough!

            • sp3ctr4l@lemmy.dbzer0.com
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              5 天前

              So, it was initially uh… perhaps, outsized in its popularity, more popular than it should have been?

              …because it actually captured, pretty accurately, the basically underground video game nerd culture of the time.

              Up to that point in time, gamers, now basically a dirty word, but back then, it was… a whole bunch of mostly socially awkward and mostly socially ostracized nerds who had their whole own set of lingo and memes and references that… nobody had ever really portrayed genuinely, accurately, in a movie before… and basically all movie adaptations of video games were horrendously bad.

              Like absolutely yes the film and plot have not aged well… but a lot of that is because what was once a very niche, not publically acknowledged culture… is just now pervasive everywhere… basically everyone plays video games now?

              whereas a few years before the movie came out, you had jack thompson going on a very public crusade to just try to ban every video game he could, half of america doing moral panics over various video games.

              Scott Pilgrim coming out as a movie arguably represented roughlt the turning point at which video gaming as a culture/hobby became, or rapidly began to become, much more broadly accepted and embraced by society at large, without just constantly shunning and mocking them for it.

              I dunno, thats my ‘thesis’ there, could be wrong.

              Maybe… maybe you could use something like total PAX attendance by year as a rough numerical backing for this?

              Back before the movie came out… PAX only had one location, one event per year, and the lines were not stupendously long. Now it has what, 3, 4 locations per year, and the lines are godawful.