• JeremyHuntQW12@lemmy.world
    link
    fedilink
    arrow-up
    4
    arrow-down
    1
    ·
    1 day ago

    But this is expected.

    These anomalies occur because of the learning of the models. They don’t have them when newly released because they have been trained on “clean” data.

    As the resolution of vectoring increases, the speed at which the data becomes corrupted increases.

    Most “hallucinations” are not really hallucinations. What happens is people put in multiple prompts changing definitions put forward by the model and then the original data gets downranked, so when a question is asked, it repeats the false data the user put in. Then they put in the screenshot at the end, not showing all the garbage they put in.

    Now remember models usually discard this information for a new session, as any new information has to go through a model approval process comparing it with the clean database originally mined.

    • ZILtoid1991@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      1 day ago

      Yeah, people don’t really realize that the reason these models are “free” is that we’re part of the learning process, and is a critical step towards AGI. I don’t think that the current generation of neural networks, not just GPTs in general, would be capable of such feat, especially as current neural networks are just very simplified models of neurons that can be represented with a simple matrix multiplication.

  • leftzero@lemmynsfw.com
    link
    fedilink
    arrow-up
    16
    arrow-down
    2
    ·
    edit-2
    2 days ago

    Photocopy of a photocopy.

    It was evident that this was inevitable since they poisoned the Internet, the very thing they train their crap on, with their own slop.

    They temporarily mitigated it by pirating every existing form of media… but that would only work as long as they didn’t train their models on anything published after they poisoned the well, which would make it even more useless for most use cases, so they kept using their own slop for training, maybe believing their own lies that they’ll be able to fix it, maybe planning to sell and run just before the bubble bursts.

    Last time we fed something its own shit and corpses we got mad cow disease.

    Guess mad “AI” ¹ is on the menu for the foreseeable future. 🤷‍♂️


    ¹ (It’s not even real AI, just fancy applied statistics to make a marginally better — but, thanks to model poisoning, progressively worse — autocomplete.)

  • snooggums@lemmy.world
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    edit-2
    2 days ago

    “AI design is inherently defective and will never work correctly.”

    Guess we need to jam it into more things!

    • wondrous_strange@lemmy.world
      link
      fedilink
      arrow-up
      1
      arrow-down
      5
      ·
      1 day ago

      As much as I agree with the sentiment and as much as I despise the current state of tech and llm’s, software and tech in general are very brittle, riddled with problems and human mistakes(a bug is just a made up word that allows displacement of responsibility).

      Just rambling don’t really have a useful point

    • Ulrich@feddit.org
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      3 days ago

      I think yes. Look at how long they’ve been trying to cram voice assistants down our throats. There’s no point at which they’ll say “no, I don’t think these are ready yet, let’s pull them back”.

      • WhatsTheHoldup@lemmy.ml
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 days ago

        It is clear to all that a bubble has been growing.

        If you’re insisting the bubble will never burst, then there has to eventually be an actual use case for this that makes back the billions they’re investing no? What’s that use case? A Copilot subscription?

        • Ulrich@feddit.org
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          there has to eventually be an actual use case for this that makes back the billions they’re investing no?

          No. They just keep investing in perpetuity. Look at Tesla.

          • WhatsTheHoldup@lemmy.ml
            link
            fedilink
            English
            arrow-up
            2
            ·
            2 days ago

            Look at Tesla.

            Sure

            Tesla’s stock has plummeted over 50% since December, causing the company to lose $800 billion in market value. That drop has also knocked roughly $100 billion off Musk’s net worth, though he remains the world’s richest person, with a fortune estimated at $329 billion by Forbes.

            According to the Financial Times, short sellers have made over $16 billion betting against Tesla in the last three months, and some analysts have downgraded their global delivery forecasts to the lowest levels since 2022.

            https://finance.yahoo.com/news/tesla-stock-tanked-hard-no-161417378.html

            • Ulrich@feddit.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              2 days ago

              Look closelier. +5% over the last 5 days. +18% over the last month. +77% over the last 12 months. +460% over the last 5 years. That’s in spite of the CEO’s recent deeply polarizing antics that have nothing to do with Tesla itself.

              • WhatsTheHoldup@lemmy.ml
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                2 days ago

                Don’t make up numbers.

                +77% over the last 12 months

                It’s -21.36%. I don’t know where you’re getting this info from.

                Type “Tesla stock” into Google and select YTD (year to date).

                • Ulrich@feddit.org
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  2 days ago

                  LOL I am not making up numbers, you just don’t understand what “year to date” means…

      • Optional@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        3 days ago

        I mean - I still don’t use them so - ? And knowing they’re infected with AI, I wouldn’t use them for anything other than the simplest, statistically-improbable-to-get-wrong tasks.

        • ChapulinColorado@lemmy.world
          link
          fedilink
          arrow-up
          7
          ·
          3 days ago

          You’d be surprised, Google voice commands have gotten so bad it can’t toggle a light. Things as simple as “define: word” are now a 50/50 of working or spitting out some random crap unrelated to what was attempted to be looked up. I’ve stopped using the little speakers for anything other than streaming music while cooking.

          • Optional@lemmy.world
            link
            fedilink
            arrow-up
            8
            arrow-down
            1
            ·
            3 days ago

            I guess - i mean, the smallpox virus is still here too, it’s just very unpopular and not very profitable.