• the_wonderfool@piefed.social
    link
    fedilink
    English
    arrow-up
    43
    arrow-down
    1
    ·
    2 days ago

    It was a fun read, but it seems like a very shitty test, designed for making bait engagement posts.

    Haha look at this stupid “ai” bot - with a catchy name that works perfectly for our pun - struggling to solve an unrealistic task, with impossible constraints (every advertisement channel was blocked), and an incredibly tight deadline.

    If the outcome of the post was to humanize a machine, it was successful. Even knowing that it’s just a set of numbers that vomits word probabilities, it’s difficult not to emphasize with the LLM starting to “sound frantic” as the deadline approached and all possible strategies it was “coming up with” were blocked by design…

    • Th4tGuyII@fedia.io
      link
      fedilink
      arrow-up
      27
      ·
      2 days ago

      I agree. This article did a great job at making me sympathetic to an LLM agent.

      Given what looks to be a simple task with a tight deadline, but is actually rendered almost impossible by bottlenecks the people who gave the task didn’t forsee - and then getting blamed for not being able to complete the task.

      Sounds like a day at my old job.

      I personally dislike LLMs for their environmental impact and corrosiveness towards human culture, and I still think this was an unfair test. It had essentially no access to the budget it was supposed to have available due to API bugs, and was blocked from any form of advertising except spam marketing that its creators punished it for using. The fuck was it meant to do, shit money out from its arse?

      • scytale@piefed.zip
        link
        fedilink
        English
        arrow-up
        11
        ·
        2 days ago

        If anything, it demonstrated how people (i.e. CEOs) think LLMs are a one-all solution for everything and use it as such.

    • Grimy@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      2 days ago

      It’s a terrible prompt too. They just spammed it with “make the most money possible”. Complex tasks need complex harnesses and multiple agents.

    • bjc@scribe.disroot.org
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 days ago

      you gotta give the ai bros credit, they’ve managed to turn “there’s no such thing as bad publicity” into a multi-disciplinary corporate stratgy.