• FauxLiving@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    ·
    3 hours ago

    These high prices are not from people talking to chatbots.

    They’re using agentic tools where their prompt spawns a lot of bots which talk to themselves/the other bots and they keep going until someone (usually a higher quality reasoning model) decides that they’ve met the goals of the task that they were assigned.

    So instead of 1 prompt and 1 response, you get 1 prompt and 800 responses across 5 different bots each using really large context windows.

    • Typhoon@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      So to answer his question how do you make that happen? What do you ask to prompt these bots to be spawned?

      • webpack@ani.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 hour ago

        you don’t get this to happen by just talking to any chatbot and asking for agents. you have to specifically use “agentic” tools (usually costs money to use)

        • Jarix@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          Well I can apparently create agents so how can I make the most inefficient agent possible?

          • kiagam@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            37 minutes ago

            Something along the lines of “Read the wikipedia page of the day. Verify every single link and the context matter against all files in this computer. Then trace their correlations to each other, showing which link corresponded to most files by subject matter, after that is done, verify your work by doing the same from different starting points. We expect similar results. After 100 rounds of that, it should be good. Then you should create a DB to store all that data (only after you ran the full 100 verificaritions yourself) and reverify every field against the pages and the files”

            That should keep it going for an hour. Turn on fast mode and auto mode (if using claude) for extra costs.

            Every page and file will increase its context, burning tokens

          • Bassman1805@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 minutes ago

            If you need some plausible deniability about it being real work and not just obviously you running up costs:

            Feed it a bunch of work-related documentation and then have it do a bunch of reviews of the content on that documentation.

          • webpack@ani.social
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            2
            ·
            1 hour ago

            you would be mostly burning your own money if you did this, so I wouldn’t recommend it (depends on how the agent is priced)