AI girlfriend bots are already flooding OpenAI’s GPT store::OpenAI’s store rules are already being broken, illustrating that regulating GPTs could be hard to control

  • tias@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 year ago

    I agree that it has limits but there are things we could do to make it reasonably good. ChatGPT knows how to execute actions (such as calling an API or doing a web search). It could probably be made to store and look up information in a vector database, essentially giving it a long-term memory.

    Given some smaller breakthroughs in performance and model size we could conceivably retrain the network on new input continuously, in order to incorporate new knowledge.

      • tias@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        1 year ago

        Vector databases are relatively good at this kind of thing, because they can find records based on queries that are semantically close instead of just a lexical search. It would probably still make sense to split the information up in fragments such as e.g., “Interstellar movie,” “watched on February 2nd, 2021,” “made me vomit”, and then connect those records to each other. GPTs are good at that kind of preprocessing. The idea would not be to store exact data such as timestamps and that’s not how vector databases work, so recall would be more associative just like for humans (I can’t ask you what movie you watched on Feburary 2nd, 2021 and expect an accurate reply either).

          • tias@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            4
            ·
            1 year ago

            Again, you will certainly hit limitations if you push it, but the example you give would work fine if you just append the added information to the database. A query for Interstellar would return both your original statements and the fact that you later said you lied about it, and all of these records are inserted into the GPT’s context (short-term memory) when discussing that subject.

      • Demdaru@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        …i may be too green to see something here, but wouldn’t simply saving month, year, topic, mood and quote enough? If AI needs everything formatted in certain input, run this through API. Teach AI to save only moments where user uses agitated language or smth and to periodically run checks if current convo allows for throwback, for example by topic, with advanced query when user asks if AI remembers something.

        Then sell all this data for fat profit.

          • Demdaru@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Thanks for examples, now yeah, that’s really ain’t that simple…and hard af to foolproof. :/

          • paraphrand@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            It’s when people dive into this sort of memory stuff that I always remember: “oh yeah, this is why people call it a stochastic parrot.”

            LLMs can do a lot. But without memory, they run into walls fast.