• merc@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      The model still calculates probability for each repetition

      Which is very cheap.

      as expensive as other queries which is definitely not free

      It’s still very cheap, that’s why they allow people to play with the LLMs. It’s training them that’s expensive.