• huginn@feddit.it
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    Here’s a white paper explicitly proving:

    1. No emergent properties (illusory due to bad measures)
    2. Predictable linear progress with model size

    https://arxiv.org/abs/2304.15004

    The field changes fast, I understand it is hard to keep up

    • Kogasa@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      Sure, if you define “emergent abilities” just so. It’s obvious from context that this is not what I described.