“Imprecise” language models are smaller, speedier—and nearly as accurate
  • Miaou@jlai.luEnglish
    3·
    6 months ago

    Multi bits models exist because thats how computers work, but there’s been a lot of work to use e.g. fixed point over floating for things like FPGAs, or with shorter integer types, and often results are more than good enough.