• morrowind@lemmy.ml
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    I’m well aware, but you don’t need to necessarily see each character to translate to bytes

    • GissaMittJobb@lemmy.ml
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      It’s not out of the question that we get emergent behaviour where the model can connect non-optimally mapped tokens and still translate them correctly, yeah.