• Drew@sopuli.xyz
    link
    fedilink
    arrow-up
    7
    ·
    20 hours ago

    I don’t think it’s training from AI data, but rather distillation: which tries to mimic another model

    So there’s a difference in what’s happening, one is taking the data as input and trying to form something new, while the other is trying to recreate the input

    • seang96A
      link
      fedilink
      arrow-up
      4
      ·
      19 hours ago

      Ah I saw it mentioned but paywall blocked the rest lol

      Distillation is basically reverse engineering for AI cool.