• Kogasa@programming.dev
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    No such thing has been “mathematically proven.” The emergent behavior of ML models is their notable characteristic. The whole point is that their ability to do anything is emergent behavior.

    • huginn@feddit.it
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      11 months ago

      Here’s a white paper explicitly proving:

      1. No emergent properties (illusory due to bad measures)
      2. Predictable linear progress with model size

      https://arxiv.org/abs/2304.15004

      The field changes fast, I understand it is hard to keep up