• PurpleClouds@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    21 days ago

    My read is that the user is saying that creating a world view contains trial and error. Online learning if you will. With the current setup this learning is very much not like this. While that makes a human to machine analogy I am also not too convinced by this reasoning. Just allow for a larger time lag and then the inference and learning is at the same scale.

    • relic_@piefed.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      21 days ago

      Yes but that’s related to LLMs specifically, not backpropagation. There’s plenty of ML paradigms that use backprop and have continual learning setups.

      Backprop is the process of how the weights are updated.