• exasperation@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    1
    ·
    2 hours ago

    What’s the difference, for the purposes of this discussion?

    Any system created out of many iterations, with feedback, of a reward/punishment system, will create complex systems that respond in complex ways. In that kind of complex system, changing a particular signaling pathway, or increasing or decreasing the weight of a factor/parameter, often has unpredictable or unintended effects.

    And if it is possible to someday create a conscious artificial general intelligence, I think it would have complexity and feedback loops created through a long process of rewards and punishments, rather than through intentional engineering. At that point hacking the details of that complexity runs risks of unintended consequences, and the complexity would bear the vestiges of the evolutionary reward system that created it.

    • Smoogs@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 hour ago

      Massive difference as Ai isn’t running with hormones underneath. I’d say that’s pretty important overlook to be attempting any comparison.

      • exasperation@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        1
        ·
        33 minutes ago

        Hormones are just a signaling mechanism that affect behavior.

        Some future hypothetical conscious AGI would have feedback and signaling mechanisms, as well, including internal reward mechanisms.

        We can talk about robot biomechanics even if they’re operated on stored electrical charge on servos and motors, rather than ATP and myofibrils. The underlying chemistry doesn’t change the level of analysis we’re talking about here, because the lower levels create analogous higher level systems.