What’s the difference, for the purposes of this discussion?
Any system created out of many iterations, with feedback, of a reward/punishment system, will create complex systems that respond in complex ways. In that kind of complex system, changing a particular signaling pathway, or increasing or decreasing the weight of a factor/parameter, often has unpredictable or unintended effects.
And if it is possible to someday create a conscious artificial general intelligence, I think it would have complexity and feedback loops created through a long process of rewards and punishments, rather than through intentional engineering. At that point hacking the details of that complexity runs risks of unintended consequences, and the complexity would bear the vestiges of the evolutionary reward system that created it.
You’re comparing animals that run on instinct and hormones to software
What’s the difference, for the purposes of this discussion?
Any system created out of many iterations, with feedback, of a reward/punishment system, will create complex systems that respond in complex ways. In that kind of complex system, changing a particular signaling pathway, or increasing or decreasing the weight of a factor/parameter, often has unpredictable or unintended effects.
And if it is possible to someday create a conscious artificial general intelligence, I think it would have complexity and feedback loops created through a long process of rewards and punishments, rather than through intentional engineering. At that point hacking the details of that complexity runs risks of unintended consequences, and the complexity would bear the vestiges of the evolutionary reward system that created it.
Massive difference as Ai isn’t running with hormones underneath. I’d say that’s pretty important overlook to be attempting any comparison.