Comments on: Evolving altruism http://www.foresight.org/nanodot/?p=3059 examining transformative technology Wed, 03 Apr 2013 18:23:47 +0000 hourly 1 http://wordpress.org/?v=3.0.4 By: http://www.foresight.org/nanodot/?p=3059#comment-854232 Fri, 05 Jun 2009 17:13:17 +0000 http://www.foresight.org/nanodot/?p=3059#comment-854232 @michael: Whether they care depends on "the clunky, preliminary, primitive consciences we have given" them. So we'd better try to do a decent job on that part. [-bruce smith] @michael: Whether they care depends on “the clunky, preliminary, primitive consciences we have given” them. So we’d better try to do a decent job on that part. [-bruce smith]

]]> By: J. Storrs Hall http://www.foresight.org/nanodot/?p=3059#comment-853105 J. Storrs Hall Tue, 02 Jun 2009 11:21:59 +0000 http://www.foresight.org/nanodot/?p=3059#comment-853105 Intelligence and morality are more closely linked than you'd think. Morality is what evolves in organisms whose environment consists of other intelligent creatures (not so much depending on the intelligence of the organism itself). Consider dogs. AIs will evolve in an environment consisting of (a) us, and (b) other AIs. Intelligence and morality are more closely linked than you’d think. Morality is what evolves in organisms whose environment consists of other intelligent creatures (not so much depending on the intelligence of the organism itself). Consider dogs.

AIs will evolve in an environment consisting of (a) us, and (b) other AIs.

]]> By: Michael Anissimov http://www.foresight.org/nanodot/?p=3059#comment-852314 Michael Anissimov Sat, 30 May 2009 03:54:53 +0000 http://www.foresight.org/nanodot/?p=3059#comment-852314 Just because they can read your arguments, what makes you think they'll care? A much easier strategy for a selfish or human-indifferent AI would be simply to destroy everything and build whatever it wants from scratch. "Intelligence" and "morality" are two different things. As Hume said, "Tis not contrary to reason to prefer the destruction of the whole world to the scratching of my finger." Just because they can read your arguments, what makes you think they’ll care? A much easier strategy for a selfish or human-indifferent AI would be simply to destroy everything and build whatever it wants from scratch.

“Intelligence” and “morality” are two different things. As Hume said, “Tis not contrary to reason to prefer the destruction of the whole world to the scratching of my finger.”

]]>