message10

From sentience@pobox.com Fri May 30 06:01:57 2003

Date: Thu, 29 May 2003 13:14:34 -0400

From: Eliezer S. Yudkowsky <sentience@pobox.com>

Reply-To: sl4@sl4.org

To: sl4@sl4.org

Subject: Re: SIAI's flawed friendliness analysis

. . .

There is no divine right of democracy; it does not confer infallibility.

What it does confer is faith and the illusion of infallibility. Congress

is not capable of understanding how little it knows, which is what makes

it dangerous. Democracy has known bugs; and those bugs, applied to

Singularity scenarios, result in predictable kills - one of which you have

just demonstrated. People who have been invested with the divine right of

democracy and the holy indignation of the voters do not have enough

humility, in the face of Nature, to confront the Singularity and survive.

. . .

--

Eliezer S. Yudkowsky http://singinst.org/

Research Fellow, Singularity Institute for Artificial Intelligence