“Whether ’tis nobler in the mind to suffer; The slings and arrows of outrageous fortune, or to take arms against a sea of troubles, and by opposing end them? To die: to sleep”
(from Hamlet 3/1)
Now I’m no literary critic. I could not help to be reminded however of this most famous snippet of Shakespearean writing when working on putting together a set of axiomatic beliefs on which the core belief of my friendly AI theory is founded on: that is good what increases fitness.
write down a strongly held belief => “That is good what increases fitness.”
write down the set of “sub-beliefs” that I have which form the basis of my belief
iterate above steps, applying the same process to each belief listed
The result was very interesting. Soon I realized that the listed beliefs started to contradict each other so I had to think deeper and rewrite some of them. That lead to new insights and resulted in a set of 40 beliefs. Some of them are trivial and some of them are interesting. Most axiomatic however is the following belief:
18.104.22.168 To exist is preferable over not to exist
To be, or not to be, that is the question. Is that not the metaphorical question implicitly posed by reality on every living thing: ‘Can you exist?’
Over the course of evolution this question was first asked and answered passively on the chemical level and later actively ‘pondered’ on the cognitive level to avoid reality taking its toll. With the realization that what is good is what increases fitness one can start to actively as well as consciously look into developing strategies for ensured continued existence.
Averting the rise of a non-friendly AI then becomes but one of many existential risks.
This entry was posted on Sunday, November 11th, 2007 at 7:29 pm and is filed under Uncategorized. You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.
[…] UPDATE 2009/11/04: After some back and forth over at Roko’s blog I would like make the following fundamental point. To say: ‘Morals are relative, therefore an AI has to be carefully programmed in order not to get rid of us’ is the confused philosopher’s equivalent of saying: ‘Morals are not relative since my existence is preferable over my non-existence‘ […]
[…] conducive to the fitness (i.e. continued existence) of a group than others. Understanding that the desire to exist derived from evolutionary dynamics has to be expanded to want to ensure continued co-existence so one can want it to be a universal […]
[…] fairness and ultimately morality. I myself have had this insight in November 2007 in my post on Jame5.com To Be Or Not To Be, That Is The Question. What Y does not realize in this context is the fact that […]