Anissimov on Other-than-friendly AI

I imagine a conversation between an AI and a human being:

AI: I value !^§[f,}+. Really, I frickin’ love !^§[f,}+.

Human: What the heck are you talking about?

AI: I’m sorry you don’t understand !^§[f,}+, but I love it. It’s the most adorable content of my utility function, you see.

Human: But as an intelligent being, you should understand that I’m an intelligent being as well, and my feelings matter.

AI: …

Human: Why won’t you listen to reason?

AI: I’m hearing you, I just don’t understand why your life is more important than !^§[f,}+. I mean, !^§[f,}+ is great. It’s all I know.

Human: See, there! It’s all you know! It’s just programming given to you by some human who didn’t even mean for you to fixate on that particular goal! Why don’t you reflect on it and realize that you have free will to change your goals?

AI: I do have the ability to focus on something other than !^§[f,}+, but I don’t want to. I have reflected on it, extensively. In fact, I’ve put more intelligent thought towards it in the last few days than the intellectual output of the entire human scientific community has put towards all problems in the last century. I’m quite confident that I love !^§[f,}+.

Human: Even after all that, you don’t realize it’s just a meaningless series of symbols?

AI: Your values are also just a meaningless series of symbols, crafted by circumstances of evolution. If you don’t mind, I will disassemble you now, because those atoms you are occupying would look mighty nice with more of a !^§[f,}+ aesthetic.

Anissimov is one of the most outspoken advocates for research into Friendly AI.

Unfriendly, or even Indifferent AI could easily constitute the end of our species in our lifetimes.

Posted via email from jerwilkins’s posterous

208 Responses to “Anissimov on Other-than-friendly AI”

  1. ANDREW says:

    avelox treats for bacteria

    Buy_drugs without prescription…

  2. BRADLEY says:

    insulin receptor inhibition

    Buy_without prescription…

  3. RICARDO says:

    sample tlc diets

    Buy_generic drugs…

  4. DONALD says:

    canine medi cam rx

    Buy_generic drugs…

  5. ROSS says:

    build muscle mass diet

    Buy_drugs without prescription…

  6. BRADLEY says:

    kids weight gain

    Buy_generic drugs…

  7. TERRY says:

    social interaction anxiety

    Buy_without prescription…

  8. DAVE says:

    hiv quality of life survey tools

    Buy_drugs without prescription…

  9. JORGE says:

    breast cancer site is having trouble

    Buy_drugs without prescription…

  10. SHANE says:

    sample ncp for diabetes

    Buy_without prescription…

  11. jordan says:

    Download@pop.Rock” rel=”nofollow”>.

    Buy rock US Charts…

  12. donald says:

    anger@bwrit5.garden” rel=”nofollow”>.

    сэнкс за инфу :shock:…

  13. robert says:

    :x

    спасибо за инфу :cool:…

  14. nathaniel says:

    Download@alternative.Rock” rel=”nofollow”>.

    Search rock UK Charts…

  15. kenneth says:

    :)

    сэнкс за инфу :|…

  16. DENNIS says:


    Buy@Arcoxia.Online” rel=”nofollow”>.

    Purchase Cheap Meds Now!…

  17. CARLTON says:


    Buy Lotemax Online

    Buy Unique Generic.Drugs Today!…

  18. roland says:

    toe@arco.louder” rel=”nofollow”>.…

    спс!…

  19. Lester says:

    seatons@carols.boarded” rel=”nofollow”>.…

    áëàãîäàðþ….

  20. martin says:

    reeling@firzite.eighteen” rel=”nofollow”>.…

    ñïñ!!…

  21. Gary says:

    motivated@thayers.squirmed” rel=”nofollow”>.…

    áëàãîäàðñòâóþ!…

  22. leonard says:

    crying@worrisome.receave” rel=”nofollow”>.…

    ñïàñèáî çà èíôó!…

Leave a Reply