Ah, but that's one of the great ideas pointed out by David Brin in his writing. He points out the need to encode in AI software an awareness of the drawbacks of mental filtering:
"The one method by which human beings can reliably be made aware of their delusions is through interaction with others -- (a crucial point that we need to make clear to burgeoning artificial intelligences! )
YOU are capable of noticing the delusions that I am too in-love-with to spot or correct. In pointing them out, you do me the service of reciprocal accountability (RA) -- or criticism -- a great boon, allowing self-improvement, and a boon which I'll be only too happy to serve back to you, in plenty. As a favor, of course."
So maybe it can be an AI that helps us out, as long as we remind it that it needs to stay within an argumentative community (in the philosophical sense) to ensure that it retains its grip on reality. (I point now at modern American neoconservatives as a perfect example of what happens when you first lose the ability to debate and then lose the ability to judge reality itself.)
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Re: :o)
Date: 2009-Aug-16, Sunday 01:18 am (UTC)"The one method by which human beings can reliably be made aware of their delusions is through interaction with others -- (a crucial point that we need to make clear to burgeoning artificial intelligences! )
YOU are capable of noticing the delusions that I am too in-love-with to spot or correct. In pointing them out, you do me the service of reciprocal accountability (RA) -- or criticism -- a great boon, allowing self-improvement, and a boon which I'll be only too happy to serve back to you, in plenty. As a favor, of course."
So maybe it can be an AI that helps us out, as long as we remind it that it needs to stay within an argumentative community (in the philosophical sense) to ensure that it retains its grip on reality. (I point now at modern American neoconservatives as a perfect example of what happens when you first lose the ability to debate and then lose the ability to judge reality itself.)