Getting Down to the Truth
As we enter 2001, an obvious gap between past fantasy and present reality is our lack of computers that care about telling the truth.As we enter 2001, an obvious gap between past fantasy and present reality is our lack of computers that care about telling the truth. The HAL 9000 computer in "2001: A Space Odyssey" became psychotic when it was ordered to conceal facts from users. The robots in Isaac Asimovs stories are incapable of disobedience; one experimental, empathetic model goes insane when ordered to tell people things that it knows will hurt them to learn. For decades, writers have assumed that the next generation of computers would have principles.
By contrast, the systems were still using are all too ready to lie to us, whether through error (say, by misreading a punched-card ballot), through repeating whatever falsehood they were last told (as in many cases of identity theft), or by showing less capacity than even a child has to know contradictory nonsense when they hear it (with innumerable examples of inconsistent input that produces, not a request for clarification, but terribly misleading results).