Google Researchers Explore Ways to Ensure Safety of Future AI Systems

 
 
By Jaikumar Vijayan  |  Posted 2016-06-22 Print this article Print
 
 
 
 
 
 
 
AI Safetry Research

Google has released a paper on AI safety in collaboration with researchers from Stanford University, University of California, Berkeley and OpenAI.

Concerns about things going wrong with the artificial intelligence systems of the future have gotten the attention of researchers at Google.

Barely two weeks after the company's DeepMind group announced a partnership with researchers at the University of Oxford to develop a kill switch for rogue AI systems, Google has released a technical paper devoted to addressing AI safety risks.

The paper, titled "Concrete Problems in AI Safety," was written in collaboration with researchers at Stanford University, University of California, Berkeley and OpenAI, a nonprofit company focused on AI research.

It outlines five basic problems the researchers say are relatively minor today but predict will assume much greater importance as machines get smarter in the future.

The paper explores practical approaches to solving these problems and ensuring that AI systems are engineered to operate in a reliable and safe manner, Google researcher Chris Olah said on the company’s Research Blog.

"While possible AI safety risks have received a lot of public attention, most previous discussions have been very hypothetical and speculative," Olah said. "We believe it's essential to ground concerns in real machine learning research and to start developing practical approaches for engineering AI systems," to operate safely, he said.

Machine learning and artificial intelligence are important areas for Google. The company has said it wants to leverage advances in these areas to make its core technologies better. It already applies AI and machine intelligence techniques in certain applications including Google Translate, Google Photos and voice search.

Company CEO Sundar Pichai has said that Google expects to see AI radically transforming the way people travel, accomplish daily tasks and tackle problems in areas such as health care and climate change.

But advancing AI means making AI systems both smarter and safer, noted OpenAI researchers Paul Christiano and Greg Brockman in blog post announcing the company’s role in the newly released technical paper. That means "ensuring that AI systems do what people actually want them to do,” the researchers said.

One of the five problems the newly released Google technical paper examines is a way to ensure an AI system will not impact its environment negatively when performing its functions. As an example, Olah pointed to programming a cleaning robot to not knock over a vase even though it can complete its task faster by doing so.

Other problems involve figuring out ways to ensure robots do not engage in activities with negative consequences, such as sticking a wet mop into an electrical outlet, or they operate in a suitably safe manner in different environments such as on a shop floor or in office.

"Many of the problems are not new, but the paper explores them in the context of cutting-edge systems," OpenAI's Christiano and Brockman said.

The new technical paper is part of what appears to be a deepening focus on addressing AI safety-related issues. Google's research with Oxford University, for instance, is focused on ensuring the hyper-intelligent AI systems of the future will never be capable of actively blocking interruption by a human operator. The goal is to ensure that engineers have a way of safely shutting down an AI system if it starts behaving in an erratic or unsafe manner.

 
 
 
 
 
 
 
 
 
 
 
 
 

Submit a Comment

Loading Comments...
 
Manage your Newsletters: Login   Register My Newsletters























 
 
 
 
 
 
 
 
 
 
 
Rocket Fuel