Google has added text translation to the new Version 1.1 of its Google
Goggles application.
Now travelers to other countries can take pictures of street signs,
restaurant menus and other text and read them in their native language.
Google launched Goggles to let users take a picture of a location
from their Google Android smartphone and trigger a Google search that pulls up information associated
with the image.
Goggles creator Hartmut Neven showed off Goggles with Google Translate at Mobile World
Congress.
The Goggles-Translate integration connects an Android smartphone's camera to
an optical character recognition engine, recognizes the image as text and
translates that text into English using Google Translate. However, the app
could only translate German text into English at the time.
As of May 6, Goggles can now read English, French, Italian, German and
Spanish and translate to many more languages.
Google plans to bring recognition capabilities to other Latin-based
languages and eventually read non-Latin languages such as Chinese, Hindi and
Arabic, Google engineers Alessandro Bissacco and Avi Flamholz said in a statement.
To use the translation feature in Goggles, users of phones running Android
1.6 or greater must point their phone at a word or phrase and use the region of
interest button to draw a box around specific words.
The user will then press the shutter button to take a picture of the word or
phrase. If Goggles recognizes the text, it will ask the user if he wants to
have it translated. The user may then press the "translate" button to
select the source and destination languages.
Goggles recognizes famous monuments and other landmarks, works of art,
and products, such as bottles of wine. Goggles Version 1.1 recognizes more
barcodes, artwork, products and logos.
The new tool also boasts an improved user interface and the ability to
trigger visual searches using pictures in a phone's photo gallery. The boost to
artwork recognition comes courtesy of Google's acquisition of visual search provider Plink.
"Computer vision is a hard problem," wrote Bissacco and Flamholz.
"While we are excited about Goggles v1.1, we know that there are many
images that we cannot yet recognize. The Google Goggles team is working on
solving the technical challenges required to make computers see."
Consumers can scan this QR code below or go to the Android Market app on their
phone and search for Google Goggles to install the app on their smartphones.