Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Innovation
    • Innovation
    • PC Hardware

    Xbox’s Kinect Senses Sign Language

    By
    Pedro Hernandez
    -
    October 31, 2013
    Share
    Facebook
    Twitter
    Linkedin

      As an Xbox peripheral, Kinect may be (mostly) fun and games for Microsoft, but the company’s research arm has other, more serious designs for the sensor technology.

      Microsoft Research Asia, working with the Chinese Academy of Sciences and Beijing Union University, has devised a prototype that translates spoken language into sign language, and vice versa, in real time. The project, called Kinect Sign Language Translator, would make it possible for users to translate between different spoken and sign languages.

      For instance, the technology can translate an English-speaking person’s speech to Chinese sign language via an on-screen avatar and can potentially be extended to more languages. “During the first six months, we focused mainly on Chinese sign language data collection and labeling,” noted Guobin Wu, research program manager for Microsoft Research Asia, in a Microsoft Research Connections Blog post.

      Should the team’s efforts reach commercialization, it could have a big effect on the world’s deaf population. “There are more than 20 million people in China who are hard of hearing, and an estimated 360 million such people around the world, so this project has immense potential to generate positive social impact worldwide,” stated Wu.

      An accompanying video shows the device in action. Users stand in front of a Kinect sensor bar, speak or sign their message, and a moment later the system delivers an on-screen translation with audio and an avatar that reproduces the signed speech.

      The group drew from several disciplines while trying to develop Kinect Sign Language Translator, said Wu, including “language modeling, translation, computer vision, speech recognition, 3D modeling, and special education.” Yet there is still plenty of work ahead, he cautioned.

      While the technology in its current state “can successfully produce good results for translator mode,” which picks up isolated words signed by a specific person, “we are diligently working to overcome the technology hurdles so that the system can reliably understand and interpret in communication mode,” Wu said. The goal of communication mode is to understand “continuous communication from any competent signer.”

      Wu added that “while we’re solving those challenges, we are also starting to build up the system’s vocabulary of American Sign Language gestures, which are different from those of Chinese Sign Language.” Nonetheless, Wu said the project is off to a good start and that his group expects “that more and more researchers from different disciplines and different countries will collaboratively build on the prototype, so that the Kinect Sign Language Translator system will ultimately benefit the global community of those who are deaf or hard of hearing.”

      Kinect, the popular peripheral for Xbox 360 and now a standard feature on the upcoming Xbox One gaming and media console, has been embraced by the hacking community. Expanding on its motion control capabilities, tech enthusiasts have used the device as a basis for robot guidance systems and advanced 3D imaging systems. In March, the company released Kinect for Windows SDK 1.7, which included support for GPU-assisted 3D scanning.

      Pedro Hernandez
      Pedro Hernandez is a contributor to eWEEK and the IT Business Edge Network, the network for technology professionals. Previously, he served as a managing editor for the Internet.com network of IT-related websites and as the Green IT curator for GigaOM Pro.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×