Close
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Subscribe
Logo
  • Latest News
  • Artificial Intelligence
  • Video
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Subscribe
    Home Innovation
    • Innovation
    • PC Hardware

    Xbox’s Kinect Senses Sign Language

    Written by

    Pedro Hernandez
    Published October 31, 2013
    Share
    Facebook
    Twitter
    Linkedin

      eWEEK content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

      As an Xbox peripheral, Kinect may be (mostly) fun and games for Microsoft, but the company’s research arm has other, more serious designs for the sensor technology.

      Microsoft Research Asia, working with the Chinese Academy of Sciences and Beijing Union University, has devised a prototype that translates spoken language into sign language, and vice versa, in real time. The project, called Kinect Sign Language Translator, would make it possible for users to translate between different spoken and sign languages.

      For instance, the technology can translate an English-speaking person’s speech to Chinese sign language via an on-screen avatar and can potentially be extended to more languages. “During the first six months, we focused mainly on Chinese sign language data collection and labeling,” noted Guobin Wu, research program manager for Microsoft Research Asia, in a Microsoft Research Connections Blog post.

      Should the team’s efforts reach commercialization, it could have a big effect on the world’s deaf population. “There are more than 20 million people in China who are hard of hearing, and an estimated 360 million such people around the world, so this project has immense potential to generate positive social impact worldwide,” stated Wu.

      An accompanying video shows the device in action. Users stand in front of a Kinect sensor bar, speak or sign their message, and a moment later the system delivers an on-screen translation with audio and an avatar that reproduces the signed speech.

      The group drew from several disciplines while trying to develop Kinect Sign Language Translator, said Wu, including “language modeling, translation, computer vision, speech recognition, 3D modeling, and special education.” Yet there is still plenty of work ahead, he cautioned.

      While the technology in its current state “can successfully produce good results for translator mode,” which picks up isolated words signed by a specific person, “we are diligently working to overcome the technology hurdles so that the system can reliably understand and interpret in communication mode,” Wu said. The goal of communication mode is to understand “continuous communication from any competent signer.”

      Wu added that “while we’re solving those challenges, we are also starting to build up the system’s vocabulary of American Sign Language gestures, which are different from those of Chinese Sign Language.” Nonetheless, Wu said the project is off to a good start and that his group expects “that more and more researchers from different disciplines and different countries will collaboratively build on the prototype, so that the Kinect Sign Language Translator system will ultimately benefit the global community of those who are deaf or hard of hearing.”

      Kinect, the popular peripheral for Xbox 360 and now a standard feature on the upcoming Xbox One gaming and media console, has been embraced by the hacking community. Expanding on its motion control capabilities, tech enthusiasts have used the device as a basis for robot guidance systems and advanced 3D imaging systems. In March, the company released Kinect for Windows SDK 1.7, which included support for GPU-assisted 3D scanning.

      Pedro Hernandez
      Pedro Hernandez
      Pedro Hernandez is a writer for eWEEK and the IT Business Edge Network, the network for technology professionals. Previously, he served as a managing editor for the Internet.com network of IT-related websites and as the Green IT curator for GigaOM Pro.

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      Get the Free Newsletter!

      Subscribe to Daily Tech Insider for top news, trends & analysis

      MOST POPULAR ARTICLES

      Artificial Intelligence

      9 Best AI 3D Generators You Need...

      Sam Rinko - June 25, 2024 0
      AI 3D Generators are powerful tools for many different industries. Discover the best AI 3D Generators, and learn which is best for your specific use case.
      Read more
      Cloud

      RingCentral Expands Its Collaboration Platform

      Zeus Kerravala - November 22, 2023 0
      RingCentral adds AI-enabled contact center and hybrid event products to its suite of collaboration services.
      Read more
      Artificial Intelligence

      8 Best AI Data Analytics Software &...

      Aminu Abdullahi - January 18, 2024 0
      Learn the top AI data analytics software to use. Compare AI data analytics solutions & features to make the best choice for your business.
      Read more
      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Video

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2024 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.