Close
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Database
    • Database

    Microsoft Machine Learning Tech Adds Captions to Images

    By
    Pedro Hernandez
    -
    November 20, 2014
    Share
    Facebook
    Twitter
    Linkedin
      Microsoft machine learning

      Microsoft is applying its machine learning research to images and the unspoken information they may contain.

      Microsoft Research Distinguished Scientist and Deputy Director John Platt and his team have been working on software that automatically captions images. The project began this summer, when a multi-disciplinary team of experts decided to tackle the challenge of distilling photos into a sentence that makes sense instead of a jumble of words.

      The system devised by Platt and his group has beaten human-generated image captioning in tests although not always, he explained in a blog post. “I’m happy to report that, in terms of BLEU score, we actually beat humans,” he wrote. “Our system achieved 21.05 percent BLEU score while the human ‘system’ scored 19.32 percent.”

      BLEU, or Bilingual Evaluation Understudy, is an algorithm used to determine the quality of a machine-translated text. “BLEU breaks the captions into chunks of length (one to four words), and then measures the amount of overlap between the system and human translations. It also penalizes short system captions,” he explained.

      Despite the achievement, the technology is far from perfect.

      “BLEU has many limitations that are well-known in the machine translation community,” he said. “We also tried testing with the METEOR [Metric for Evaluation of Translation with Explicit Ordering] metric, and got somewhat below human performance (20.71 percent vs. 24.07 percent).”

      The technology was preferred by a fair amount of people when they were asked to evaluate Microsoft’s machine-generated captions. Using Amazon’s Mechanical Turk service, which pays “workers” to complete Human Intelligence Tasks online, “people thought that the system caption was the same or better than a human caption,” reported Platt.

      Microsoft has been aggressively leveraging its machine learning research to build a smart software and services portfolio.

      In March, Platt told attendees of the GigaOm Structure Data conference that “machine learning is pretty much pervasive throughout all Microsoft products. So, whenever you use a Microsoft product, you’re using a system that’s been generated from machine learning.”

      Examples include the company’s Bing search engine and Kinect motion sensor. “The only way you can answer the billions of questions Bing answers is to have something that operates autonomously In Xbox; the Kinect was also trained with machine learning,” said Platt. “The fact that it can see you in the room even though it’s poor lighting and you can wave your arms and it can track you—that’s all done with a piece of software that was trained with machine learning.”

      Microsoft has since introduced a new cloud-based machine learning service (Azure ML) for businesses venturing into predictive analytics. Office Graph, the underlying technology that powers the Office Delve app, leverages machine learning to determine the connections between workers and bring to the surface conversations and content in an effort to foster collaboration and improve productivity.

      Pedro Hernandez
      Pedro Hernandez is a contributor to eWEEK and the IT Business Edge Network, the network for technology professionals. Previously, he served as a managing editor for the Internet.com network of IT-related websites and as the Green IT curator for GigaOM Pro.

      MOST POPULAR ARTICLES

      Big Data and Analytics

      Alteryx’s Suresh Vittal on the Democratization of...

      James Maguire - May 31, 2022 0
      I spoke with Suresh Vittal, Chief Product Officer at Alteryx, about the industry mega-shift toward making data analytics tools accessible to a company’s complete...
      Read more
      Cybersecurity

      Visa’s Michael Jabbara on Cybersecurity and Digital...

      James Maguire - May 17, 2022 0
      I spoke with Michael Jabbara, VP and Global Head of Fraud Services at Visa, about the cybersecurity technology used to ensure the safe transfer...
      Read more
      Applications

      Cisco’s Thimaya Subaiya on Customer Experience in...

      James Maguire - May 10, 2022 0
      I spoke with Thimaya Subaiya, SVP and GM of Global Customer Experience at Cisco, about the factors that create good customer experience – and...
      Read more
      Big Data and Analytics

      GoodData CEO Roman Stanek on Business Intelligence...

      James Maguire - May 4, 2022 0
      I spoke with Roman Stanek, CEO of GoodData, about business intelligence, data as a service, and the frustration that many executives have with data...
      Read more
      Cloud

      Yotascale CEO Asim Razzaq on Controlling Multicloud...

      James Maguire - May 5, 2022 0
      Asim Razzaq, CEO of Yotascale, provides guidance on understanding—and containing—the complex cost structure of multicloud computing. Among the topics we covered:  As you survey the...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×