Close
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Menu
eWEEK.com
Search
eWEEK.com
  • Latest News
  • Cybersecurity
  • Big Data and Analytics
  • Cloud
  • Mobile
  • Networking
  • Storage
  • Applications
  • IT Management
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications

    Acquired by Microsoft, Maluuba’s AI Beats Ms. Pac-Man, Eyes Sales Orgs

    By
    PEDRO HERNANDEZ
    -
    June 14, 2017
    Share
    Facebook
    Twitter
    Linkedin
      artificial intelligence

      Maluuba, the Canadian artificial intelligence (AI) startup that Microsoft acquired earlier this year, has beat Ms. Pac-Man using its technology. And the feat may have implications beyond the realm of retro arcade games.

      The group achieved the highest possible score of 999,990 using a technique called Hybrid Reward Architecture for Reinforcement Learning. Maluuba picked Ms. Pac-Man to test its technology because it requires human-like intelligence to beat, according to the company.

      Ms. Pac-Man is also considered tougher to win than Pac-Man because it was intentionally designed to subject players to more unpredictability, which kept arcade goers dropping quarters into the game after it was released in 1982.

      Fast forward a few decades, and the classic video game is helping Microsoft advance its AI capabilities with the potential for practical applications in sales organizations and other business environments.

      Maluuba’s Hybrid Reward Architecture beat Ms. Pac-Man like workforces tackle complex challenges: by distributing the work. More than 150 AI agents were deployed and rewarded for finding pellets—which are consumed along with bonuses to rack up points and advance through stages—and avoiding ghosts, Ms. Pac-Man’s deadly adversaries.

      Those agents would then offer suggestions to a top agent, which evaluated the suggestions and decided in which direction to move Ms. Pac-Man. The top agent also weighed how intensely the agents wanted to move in a particular direction.

      In an example provided by Microsoft, the company said this approach helps the AI make better decisions. Rather than follow the directions of a majority of agents that were motivated to move right to chomp down on a pellet, the top agent would heed the suggestions of the handful of agents that noticed a ghost on that lethal path and wanted to head left instead.

      Maluuba also discovered that the system worked the best when agents acted egotistically and were laser-focused on one objective, like finding the best path to a pellet. It created a cooperative environment in which each agent only cared about a problem at the exclusion of all others but somewhat counterintuitively contributed positively to the entire collective.

      Maluuba program manager Rahul Mehrotra believes his group’s research can be used in software that empowers sales teams in the future.

      Mehrotra believes the Hybrid Reward Architecture AI technology used to beat Ms. Pac-Man may one day “help a company’s sales organization make precise predictions about which potential customers to target at a particular time or on a particular day,” wrote Microsoft writer Allison Linn in a blog post. “The system could use multiple agents, each representing one client, with a top agent weighing factors such as which clients are up for contract renewal, which contracts are worth the most to the company and whether the potential customer is typically in the office that day or available at that time.”

      Beyond sales software, Microsoft envisions applications in natural language processing, financial modeling and robotics. A research paper on Hybrid Reward Architecture for Reinforcement Learning is available here. A video of the technology in action can be viewed here.

      MOST POPULAR ARTICLES

      Android

      Samsung Galaxy XCover Pro: Durability for Tough...

      CHRIS PREIMESBERGER - December 5, 2020 0
      Have you ever dropped your phone, winced and felt the pain as it hit the sidewalk? Either the screen splintered like a windshield being...
      Read more
      Cloud

      Why Data Security Will Face Even Harsher...

      CHRIS PREIMESBERGER - December 1, 2020 0
      Who would know more about details of the hacking process than an actual former career hacker? And who wants to understand all they can...
      Read more
      Cybersecurity

      How Veritas Is Shining a Light Into...

      EWEEK EDITORS - September 25, 2020 0
      Protecting data has always been one of the most important tasks in all of IT, yet as more companies become data companies at the...
      Read more
      Big Data and Analytics

      How NVIDIA A100 Station Brings Data Center...

      ZEUS KERRAVALA - November 18, 2020 0
      There’s little debate that graphics processor unit manufacturer NVIDIA is the de facto standard when it comes to providing silicon to power machine learning...
      Read more
      Apple

      Why iPhone 12 Pro Makes Sense for...

      WAYNE RASH - November 26, 2020 0
      If you’ve been watching the Apple commercials for the past three weeks, you already know what the company thinks will happen if you buy...
      Read more
      eWeek


      Contact Us | About | Sitemap

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Property of TechnologyAdvice.
      Terms of Service | Privacy Notice | Advertise | California - Do Not Sell My Info

      © 2020 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×