Close
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
Read Down
Sign in
Close
Welcome!Log into your account
Forgot your password?
Read Down
Password recovery
Recover your password
Close
Search
Logo
Logo
  • Latest News
  • Artificial Intelligence
  • Big Data and Analytics
  • Cloud
  • Networking
  • Cybersecurity
  • Applications
  • IT Management
  • Storage
  • Sponsored
  • Mobile
  • Small Business
  • Development
  • Database
  • Servers
  • Android
  • Apple
  • Innovation
  • Blogs
  • PC Hardware
  • Reviews
  • Search Engines
  • Virtualization
More
    Home Applications
    • Applications
    • Big Data and Analytics
    • Cloud
    • Database
    • Innovation
    • IT Management

    IBM’s Bayesian Optimization Accelerator on its Way to Commercial Viability

    By
    Charles King
    -
    December 17, 2020
    Share
    Facebook
    Twitter
    Linkedin
      IBM.Bayesian.Accelerator

      How complex computing technologies become commercial solutions is often unclear. In most instances, launch announcements mark the first time the public hears about such products. However, that is not always the case. For example, the appearance of IBM’s recently introduced Bayesian Optimization Accelerator can be tracked over other company breakthrough innovations. Following that trial offers some insights into how what some people might consider an obscure technology can become a commercially viable product.

      What is Bayesian optimization?

      Originated by the Rev. Thomas Bayes in 1763, the Bayes theorem determines the probability of an event based on knowledge of conditions that might influence or be related to the event. As noted in Stephen Meserve’s post (link is above) on IBM’s new solution, Bayesian methods are commonplace in mathematics, but applying standard solutions, such as Monte Carlo search, to product design problems is often challenging or impractical.

      With that in mind, IBM designed the Bayesian Optimization Accelerator to find optimal solutions for real-world design challenges in less time and with fewer resources than other solutions. It can scale to orders of magnitude larger in a number of dimensions and tackle highly complex problems. Plus, IBM’s solution can determine design points with a smaller number of samples than other methods require, delivering results faster and more cost-effectively.

      However, developing the Bayesian Optimization Accelerator as a commercial solution required the efforts of several IBM teams and business units.

      Hardware foundation: IBM’s POWER9-based AC922

      Introduced late in 2017, Power Systems AC922 was the first commercial IBM server to utilize the company’s new POWER9 processors, as well as NVIDIA Tesla Volta 100 (V100) GPUs. The AC922 also incorporated features developed for the Summit and Sierra supercomputers deployed at the U.S. Department of Energy’s Oak Ridge Laboratory. The Summit system also led the Top500.org top-performing supercomputer lists from June 2018 until June 2020.

      As noted in a blog by Ron Gordon at the time of the launch, the “AC” designation in the AC922 stands for Accelerated Computing because of the performance of two POWER9 CPUs, I/O bandwidth and memory bandwidth and up to four NVIDIA GPUs. The AC922 is particularly well suited for Artificial Intelligence applications, including machine learning and deep learning, using Linux and frameworks like Torch and Caffe.

      The AC922 continues to deliver superb performance for AI workloads and provides a hardware foundation for the new Bayesian Optimization Accelerator.

      How IBM Research’s Bayesian optimization helps drive Power innovations

      In June 2020, IBM discussed advances achieved by a team of engineers in its High-Speed Bus Signal Integrity (HSB-SI) organization. Implementing IBM Bayesian optimization software, a machine-learning tool developed by IBM Research, the team was able to reduce the number of simulations required to reach the optimal configuration for chip-to-chip communications.

      The legacy “brute force” processes that are typically used to analyze chip-to-chip design channels are engineering- and simulation-intensive and take days to arrive at an optimal combination. By running IBM Research’s software on a Power Systems server, the HSB-SI engineers were able to cut the amount of time required to deliver the same results and used far fewer compute resources to get there.

      I wrote about the team’s achievement earlier this year. Using a 10-core Power System server with IBM Bayesian optimization software reduced the compute time required for one job from nearly eight days to 80 minutes. In circumstances where results were required to be delivered in 100 minutes, a Bayesian optimization-enabled Power System server with 9-cores successfully completed that task while brute force techniques required a system with 1,126 cores to achieve the same results.

      Enter IBM’s Bayesian Optimization Accelerator

      The new IBM solution is a dedicated Power Systems appliance optimized for accelerating Bayesian search calculations. The appliance’s minimum technical requirements include an IBM Power Systems AC922 with dual POWER9 CPUs, 256GB of memory, two NVIDIA V100 GPUs, two 1.6 TB NVMe SSDs and two 1Gb Ethernet ports. Software requirements include RHEL 8, CUDA 11 and ESSL 6.3. Appliances can also be configured to meet specific technical and design requirements.

      Key features include enabling task parallelization to reduce CPU and wall clock time, scaling to orders of magnitude more dimensions than conventional open-source Bayesian libraries, determining design points with fewer samples than methods, like Grid and Random search require, and ensuring traceability to models to build trust in model design methodologies. IBM also notes that the new appliance offers improved throughput and is easy to add to existing HPC clusters.

      Final analysis

      While some products appear to spring fully formed from the minds of inventors and developers, far more evolve and are assembled from various, often disparate individual and team efforts. IBM’s new Bayesian Optimization Accelerator is clearly among this latter group. The core Power Systems AC922 platform was enabled by IBM’s new-generation POWER9 CPUs, the company’s efforts in designing the Summit and Sierra supercomputers and its strategic partnerships with NVIDIA, Mellanox and others.

      On the software side, the new solution owes much to the work of IBM Research developers. By their efforts and in concert with IBM Power Systems hardware, the company’s Bayesian optimization software massively improved the speed and efficiency of what had been highly complex and resource-intensive design processes.

      Today, companies have access to commercial iterations of what were once speculative IBM projects. As those organizations put the Bayesian Optimization Accelerator to work, its journey is likely to be eclipsed by the new and unique destinations it helps IBM customers achieve.

      Charles King is a principal analyst at PUND-IT and a regular contributor to eWEEK.  © 2020 Pund-IT, Inc. All rights reserved.

      Charles King
      https://pund-it.com
      Charles King is a longtime contributor to eWEEK and founder and principal analyst at PUND-IT. He covers a wide range of IT topics, including large enterprise systems, processors, servers, cloud services and others. Mr. King is considered one of the top 10 IT analysts in the world by Apollo Research, which quantified the listing of 3,960 analysts globally by their individual press coverage metrics (number of mentions and length of responses in the press).
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.
      Get the Free Newsletter!
      Subscribe to Daily Tech Insider for top news, trends & analysis
      This email address is invalid.

      MOST POPULAR ARTICLES

      Latest News

      Zeus Kerravala on Networking: Multicloud, 5G, and...

      James Maguire - December 16, 2022 0
      I spoke with Zeus Kerravala, industry analyst at ZK Research, about the rapid changes in enterprise networking, as tech advances and digital transformation prompt...
      Read more
      Applications

      Datadog President Amit Agarwal on Trends in...

      James Maguire - November 11, 2022 0
      I spoke with Amit Agarwal, President of Datadog, about infrastructure observability, from current trends to key challenges to the future of this rapidly growing...
      Read more
      IT Management

      Intuit’s Nhung Ho on AI for the...

      James Maguire - May 13, 2022 0
      I spoke with Nhung Ho, Vice President of AI at Intuit, about adoption of AI in the small and medium-sized business market, and how...
      Read more
      Applications

      Kyndryl’s Nicolas Sekkaki on Handling AI and...

      James Maguire - November 9, 2022 0
      I spoke with Nicolas Sekkaki, Group Practice Leader for Applications, Data and AI at Kyndryl, about how companies can boost both their AI and...
      Read more
      Cloud

      IGEL CEO Jed Ayres on Edge and...

      James Maguire - June 14, 2022 0
      I spoke with Jed Ayres, CEO of IGEL, about the endpoint sector, and an open source OS for the cloud; we also spoke about...
      Read more
      Logo

      eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site’s focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

      Facebook
      Linkedin
      RSS
      Twitter
      Youtube

      Advertisers

      Advertise with TechnologyAdvice on eWeek and our other IT-focused platforms.

      Advertise with Us

      Menu

      • About eWeek
      • Subscribe to our Newsletter
      • Latest News

      Our Brands

      • Privacy Policy
      • Terms
      • About
      • Contact
      • Advertise
      • Sitemap
      • California – Do Not Sell My Information

      Property of TechnologyAdvice.
      © 2022 TechnologyAdvice. All Rights Reserved

      Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.

      ×