Intel Gaudi2 Accelerator MLPerf Benchmarks Show A Viable AI Alternative To NVIDIA’s GPUs

 

International Conference on Nuclear Physics and Particle Physics Research Excellence


Intel has released updated MLPerf benchmarks of its Gaudi2 accelerators, which have been the talk of the town recently. The data obtained proves that the Gaudi AI accelerators are framing out to be a viable alternative to NVIDIA's H100 GPUs, allowing Intel to get its share of the "AI hype".


Before diving into the benchmarks, it is important to realize that the AI industry is predicted to grow exponentially in the coming years. Gartner, an American insight firm, has disclosed that the AI industry is set to reach a $53.4 billion valuation in 2023, which is an increment of 20.9% from the previous year. Moreover, the firm predicts that the industry could almost reach the $120 billion mark by 2027, which is a prime reason why companies like Intel and AMD are striving to make a dominant entry with their own AI solutions.




Based on the data released by Intel, Gaudi2 accelerators have seen a decent performance uplift, outperforming NVIDIA's A100 AI GPUs by a good margin. Intel says that their Gaudi2 accelerator offers much better "value" compared to their counterparts in the market, and they are indeed right given the inflated prices NVIDIA's AI GPUs are being sold at.

While the above-mentioned statistics are indeed impressive, Intel has left out some details to reveal such as relevant TDP and temperature stats. They don't matter in the longer run especially with the current state of the industry, since the H100s are facing an immense shortage, with the demand and supply chain disrupted due to an "influx" of huge orders. In light of this, Intel's Gaudi2 accelerators are turning out to be a strong alternative, however, work still needs to be done here.

Apart from Gaudi accelerators, Intel also revealed some benchmarks of their 4th Gen Intel Xeon Scalable and Xeon CPU Max, which have been lately thriving in the industry due to the performance value they bring onboard. These are the main result highlights:The 4th Gen Intel Xeon Scalable processor is ideal for building and deploying general-purpose AI workloads with the most popular AI frameworks and libraries. For the GPT-J 100-word summarization task of a news article of approximately 1,000 to 1,500 words, 4th Gen Intel Xeon processors summarized two paragraphs per second in offline mode and one paragraph per second in real-time server mode.

For the first time, Intel submitted MLPerf results for the Intel Xeon CPU Max Series, which provides up to 64 gigabytes (GB) of high-bandwidth memory. For GPT-J, it was the only CPU able to achieve 99.9% accuracy, which is critical for applications for which the highest accuracy is of paramount performance.

Zinsner has expressed the company's attention to adopting a more "balanced" approach in the AI industry, offering competitive products. The official has realized that fact that the company's Sapphire Rapids lineup has received more attention, while the AI accelerator department was left out. Zinsner claims that Intel has been focusing on its GPU segment for a while now, with a majority of the company's finances allocated to its development which catalyzed the "downfall" of data center revenue.
Intel is currently moving towards focusing on the AI industry since it has seen the wonders it has done with the likes of NVIDIA and SK Hynix. The approach of Team Blue with Gaudi AI accelerators in the future is hinting towards a positive upturn, and one of the indicators we have seen is the company's plans to integrate next-gen Falcon Shores chips with the Gaudi lineup, expanding its potential to a whole new level. However, work needs to be done here and the only way Intel could oust competition is through revamping its AI products to a whole new level.

Intel collaborated with its original equipment manufacturer (OEM) customers to deliver their own submissions, further showcasing AI performance scalability and wide availability of general-purpose servers powered by Intel Xeon processors that can meet customer service level agreements (SLAs).


#IntelGaudi2#AIHardware#MLPerf#AlternativeToNVIDIA#AIAcceleration#Gaudi2VsNVIDIA
#AIInnovation#GPUAlternative#IntelAI#AIHardwareBenchmark#MLPerfBenchmark
#AIVision#AIResearch#AcceleratedComputing#AIInfrastructure#IntelVsNVIDIA
#AICompute#DeepLearning#AIWorkloads

Comments

Post a Comment

Popular posts from this blog

Nuclear power: The safer and cheaper alternative to fossil fuels

Image
As countries across the globe struggle to balance their desire for a reliable energy supply with their contribution to climate change, nuclear power presents a solution. The global reliance on fossil fuels is a function of our energy needs, and although there have been numerous initiatives implemented in order to reduce demand, such as levying large taxes on air transport, appropriate sources of supply still need to be defined. Fossil fuels such as coal, oil and gas have the benefit of being capable of servicing our energy needs. However, they are a chief contributor to climate change, and as countries attempt to meet the Paris Agreement of keeping global temperature below 2o above pre-industrial levels, non-carbon energy sources are essential. Positives and negatives So, what are the pros and cons of nuclear power as a safer, cheaper alternative to fossil fuels? Well, where renewable sources such as wind or solar are clean, they are also intermittent, require an uneven geographical
Read more

Physicists Detect Subatomic Neutrinos Made by a Particle Collider for the First Time

Image
  International Conference on Nuclear Physics and Particle Physics Research Excellence In a scientific first, a team led by physicists at the University of California, Irvine (UCI) has detected neutrinos created by a particle collider. The discovery promises to deepen scientists’ understanding of the subatomic particles, which were first spotted in 1956 and play a key role in the process that makes stars burn. The work could also shed light on cosmic neutrinos that travel large distances and collide with the Earth, providing a window on distant parts of the universe. It’s the latest result from the Forward Search Experiment, or FASER, a particle detector designed and built by an international group of physicists and installed at CERN, the European Council for Nuclear Research in Geneva, Switzerland. There, FASER detects particles produced by CERN’s Large Hadron Collider. “We’ve discovered neutrinos from a brand-new source – particle colliders – where you have two beams of particles sma
Read more

Physics Breakthrough: Scientists Discover Rydberg Moiré Excitons

Image
International Conference on Nuclear Physics The Rydberg state is prevalent across various physical mediums such as atoms, molecules, and solid materials. Rydberg excitons, which are highly energized, Coulomb-bound electron-hole pair states, were initially identified in the 1950s within the semiconductor material, Cu2O. In a study published in Science, Dr. Xu Yang and his colleagues from the Institute of Physics (IOP) of the Chinese Academy of Sciences (CAS), in collaboration with researchers led by Dr. Yuan Shengjun of Wuhan University, have reported observing Rydberg moiré excitons, which are moiré-trapped Rydberg excitons in the monolayer semiconductor WSe2 adjacent to small-angle twisted bilayer graphene (TBG). The solid-state nature of Rydberg excitons, combined with their large dipole moments, strong mutual interactions, and greatly enhanced interactions with the surroundings, holds promise for a wide range of applications in sensing, quantum optics, and quantum simulation. Howeve
Read more