2023-01-25 14:00:00

Deci delivers breakthrough inference performance on Intel's 4th Gen Sapphire Rapids CPU

Logo PR Newswire
PR Newswire

The Intel-Deci breakthrough enables AI developers to achieve GPU-like AI inference performance on CPUs in production for both computer vision and NLP tasks

TEL AVIV, Israel, Jan. 25, 2023 /PRNewswire-PRWeb/ -- Deci, the deep learning company building the next generation of AI, announced a breakthrough performance on Intel's newly released 4th Gen Intel® Xeon® Scalable processors, code-named Sapphire Rapids. By optimizing the AI models which run on Intel's new hardware, Deci enables AI developers to achieve GPU-like inference performance on CPUs in production for both Computer Vision and Natural Language Processing (NLP) tasks.

Deci utilized its proprietary AutoNAC (Automated Neural Architecture Construction) technology to generate custom hardware-aware model architectures that deliver unparalleled accuracy and inference speed on the Intel Sapphire Rapids CPU. For computer vision, Deci delivered a 3.35x throughput increase, as well as a 1% accuracy boost, when compared to an INT8 version of a ResNet50 running on Intel Sapphire Rapids. For NLP, Deci delivered a 3.5x acceleration compared to the INT8 version of the BERT model on Intel Sapphire Rapids, as well as a +0.1 increase in accuray. All models were compiled and quantized to INT8 with Intel® Advanced Matrix Extensions (AMX) and Intel extension for PyTorch.

"This performance breakthrough marks another chapter in the Deci-Intel partnership which empowers AI developers to achieve unparalleled accuracy and inference performance with hardware-aware model architectures powered by NAS," said Yonatan Geifman, CEO and Co-Founder of Deci. "We are thrilled to enable our joint customers to achieve scalable, production grade performance, within days".

Deci and Intel have maintained broad strategic business and technology collaborations since 2019, most recently announcing the acceleration of deep learning models using Intel Chips with Deci's AutoNAC technology . Deci is a member of the Intel Disruptor program and has collaborated with Intel on multiple MLPerf submissions. Together, the two are enabling new deep learning based applications to run at scale on Intel CPUs, while reducing development costs and time to market.

If you are using CPUs for deep learning inference or planning to do so, talk with Deci's experts to learn how you can quickly obtain better performance and ensure maximum hardware utilization. To learn more about the Deci-Intel collaboration, go to https://deci.ai/intel/

About Deci

Deci enables deep learning to live up to its true potential by using AI to build better AI. With the company's deep learning development platform, AI developers can build, optimize, and deploy faster and more accurate models for any environment including cloud, edge, and mobile, allowing them to revolutionize industries with innovative products. The platform is powered by Deci's proprietary automated Neural Architecture Construction technology (AutoNAC), which automatically generates and optimizes deep learning models' architecture and allows teams to accelerate inference performance, enable new use cases on limited hardware, shorten development cycles and reduce computing costs. Founded by Yonatan Geifman, Jonathan Elial, and Professor Ran El-Yaniv, Deci's team of deep learning engineers and scientists are dedicated to eliminating production-related bottlenecks across the AI lifecycle.

Media Contact

Garrett Krivicich, Deci, 1 786-233-7684, garrett@headline.media


Logo GlobeNewswire
TechnologyPress Release2023-01-25 14:00:00
AI-Powered Pipeline Projections, Demand Generation Effectiveness and Lead Prioritization Features Help Align CMOs and CROs for Sales Success PALO ALTO,...

Logo Channel NewsAsia
Business / FinanceBy Cna2023-01-24 22:25:49
Best News Website or Mobile Service WAN-IFRA Digital Media Awards Worldwide Best News Website or Mobile Service Digital Media Awards Worldwide STOCKHOLM :...

Logo PR Newswire
TechnologyPress Release2023-01-25 13:44:00
Intellimize to future-proof stranded Google Optimize 360 customers with the AI-powered efficiency of programmatic CRO SAN FRANCISCO, Jan. 25, 2023...

Logo PR Newswire
TechnologyPress Release2023-01-24 15:05:00
Creatives using Alteon can download the free Alteon Accelerator, powered by IBM Aspera, to upload media files up to 5TB 100% faster than TCP. MIAMI, Jan. 24,...

Logo GlobeNewswire
EconomyPress Release2023-01-24 14:45:00
The emergence of quantum computing, the emergence of autonomous robotics, and the surge in the implementation of AI chips in robotics drive the global...

Logo Benzinga
Business / FinanceBy Benzinga Insights2023-01-25 14:00:56
Intel INTC is set to give its latest quarterly earnings report on Thursday, 2023-01-26. Here's what investors need to know before the announcement. Analysts...

Logo EIN Presswire
TechnologyPress Release2023-01-24 15:48:14
Emergen Research Logo Rising volume of complex data and need for reduction in hardware costs are some key factors driving growth of the AI & advanced...

Logo EIN Presswire
Powering Computer Vision AI on Compact Edge Devices Lanner, Telco Systems, and CVEDIA Partner to Showcase the Power of Edge Computing with Computer Vision AI...

Logo PR Newswire
TechnologyPress Release2023-01-24 15:20:00
Intellecta Hyper Analytics from OnviSource Utilizes a Unified Combination of Advanced Technologies in AI, Multilevel Relational Deep Mining, Robotic Process...

Logo Benzinga
Business / FinanceBy Business Wire2023-01-24 15:35:00
Tachyum today released a white paper "Tachyum Storage Strategy and Direction for Prodigy Data Center Deployments" detailing a storage strategy to maximize...

Logo PR Newswire
TechnologyPress Release2023-01-25 05:53:00
The integration helps developers to develop and manage applications in increasingly complex and safety-critical industries such as aerospace, automotive,...

Logo PR Newswire
TechnologyPress Release2023-01-24 15:30:00
DALLAS, Jan. 24, 2023 /PRNewswire/ -- Informed.IQ, developer of AI-based software that verifies, streamlines and optimizes loan processing, is collaborating...

Logo GlobeNewswire
EconomyPress Release2023-01-24 14:45:00
Artificial Intelligence in Healthcare Market Trends and Insights By Component (Hardware, Software, Services), Application (Robot-Assisted Surgery, Virtual...

Logo GlobeNewswire
EconomyPress Release2023-01-24 20:30:00
The Data Center Accelerator market size was valued at USD 13.11 billion in 2021 and the worldwide data center accelerator market size is expected to reach...

Logo PR Newswire
TechnologyPress Release2023-01-24 14:15:00
LOS ALAMITOS, Calif., Jan. 24, 2023 /PRNewswire/ -- Registration is open for the 2023 IEEE Conference on Artificial Intelligence (CAI) taking place 5-6 June...

Logo GlobeNewswire
EntertainmentPress Release2023-01-25 13:00:00
VANCOUVER, British Columbia, Jan. 25, 2023 (GLOBE NEWSWIRE) -- Alpha Metaverse Technologies Inc. (Alpha'' or the Company) (CSE: ALPA) (OTC PINK: APETF) (FSE:...

Logo GlobeNewswire
TechnologyPress Release2023-01-24 16:00:00
Moonstone, PACE Capabilities to be Showcased at Photonics West BOSTON, Jan. 24, 2023 (GLOBE NEWSWIRE) -- Lightelligence, the global leader in optical...

Logo Channel NewsAsia
Business / FinanceBy Cna2023-01-25 00:53:37
Best News Website or Mobile Service WAN-IFRA Digital Media Awards Worldwide Best News Website or Mobile Service Digital Media Awards Worldwide Microsoft Corp...

Logo The Business Journals
Technology2023-01-24 13:59:21
Intel Corp. has an official name and new renderings for its $20 billion semiconductor manufacturing campus in New Albany, Ohio outside Columbus.

Logo Benzinga
Business / FinanceBy Business Wire2023-01-25 11:06:00
Tecnotree, a global digital platform and services leader for 5G and cloud-native technology, post the acquisition of a North American AI/ML company in...