AWS introduces its next-gen custom chip to train ML models, Trainium
Date: 2020-12-03   Author: Saipriya Iyer  Category: #news

AWS introduces its next-gen custom chip to train ML models, Trainium

Amazon subsidiary AWS recently introduced a new custom chip for training machine learning models, dubbed AWS Trainium. According to the company, the next-gen chip, launched at the re:Invent developer conference, is designed to deliver better performance than its competitors in the cloud, with PyTorch, TensorFlow and MXNet support.

The chip will be made available inside Amazon’s machine learning platform Amazon SageMaker, and as EC2 instances. New instances built on these custom chips are set to launch in 2021.

Cost and speed are among the main benefits associated with the Trainium chips. AWS has committed to almost 45% lower cost-per-inference and 30% higher throughput in these chips, in comparison with the standard AWS GPU instances.

In addition to the new launch, AWS has also inked a partnership with Intel for the launch of new EC2 instances powered by Habana Gaudi for training machine learning models. Geared up for a 2021 launch, these instances are designed to provide a 40% improvement in price/performance as compared to the current GPU-based EC2 instances for ML training. The chips will also feature PyTorch and TensorFlow support.

Both offerings are complementary to the AWS Inferentia platform, which was launched at the re:Invent conference last year. For the record, Inferentia serves as the inferencing counterpart to these ML training pieces, and also makes use of a custom chip.

As per a statement released by the AWS team, the new AWS Trainium addresses the limitations arising from fixed ML training budgets and the subsequent cap on frequency and scope of training needed for the enhancement of the models and their applications, by delivering superior performance and relatively economical costs for ML training in the cloud. With the use of Inferentia and Trainium, the statement claims, customers will have access to an end-to-end ML compute flow, from scaling of training workloads to the deployment of accelerated inference.

The new custom chips will reportedly be introduced into the AWS cloud in the 1st half of 2021.

Source Credit: https://techcrunch.com/2020/12/01/aws-launches-trainium-its-new-custom-ml-training-chip/

 

 



About Author


Saipriya Iyer

Saipriya Iyer

Saipriya Iyer currently works as a content developer for AlgosOnline. A computer engineer by profession, she ventured into the field of writing for the love of playing with words. Having had a previous experience of 3 years under her belt, she has dabbled with website...

Read More

More from Saipriya


Post Recommendents

Spinning Disk Confocal Microscopes Market Projection By Key Players, Status, Growth, Revenue, SWOT Analysis Forecast 2026
Author: Ashwin Naphade

Market Study Report LLC adds new report on Global Spinning Disk Confocal Microscopes Market Research, which contains company information, geographical data and market analysis about this industry for all stakeholders involved in or wanting to get ...


2,6-Diaminopurine (CAS 1904-98-9) Market Comprehensive Analysis, Growth Forecast from 2021 to 2026
Author: Ashwin Naphade

Market Study Report LLC Adds New Global 2,6-Diaminopurine (CAS 1904-98-9) Market Report to its research database. The report presents a deep study of the market growth factors and drivers, application potential and much more.

The researc...


Gas Detector Tubes Market Size, Growth Trends, Top Players, Application Potential and Forecast to 2026
Author: Ashwin Naphade

The latest report on ' Gas Detector Tubes market' as Added by Market Study Report, LLC, offers comprehensive details on industry size, regional spectrum and revenue estimates of the business. In addition, the report stresses on major chall...