-

Trainium3 UltraServers Now Available: Enabling Customers to Train and Deploy AI Models Faster at Lower Cost

Amazon EC2 Trn3 UltraServers powered by AWS's first 3nm AI chip help organizations of all sizes run their most ambitious AI training and inference workloads

LAS VEGAS--(BUSINESS WIRE)--At AWS re:Invent, Amazon Web Services, Inc. (AWS), an Amazon.com, Inc. company (NASDAQ: AMZN), today announced the general availability of Trainium3 UltraServers powered by the new Trainium3 chip.

Key takeaways

  • Trainium3 UltraServers deliver high performance for AI workloads with up to 4.4x more compute performance, 4x greater energy efficiency, and almost 4x more memory bandwidth than Trainium2 UltraServers—enabling faster AI development with lower operational costs.
  • Trn3 UltraServers scale up to 144 Trainium3 chips, delivering up to 362 FP8 PFLOPs with 4x lower latency to train larger models faster and serve inference at scale.
  • Customers including Anthropic, Karakuri, Metagenomi, NetoAI, Ricoh, and Splash Music are reducing training and inference costs by up to 50% with Trainium, while Decart is achieving 4x faster inference for real-time generative video at half the cost of GPUs, and Amazon Bedrock is already serving production workloads on Trainium3.

To get the full story on AWS Trainium3 UltraServers, visit About Amazon.

About AWS

Amazon Web Services (AWS) is guided by customer obsession, pace of innovation, commitment to operational excellence, and long-term thinking. By democratizing technology for nearly two decades and making cloud computing and generative AI accessible to organizations of every size and industry, AWS has built one of the fastest-growing enterprise technology businesses in history. Millions of customers trust AWS to accelerate innovation, transform their businesses, and shape the future. With the most comprehensive AI capabilities and global infrastructure footprint, AWS empowers builders to turn big ideas into reality. Learn more at aws.amazon.com and follow @AWSNewsroom.

Contacts

Amazon.com, Inc.
Media Hotline
Amazon-pr@amazon.com
www.amazon.com/pr

Industry:

Amazon.com, Inc.

NASDAQ:AMZN
Release Versions
English

Contacts

Amazon.com, Inc.
Media Hotline
Amazon-pr@amazon.com
www.amazon.com/pr

More News From Amazon.com, Inc.

Mark Your Calendars: Amazon Announces Prime Day Event from June 23–26, with Millions of Exclusive Deals for Prime Members

SEATTLE--(BUSINESS WIRE)--Amazon (NASDAQ: AMZN) today announced that Prime Day returns from June 23 at 12:01 a.m. PDT through June 26, kicking off summer with millions of deals exclusively for Prime members. This year’s event makes it easy to save on everything members need, from the season's biggest fashion trends and K-beauty favorites to summer of soccer essentials, patio furniture, and outdoor entertaining—plus savings on fresh groceries and back-to-school essentials, all with fast, free de...

Amazon's New Prime Business and Amazon Business Credit Cards, Powered by U.S. Bank and Mastercard®, Are Now Available with Enhanced Rewards and Flexible Financing

SEATTLE--(BUSINESS WIRE)--Amazon today launched the new Prime Business Card and Amazon Business Card, bringing together the Amazon rewards business customers love with powerful new benefits to help businesses make the most of their spending on Amazon. These cards, issued by U.S. Bank as part of the Mastercard® network, offer rewards wherever customers are shopping, access to flexible financing for purchases, and no annual or foreign transaction fees. Both cards are now available to new applican...

Amazon Rolls Out Amazon Now to Dozens of Cities Across the U.S., Providing 30-Minute Delivery to Millions of Customers

SEATTLE--(BUSINESS WIRE)--Amazon.com, Inc. (NASDAQ: AMZN) today announced the rollout of its ultra-fast delivery service Amazon Now to dozens of cities and millions of customers across the U.S. Amazon Now, which provides thousands of fresh groceries, everyday household essentials, and locally relevant items in about 30 minutes or less, is now widely available in Atlanta, Dallas-Fort Worth, Philadelphia, and Seattle, and is rapidly expanding in dozens more cities including Austin, Houston, Minne...
Back to Newsroom