Joint Industry and Government Initiative to Demonstrate Long Distance InfiniBand(R) at SC05
These leading telecommunications and technology organizations are jointly providing the equipment, software and applications for industry and research partners to demonstrate the value of high-performance, low-latency direct access networking at 10 Gigabits per second over a long distance infrastructure. InfiniBand is a high performance, switched fabric interconnect standard for servers and OpenIB is an industry Alliance that supplies open source InfiniBand software. Both are quickly becoming the preferred standard in high performance computing, grid and enterprise data centers.
“The goal of this demonstration is to show that InfiniBand and the OpenIB software can support advanced simulation, computing and visualization across wide area networks”
The demonstration will link servers, clusters, storage systems, switches and optical service platforms over circuits provided by Qwest originating at the Intel data center in DuPont, Wash. and extending over 50 miles to the Washington State Convention Center via the Pacific Wave NorthWest GigaPop at the University of Washington.
During the conference several demonstrations will highlight some of the possible applications for long distance InfiniBand:
-- Remote data center replication
-- High performance interfaces to the WAN for IB-based clusters+supercomputers
-- GRID computing
-- High performance media streaming
-- Campus area InfiniBand: aggregating departmental clusters into super-clusters
-- Campus and metro InfiniBand storage
At each endpoint, InfiniBand over optical (either DWDM or SONET OC192) is converted by Longbow XRs from Obsidian Research. The Longbow enables globally distributed InfiniBand fabrics to seamlessly cross connect by encapsulating 4X InfiniBand over OC-192c SONET, ATM or 10GbE WANs at full InfiniBand data rates. The conversion is totally transparent to the InfiniBand fabric and is interoperable with OpenIB's software stack and subnet manager. The Naval Research Laboratory (NRL) initiated and supported early development of this capability.
"Microsoft's keynote demonstration at Supercomputing 2005 showcased the improved productivity for scientists made possible by seamless access from the workstation to structured data stores, personal desk-side clusters for interactive analysis and large heterogeneous pools of computing resources for detailed studies," said Kyril Faenov, director of high performance computing, Microsoft Corp. "The high-bandwidth connectivity to Intel's Dupont location allowed us to seamlessly incorporate a 256-core Intel(R) Xeon(TM) cluster running Windows Compute Cluster Server 2003 to the mix of computing resources."
"The goal of this demonstration is to show that InfiniBand and the OpenIB software can support advanced simulation, computing and visualization across wide area networks," said Bill Boas vice-chair of OpenIB and a computer scientist at Lawrence Livermore National Laboratory. "Our researchers need such capabilities to enable the range of simulations they perform for our stockpile stewardship mission for the National Nuclear Security Agency of the Department of Energy."
"InfiniBand is an industry standard that is currently deployed worldwide, and this demonstration highlights the benefits that are driving so many organizations to make InfiniBand their interconnect of choice," noted Jim Pappas, director of technology initiatives, Server Platforms Group, Intel Corporation. "Companies that need high performance, low latency, enterprise-level communication, particularly over significant distances, will be particularly interested in the demonstration."
Cisco Systems has contributed the Cisco ONS 15454 SONET Multiservice Provisioning Platform (MSPP) chassis with Cisco ONS 15454-OC192-LR2 Line cards and Cisco ONS 15454 DWDM Multiservice Transport Platform (MSTP). Intel's contribution includes use of 128-nodes (512-cores) from the Intel Dual-Core HPC Cluster physically located in DuPont, Wash. Based on off-the-shelf technologies, including the next-generation dual-core Intel Xeon processor and an InfiniBand interconnect, the cluster represents a new era that rapidly increases performance while reducing or holding steady the requirements for power, heat and floor space. Industry collaborators and end users can access the machine through the Intel Remote Access Service and use it to test drive their codes and accelerate their move to Intel multi-core computing. Alone, this cluster delivers theoretical peak performance of 3.2 teraflops. NRL and Obsidian Research donated the Longbow XR InfiniBand range extenders and Qwest provided the optical fiber infrastructure.
About OpenIB Alliance
The OpenIB Alliance is an industry association chartered to deliver a single, open-source Linux-based and Windows-based software stack for deploying InfiniBand. Founded in June 2004, the OpenIB Alliance is comprised of technology vendors and end-user organizations including: Appro; Cisco Systems, Inc.; Data Direct Networks, Inc.; Dell; Engenio Information Technologies, Inc.; Intel; Lawrence Livermore National Laboratory; Los Alamos National Laboratory; Linux Networx; Mellanox Technologies; Network Appliance; Oracle Corporation; PathScale; Rackable Systems; Sandia National Laboratories; Silicon Graphics; SilverStorm Technologies; Sun Microsystems, Inc.; Tyan Computer; Veritas Software; and Voltaire. More information about the OpenIB Alliance is available at www.openib.org.
About Cisco Systems
Cisco Systems, Inc. (NASDAQ:CSCO), the worldwide leader in networking for the Internet. News and information are available at www.cisco.com.
Qwest Communications International Inc. (NYSE:Q) is a leading provider of high-speed Internet, data, video and voice services. With approximately 40,000 employees, Qwest is committed to the "Spirit of Service" and providing world-class services that exceed customers' expectations for quality, value and reliability. For more information, please visit the Qwest Web site at www.qwest.com.
U.S. Department of Energy NNSA ASC PathForward
PathForward is a technology vendor partnership project of the National Nuclear Security Administration's (NNSA) Advanced Simulation and Computing (ASC) Program -- an integral and vital element of our nation's Stockpile Stewardship Program, by which the U.S. ensures confidence in the safety, performance, and reliability of its nuclear stockpile. The OpenIB InfiniBand PathForward is a joint project with Cisco, Intel, and Voltaire. Through PathForward, ASC strives to make strategic, targeted investments with its vendor partners to accelerate the development of hardware and software technologies needed to ensure that complete, balanced systems for capability and capacity computing at Lawrence Livermore National Laboratory (LLNL), Los Alamos National Laboratory (LANL), and Sandia National Laboratories (SNL) are available in the marketplace for out-year procurements by the program.
Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
InfiniBand(TM/SM) is a trademark and service mark of the InfiniBand Trade Association. Other names and brands are the property of their respective owners.
All product and company names herein may be trademarks of their registered owners.