© Quantum Corporation. All rights reserved. | Page Feedback
Solving the world’s toughest problems requires complex and challenging analysis. Across the diverse fields in HPC, researchers create computational models to advance the understanding of our world and discover new possibilities. Whether in fluid mechanics, geosciences, oil and gas, genomics, climate modeling, intelligence, or network forensics—a vast amount of valuable data is being created and processed.
HPC applications require massive parallel processing and storage that can support the ultra-high streaming performance—both writes and reads—that enable HPC workflows.
Quantum offers two different high-performance storage solutions for HPC workflows: StorNext® scale-out storage and QXS hybrid storage deployed with Lustre®. Here we focus on Quantum QXS hybrid storage for Lustre environments.
Quantum QXS hybrid storage delivers the high-speed storage required by demanding HPC environments and the Lustre file system. To enable massively parallel reads, QXS hybrid storage includes Q-Turbo, a patented data caching architecture which leverages the QXS hybrid storage redundant controllers, and an adaptive caching technology to accommodate dozens of independent streams of data without degrading throughput. Q-Turbo and adaptive caching are critical features for HPC applications that depend upon reliable, high-performance data streaming.
Quantum QXS hybrid storage includes Q-Tier, a real-time tiering feature that moves data among different types of storage within a single array—between flash, high performance HDDs, and lower cost HDDs—based on real-time data access patterns, ensuring the most frequently accessed data is on the fastest storage. This provides the most needed data with the highest I/O possible, and also reduces bottlenecks.
Quantum QXS hybrid storage also includes Q-Tools, which optimize storage utilization yet minimize the hands on management required. These tools include thin provisioning, which optimizes storage by allocating only what is actually being used; Q-Snap, which provides data protection by enabling you to create and save snapshots of a volume; and quick rebuilds, which rebuilds storage that only contains data for fast recovery. Flexible configurations allow for any combination of flash and disk with densities of up to 56 drives per rack.
Figure 1 – Lustre HPC Environments Powered by Quantum QXS Hybrid Storage
QXS hybrid storage from Quantum can be the cornerstone of a Lustre solution that is fully redundant and optimized for performance—ensuring that mission-critical applications always have access to critical data. Together, Lustre and Quantum QXS hybrid storage enable the massive scale and blazing fast performance required for HPC modeling, simulation, and analysis.
Quantum QXS hybrid storage delivers extreme performance, even at petascale—with 12GBs/sec for reads, 5.7GBs/sec for writes, and 200,000 IOPS. With a redundant architecture that is both NEBS and MIL-SPEC compliant, the ruggedized reliability of QXS hybrid storage is ideal for demanding HPC environments.
Quantum QXS hybrid storage—with its combination of speed, scale, and reliability—is the perfect fit for open-source Lustre deployments in HPC.