StorNext File System
StorNext® is a modern file system with advanced data management and high-speed access to your data for faster insights and dynamic business value.
Unlock Insights. Accelerate Innovation. Deliver Outstanding Experiences.
Organizations today, like yours, need to manage the growing demands of massive amounts of unstructured data and high-resolution video. StorNext is a software-defined file system and data management platform designed for organizations that require the highest streaming performance, reliability, and massive scale.
It is ideally suited for data-intensive uses, such as scientific and life sciences research, healthcare, artificial intelligence (AI), ADAS, financial services, data analytics, and media / post-production. It delivers performance and scalability for ingesting, processing, and working on your data. Sophisticated data management policies help you manage, protect, and archive your data assets and files over time, and across local and cloud storage.
Fast Data Access When and Where You Need It
StorNext software provides you with high-speed streaming performance, reliability, and massive scalability for your data when and where you need it. StorNext’s file system architecture includes a broad range of flexible connectivity options, a rich set of data services, data management features, and monitoring interfaces.
- Clients and Connectivity
- StorNext Client
StorNext clients running MacOS, Linux, or Windows may connect to a StorNext File Storage system in a variety of ways. Each connectivity method benefits from unique characteristics, enabling you to maximize performance, affordability, and simplicity.
The highest performance is achieved by connecting to a StorNext cluster using StorNext client software. Apple machines may take advantage of the XSAN client built into MacOS. Windows and Linux machines require a simple code installation. StorNext clients connect in direct mode or proxy mode. For the fastest performance and lowest latency route to the storage, RDMA, FC SAN, and IB SAN clients connect directly to the storage network. LAN clients use proxy mode – gaining access to the shared storage through a proxy using a custom high-performance protocol.
NAS connectivity is simple and requires no separate client software installation. In a StorNext cluster, one or more nodes may be configured as NAS gateways. NAS gateway nodes work together to provide automatic load balancing and failover, and support both SMB and NFS for universal connectivity.
- Data Services
There is more to StorNext Scale-out File Storage than the file system. A robust selection of integrated data services provide data protection and cost control, enable collaboration, and open avenues for integration with other applications.
FlexTier makes StorNext self-protecting. FlexTier policies write files to secondary storage or cloud upon arrival, track copies and versions, and automatically offloads unused files from primary storage to make room for hot content. The Offline File Manager plug-in for Windows Explorer and Mac Finder gives end-users visibility and control over content location.
FlexSync is a simple, high-performance tool for creating local or remote replicas, from single directories to complete file systems. FlexSync is the only replication and synchronization tool that protects all StorNext-specific metadata, providing an absolute one-for-one copy.
Every file system needs rules to ensure the equitable distribution of resources. StorNext supports quotas for managing and reporting on usage of both primary and secondary storage. User, group, directory, and project-level quotas provide a flexible structure. A system of soft limits, grace periods, and hard limits enables enforcement from simply reporting violations to blocking new data from being written.
Storage performance is a valuable resource. StorNext Quality of Service (QoS) rules enable administrators to control bandwidth allocation to clients based on their needs and priorities. Critical users can be guaranteed bandwidth, while other clients share the remaining throughput based on a hierarchical priority structure.
- File System Architecture
- Stripe Groups
- File System Pools
- Storage Allocation
- Metadata Management
The StorNext File System (SNFS) is at the heart of every StorNext cluster, responsible for much of the system’s power, scalability, and flexibility. Refined over two decades of continuous development, SNFS extracts maximum performance from your storage. A comprehensive selection of data services provides additional value.
StorNext introduces two layers of abstraction that provide important expanded capabilities. Stripe groups enable scaling both file system performance and capacity by aggregating multiple storage arrays and allowing the separation of data with different access patterns.
File system pools maximize the utility of your high-performance storage and reduce overall storage cost. Pools are an optional, second layer of abstraction within a StorNext file system, and enable primary storage tiering, which transparently moves data between different classes of primary storage, such as NVMe and HDD.
One of the most important jobs of any file system is determining where to place files on storage. Allocation is a critical function because it affects performance. StorNext uses multiple intelligent allocation techniques, including optimistic allocation, a patented method known as Allocation Session Reservation, and a patented method for avoiding the read/modify/write penalty incurred by short writes.
|8190736||Reducing messaging in a client-server system|
|8554909||Reducing messaging in a client-server system|
|9456041||Method and apparatus for reducing messaging in a client-server system by selectively transitioning state mode|
|9342568||Reducing metadata controller communication volume|
|Compressed Metadata Cache|
|9176887||Compressed level two block buffer metadata cache|
|8977590||Front-end intelligence for monitoring back-end state|
|9069790||Multi-threaded message passing journal|
|9483356||Heuristic journal reservations|
File system metadata includes file names, locations, timestamps, permissions, flags, and other attributes. This is distinct from content metadata – things like artist, track number, and bitrate. StorNext manages file system metadata, leaving content metadata management to external applications. Metadata operations must be fast and efficient, so they don’t impede file system performance. To achieve this, StorNext stores metadata separately from file data, and can even flow metadata communication over a separate network from the data. A patented compressed L2 metadata cache ensures that all or most metadata reads are from RAM, and a patented buffering system accelerates metadata writes. Many additional patents cover advances in metadata communication and file system journaling. A custom, patented spatial database is used to archive all metadata changes, eliminating the need to scan to detect changes to the file system.
- Management Interfaces
- Web GUI
- Web Services API
- Command Line
Whether for day-to-day monitoring and admin tasks, automating routine processes, or power scripting, StorNext has the right GUI interface for the job with a corresponding CLI for power users and scripted automation. The Web Services API is ideal for interfacing with other applications in your workflow. Cloud Analytics enables you and Quantum Support to proactively monitor the health of all of your Quantum systems from anywhere.
Quantum’s optional Cloud Analytics console enables administrators to monitor all of their StorNext systems and Quantum tape libraries from anywhere. Quantum Service and Support provides proactive troubleshooting.
While the Web GUI and CLI are useful for everyday administrative activities, the Web Services API (WSAPI) is a modern, secure interface for connecting applications to StorNext. Many Quantum Technology Partners have integrated their applications with StorNext, using the WSAPI to gain information about StorNext’s internal state, or drive operations directly from their applications.
Every system administrator knows that automation of commonly performed tasks can save time and reduce errors, and automation means scripting. StorNext provides a comprehensive command-line interface (CLI) enabling administrators to script any action available in the GUI, and more. Scripts may be run ad-hoc or scheduled.
Clients and Connectivity
File System Architecture
Broadest Range of Connectivity Options
Including NFS, SMB, S3, and StorNext File System client for MAC, Windows, or Linux.
Independently Scale Performance, User Access, and Capacity
Scale-out performance up to thousands of clients, and scale capacity with any type of storage up to billions of files.
Versatile Storage Options
Scale file system clusters using any combination of NVMe, SSD, and HDD.
Highest Streaming Performance
Up to 23 GB per second on a single stream.
Software-Defined Data Management, Protection
Protect, manage, and archive your data across flash, disk, object, tape, and cloud with versatile data management capabilities.
Ecosystem Integration and Support with Open APIs
StorNext is a POSIX-compliant file system with a standard set of APIs and a broad ecosystem of integrated and certified applications.
File System Use Cases
Big data analytics, machine learning, IoT, video surveillance, ADAS
Medical records, genomics sequencing, bioimaging
Editing, VFX, animation, sports production, TV and broadcast
Classroom curriculum, training, Earth observation, space research, national security, intelligence
Transactions, risk management, market simulation
Supply chain, warehousing, transportation, R&D