HPC Storage Infrastructure

High performance computing demands more from a storage system. Quobyte delivers functionality, 24/7 reliability, and scalability to help you solve the world’s toughest problems.

Work Like a Hyperscaler

As a team that’s worked in HPC centers we understand the challenges that you face on a daily basis. That’s why we made it our mission to fuse high performance computing and hyperscale tech and operations to bring those two worlds together for a true parallel, POSIX compliant file system. Our unique shared-nothing architecture simplifies storage management, eliminates data silos and wasted storage space, and uncaps performance limitations.

Case Study logo

Find out how STFC manages 45 PB of data - and growing - on Quobyte.

READ MORE

Unlimited Performance

Quobyte clusters can scale from 4 to 1000s of storage servers and more, providing unlimited performance and consistent low latency to applications. The only limit is the performance of the hardware and network. The patented Quobyte technology for fault-tolerance provides scalability and reliability without centralized components. Capacity, metadata and IOPS/bandwidth can be scaled independently to match the user's or application requirements.

Unified Storage

We eliminate data silos to provide simultaneous access to files from any supported interface. This enables real-time data sharing, reduces unnecessary data copies, and lets your storage system easily serve any application.

Unconditional Simplicity™

Operate like a hyperscaler and take back your weekends. Our highly automated system instantly adapts to hardware issues, guarantees 100% nondisruptive updates and maintenance, and gives you the power to manage 100+PB with just two admins. After you install Quobyte, you’ll only have to work during business hours, you get to schedule hardware maintenance/installation on your own time, and you’ll eliminate the headache of constantly troubleshooting fragile HPC storage.

Choosing Between Performance and Reliability?
Quobyte Gives You Both

I love the model that allows you to scale with your dollars and your return…That’s why we love Quobyte. And the support is enterprise-class, top notch.

Chris Sullivan, Assistant Director for Biocomputing at Oregon State University’s Center for Genome Research and Biocomputing
Scale-out Performance

Quobyte scales linearly from 4 to 1000s of nodes without ever encountering bottlenecks or single points of failure. Give your users the performance that they’ve been waiting for, and they’ll be glad that you did. After all, happy users translate to happy admins.

  • Add drives and servers to linearly increase capacity, throughput, IOPS, and metadata performance.
  • True parallelism provides lockless read/write to the same file across any number of clients.
  • File striping to aggregate performance of many machines and drives for massive throughput.
  • Native MPI-IO driver completely bypasses the kernel and provides even more performance than regular Linux file system drivers.
    Read our blog post
Storage for any Interface

Data silos and managing multiple versions of the same file across multiple storage systems for access by varying platforms is a thing of the past.

  • Quobyte supports Linux, Windows, MacOS, HDFS, TensorFlow, NFS v3/4, SMB, MPI-IO, S3, and CIFS interfaces.
  • Single namespaces from all interfaces, i.e. file, S3, and Hadoop.
  • NFSv4 ACLs shared, enforced across all protocols.
  • Run scratch, home, archive, and all workloads from the same storage system with NVMe and HDD supported.
Simplified Management

Other HPC file storage systems are a real headache, even on the best of days. When something breaks it goes from bad to worse. It doesn’t have to be that way.

  • Quobyte doesn’t require kernel modules, keeping everything within the userspace.
  • Install in minutes from a single RPM package.
  • Operate and configure from the UI, via command line or REST API.
  • Server side runs on CentOS, RHEL, Ubuntu, Debian, and SLES, with client drivers for Linux, Windows and Mac.
  • Quobyte is hardware-agnostic. Our software runs on standard servers from most vendors or in the cloud, eliminating requirements for specialized hardware.
    Learn about our recommended hardware configs
  • Seamless combine HDD, SSD, and NVMe drives in the same system.
Built-in Fault Tolerance Puts You in Control

We like to call Quobyte your weekend pass. You’re never going to have to come into the office on a Saturday or before dawn ever again. Our technology serves you, never the other way around. You control your schedule.

  • Automatic file replication coupled with data protection across machines and automated declustered rebuild lets you schedule hardware replacements on your own time without sacrificing any redundancy.
  • Quobyte is self-healing without impacting performance.
  • Update software, perform maintenance, or reconfigure data placement policies while the system continues to run. Maintenance windows are a thing of the past.
  • Read our architecture whitepaper
Truly Software-Defined Storage

You dictate your storage system’s behavior entirely from the user interface. Quobyte gives you complete control over your storage system, enabling you to optimize for cost, performance, and security.

  • Quobyte enables you to assign policy-based data management and placement. This lets you change how the system works while it runs by tiering data, carving out dedicated hardware, and other functions, while also giving you control over where to place data and how to protect it. Instead of manually moving data or hardware, just make a few easy clicks.
  • Transparently move data between tiers, such as flash to HDD, based on age, size, and other criteria.
  • Multi-tenancy and optional hardware isolation allow you to isolate users, groups, or projects in your hardware. Change these settings at any time.
Protect Your Data

We designed security into Quobyte from the very beginning to ensure your data’s confidentiality, integrity, and availability.

  • No more RAID: mix and match between erasure coding (EC) and/or synchronous replication across servers.
  • Patented synchronous replication provides fault-tolerance without introducing scalability bottlenecks.
  • Quobyte can automatically select the best data protection mechanism for you, or you can customize at will.
  • Recoding enables transfers from replicated to erasure coded method for archival data.
  • End-to-end checksums on all data and metadata, both in transit and at rest.
  • Automatic failover built into protocol eliminates the need for IP failover or fragile HA solutions.
Artificial Intelligence and Machine Learning

AI and ML for modeling and analytics are major players in today’s HPC ecosystem. Quobyte makes your machines even smarter.

  • Native TensorFlow plugin for ML reduces latency and CPU utilization.
  • Unified storage keeps all steps of the ML pipeline (ingest, preprocessing, training, etc.) on the same storage system.
  • Consistent low latency across many clients thanks to linear scaling.
  • Learn more about Quobyte for ML
Integrated with Modern IT Infrastructure

Quobyte is integrated with the leading open source infrastructure projetcs.

  • Prometheus-based monitoring and Grafana dashboard.
  • Kubernetes CSI plugin and operator.
  • OpenStack driver for Block Storage Cinder and Manila shared file system
More than Meets the Eye

We packed Quobyte full of features that improve performance, unify storage, and simplify the entire storage environment. This means Quobyte provides both users and admins the tools they need to get the job done.

  • Fairness between IO streams, workloads, and users on metadata.
  • Scalable file range locks.
  • Recoding for space efficiency.
  • Data mover between clusters.
  • Unlimited number of volumes with thin provisioning
  • Implement quotas without impacting performance.
  • IP-based and X.509 certificate support for access control.
  • Learn more about our features