Our musings on all things software, storage, and beyond.
Posted by on
How does the Native Quobyte HDFS Driver work? The driver implements the HDFS API, which means that it has the same API as HDFS but replaces it completely. Your big data applications, such as Hadoop, Spark or Hive, talk to Quobyte instead of HDFS, but won’t notice the difference. This also means that you won’t […] READ MORE
By on
If you hear the term, “hot spares”, run! No, really. Recently, someone asked me whether our system requires hot spares, and after a moment of shock and confusion I couldn’t resist but answer with a Star Wars quote: “Now there’s a term I’ve not heard in a long time.” Turns out that there are newer […] READ MORE
By on
Should I run my storage on the same nodes that I use as Hadoop workers, or should I have dedicated storage servers and worker nodes that only do compute? This question has been puzzling data administrators since Hadoop first became popular in the late 2000s. Even if you don’t use Hadoop but use other big […] READ MORE
By on
Don’t get me wrong. The cloud is amazing. It has made it so much easier to start new data projects, experiment with machine learning, and quickly move storage infrastructures into production. The flexibility alone has provided businesses with the much-needed resources for short-term, immediate projects (like a spike in workloads) that on-prem often just can’t […] READ MORE
Posted by on
Getting a lot of files from A to B is still not an easy task. While rsync is versatile it’s not the fastest and parallelizing rsync is no fun. Quobyte comes with two mechanisms to make data migrations easy. The command line tool qcopy used to move data onto a Quobyte cluster from any (Linux) […] READ MORE
Posted by on
Container management standard was designed for scale-out applications, so storage systems must scale-out too. Kubernetes, the popular container management system, offers enterprises many benefits: agility, scalability, faster development, and management. Consequently, open-source orchestration software has quickly been gaining traction. One ripple effect is many enterprise storage systems are struggling to keep pace with their […] READ MORE
By on
UPDATE (February 2021): We migrated the demo to our new 3.0 release. Being developers and sysadmins ourselves, we like software that we can just test quickly in a container. That’s why we decided to bring you a single container demo of Quobyte. This demo will start a container with all Quobyte services and the Quobyte […] READ MORE
By on
It has been some time since our first blog post on Quobyte and Kubernetes (Quobernetes) and this year marks the fifth anniversary of our Kubernetes support. Our new Quobyte Free Edition comes with full Kubernetes support, so it’s time for new tutorials how to take full advantage of Quobyte persistent volumes: A step-by-step guide on how […] READ MORE
By on
One of the big challenges for storage admins is the mix of millions (billions?) of small files and large files in the same file system. Small files need to be treated differently than large files, e.g. you want them on flash for high performance. On the other hand, large files are great for HDDs to […] READ MORE
Posted by on
In a fireside chat with Joe Chapman, IT Manager at 3vGeomatics, Quobyte’s CEO and Co-founder Bjorn Kolbeck discussed how 3vGeomatics, an InSAR company is helping to solve complex problems. Following is a brief summary of the conversation: 3vGeomatics’ goal is to make InSAR contribute to all assets, life, and environmental protection. With the advent of […] READ MORE