Our musings on all things software, storage, and beyond.
Posted by on
We recently wrote about Hadoop’s HDFS and how it was once mighty and instrumental in big data, but today the file system’s flaws leave it buckling under modern analytics and AI workloads. Anyone working in those spaces needs to be aware of these disadvantages. But what about the rest of the enterprise storage market? For […] READ MORE
Posted by on
You would never send a kid to college with a toddler bed. They’ve outgrown it, right? The Lightning McQueen bed that fit 15 years ago obviously no longer suits present needs. Why, then, wouldn’t an enterprise reach the same conclusion about its data storage? What is HDFS? Apache’s Hadoop distributed file system (HDFS) and its […] READ MORE
Posted by on
How does the Native Quobyte HDFS Driver work? The driver implements the HDFS API, which means that it has the same API as HDFS but replaces it completely. Your big data applications, such as Hadoop, Spark or Hive, talk to Quobyte instead of HDFS, but won’t notice the difference. This also means that you won’t […] READ MORE
By on
Should I run my storage on the same nodes that I use as Hadoop workers, or should I have dedicated storage servers and worker nodes that only do compute? This question has been puzzling data administrators since Hadoop first became popular in the late 2000s. Even if you don’t use Hadoop but use other big […] READ MORE
By on
If you hear the term, “hot spares”, run! No, really. Recently, someone asked me whether our system requires hot spares, and after a moment of shock and confusion I couldn’t resist but answer with a Star Wars quote: “Now there’s a term I’ve not heard in a long time.” Turns out that there are newer […] READ MORE
By on
Don’t get me wrong. The cloud is amazing. It has made it so much easier to start new data projects, experiment with machine learning, and quickly move storage infrastructures into production. The flexibility alone has provided businesses with the much-needed resources for short-term, immediate projects (like a spike in workloads) that on-prem often just can’t […] READ MORE
Posted by on
Getting a lot of files from A to B is still not an easy task. While rsync is versatile it’s not the fastest and parallelizing rsync is no fun. Quobyte comes with two mechanisms to make data migrations easy. The command line tool qcopy used to move data onto a Quobyte cluster from any (Linux) […] READ MORE
Posted by on
Container management standard was designed for scale-out applications, so storage systems must scale-out too. Kubernetes, the popular container management system, offers enterprises many benefits: agility, scalability, faster development, and management. Consequently, open-source orchestration software has quickly been gaining traction. One ripple effect is many enterprise storage systems are struggling to keep pace with their […] READ MORE
By on
UPDATE (February 2021): We migrated the demo to our new 3.0 release. Being developers and sysadmins ourselves, we like software that we can just test quickly in a container. That’s why we decided to bring you a single container demo of Quobyte. This demo will start a container with all Quobyte services and the Quobyte […] READ MORE
By on
It has been some time since our first blog post on Quobyte and Kubernetes (Quobernetes) and this year marks the fifth anniversary of our Kubernetes support. Our new Quobyte Free Edition comes with full Kubernetes support, so it’s time for new tutorials how to take full advantage of Quobyte persistent volumes: A step-by-step guide on how […] READ MORE