How does the Native Quobyte HDFS Driver work?
The driver implements the HDFS API, which means that it has the same API as HDFS but replaces it completely. Your big data applications, such as Hadoop, Spark or Hive, talk to Quobyte instead of HDFS, but won’t notice the difference. This also means that you won’t have to change your applications at all.
The native Quobyte HDFS driver comes as a rpm or deb package and contains the Java based plugin, the actual libquobyte that implements the Quobyte client and the necessary dependencies.
The applications talk to the Quobyte driver via one of the two file system interfaces in Hadoop: The FileSystem or the AbstractFileSystem. The Quobyte driver translates the calls from the applications into RPCs to the Quobyte Registry, Metadata and Data services. The communication between the native Quobyte HDFS driver and the Quobyte services is via TCP.
How to configure the Driver with Hadoop/Spark/HBase and other tools?
Each tool in the analytics ecosystem requires a slightly different configuration. Check out our tutorials for hadoop, spark, HBase and Apache Drill for step-by-step instructions. Generally speaking you need to do three things: