18 lines
795 B
Plaintext
18 lines
795 B
Plaintext
|
-----------------------------------------------------------------------------
|
||
|
|
HttpFS - Hadoop HDFS over HTTP
|
||
|
|
|
||
|
|
HttpFS is a server that provides a REST HTTP gateway to HDFS with full
|
||
|
|
filesystem read & write capabilities.
|
||
|
|
|
||
|
|
HttpFS can be used to transfer data between clusters running different
|
||
|
|
versions of Hadoop (overcoming RPC versioning issues), for example using
|
||
|
|
Hadoop DistCP.
|
||
|
|
|
||
|
|
HttpFS can be used to access data in HDFS on a cluster behind of a firewall
|
||
|
|
(the HttpFS server acts as a gateway and is the only system that is allowed
|
||
|
|
to cross the firewall into the cluster).
|
||
|
|
|
||
|
|
HttpFS can be used to access data in HDFS using HTTP utilities (such as curl
|
||
|
|
and wget) and HTTP libraries Perl from other languages than Java.
|
||
|
|
-----------------------------------------------------------------------------
|