Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,548 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7280 Commits

Author SHA1 Message Date
Arpit Agarwal d41245ca56 HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. (Contributed by Arpit Agarwal) 2018-04-25 15:50:52 -07:00
Yiqun Lin b06601acce HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 2018-04-24 11:25:23 +08:00
Inigo Goiri df92a17e02 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 2018-04-23 19:12:16 -07:00
Bharat Viswanadham 9b5375e0c1 HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham 2018-04-23 16:09:01 -07:00
Lei Xu 42e82f0281 Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. 
(cherry picked from commit f6ecb76d0b)

Conflicts:
	hadoop-project-dist/pom.xml
 2018-04-23 14:14:05 -07:00
Chris Douglas f411de6a79 HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 2018-04-23 11:13:18 -07:00
Arpit Agarwal c533c77047 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:08:53 -07:00
Inigo Goiri 63803e7051 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 2018-04-22 19:49:35 -07:00
Arpit Agarwal 1c1ce63cda HDFS-13055. Aggregate usage statistics from datanodes. Contributed by Ajay Kumar. 2018-04-22 08:07:19 -07:00
Yiqun Lin b6dae26f44 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 2018-04-21 13:19:09 +08:00
Sangjin Lee f40969a141 HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov. 2018-04-20 20:33:10 -07:00
Inigo Goiri 1134af9ad1 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 2018-04-19 14:56:36 -07:00
Shashikant Banerjee e4c39f3247
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-19 08:35:38 +09:00
Bharat Viswanadham bf7694d020 HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee 2018-04-18 08:23:45 -07:00
Mukul Kumar Singh bf2f493f81 HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee. 2018-04-18 16:11:37 +05:30
Erik Krogen 2d9e791a90
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-18 14:38:23 +09:00
Wei Yan e4313e7e47 HDFS-13466. RBF: Add more router-related information to the UI. 2018-04-17 15:01:07 -07:00
Inigo Goiri c9b33514b8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 2018-04-17 14:19:23 -07:00
Bharat Viswanadham a68b04370f HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh 2018-04-17 12:37:30 -07:00
Yiqun Lin c4d3636c21 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 2018-04-17 11:23:22 +08:00
Arpit Agarwal d907fdc3cd HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:16:59 -07:00
Wei-Chiu Chuang e66e287efe HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 2018-04-13 09:17:34 -07:00
Xiao Chen 6503593711 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 2018-04-13 09:05:17 -07:00
Bharat Viswanadham fa8b88ab2b HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee. 2018-04-13 08:56:02 -07:00
Yiqun Lin 0725953efe HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 2018-04-13 17:55:45 +08:00
Akira Ajisaka 9b0b9f2af2
HDFS-13436. Fix javadoc of package-info.java 2018-04-13 13:23:51 +09:00
Inigo Goiri 044341b4e4 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 2018-04-12 09:30:11 -07:00
Inigo Goiri b5353c75d9 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit ac32b3576d.
 2018-04-12 09:28:23 -07:00
Inigo Goiri d272056fcb Revert "HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar." 
This reverts commit 18de6f2042.
 2018-04-12 08:42:19 -07:00
Mukul Kumar Singh 7ed8511ad8 HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee. 2018-04-12 20:12:31 +05:30
Akira Ajisaka 113af12cfb
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 2018-04-12 17:47:37 +09:00
Akira Ajisaka c7cd362afd
HDFS-13427. Fix the section titles of transparent encryption document. 2018-04-12 10:44:56 +09:00
Inigo Goiri 18de6f2042 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 2018-04-11 12:03:14 -07:00
Inigo Goiri f7d5bace43 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 2018-04-11 10:43:43 -07:00
Wei Yan 0c93d43f3d HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:37:43 -07:00
James Clampffer eefe2a147c HDFS-13403: libhdfs++ Use hdfs::IoService object rather than asio::io_service. Contributed by James Clampffer. 2018-04-11 10:27:23 -04:00
Xiao Chen 7c9cdad6d0 HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-10 21:31:48 -07:00
Xiao Chen e76c2aeb28 HDFS-13363. Record file path when FSDirAclOp throws AclException. Contributed by Gabor Bota. 2018-04-10 11:19:48 -07:00
Rakesh Radhakrishnan f89594f0b8 HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 2018-04-10 23:35:00 +05:30
Weiwei Yang 6729047a8b HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 2018-04-10 22:10:44 +08:00
Yiqun Lin e87be8a2a4 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 2018-04-10 15:34:42 +08:00
Yiqun Lin a92200f4a6 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 2018-04-10 14:29:28 +08:00
Inigo Goiri e9b9f48dad HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 2018-04-09 10:09:25 -07:00
Inigo Goiri ac32b3576d HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 2018-04-09 09:16:48 -07:00
Yiqun Lin 5700556cd6 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 2018-04-08 12:01:55 +08:00
Surendra Singh Lilhore 70590cd8d9 HDFS-13292. Crypto command should give proper exception when trying to set key on existing EZ directory. Contributed by Ranith Sardar. 2018-04-07 11:23:49 +05:30
Wangda Tan 6cf023f9b7 Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:39 -07:00
Wei Yan 3121e8c293 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 2018-04-05 12:00:52 -07:00
Lei Xu d737bf99d4 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 2018-04-05 09:59:10 -07:00
Yiqun Lin 2be64eb201 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 15:08:40 +08:00
Xiao Chen 57374c4737 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 2018-04-02 22:48:26 -07:00
Inigo Goiri dc8e343201 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 2018-03-31 09:46:13 -07:00
Konstantin V Shvachko acfd764fcc HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 2018-03-30 18:55:35 -07:00
Xiao Chen 2c6cfad5a3 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 2018-03-29 15:46:34 -07:00
Wei-Chiu Chuang ad10cbd91b HDFS-13357. Improve AclException message "Invalid ACL: only directories may have a default ACL.". Contributed by Gabor Bota. 2018-03-29 07:08:22 -07:00
Arpit Agarwal a991e899fb HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:17 -07:00
Yiqun Lin a71656c1c1 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 2018-03-28 11:00:08 +08:00
Inigo Goiri 4cef01147f HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 2018-03-27 10:31:03 -07:00
Inigo Goiri 947b282984 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 2018-03-26 09:42:51 -07:00
Yiqun Lin cfc3a1c8f0 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 2018-03-26 18:33:07 +08:00
Lei Xu 7616683db5 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:48:36 -07:00
weiy 6e31a09084 HDFS-12512. RBF: Add WebHDFS. 2018-03-23 08:32:25 -07:00
James Clampffer 8620d2bdf9 HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein. 2018-03-22 17:19:47 -04:00
James fc5e44d9ed HDFS-12427: libhdfs++: Prevent requests from holding dangling pointer to RpcEngine. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 48db24a430 HDFS-11294: libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 12942f679a HDFS-10787: libhdfs++: Public API should expose configuration parser. Original patch contributed by Mitchell Tracy, followup work and compile warning fixes contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer eeb49d0ca7 HDFS-12237: libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer 22ea06a3dd HDFS-12134: libhdfs++: Add a synchronization interface for the GSSAPI. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 033433bce7 HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer 53e40bc718 HDFS-10874: libhdfs++: Public API headers should not depend on internal implementation. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer 3db261d45b HDFS-12103: libhdfs++: Provide workaround to support cancel on filesystem connect until HDFS-11437 is resolved. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 23afd50865 HDFS-11908: libhdfs++: Authentication failure when first NN of a kerberized HA cluster is standby. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer e64ba87486 HDFS-12104: libhdfs++: Make sure all steps in SaslProtocol end up calling AuthComplete. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 3c743b475e HDFS-12013: libhdfs++: read with offset at EOF should return 0 bytes instead of error. Contributed by Xiaowei Zhu 2018-03-22 17:19:47 -04:00
James Clampffer c5e7a69523 HDFS-11971: libhdfs++: [Fix] a few portability issues. Contributed by Anatoli Schein 2018-03-22 17:19:47 -04:00
James Clampffer 1c9b174663 HDFS-11518: libhdfs++: Add a build option to skip building examples, tests, and tools. Contributed by Anatoli Schein. 2018-03-22 17:19:47 -04:00
James Clampffer 869317be0a HDFS-10785: libhdfs++: Implement the rest of the tools. Contributed by Anatoli Schein 2018-03-22 17:19:47 -04:00
James Clampffer 52445fd4ee HDFS-11544: libhdfs++: Revert HDFS-11544.HDFS-8707.001.patch due to invalid memory access regression. Done by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer c2386bc2f3 HDFS-11758: libhdfs++: Catch exceptions thrown by runtime hooks. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 57cdad73de HDFS-11767: libhdfs++: SASL events should be scoped closer to usage. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James b584e34f2f HDFS-11730: libhdfs++: RpcConnection should handle authorization error call id. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James fdb88eb57e HDFS-11544: libhdfs++: Improve C API error reporting. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 3e53da2d62 HDFS-11106: libhdfs++: Some refactoring to better organize files (part 2). Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 0f3f8db113 HDFS-11449: libhdfs++: Log Datanode read size when reading from an HDFS block. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James 606d20c6c0 HDFS-11436: libhdfs++: Fix race condition in ScopedResolver. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 8783461e2e HDFS-11028: libhdfs++: FileSystem needs to be able to cancel pending connections. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 58de2df860 HDFS-10685: libhdfs++: return explicit error when non-secured client connects to secured server. Contributed by Kai Jiang. 2018-03-22 17:19:47 -04:00
James 69d55340f8 HDFS-11305: libhdfs++: Log Datanode information when reading an HDFS block. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James a30cf6a369 HDFS-10796: libhdfs++: Previous commit was missing test/hdfs_ioservice_test.cc, adding it. 2018-03-22 17:19:47 -04:00
James fbff671e0f HDFS-10796: libhdfs++: rationalize ioservice interactions. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James dd7837c429 HDFS-11106: libhdfs++: Some refactoring to better organize files. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 2524afbc20 HDFS-11099: libhdfs++: Expose rack id in hdfsDNInfo. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James b7d9a0f827 HDFS-11027: libbhdfs++: Don't retry if there is an authentication failure. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James 59a3926946 HDFS-11014: libhdfs++: Make connection to HA clusters faster. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 6dd47cae86 libhdfs++: Get rid of lock in RpcConnectionImpl destructor. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 7ebecaeede HDFS-10898: libhdfs++: Make log levels consistent. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 2a42eeb66f HDFS-10931: libhdfs++: Fix object lifecycle issues in the BlockReader (see follow up work in jira). Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
Bob Hansen 69cb05d292 HDFS-10595: libhdfs++: deconflate client name and client id 2018-03-22 17:19:47 -04:00
Bob Hansen d22e4b2eb7 HDFS-10450b: libhdfs++: Add Cyrus SASL support (engines). Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
Bob Hansen 549a5dbce9 HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
James 9d1c902159 HDFS-10705: libhdfs++: FileSystem should have a convenience no-args ctor. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 4f6cb5d1a1 HDFS-10754: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 05ddb31081 HDFS-10761: libhdfs++: Fix broken logic in HA retry policy. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James b9cf0e932d HDFS-10746: libhdfs++: synchronize access to working_directory and bytes_read_. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James cbb3e9fe58 HDFS-10740: libhdfs++: Implement recursive directory generator. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 2a8edd4e52 HDFS-9271: libhdfs++: Implement basic NN operations. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James b1ed72e098 HDFS-10739: libhdfs++: In RpcEngine replace vector with deque for pending requests. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 649aff11fe HDFS-10672: libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 4cb0dad5e5 HDFS-10441: libhdfs++: HA namenode support. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James d75c835696 Revert HDFS-10543 patch due to correctness issues it caused. Done by James Clampffer 2018-03-22 17:19:47 -04:00
James a586ccbcfa HDFS-9890: libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James a23e6b422b HDFS-10578. libhdfs++: Silence compile warnings from URI parser. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James a0c7aee3b6 HDFS-10543: libhdfs++: hdfsRead stops at block boundary. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
Bob Hansen d4c3cfbf47 HDFS-10524: libhdfs++: Implement chmod and chown. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 88c5768f99 HDFS-10515: libhdfs++: Implement mkdirs, rmdir, rename, and remove 2018-03-22 17:19:46 -04:00
Bob Hansen 193314dc34 HDFS-10511: libhdfs++: make error returning mechanism consistent across all hdfs operations. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 2616fe2025 HDFS-10526: libhdfs++: Add connect timeouts to async_connect calls. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James de6fce7817 HDFS-10527: libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
Bob Hansen 9ac66ccaa3 HDFS-10494: libhdfs++: Implement snapshot operations and GetFsStats. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
James d64bbf983e Revert HDFS-9890. Needs some more work to reflect the current status of HDFS-8707. Done by James Clampffer 2018-03-22 17:19:46 -04:00
James 11b68ecebe HDFS-9890. libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
Bob Hansen 50aa4ea776 HDFS-10454: libhdfspp: Move NameNodeOp to a separate file. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 0496bc5464 HDFS-10464: libhdfs++: Implement GetPathInfo and ListDirectory. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 18f4d2f42e HDFS-10465: libhdfs++: Implement GetBlockLocations. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen f1f0b8f0f8 HDFS-10366: libhdfs++: Add SASL authentication. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 93382381f6 HDFS-10188. libhdfs++: Implement debug allocators. Contributed by Xiaowei Zhu 2018-03-22 17:19:46 -04:00
James b9eeecc477 HDFS-10332. hdfs-native-client fails to build with CMake 2.8.11 or earlier. Contributed by Tibor Kiss 2018-03-22 17:19:46 -04:00
James cc51f2ce58 HDFS-10310. hdfsConnect hangs when given bad host or port. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James e542db66ee HDFS-10311: DatanodeConnection::Cancel should not delete the underlying socket. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 1cbfd6f962 libhdfs++: File length doesn't always count the last block if it's being written to. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
James 60c3437267 HDFS-10247: libhdfs++: Datanode protocol version mismatch fix. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen ed77d8d5df HDFS-10231: libhdfs++: Fix race conditions in RPC layer. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 015d93a715 HDFS-10222. libhdfs++: Shutdown sockets to avoid 'Connection reset by peer'. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 427edae365 HDFS-9616. libhdfs++: Add runtime hooks to allow a client application to add low level monitoring and tests. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 0f1a278dd5 HDFS-9118: libhdfs++ Add logging system. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen 8f4a66ab8f HDFS-9556: libhdfs++: pull Options from default configs by default. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Bob Hansen f25bff50bf HDFS-9932: added uriparser2 library to HDFS-8707. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Bob Hansen 69ee2e6a7e HDFS-9792: libhdfs++: EACCES not setting errno correctly. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 6a96f978eb HDFS-9699: libhdfs++: Add appropriate catch blocks for asio operations that throw. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 1600e6bba8 HDFS-9791: libhdfs+_+: ConfigurationLoader throws parse_exception on invalid input. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 2cd7ab5e94 HDFS-9753. libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
Bob Hansen 22ae319360 HDFS-9737: libhdfs++: Create examples of consuming libhdfs++ (pt 2). Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen f591b95e08 HDFS-9749: libhdfs++: RPC engine will attempt to close an asio socket before it's been opened. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen 288a9a9ee7 HDFS-9741: libhdfs++: GetLastError not returning meaningful messages after some failures. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen d807773752 HDFS-9738: libhdfs++: Implement simple authentication. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 71b4f2ea25 HDFS-9737: libhdfs++: Create examples of consuming libhdfs++. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 7e946c7e30 HDFS-9712. libhdfs++: Reimplement Status object as a normal struct 2018-03-22 17:19:46 -04:00
Bob Hansen ad23cf1490 HDFS-9679: Fix inconsistencies with libhdfs C API. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 166b3d49df HDFS-9643. libhdfs++: Support async cancellation of read operations. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 5cd2a1766c HDFS-9687. libhdfs++: potential segfault after teardown. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 1017ccabeb HDFS-9628. libhdfs++: implement builder apis from C bindings. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James dc335474a6 HDFS-9636. libhdfs++: for consistency, include files should be in hdfspp. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 11671c2bf6 HDFS-9627. libhdfs++: Add mechanism to retrieve human readable error messages through the C API. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James e376c022f4 HDFS-9609. libhdfs++: Allow seek to EOF. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 7d8452040d HDFS-9325. libhdfs++ Allow the location of hadoop source tree resources to be passed to CMake during a build. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 5dc2da1e6f HDFS-9487. libhdfs++ Enable builds with no compiler optimizations. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James e18db92398 HDFS-9523. libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 31d28e3105 HDFS-9524. libhdfs++ deadlocks in Filesystem::New if NN connection fails. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James dba377bfcc HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 6c80d02a03 HDFS-9538. libhdfs: load configuration from files. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 567c3ed44f HDFS-9537. libhdfs++ implement HDFSConfiguration class. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 6c33f89aea HDFS-9417. Clean up the RAT warnings in the HDFS-8707 branch. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 7cd98323ec HDFS-9489. Enable CI infrastructure to use libhdfs++ hdfsRead. Contributed by Stephen Walkauskas. 2018-03-22 17:19:46 -04:00
James d6a04cdbdd HDFS-9460. Suppress warnings from third-party libraries. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James c59bd00a56 HDFS-9486. Fix valgrind failures when using more than 1 io_service worker thread. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 58f2c7183e HDFS-9228. libhdfs++ should respect NN retry configuration settings. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James eb70a64362 HDFS-9504. Initialize BadNodeTracker in FileSystemImpl constructor. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 8dac1094d8 HDFS-9497. move lib/proto/cpp_helpers to third-party since it won't have an ASF license. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James d7ecf396c9 HDFS-9144. Refactoring libhdfs++ into stateful/ephemeral objects. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 5ba8e8ab7b Revert HDFS-9448. 2018-03-22 17:19:46 -04:00
James 9a0a34bbfa HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
James 584c2a204d HDFS-9452. libhdfs++ Fix memory stomp in OpenFileForRead. Contributed by James Clampffer 2018-03-22 17:19:45 -04:00
James 87362b1c17 HDFS-9117. Config file reader / options classes for libhdfs++. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
James a38703fdfc HDFS-9359. Test libhdfs++ with existing libhdfs tests. Contributed by Stephen Walkauskas. 2018-03-22 17:19:45 -04:00
James 64f0e78490 HDFS-9368. Implement reads with implicit offset state in libhdfs++. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 6f44d92071 HDFS-9103. Retry reads on DN failure. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 7dd29e548c HDFS-9408. Build both static and dynamic libraries for libhdfspp. Contributed by Stephen Walkauskas. 2018-03-22 17:19:45 -04:00
Haohui Mai af9bc25ac5 HDFS-9419. Import the optional library into libhdfs++. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
Haohui Mai a0b8f56317 HDFS-9328. Formalize coding standards for libhdfs++. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai a59714dcdb HDFS-9320. libhdfspp should use sizeof(int32_t) instead of sizeof(int) when parsing data. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 5f1d0957b2 HDFS-9340. libhdfspp fails to compile after HDFS-9207. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai dbd1d0c75b HDFS-8766. Implement a libhdfs(3) compatible API. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 422a6e4ed5 HDFS-9288. Import RapidXML 1.13 for libhdfspp. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
Haohui Mai a14d1f741f HDFS-9265. InputStreamImpl should hold a shared_ptr of the BlockReader. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 08794423e8 HDFS-9207. Move the implementation to the hdfs-native-client module. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 9e929a7a0d HDFS-9095. RPC client should fail gracefully when the connection is timed out or reset. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 06326b37c9 HDFS-9108. InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 6294141aeb HDFS-9116. Suppress false positives from Valgrind on uninitialized variables in tests. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 9480c116ac HDFS-9093. Initialize protobuf fields in RemoteBlockReaderTest. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai a559ef0243 HDFS-9025. Fix compilation issues on arch linux. Contributed by Owen O'Malley. 2018-03-22 17:19:45 -04:00
Haohui Mai bc47acc9d9 HDFS-8952. InputStream.PositionRead() should be aware of available DNs. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 1efb677976 HDFS-8774. Implement FileSystem and InputStream API for libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai bccc640648 HDFS-8775. SASL support for data transfer protocol in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 26d9f6cee3 HDFS-8788. Implement unit tests for remote block reader in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 1bec75a13c HDFS-8764. Generate Hadoop RPC stubs from protobuf definitions. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 65b864f341 HDFS-8759. Implement remote block reader in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai a6b2fb64c4 HDFS-8758. Implement the continuation library in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 63eee296c7 HDFS-8745. Use Doxygen to generate documents for libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 40a1f3631d HDFS-8737. Initial implementation of a Hadoop RPC v9 client. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 95b479b8c1 HDFS-8725. Use std::chrono to implement the timer in the asio library. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00