Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,799 Commits 326 Branches 371 Tags
Commit Graph

317 Commits

Author SHA1 Message Date
Eric Yang
da61953a0b HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:26:46 -08:00
Kihwal Lee
b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00
Kihwal Lee
3d8d8f1497 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
 2016-01-21 09:33:30 -06:00
Colin Patrick Mccabe
c56044b9ee HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe) 
(cherry picked from commit 7905788db94d560e6668af0d4bed22b326961aaf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
 2016-01-20 11:27:51 -08:00
Kihwal Lee
8d04b7c272 HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472996562eb3d610649246770c2888c6b)
 2016-01-08 11:15:12 -06:00
Uma Mahesh
cdd796d199 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
 2016-01-04 15:04:46 -08:00
Kihwal Lee
131260f0a7 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4b20ece0039a876def129fa5eb9234f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2015-12-22 14:19:12 -06:00
Colin Patrick Mccabe
31d2fb91fc HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe) 
(cherry picked from commit e63388fdf22b5fd20ca00f9fad9f40656f117d95)
 2015-12-18 10:05:12 -08:00
cnauroth
e8e3737ce8 HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp. 
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
 2015-12-16 11:11:27 -08:00
Andrew Wang
2796c1099f HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
 2015-12-15 14:39:04 -08:00
cnauroth
1072be12b9 HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. Contributed by Xiaobing Zhou. 
(cherry picked from commit 303f80e6567023985f00e5f33ff41a7bbb4d6072)
 2015-12-08 10:50:13 -08:00
Arpit Agarwal
6999e764cb HDFS-9414. Add missing license header 2015-12-05 09:24:44 -08:00
Arpit Agarwal
71be31201a HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. (Contributed by Xiaobing Zhou) 2015-12-04 20:53:43 -08:00
Xiaoyu Yao
eb7f9901b4 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97a80c39d4bbb3005e42dacae6726baf)
 2015-12-04 16:57:58 -08:00
Tsz-Wo Nicholas Sze
bac127a4e2 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-02 17:49:16 -08:00
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Xiaoyu Yao
4f1f9f7eff HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao. 
(cherry picked from commit e3d673901b396cf5bbede5ed6f607ce68301ec0a)
 2015-11-25 13:54:22 -08:00
Uma Mahesh
52c889ac14 HDFS-9433. DFS getEZForPath API on a non-existent file should throw FileNotFoundException (Rakesh R via umamahesh) 
(cherry picked from commit 411e2b2e7cd63273a3819f99a3275821dfbcc9ce)
 2015-11-23 18:46:48 -08:00
Haohui Mai
d469e9e4ca HDFS-7988. Replace usage of ExactSizeInputStream with LimitInputStream. Contributed by Walter Su. 2015-11-23 10:50:23 -08:00
Haohui Mai
2c185222f9 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:06:36 -08:00
Akira Ajisaka
c74e42b4a2 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
 2015-11-19 20:55:36 +09:00
cnauroth
7b94ae17ab HDFS-9400. TestRollingUpgradeRollback fails on branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bad2afe39a3a589ca9d25de297a080b974645fea)
 2015-11-18 11:00:18 -08:00
Xiaoyu Yao
48a494cdc3 HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 41d3f8899d8b96568f56331eaf598bb356ecdae0)
 2015-11-10 16:48:06 -08:00
Zhe Zhang
edd4b2d458 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen. 
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
 2015-11-10 09:55:39 -08:00
Kihwal Lee
ceb062f093 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e3824475581454c1e17a0d7c94529efde)
 2015-11-09 08:57:25 -06:00
cnauroth
385dcc4064 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 
(cherry picked from commit 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)
 2015-11-07 07:39:45 -08:00
Tsz-Wo Nicholas Sze
9766fc988f HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:22:36 +08:00
cnauroth
75bcc8bcd8 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 
(cherry picked from commit 66c096731052fb187dc49f5bcaec8432c4b92d0c)
 2015-11-05 22:07:34 -08:00
cnauroth
6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796c58119d1b42dda55d6916bdab56dfe)
 2015-11-05 06:48:32 -08:00
Zhe Zhang
4f29f5d192 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: I0591b1f9c6a0a8b368408b195151de2e0aa440c4
 2015-11-03 14:23:02 -08:00
Haohui Mai
9e911a2439 HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:53 -07:00
Ming Ma
2c335a8434 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 
(cherry picked from commit aa09880ab85f3c35c12373976e7b03f3140b65c8)
 2015-10-27 09:29:37 -07:00
Yongjun Zhang
b50af4e04a HDFS-7284. Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 5e718de522328d1112ad38063596c204aa43f539)
 2015-10-26 13:36:25 -07:00
Arpit Agarwal
b727dfd61c HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 21:40:26 -07:00
Haohui Mai
558ae8c2df HDFS-9301. HDFS clients can't construct HdfsConfiguration instances. Contributed by Mingliang Liu. 2015-10-23 14:53:15 -07:00
Kihwal Lee
d24d0fd981 HDFS-9290. DFSClient#callAppend() is not backward compatible for slightly older NameNodes. Contributed by Tony Wu. 
(cherry picked from commit b9e0417bdf2b9655dc4256bdb43683eca1ab46be)
 2015-10-23 16:38:47 -05:00
Andrew Wang
c35771c46e HDFS-9250. Add Precondition check to LocatedBlock#addCachedLoc. Contributed by Xiao Chen. 
(cherry picked from commit 8175c4f6b9fc17ff2e0fc568d798f9b6f2487696)
 2015-10-19 16:13:14 -07:00
Andrew Wang
12d3b69217 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 
(cherry picked from commit c32614f410fb62a7179abfefbab42a05415a3066)
 2015-10-09 11:57:07 -07:00
Jing Zhao
a4b8dc48f1 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 
(cherry picked from commit 239d119c6707e58c9a5e0099c6d65fe956e95140)
 2015-10-06 23:55:33 -07:00
Vinayakumar B
96fbe42bd7 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 874c8ed2399ff5f760d358abae3e98c013f48d22)
 2015-10-06 15:55:12 +05:30
Haohui Mai
1257483ebf HDFS-8979. Clean up checkstyle warnings in hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-10-03 11:37:19 -07:00
cnauroth
7273ef0590 HDFS-9175. Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public. Contributed by Santhosh Nayak. 
(cherry picked from commit c7e03c3a6cf8ccd73a1734a1d19bd8d753b2974c)
 2015-09-30 16:06:45 -07:00
Haohui Mai
37d42fcec1 HDFS-8971. Remove guards when calling LOG.debug() and LOG.trace() in client package. Contributed by Mingliang Liu. 2015-09-29 17:52:42 -07:00
Haohui Mai
58bdc9c672 Revert "HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai." 
This reverts commit cf873fff9f211e0832d00c7808eee2cc63ad3237.
 2015-09-29 17:51:31 -07:00
Haohui Mai
cf873fff9f HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-09-29 17:48:35 -07:00
Haohui Mai
cf6fb09162 HDFS-9166. Move hftp / hsftp filesystem to hfds-client. Contributed by Mingliang Liu. 2015-09-29 10:07:19 -07:00
Haohui Mai
c705eab221 HDFS-9165. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-29 09:51:30 -07:00
Colin Patrick Mccabe
171bd1cb2b HADOOP-12447. Clean up some htrace integration issues (cmccabe) 
(cherry picked from commit 850d679acb935a6a6b0e6cb6f69d998e99395468)
 2015-09-29 09:38:10 -07:00
Kihwal Lee
95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 
(cherry picked from commit 3abbdc929bde05f8819f5410cef1eaeb8940203f)
 2015-09-28 17:33:20 -05:00
Lei Xu
213ff984ee HDFS-9147. Fix the setting of visibleLength in ExternalBlockReader. (Colin P. McCabe via Lei (Eddy) Xu) 
(cherry picked from commit e5992ef4df63fbc6a6b8e357b32c647e7837c662)
 2015-09-28 13:43:52 -07:00