Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,946 Commits 326 Branches 371 Tags
Commit Graph

199 Commits

Author SHA1 Message Date
Haohui Mai
d469e9e4ca HDFS-7988. Replace usage of ExactSizeInputStream with LimitInputStream. Contributed by Walter Su. 2015-11-23 10:50:23 -08:00
Haohui Mai
2c185222f9 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:06:36 -08:00
Akira Ajisaka
c74e42b4a2 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
 2015-11-19 20:55:36 +09:00
cnauroth
7b94ae17ab HDFS-9400. TestRollingUpgradeRollback fails on branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bad2afe39a3a589ca9d25de297a080b974645fea)
 2015-11-18 11:00:18 -08:00
Xiaoyu Yao
48a494cdc3 HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 41d3f8899d8b96568f56331eaf598bb356ecdae0)
 2015-11-10 16:48:06 -08:00
Zhe Zhang
edd4b2d458 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen. 
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
 2015-11-10 09:55:39 -08:00
Kihwal Lee
ceb062f093 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e3824475581454c1e17a0d7c94529efde)
 2015-11-09 08:57:25 -06:00
cnauroth
385dcc4064 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 
(cherry picked from commit 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)
 2015-11-07 07:39:45 -08:00
Tsz-Wo Nicholas Sze
9766fc988f HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:22:36 +08:00
cnauroth
75bcc8bcd8 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 
(cherry picked from commit 66c096731052fb187dc49f5bcaec8432c4b92d0c)
 2015-11-05 22:07:34 -08:00
cnauroth
6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796c58119d1b42dda55d6916bdab56dfe)
 2015-11-05 06:48:32 -08:00
Zhe Zhang
4f29f5d192 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: I0591b1f9c6a0a8b368408b195151de2e0aa440c4
 2015-11-03 14:23:02 -08:00
Haohui Mai
9e911a2439 HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:53 -07:00
Ming Ma
2c335a8434 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 
(cherry picked from commit aa09880ab85f3c35c12373976e7b03f3140b65c8)
 2015-10-27 09:29:37 -07:00
Yongjun Zhang
b50af4e04a HDFS-7284. Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 5e718de522328d1112ad38063596c204aa43f539)
 2015-10-26 13:36:25 -07:00
Arpit Agarwal
b727dfd61c HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 21:40:26 -07:00
Haohui Mai
558ae8c2df HDFS-9301. HDFS clients can't construct HdfsConfiguration instances. Contributed by Mingliang Liu. 2015-10-23 14:53:15 -07:00
Kihwal Lee
d24d0fd981 HDFS-9290. DFSClient#callAppend() is not backward compatible for slightly older NameNodes. Contributed by Tony Wu. 
(cherry picked from commit b9e0417bdf2b9655dc4256bdb43683eca1ab46be)
 2015-10-23 16:38:47 -05:00
Andrew Wang
c35771c46e HDFS-9250. Add Precondition check to LocatedBlock#addCachedLoc. Contributed by Xiao Chen. 
(cherry picked from commit 8175c4f6b9fc17ff2e0fc568d798f9b6f2487696)
 2015-10-19 16:13:14 -07:00
Andrew Wang
12d3b69217 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 
(cherry picked from commit c32614f410fb62a7179abfefbab42a05415a3066)
 2015-10-09 11:57:07 -07:00
Jing Zhao
a4b8dc48f1 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 
(cherry picked from commit 239d119c6707e58c9a5e0099c6d65fe956e95140)
 2015-10-06 23:55:33 -07:00
Vinayakumar B
96fbe42bd7 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 874c8ed2399ff5f760d358abae3e98c013f48d22)
 2015-10-06 15:55:12 +05:30
Haohui Mai
1257483ebf HDFS-8979. Clean up checkstyle warnings in hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-10-03 11:37:19 -07:00
cnauroth
7273ef0590 HDFS-9175. Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public. Contributed by Santhosh Nayak. 
(cherry picked from commit c7e03c3a6cf8ccd73a1734a1d19bd8d753b2974c)
 2015-09-30 16:06:45 -07:00
Haohui Mai
37d42fcec1 HDFS-8971. Remove guards when calling LOG.debug() and LOG.trace() in client package. Contributed by Mingliang Liu. 2015-09-29 17:52:42 -07:00
Haohui Mai
58bdc9c672 Revert "HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai." 
This reverts commit cf873fff9f211e0832d00c7808eee2cc63ad3237.
 2015-09-29 17:51:31 -07:00
Haohui Mai
cf873fff9f HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-09-29 17:48:35 -07:00
Haohui Mai
cf6fb09162 HDFS-9166. Move hftp / hsftp filesystem to hfds-client. Contributed by Mingliang Liu. 2015-09-29 10:07:19 -07:00
Haohui Mai
c705eab221 HDFS-9165. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-29 09:51:30 -07:00
Colin Patrick Mccabe
171bd1cb2b HADOOP-12447. Clean up some htrace integration issues (cmccabe) 
(cherry picked from commit 850d679acb935a6a6b0e6cb6f69d998e99395468)
 2015-09-29 09:38:10 -07:00
Kihwal Lee
95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 
(cherry picked from commit 3abbdc929bde05f8819f5410cef1eaeb8940203f)
 2015-09-28 17:33:20 -05:00
Lei Xu
213ff984ee HDFS-9147. Fix the setting of visibleLength in ExternalBlockReader. (Colin P. McCabe via Lei (Eddy) Xu) 
(cherry picked from commit e5992ef4df63fbc6a6b8e357b32c647e7837c662)
 2015-09-28 13:43:52 -07:00
Kihwal Lee
468b330feb HDFS-9106. Transfer failure during pipeline recovery causes permanent write failures. Contributed by Kihwal Lee. 
(cherry picked from commit 4c9497cbf02ecc82532a4e79e18912d8e0eb4731)
 2015-09-28 14:30:06 -05:00
Colin Patrick Mccabe
3b9d32627f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 
(cherry picked from commit 892ade689f9bcce76daae8f66fc00a49bee8548e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 2015-09-28 08:15:00 -07:00
Haohui Mai
504d6fd950 HDFS-8740. Move DistributedFileSystem to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-27 10:54:53 -07:00
Haohui Mai
94cbb6d164 HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-26 11:16:50 -07:00
Lei Xu
82d4c05b2d HDFS-9133. ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF. (Colin Patrick McCabe via Lei (Eddy) Xu) 
(cherry picked from commit 67b0e967f0e13eb6bed123fc7ba4cce0dcca198f)
 2015-09-25 16:02:27 -07:00
Lei Xu
1a2870f6ff HDFS-9132. Pass genstamp to ReplicaAccessorBuilder. (Colin Patrick McCabe via Lei (Eddy) Xu) 2015-09-25 15:51:29 -07:00
Yongjun Zhang
bc5ee80794 HDFS-5795. RemoteBlockReader2#checkSuccess() shoud print error status. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 83e65c5fe84819b6c6da015b269fb4e46a88d105)
 2015-09-24 22:15:28 -07:00
Haohui Mai
85c73d159e HDFS-9134. Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants. Contributed by Mingliang Liu. 2015-09-24 20:29:52 -07:00
Haohui Mai
d148b6a234 HDFS-9131. Move config keys used by hdfs-client to HdfsClientConfigKeys. Contributed by Mingliang Liu. 2015-09-24 00:30:17 -07:00
Haohui Mai
090b1f6398 HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu. 2015-09-22 20:57:11 -07:00
Haohui Mai
ed7211563c HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu. 2015-09-22 20:52:46 -07:00
Haohui Mai
4e752a37e7 HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu. 2015-09-21 19:43:14 -07:00
Lei Xu
0095936a6a HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). 
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
(cherry picked from commit 3a9c7076e81c1cc47c0ecf30c60abd9a65d8a501)
 2015-09-19 18:09:56 -07:00
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
cnauroth
b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. 
(cherry picked from commit 559c09dc0eba28666c4b16435512cc2d35e31683)
 2015-09-15 15:13:56 -07:00
Haohui Mai
323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Arpit Agarwal
d732c7b9de HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu) 2015-09-11 10:12:02 -07:00
Vinayakumar B
03f50de48d HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) 
(cherry picked from commit 0f0e897bf1ff8383f3f524ba83161969531b0772)
 2015-09-09 22:59:55 +05:30