Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,031 Commits 326 Branches 371 Tags
Commit Graph

3415 Commits

Author SHA1 Message Date
yliu
9c47ab32b1 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:23:50 +08:00
Yongjun Zhang
1a5f3e93c3 HDFS-9092. Nfs silently drops overlapping write requests and causes data copying to fail. Contributed by Yongjun Zhang. 
(cherry picked from commit 151fca5032719e561226ef278e002739073c23ec)
 2015-09-28 18:47:47 -07:00
Kihwal Lee
95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 
(cherry picked from commit 3abbdc929bde05f8819f5410cef1eaeb8940203f)
 2015-09-28 17:33:20 -05:00
Lei Xu
213ff984ee HDFS-9147. Fix the setting of visibleLength in ExternalBlockReader. (Colin P. McCabe via Lei (Eddy) Xu) 
(cherry picked from commit e5992ef4df63fbc6a6b8e357b32c647e7837c662)
 2015-09-28 13:43:52 -07:00
Lei Xu
74092f2144 HDFS-9148. Incorrect assert message in TestWriteToReplica#testWriteToTemporary (Tony Wu via Lei (Eddy) Xu) 
(cherry picked from commit 50741cb568d4da30b92d4954928bc3039e583b22)
 2015-09-28 13:28:08 -07:00
Kihwal Lee
468b330feb HDFS-9106. Transfer failure during pipeline recovery causes permanent write failures. Contributed by Kihwal Lee. 
(cherry picked from commit 4c9497cbf02ecc82532a4e79e18912d8e0eb4731)
 2015-09-28 14:30:06 -05:00
Colin Patrick Mccabe
3b9d32627f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 
(cherry picked from commit 892ade689f9bcce76daae8f66fc00a49bee8548e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 2015-09-28 08:15:00 -07:00
Haohui Mai
504d6fd950 HDFS-8740. Move DistributedFileSystem to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-27 10:54:53 -07:00
Colin Patrick Mccabe
2dca55be00 HDFS-9087. Add some jitter to DataNode.checkDiskErrorThread (Elliott Clark via Colin P. McCabe) 
(cherry picked from commit 0b31c237f2622e256726fc5d7698f0f195dbdbc1)
 2015-09-26 20:37:54 -07:00
Haohui Mai
94cbb6d164 HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-26 11:16:50 -07:00
Colin Patrick Mccabe
e5dc723d48 HDFS-8873. Allow the directoryScanner to be rate-limited (Daniel Templeton via Colin P. McCabe) 
(cherry picked from commit 7a3c381b39887a02e944fa98287afd0eb4db3560)
 2015-09-26 04:21:23 -07:00
Lei Xu
82d4c05b2d HDFS-9133. ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF. (Colin Patrick McCabe via Lei (Eddy) Xu) 
(cherry picked from commit 67b0e967f0e13eb6bed123fc7ba4cce0dcca198f)
 2015-09-25 16:02:27 -07:00
Lei Xu
1a2870f6ff HDFS-9132. Pass genstamp to ReplicaAccessorBuilder. (Colin Patrick McCabe via Lei (Eddy) Xu) 2015-09-25 15:51:29 -07:00
Colin Patrick Mccabe
a6166aa552 HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe) 
(cherry-picked from 4e7c6a653f108d44589f84d78a03d92ee0e8a3c3)
 2015-09-25 15:33:02 -07:00
Jing Zhao
aca014ea67 HDFS-9112. Improve error message for Haadmin when multiple name service IDs are configured. Contributed by Anu Engineer. 
(cherry picked from commit 83e99d06d0e5a71888aab33e9ae47460e9f1231f)
 2015-09-25 14:21:52 -07:00
Yongjun Zhang
bc5ee80794 HDFS-5795. RemoteBlockReader2#checkSuccess() shoud print error status. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 83e65c5fe84819b6c6da015b269fb4e46a88d105)
 2015-09-24 22:15:28 -07:00
Yongjun Zhang
16ae3f5d46 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 3187dbd7a8b6376134a00e5c9c4693d8eb762c9d)
 2015-09-24 21:41:48 -07:00
Haohui Mai
85c73d159e HDFS-9134. Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants. Contributed by Mingliang Liu. 2015-09-24 20:29:52 -07:00
Arpit Agarwal
3c06162259 HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:58 -07:00
Haohui Mai
13bdc20d2b HDFS-7529. Consolidate encryption zone related implementation into a single class. Contributed by Rakesh R. 2015-09-24 08:46:44 -07:00
Vinayakumar B
a0ff9af827 HDFS-9076. Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit e52bc697f8f9c255dfc4d01b71272931153721c9)
 2015-09-24 17:44:18 +05:30
Haohui Mai
d148b6a234 HDFS-9131. Move config keys used by hdfs-client to HdfsClientConfigKeys. Contributed by Mingliang Liu. 2015-09-24 00:30:17 -07:00
Haohui Mai
7e4bd11b5b HDFS-9130. Use GenericTestUtils#setLogLevel to the logging level. Contributed by Mingliang Liu. 2015-09-24 00:12:29 -07:00
Haohui Mai
3d8f6b9d48 HDFS-9128. TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Contributed by Chris Nauroth. 2015-09-23 19:38:21 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
 2015-09-23 15:12:30 -07:00
Vinayakumar B
017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a2c76e5f26301d4b01e56b347442f3dec171591d)
 2015-09-23 15:45:21 +05:30
Haohui Mai
090b1f6398 HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu. 2015-09-22 20:57:11 -07:00
Haohui Mai
ed7211563c HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu. 2015-09-22 20:52:46 -07:00
Vinayakumar B
96e3fbf401 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 
(cherry picked from commit 57003fa971658c8482240f70445a6822c7692844)
 2015-09-22 16:33:41 +05:30
Vinayakumar B
2893da4f53 HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 10ab7d595ece59f2d00b406ba8812c6295a4187f)
 2015-09-22 12:31:02 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Haohui Mai
4e752a37e7 HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu. 2015-09-21 19:43:14 -07:00
Lei Xu
0095936a6a HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). 
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
(cherry picked from commit 3a9c7076e81c1cc47c0ecf30c60abd9a65d8a501)
 2015-09-19 18:09:56 -07:00
Haohui Mai
41f1f1aabf HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu. 2015-09-18 18:24:09 -07:00
Jing Zhao
b4e1279217 HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao. 
(cherry picked from commit 3f4275310203de4ccfb15337f3c503e25408a265)
 2015-09-18 09:27:10 -07:00
Yongjun Zhang
9859fd006b HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 2015-09-18 07:29:51 -07:00
Vinayakumar B
f40b4f4542 HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) 2015-09-18 16:42:22 +05:30
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Aaron T. Myers
e533555b57 Fix-up for HDFS-9072 - adding missing import of DFSTestUtil. 2015-09-16 12:30:31 -07:00
Haohui Mai
a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran
9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran
1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Haohui Mai
08c2c402cf HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash. 2015-09-15 16:48:33 -07:00
cnauroth
b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. 
(cherry picked from commit 559c09dc0eba28666c4b16435512cc2d35e31683)
 2015-09-15 15:13:56 -07:00
Vinayakumar B
2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 
(cherry picked from commit ce69c9b54c642cfbe789fc661cfc7dcbb07b4ac5)
 2015-09-16 00:18:59 +05:30
Ming Ma
3531823fcc HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma) 
(cherry picked from commit 083b44c136ea5aba660fcd1dddbb2d21513b4456)
 2015-09-15 10:18:44 -07:00
Vinayakumar B
aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a4405674919d14be89bc4da22db2f417b5ae6ac3)
 2015-09-15 17:33:15 +05:30
Haohui Mai
df9bb7449c HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton. 2015-09-14 20:27:24 -07:00
Haohui Mai
5546df0020 HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu. 2015-09-14 18:23:10 -07:00
Colin Patrick Mccabe
149d731559 HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe) 
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
(cherry picked from commit 7b5cf5352efedc7d7ebdbb6b58f1b9a688812e75)
 2015-09-14 16:02:26 -07:00