Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,011 Commits 326 Branches 371 Tags
Commit Graph

3404 Commits

Author SHA1 Message Date
Lei Xu
82d4c05b2d HDFS-9133. ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF. (Colin Patrick McCabe via Lei (Eddy) Xu) 
(cherry picked from commit 67b0e967f0e13eb6bed123fc7ba4cce0dcca198f)
 2015-09-25 16:02:27 -07:00
Lei Xu
1a2870f6ff HDFS-9132. Pass genstamp to ReplicaAccessorBuilder. (Colin Patrick McCabe via Lei (Eddy) Xu) 2015-09-25 15:51:29 -07:00
Colin Patrick Mccabe
a6166aa552 HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe) 
(cherry-picked from 4e7c6a653f108d44589f84d78a03d92ee0e8a3c3)
 2015-09-25 15:33:02 -07:00
Jing Zhao
aca014ea67 HDFS-9112. Improve error message for Haadmin when multiple name service IDs are configured. Contributed by Anu Engineer. 
(cherry picked from commit 83e99d06d0e5a71888aab33e9ae47460e9f1231f)
 2015-09-25 14:21:52 -07:00
Yongjun Zhang
bc5ee80794 HDFS-5795. RemoteBlockReader2#checkSuccess() shoud print error status. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 83e65c5fe84819b6c6da015b269fb4e46a88d105)
 2015-09-24 22:15:28 -07:00
Yongjun Zhang
16ae3f5d46 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 3187dbd7a8b6376134a00e5c9c4693d8eb762c9d)
 2015-09-24 21:41:48 -07:00
Haohui Mai
85c73d159e HDFS-9134. Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants. Contributed by Mingliang Liu. 2015-09-24 20:29:52 -07:00
Arpit Agarwal
3c06162259 HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:58 -07:00
Haohui Mai
13bdc20d2b HDFS-7529. Consolidate encryption zone related implementation into a single class. Contributed by Rakesh R. 2015-09-24 08:46:44 -07:00
Vinayakumar B
a0ff9af827 HDFS-9076. Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit e52bc697f8f9c255dfc4d01b71272931153721c9)
 2015-09-24 17:44:18 +05:30
Haohui Mai
d148b6a234 HDFS-9131. Move config keys used by hdfs-client to HdfsClientConfigKeys. Contributed by Mingliang Liu. 2015-09-24 00:30:17 -07:00
Haohui Mai
7e4bd11b5b HDFS-9130. Use GenericTestUtils#setLogLevel to the logging level. Contributed by Mingliang Liu. 2015-09-24 00:12:29 -07:00
Haohui Mai
3d8f6b9d48 HDFS-9128. TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Contributed by Chris Nauroth. 2015-09-23 19:38:21 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
 2015-09-23 15:12:30 -07:00
Vinayakumar B
017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a2c76e5f26301d4b01e56b347442f3dec171591d)
 2015-09-23 15:45:21 +05:30
Haohui Mai
090b1f6398 HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu. 2015-09-22 20:57:11 -07:00
Haohui Mai
ed7211563c HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu. 2015-09-22 20:52:46 -07:00
Vinayakumar B
96e3fbf401 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 
(cherry picked from commit 57003fa971658c8482240f70445a6822c7692844)
 2015-09-22 16:33:41 +05:30
Vinayakumar B
2893da4f53 HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 10ab7d595ece59f2d00b406ba8812c6295a4187f)
 2015-09-22 12:31:02 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Haohui Mai
4e752a37e7 HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu. 2015-09-21 19:43:14 -07:00
Lei Xu
0095936a6a HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). 
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
(cherry picked from commit 3a9c7076e81c1cc47c0ecf30c60abd9a65d8a501)
 2015-09-19 18:09:56 -07:00
Haohui Mai
41f1f1aabf HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu. 2015-09-18 18:24:09 -07:00
Jing Zhao
b4e1279217 HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao. 
(cherry picked from commit 3f4275310203de4ccfb15337f3c503e25408a265)
 2015-09-18 09:27:10 -07:00
Yongjun Zhang
9859fd006b HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 2015-09-18 07:29:51 -07:00
Vinayakumar B
f40b4f4542 HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) 2015-09-18 16:42:22 +05:30
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Aaron T. Myers
e533555b57 Fix-up for HDFS-9072 - adding missing import of DFSTestUtil. 2015-09-16 12:30:31 -07:00
Haohui Mai
a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran
9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran
1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Haohui Mai
08c2c402cf HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash. 2015-09-15 16:48:33 -07:00
cnauroth
b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. 
(cherry picked from commit 559c09dc0eba28666c4b16435512cc2d35e31683)
 2015-09-15 15:13:56 -07:00
Vinayakumar B
2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 
(cherry picked from commit ce69c9b54c642cfbe789fc661cfc7dcbb07b4ac5)
 2015-09-16 00:18:59 +05:30
Ming Ma
3531823fcc HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma) 
(cherry picked from commit 083b44c136ea5aba660fcd1dddbb2d21513b4456)
 2015-09-15 10:18:44 -07:00
Vinayakumar B
aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a4405674919d14be89bc4da22db2f417b5ae6ac3)
 2015-09-15 17:33:15 +05:30
Haohui Mai
df9bb7449c HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton. 2015-09-14 20:27:24 -07:00
Haohui Mai
5546df0020 HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu. 2015-09-14 18:23:10 -07:00
Colin Patrick Mccabe
149d731559 HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe) 
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
(cherry picked from commit 7b5cf5352efedc7d7ebdbb6b58f1b9a688812e75)
 2015-09-14 16:02:26 -07:00
Colin Patrick Mccabe
2596695654 HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53bad4eb008ec553dcdbe01e7ae975dcecde6590)
 2015-09-14 15:52:39 -07:00
Steve Loughran
c951d56556 HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel) 2015-09-14 10:36:34 +01:00
Haohui Mai
323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Vinayakumar B
7545488b12 HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina) 
(cherry picked from commit c7156503856e24faf844c5c647157b310d8b537f)
 2015-09-12 17:40:41 +05:30
Vinayakumar B
1857621671 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) 
(cherry picked from commit d8455479b83e369fe9b5fe305c7beece93722fed)
 2015-09-12 12:36:37 +05:30
Kihwal Lee
50a367da20 Fix up CHANGES.txt 2015-09-11 16:02:05 -05:00
Arpit Agarwal
d732c7b9de HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu) 2015-09-11 10:12:02 -07:00
Vinod Kumar Vavilapalli
d5823452b9 HDFS-7314. Moving to 2.6.1 CHANGES.txt section. 
(cherry picked from commit f103a70af5c5b01931b5cd2e5782eac5aeeb31cd)
 2015-09-10 16:47:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed111884d0375c177239073153139848)
 2015-09-10 14:01:15 -07:00
Kihwal Lee
633344aa57 HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee 
(cherry picked from commit a40342b0dab1f9137ae4b3679a5aca7f2a57d23d)
 2015-09-10 09:18:10 -05:00
Akira Ajisaka
c260a8aa93 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:50:57 +09:00