2614 Commits

Author SHA1 Message Date
Haohui Mai
7f8d5dc802 HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai. 2014-11-20 19:21:35 -08:00
Haohui Mai
4b99bde929 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:28:03 -08:00
Andrew Wang
988682ac29 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated.
(cherry picked from commit 765aecb4e127ebaf6c7b060a8b5cd40c6428e296)
2014-11-19 17:53:25 -08:00
Andrew Wang
fbce4df711 HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang.
(cherry picked from commit 5bd048e8378034b496bacc73b470a25d855aceb1)
2014-11-18 22:17:04 -08:00
Andrew Wang
2e15754a92 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
(cherry picked from commit 406c09ad1150c4971c2b7675fcb0263d40517fbf)
2014-11-18 22:14:17 -08:00
cnauroth
69eb56ad6d HDFS-7398. Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit. Contributed by Gera Shegalov.
(cherry picked from commit 9e81be01144d5cf520313608e85cdc1d8063aa15)
2014-11-18 16:59:54 -08:00
Haohui Mai
6a32f77de8 HDFS-7406. SimpleHttpProxyHandler puts incorrect "Connection: Close" header. Contributed by Haohui Mai. 2014-11-18 14:53:19 -08:00
Haohui Mai
22e99e9839 HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. 2014-11-18 11:05:25 -08:00
Andrew Wang
f157ce08f8 Revert "HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu."
This reverts commit ad32886ae637c9a6d529a94798c75905ee6c51b3.
2014-11-18 10:52:48 -08:00
Andrew Wang
1e14792be6 HADOOP-11312. Fix unit tests to not use uppercase key names.
(cherry picked from commit bcd402ae380ead1234bfdfc53f485d3fb1391288)
2014-11-18 10:48:10 -08:00
Haohui Mai
ad32886ae6 HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. 2014-11-17 17:35:53 -08:00
Andrew Wang
541172f2ee HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang)
(cherry picked from commit dcb8e24427b02e2f3ff9a12d2eb1eb878e3443bb)
2014-11-17 17:34:02 -08:00
Brandon Li
7b2a884077 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang
(cherry picked from commit 351c5561c2fd380ab7746ca4e91d7b838e61e03f)
2014-11-17 13:25:43 -08:00
Haohui Mai
6eb88c278c HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 12:56:03 -08:00
Vinayakumar B
5bb47d0418 HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B)
(cherry picked from commit 6783d17fcf5b25165767888f756a6b7802ab1371)
2014-11-17 20:20:36 +05:30
Colin Patrick Mccabe
5d3c130e8f HDFS-7394. Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache (Keith Pak via Colin P. McCabe)
(cherry picked from commit 26d3b7e6ae867596bbced0bfddde22d3c0d976bb)
2014-11-16 21:21:24 -08:00
cnauroth
72207f65aa HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang.
(cherry picked from commit 1925e2a4ae78ef4178393848b4d1d71b0f4a4709)
2014-11-14 16:46:24 -08:00
Haohui Mai
7aa6da654d HDFS-7395. BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit. Contributed by Haohui Mai. 2014-11-13 14:43:22 -08:00
Arun C. Murthy
fc324d7062 Preparing to release hadoop-2.6.0-rc1.
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)
2014-11-13 13:03:13 -08:00
cnauroth
4e9001530f HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permission mess up. Contributed by jiangyu.
(cherry picked from commit b0a41de68c5b08f534ca231293de053c0b0cbd5d)
2014-11-13 12:35:39 -08:00
Tsz-Wo Nicholas Sze
679684ab10 HDFS-7358. Clients may get stuck waiting when using ByteArrayManager. 2014-11-13 12:30:59 -08:00
cnauroth
69a7780ee5 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:44:05 -08:00
Haohui Mai
744ff32187 Fix CHANGES.txt to keep it consistent with trunk. 2014-11-12 20:12:34 -08:00
Haohui Mai
c18dd3fc5e HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb. 2014-11-12 20:06:25 -08:00
Arun C. Murthy
7c6f03ba20 HDFS-7391. Renable SSLv2Hello in HttpFS. Contributed by Robert Kanter.
(cherry picked from commit 9f0319bba1788e4c579ce533b14c0deab63f28ee)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-12 18:59:27 -08:00
Arun C. Murthy
09f36b1688 HDFS-7387. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 11:41:20 -08:00
Haohui Mai
3cb426be45 HDFS-7375. Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement. Contributed by Haohui Mai. 2014-11-11 18:42:49 -08:00
cnauroth
7e1e0cbbb8 HDFS-7389. Named user ACL cannot stop the user from accessing the FS entity. Contributed by Vinayakumar B.
(cherry picked from commit 163bb55067bde71246b4030a08256ba9a8182dc8)
2014-11-11 13:32:26 -08:00
Brandon Li
0c3b7887e6 HDFS-7387. NFS may only do partial commit due to a race between COMMIT and write. Contributed by Brandon Li
(cherry picked from commit 99d9d0c2d19b9f161b765947f3fb64619ea58090)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
2014-11-11 13:10:09 -08:00
Haohui Mai
14a9ff1b9c HDFS-7381. Decouple the management of block id and gen stamps from FSNamesystem. Contributed by Haohui Mai. 2014-11-11 12:42:02 -08:00
Haohui Mai
d47a34fc66 HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:43:16 -08:00
Karthik Kambatla
92de44c2c5 Set the release date for 2.5.2
(cherry picked from commit 68a050872896f93582f95420dd6e2bdefa4fd7cc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-10 15:23:43 -08:00
Arun C. Murthy
adfb830a2b Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT. 2014-11-09 19:19:02 -08:00
Arun C. Murthy
cff08dab5e Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.
(cherry picked from commit 770cc144425b6188d9b93178c77a35cd830a60df)
2014-11-09 18:48:01 -08:00
Arun C. Murthy
1fc98b5c9a Revert "HDFS-7383. Merged to branch-2.6 also."
This reverts commit 755af2768b2be1ded532e795db30ec0bfea03e66.
2014-11-09 18:25:05 -08:00
Arun C. Murthy
755af2768b HDFS-7383. Merged to branch-2.6 also.
(cherry picked from commit f62ec31739cc15097107655c6c8265b5d3625817)
2014-11-09 18:22:58 -08:00
Suresh Srinivas
d8e699be73 HDFS-7383. Moved the jira from release 2.7.0 section to 2.6.0 in CHANGES.txt 2014-11-09 18:22:18 -08:00
Suresh Srinivas
d4f2e791a5 HDFS-7383. DataNode.requestShortCircuitFdsForRead may throw NullPointerException. Contributed by Tsz Wo Nicholas Sze. 2014-11-09 17:55:49 -08:00
Arun C. Murthy
1f5bad04ce HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs.
(cherry picked from commit 6caa8100d5d2547e34356dc279fd5e65b81a925a)
2014-11-09 05:23:10 -08:00
cnauroth
98b81c6624 HDFS-7382. DataNode in secure mode may throw NullPointerException if client connects before DataNode registers itself with NameNode. Contributed by Chris Nauroth.
(cherry picked from commit 9ba8d8c7eb65eeb6fe673f04e493d9eedd95a822)
2014-11-08 22:29:15 -08:00
Haohui Mai
52d5425aad HDFS-7379. TestBalancer#testBalancerWithRamDisk creates test files incorrectly. Contributed by Xiaoyu Yao. 2014-11-07 13:39:23 -08:00
cnauroth
c7752f9180 HDFS-7226. Update CHANGES.txt to indicate fix in 2.6.0.
(cherry picked from commit d026f3676278e24d7032dced5f14b52dec70b987)
2014-11-06 23:10:48 -08:00
cnauroth
58e8b280c7 HDFS-7221. Update CHANGES.txt to indicate fix in 2.6.0.
(cherry picked from commit e7f1c0482e5dff8a1549ace1fc2b366941170c58)
2014-11-06 22:47:24 -08:00
Jing Zhao
10fe37522c HDFS-7364. Balancer always shows zero Bytes Already Moved. Contributed by Tsz Wo Nicholas Sze.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
2014-11-06 17:55:49 -08:00
Haohui Mai
d0101f1ce3 HDFS-7365. Remove hdfs.server.blockmanagement.MutableBlockCollection. Contributed by Li Lu. 2014-11-06 13:53:51 -08:00
Milan Desai
5c8b55856b HDFS-7336. Unused member DFSInputStream.buffersize. Contributed by Milan Desai. 2014-11-05 20:52:36 -08:00
Byron Wong
693939782b HDFS-7329. Improve logging when MiniDFSCluster fails to start. Contributed by Byron Wong. 2014-11-05 20:52:34 -08:00
Haohui Mai
ee44d8fb3f HDFS-7367. HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol. Contributed by Chris Nauroth. 2014-11-05 20:34:11 -08:00
Konstantin V Shvachko
74d40b3d9e HDFS-7361. TestCheckpoint fails after change of log message related to locking violation. Contributed by Konstantin Shvachko. 2014-11-05 20:23:13 -08:00
Haohui Mai
0f9d0d9d8f HDFS-7366. BlockInfo should take replication as an short in the constructor. Contributed by Li Lu. 2014-11-05 18:13:55 -08:00