Commit Graph

4178 Commits

Author SHA1 Message Date
Mingliang Liu 059d33bb8b HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger
(cherry picked from commit 012d28a1fa)
2016-12-20 14:29:33 -08:00
Xiao Chen aec0d06a34 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu.
(cherry picked from commit 5b7acdd206)
2016-12-20 12:27:44 -08:00
Brahma Reddy Battula a43bbea3c8 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1b401f6a73)
2016-12-20 21:16:54 +05:30
Akira Ajisaka 1e3304ad23 HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit d2026ae9e6)
(cherry picked from commit a95acbcb6e)
2016-12-20 14:37:57 +09:00
Akira Ajisaka 07a221e6aa HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit 36947f79ba)
(cherry picked from commit eaa50a1087)
2016-12-16 00:41:03 +09:00
Akira Ajisaka 901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
(cherry picked from commit 72bff192cd)
(cherry picked from commit 190b2dca62)
2016-12-14 18:54:39 +09:00
Andrew Wang 158292fd7e HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge.
(cherry picked from commit fbdbbd57cd)
(cherry picked from commit 6b795c34d0)
2016-12-13 18:01:40 -08:00
Wei-Chiu Chuang fa3b2bee61 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 292bd78b44)
2016-12-09 16:12:09 -08:00
Andrew Wang e8b0ef0618 HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:56:49 -08:00
Andrew Wang bced9e2e5b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N.
(cherry picked from commit 5bd7dece92)
(cherry picked from commit 85adc6677b)
2016-12-09 12:05:50 -08:00
Vinayakumar B b1c08737d8 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B)
(cherry picked from commit d1d4aba71b)
(cherry picked from commit 199d8b5594)
2016-12-09 14:58:28 +05:30
Xiao Chen 892ee3f191 HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil.
(cherry picked from commit 401c731872)
2016-12-08 12:41:31 -08:00
Akira Ajisaka 59b0857c6b HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
(cherry picked from commit 9ef89ede2f)
(cherry picked from commit e00a124cb5)
2016-12-08 13:42:02 +09:00
Vinayakumar B 7dc22dbe0c HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula)
(cherry picked from commit 6d2332ae37)
(cherry picked from commit 4b21b47f56)
2016-12-07 15:58:29 -08:00
Kihwal Lee ac9801fec8 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:08:28 -06:00
Andrew Wang 1a7b2ab9bb Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang"
This reverts commit 3b80424d4f.
2016-12-05 23:09:30 -08:00
Andrew Wang 79f830ed22 HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang.
(cherry picked from commit 8e63fa98ea)
(cherry picked from commit 2fdae7324b)
2016-12-05 18:14:09 -08:00
Mingliang Liu 3b80424d4f HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang
(cherry picked from commit c7ff34f8dc)
(cherry picked from commit be969e5918)
2016-12-02 11:38:36 -08:00
Akira Ajisaka 5025a898e1 HDFS-11180. Intermittent deadlock in NameNode when failover happens.
(cherry picked from commit 5a7941a4fc)
2016-12-02 11:35:22 +09:00
Kihwal Lee dd4acebb41 HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp.
(cherry picked from commit 0d8a35bd6d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
2016-12-01 12:20:30 -06:00
Robert Kanter 92ee5e2077 HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
(cherry picked from commit 47ca9e26fb)
(cherry picked from commit 285edf691d)
2016-11-28 18:23:23 -08:00
Akira Ajisaka 011d478aab HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin.
(cherry picked from commit 636f7547b7)
(cherry picked from commit 0df7f5cdf6)
2016-11-25 17:50:43 +09:00
Brahma Reddy Battula 9be7b353dd HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
(cherry picked from commit afcf8d38e7)
2016-11-22 20:36:32 +05:30
Kihwal Lee f5410f0814 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang.
(cherry picked from commit 774b0cd845)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-11-21 10:52:42 -06:00
Brahma Reddy Battula ce4cd98784 HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula.
(cherry picked from commit f922067748)
2016-11-21 19:36:57 +05:30
Brahma Reddy Battula 23ddb98e1b HDFS-11144. TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception. Contributed By Brahma Reddy Battula.
(cherry picked from commit c68dad18ab)
2016-11-21 11:00:15 +05:30
Brahma Reddy Battula f0e2271149 HDFS-11134. Fix bind exception threw in TestRenameWhileOpen. Contributed By Yiqun Lin.
(cherry picked from commit b2d4b7b1b9)
2016-11-17 10:26:50 +05:30
Mingliang Liu a8dadd8c53 HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin
(cherry picked from commit c90891e7b3)
2016-11-16 13:13:19 -08:00
Kihwal Lee 15f08e9298 HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla.
(cherry picked from commit 4fcea8a0c8)
2016-11-15 14:57:04 -06:00
Zhe Zhang c6e7b631bd HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
(cherry picked from commit 818915aabb)
2016-11-14 16:39:26 -08:00
Brahma Reddy Battula 4dc40fe28e HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin
(cherry picked from commit 6efb8c9c60)
2016-11-14 20:42:50 +05:30
Erik Krogen 3d52459712 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen.
(cherry picked from commit 98d9e9c4c8)
2016-11-13 14:54:49 -08:00
Mingliang Liu 4bcef1c616 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu
(cherry picked from commit fb3a5085e8)
2016-11-12 10:37:46 -08:00
Mingliang Liu fcedb6812b HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula
(cherry picked from commit 2ee18fc15e)
2016-11-11 22:19:39 -08:00
Xiaoyu Yao c443ecb267 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang.
(cherry picked from commit 4484b48498)
2016-11-11 14:32:11 -08:00
Mingliang Liu ae7a20f524 HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin
(cherry picked from commit aa6010ccca)
2016-11-11 12:35:21 -08:00
Brahma Reddy Battula 121b56de14 HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru.
(cherry picked from commit 1ae57f0f75)
2016-11-11 20:11:13 +05:30
Xiao Chen d81706cd99 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge.
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
2016-11-09 17:16:36 -08:00
Wei-Chiu Chuang 1d75da8e26 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 16430c64b7)
2016-11-09 13:32:35 -08:00
Mingliang Liu ad992e05a6 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou
(cherry picked from commit 62d8c17dfd)
2016-11-08 17:10:59 -08:00
Mingliang Liu 00625004b7 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou
(cherry picked from commit 0c0ab102ab)
2016-11-04 14:45:43 -07:00
Mingliang Liu b082d4b746 HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang
(cherry picked from commit 7534aee09a)
2016-11-03 13:55:43 -07:00
Arpit Agarwal 3f2bfdba3e HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:33:28 -07:00
Brahma Reddy Battula 77142827e8 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu.
(cherry picked from commit 35e6081020)
2016-11-02 10:40:22 +05:30
Mingliang Liu 10eb21e52e HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou
(cherry picked from commit fa1512a740)
2016-11-01 14:50:16 -07:00
Kihwal Lee db6dfeca1a HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp.
(cherry picked from commit 7c1a1834e4)
2016-11-01 08:26:25 -05:00
Brahma Reddy Battula c895f08936 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R.
(cherry picked from commit 1c5708f6de)
2016-11-01 10:53:37 +05:30
Kihwal Lee 91640a0170 Addendum of HDFS-10722 to include HDFS-7964 logic.
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
(cherry picked from commit c2bb9bf00c)
2016-10-31 16:37:00 -07:00
Zhe Zhang 7900b1e803 Revert "HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp."
This reverts commit c2bb9bf00c.
2016-10-31 16:35:05 -07:00
Kihwal Lee c2bb9bf00c HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp.
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
2016-10-31 16:30:39 -07:00