Commit Graph

14529 Commits

Author SHA1 Message Date
Konstantin V Shvachko de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 19:08:12 -07:00
Konstantin V Shvachko c138682e04 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322)
2018-03-29 18:03:32 -07:00
Arpit Agarwal 7e5c8faeb7 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 13:08:04 -07:00
Chris Douglas cc0a791794 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao
(cherry picked from commit 081c350188)
(cherry picked from commit ac16e8f4d3)
2018-03-28 12:04:20 -07:00
Yiqun Lin f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:59:36 -07:00
Subru Krishnan 304ce18714 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 09999d7e01)
2018-03-28 11:51:59 -07:00
Subru Krishnan b36b438043 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 0ab1d2f25b.
2018-03-28 11:51:59 -07:00
Zhe Zhang c93ab3e623 YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
(cherry picked from commit f3b41bb1ad)
2018-03-28 11:44:44 -07:00
Subru Krishnan 0ab1d2f25b YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 2a2ef15caf)
2018-03-27 17:47:37 -07:00
Wei-Chiu Chuang 827d2015c4 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
(cherry picked from commit 3fe41c65d8)
(cherry picked from commit 1176a128d6)
(cherry picked from commit c6939e9330)
2018-03-27 13:38:06 -07:00
Inigo Goiri 6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
2018-03-27 10:33:31 -07:00
Inigo Goiri 90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
2018-03-26 09:44:34 -07:00
Yiqun Lin 622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
2018-03-26 20:03:20 +08:00
Wei Yan 69c08f3dd3 HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
2018-03-23 10:39:08 -07:00
Rohith Sharma K S c2f26facd1 YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
(cherry picked from commit 75fc05f369)
2018-03-23 12:25:03 +05:30
Rohith Sharma K S 5fba8c67de YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 2018-03-23 12:05:11 +05:30
Sunil G b39245d2a5 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
(cherry picked from commit 22c5ddb7c4)
2018-03-23 10:58:13 +05:30
Inigo Goiri 3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
2018-03-22 13:37:06 -07:00
Arpit Agarwal fe4fe23f83 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:51:56 -07:00
Kihwal Lee d2c3a56ad8 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2018-03-22 12:31:52 -05:00
Inigo Goiri 06bebcc7d2 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
2018-03-22 09:23:25 -07:00
Konstantin V Shvachko 52752840f8 HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
2018-03-21 17:21:28 -07:00
Jason Lowe 13f74a3601 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31)
2018-03-21 17:40:05 -05:00
Jason Lowe a253925862 Revert "YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen."
This reverts commit a01091e90c.
2018-03-21 17:36:24 -05:00
Inigo Goiri 8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin 0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
2018-03-21 11:42:21 +08:00
Rohith Sharma K S a01091e90c YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen.
(cherry picked from commit 29acea5000)
2018-03-21 08:30:03 +05:30
Yiqun Lin fb77ac6243 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong.
(cherry picked from commit 69fe4407eb)
2018-03-21 10:55:43 +08:00
Inigo Goiri d6df90f7b5 HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit fe224ff972)
2018-03-20 11:21:44 -07:00
weiy 4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Inigo Goiri 30d9a5db29 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang.
(cherry picked from commit e65ff1c8be)
2018-03-19 17:21:55 -07:00
Sammi Chen 2285afb32e HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu.
(cherry picked from commit d67a5e2dec)
2018-03-19 15:09:23 +08:00
Yufei Gu 204674f414 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi.
(cherry picked from commit 49c747ab18)
2018-03-16 16:34:14 -07:00
Inigo Goiri f278494a5f HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 14:59:01 -07:00
Inigo Goiri 5e917a1501 Revert "HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak."
This reverts commit 972c322301.
2018-03-16 14:26:09 -07:00
Inigo Goiri 972c322301 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak.
(cherry picked from commit 08ff1586d5)
2018-03-16 10:31:02 -07:00
Inigo Goiri 4615c0bba2 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit e71bc00a47)
2018-03-16 09:15:23 -07:00
Inigo Goiri 3a5f50fa6e Revert "HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri."
This reverts commit ccf07fdafd.
2018-03-16 09:12:30 -07:00
Inigo Goiri b1b10007a4 HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. Contributed by Inigo Goiri. 2018-03-15 11:30:52 -07:00
Inigo Goiri ccf07fdafd HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit e71bc00a47)
2018-03-15 10:51:04 -07:00
Yiqun Lin 3fad968624 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:12:25 +08:00
Inigo Goiri 299b40ff8b HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan.
(cherry picked from commit 41fc7f80be)
2018-03-14 13:16:32 -07:00
Yiqun Lin b3d56cb835 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri.
(cherry picked from commit 76be6cbf6c)
2018-03-14 11:25:08 +08:00
Inigo Goiri 36451f2d54 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.
(cherry picked from commit 427fd027a3)
2018-03-13 20:06:07 -07:00
Chris Douglas 340cd5f1b1 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
(cherry picked from commit a03c8ea61f)
2018-03-12 20:08:46 -07:00
Yiqun Lin 38c21ec651 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong.
(cherry picked from commit 19292bc264)
2018-03-13 11:06:53 +08:00
Yiqun Lin 5edbd1a258 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin.
(cherry picked from commit 7fab787de7)
2018-03-13 10:33:12 +08:00
Akira Ajisaka b0c80f1c81
HDFS-12156. TestFSImage fails without -Pnative
(cherry picked from commit 319defafc1)
2018-03-13 11:29:44 +09:00
Yiqun Lin 2ca6cf3170 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin.
(cherry picked from commit 4afd50b106)
2018-03-13 10:18:23 +08:00
Inigo Goiri 7fded36e4c HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong.
(cherry picked from commit 91c82c90f0)
2018-03-12 17:30:45 -07:00