Commit Graph

14503 Commits

Author SHA1 Message Date
Weiwei Yang 2b2e2ac5f4 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. Contributed by Tao Yang. 2018-04-11 20:21:05 +08:00
Rohith Sharma K S 754e5189ee MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
(cherry picked from commit 6cc59a09e7)
2018-04-11 09:52:17 +05:30
Vrushali C fe4c7ee94c YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5)
2018-04-11 09:51:42 +05:30
Xiao Chen 95cedc5587 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 2018-04-10 15:46:46 -07:00
Jason Lowe 0fb1457d86 HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 2018-04-10 16:59:31 -05:00
Yiqun Lin ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
2018-04-10 15:39:46 +08:00
Yiqun Lin 9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
2018-04-10 14:47:55 +08:00
Sammi Chen 1d78825bf1 HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu. 2018-04-10 14:24:31 +08:00
Xiao Chen f667ef1f65 HADOOP-15375. Branch-2 pre-commit failed to build docker image. 2018-04-09 15:35:10 -07:00
Inigo Goiri 78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.
(cherry picked from commit e9b9f48dad)
2018-04-09 10:11:38 -07:00
Inigo Goiri 7e692425d5 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
2018-04-09 09:18:42 -07:00
Yiqun Lin 14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
2018-04-08 12:07:44 +08:00
Subru Krishnan 05246b7585 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru).
(cherry picked from commit 00905efab2)
2018-04-06 16:38:28 -07:00
Haibo Chen b19267259b YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870)
(cherry picked from commit b232dcab33)
(cherry picked from commit ca105d1c8e)
2018-04-06 09:47:25 -07:00
Sean Mackrory b412958f70 HDFS-13176. WebHdfs file path gets truncated when having semicolon inside. Contributed by Zsolt Venczel. 2018-04-06 07:41:58 -06:00
Wei Yan 689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
2018-04-05 13:23:07 -07:00
Haibo Chen a7d8b4d775 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4)
(cherry picked from commit 6658018410)
(cherry picked from commit 9cb378f5c7)
2018-04-05 11:45:01 -07:00
Steve Loughran e5351608ca HADOOP-14651. Update okhttp version to 2.7.5.
Contributed by Ray Chiang and John Zhuge.
2018-04-04 15:16:20 +01:00
Inigo Goiri 4276a858f8 HDFS-13337. Backport HDFS-4275 to branch-2.9. Contributed by Xiao Liang. 2018-04-03 13:55:44 -07:00
Xiao Chen b8d8c25a18 HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.
(cherry picked from commit 59d78a5088)
2018-04-03 11:14:26 -07:00
Inigo Goiri 254ec1e4d3 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 09:29:20 -07:00
Xiao Chen 117a8d6573 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
2018-04-02 23:10:35 -07:00
Xiao Chen 251fc1fb40 HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
2018-04-02 22:55:03 -07:00
Inigo Goiri c6a013c9e0 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
2018-03-31 09:47:36 -07:00
Konstantin V Shvachko de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 19:08:12 -07:00
Konstantin V Shvachko c138682e04 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322)
2018-03-29 18:03:32 -07:00
Arpit Agarwal 7e5c8faeb7 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 13:08:04 -07:00
Chris Douglas cc0a791794 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao
(cherry picked from commit 081c350188)
(cherry picked from commit ac16e8f4d3)
2018-03-28 12:04:20 -07:00
Yiqun Lin f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:59:36 -07:00
Subru Krishnan 304ce18714 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 09999d7e01)
2018-03-28 11:51:59 -07:00
Subru Krishnan b36b438043 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 0ab1d2f25b.
2018-03-28 11:51:59 -07:00
Zhe Zhang c93ab3e623 YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
(cherry picked from commit f3b41bb1ad)
2018-03-28 11:44:44 -07:00
Subru Krishnan 0ab1d2f25b YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 2a2ef15caf)
2018-03-27 17:47:37 -07:00
Wei-Chiu Chuang 827d2015c4 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
(cherry picked from commit 3fe41c65d8)
(cherry picked from commit 1176a128d6)
(cherry picked from commit c6939e9330)
2018-03-27 13:38:06 -07:00
Inigo Goiri 6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
2018-03-27 10:33:31 -07:00
Inigo Goiri 90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
2018-03-26 09:44:34 -07:00
Yiqun Lin 622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
2018-03-26 20:03:20 +08:00
Wei Yan 69c08f3dd3 HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
2018-03-23 10:39:08 -07:00
Rohith Sharma K S c2f26facd1 YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
(cherry picked from commit 75fc05f369)
2018-03-23 12:25:03 +05:30
Rohith Sharma K S 5fba8c67de YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 2018-03-23 12:05:11 +05:30
Sunil G b39245d2a5 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
(cherry picked from commit 22c5ddb7c4)
2018-03-23 10:58:13 +05:30
Inigo Goiri 3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
2018-03-22 13:37:06 -07:00
Arpit Agarwal fe4fe23f83 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:51:56 -07:00
Kihwal Lee d2c3a56ad8 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2018-03-22 12:31:52 -05:00
Inigo Goiri 06bebcc7d2 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
2018-03-22 09:23:25 -07:00
Konstantin V Shvachko 52752840f8 HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
2018-03-21 17:21:28 -07:00
Jason Lowe 13f74a3601 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31)
2018-03-21 17:40:05 -05:00
Jason Lowe a253925862 Revert "YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen."
This reverts commit a01091e90c.
2018-03-21 17:36:24 -05:00
Inigo Goiri 8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin 0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
2018-03-21 11:42:21 +08:00