Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,072 Commits 326 Branches 371 Tags
Commit Graph

18072 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Subru Krishnan
f39f395060 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e014fde717e8b122773b68664f4594106)
(cherry picked from commit a0091ec4b3c28a468f95d8f066a769320937ad6f)
 2018-03-29 09:47:19 -07:00
Subru Krishnan
b56f657940 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 85eebf1bebc7b191dcd692395f77903257cd85c4.

(cherry picked from commit ed49f59e1896a81c9ab4e3a744413f9f1bb37da0)
 2018-03-29 09:46:44 -07:00
Wangda Tan
7a01bfd201 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda) 
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebca315804c80012eea5f31275ac25518)
(cherry picked from commit a2b4daab55f3ba841835a2d3440f451f0ced9a99)
 2018-03-29 09:46:17 -07:00
Yiqun Lin
44ebe55314 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
(cherry picked from commit 99766992e6e2995046621827a64272afede62b99)
 2018-03-29 09:46:11 -07:00
Sunil G
b5fd90c3a8 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 
(cherry picked from commit d1e378d02bdaec2f078ccc89698e7959ffcc71b3)
(cherry picked from commit 6c904388f401d3ca1641050fa4ff9996dff54aa4)
 2018-03-29 09:46:06 -07:00
Subru Krishnan
276a5ca632 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
(cherry picked from commit 85eebf1bebc7b191dcd692395f77903257cd85c4)
 2018-03-29 09:45:58 -07:00
Wei-Chiu Chuang
762126fac8 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
(cherry picked from commit 1176a128d632925749db0a81a719fd8141c3cbb6)
 2018-03-29 09:45:51 -07:00
Inigo Goiri
2a5fad183e HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
(cherry picked from commit c1fc87dcce6cabca61cfc509a76cb4a093dfd722)
 2018-03-29 09:45:36 -07:00
Jitendra Pandey
7155ef28f9 HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair. 
(cherry picked from commit 91b98ad03a430e0b84d78ad7170d56f016a90d2f)
 2018-03-29 09:45:29 -07:00
Haibo Chen
7580c529a1 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d798a517443afd0b441883ccc4e9136ba)
(cherry picked from commit e00e08365e02e77a1d9ae3cc16e65ddb543b5b20)
 2018-03-29 09:45:22 -07:00
Wangda Tan
3c826d379d YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda) 
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d919fddae983fc13d4ba4e4e5cb9533)
(cherry picked from commit dc99611878e99175b027b8baf2dec3150e175401)
 2018-03-29 09:45:16 -07:00
Wangda Tan
b600608b2d YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda) 
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad78b8464da252d0e23c08675898b9d8)
(cherry picked from commit 62b95373329c64b90d266019f98f423f3c635351)
 2018-03-29 09:45:09 -07:00
Wangda Tan
0b7eed5e34 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda) 
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f83022b411a8740d58486a7f68ab2af6)
(cherry picked from commit 54da6a0d78c7832d647831b73030a1f75db932a9)
 2018-03-29 09:45:03 -07:00
Inigo Goiri
aa66e7cc27 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
(cherry picked from commit 0dc16559ee62f4f1691fae017d18358fe15c24cd)
 2018-03-29 09:44:57 -07:00
Yiqun Lin
8890bba13a HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
(cherry picked from commit 1e01ddfe4f0075f5185ea6f3fc083b39c62a7d2a)
 2018-03-29 09:44:50 -07:00
Wangda Tan
5f5f5a6eb1 YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda) 
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
(cherry picked from commit 24f75e097a67ae90d2ff382bb2f2559caa02f32f)
(cherry picked from commit c98dd3bf18f6551f5be912ed36264a21cf8d42d9)
 2018-03-29 09:44:42 -07:00
weiy
640b03e068 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
(cherry picked from commit d17aa8d0528a499e594aec4cb3e74651283f3479)
 2018-03-29 09:41:52 -07:00
Rohith Sharma K S
4ecb50a8ab YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369929db768b767d79351bca8c13ad9ba)
(cherry picked from commit 91791a8abdf3d46278ee7c15eeb3dddc43918742)
 2018-03-29 09:41:36 -07:00
Sunil G
c30b026997 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4fb48d5bf5a7456d0b1b27d48c2a485)
(cherry picked from commit e10e6c90129f5d2f1ecdbaf18a43c529574505f4)
 2018-03-29 09:41:20 -07:00
Inigo Goiri
a9515dae7d HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
(cherry picked from commit 59ab86311cd02ef37d08291a4ca63db92bf24521)
 2018-03-29 09:41:09 -07:00
Arpit Agarwal
a30a863c7f HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 
(cherry picked from commit d82e846fa43a441af86355d95a5464c7ebcd5c15)
 2018-03-29 09:40:05 -07:00
Kihwal Lee
c05dd318bf HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)
(cherry picked from commit c245eceddad8883103df30bbff9a285798f29fdf)
 2018-03-29 09:39:57 -07:00
Inigo Goiri
05b9f0f5b7 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b80438bfbdf7e5af853b9044a63bd1352c)
(cherry picked from commit 485348a337cd1923ab51784784f560f82c11af26)
 2018-03-29 09:39:46 -07:00
Konstantin V Shvachko
3018aa64ae HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
(cherry picked from commit 21db4e9efe9ff634c905aa32667d9dbb203b3699)
 2018-03-29 09:39:11 -07:00
Jason Lowe
dc075b727a YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e319c3273243dda9993fb6c2d776eb7cc)
(cherry picked from commit 5d4b2c31a19b2ce7d94a9ca12ed6a1def428bb83)
 2018-03-29 09:38:50 -07:00
Yiqun Lin
d7d35fd4f0 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
(cherry picked from commit 0db4b587c604300ffb44677f7cf81ae3faa430d3)
 2018-03-29 09:38:42 -07:00
Yiqun Lin
94b826d2c7 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
(cherry picked from commit 131546002da0dc6d8d511a62599df071279ef347)
 2018-03-29 09:37:47 -07:00
Sunil G
8443bb2ffb YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c50e8264e07f6b1dadaeedba676c8c2)
 2018-03-29 21:43:34 +05:30
Lei Xu
704d43603b Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:58:14 -07:00
Lei Xu
b6a10e2b2b Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:57:45 -07:00
Wangda Tan
b72856287c Updated index.md.vm for 3.1.0 release 
Change-Id: Idc5ab7167562b8bc99d32c27af4744e45fa7473e
release-3.1.0-RC0 		2018-03-21 16:53:43 -07:00
Rohith Sharma K S
4d020c49a9 YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000337a7f529bb1810a2af2b0af4d5f1d)
(cherry picked from commit bbfe36d6865a568d0e709e651a3f48ab9644794b)
 2018-03-21 16:49:47 -07:00
Haibo Chen
dfcafa84ac YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 3ff6977d3e29cff455a71f668bec8ed35fb90774)
 2018-03-21 16:41:10 -07:00
Wangda Tan
0972780c47 Preparing for 3.1.0 release 
Change-Id: I9865da5d4c9437248e136b1161e0868567ab014d
 2018-03-20 11:34:03 -07:00
Inigo Goiri
9b96e7522b HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972a299a74c16a6a20ddd85ea16486b1e)
 2018-03-20 11:20:37 -07:00
weiy
c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Sammi Chen
5acc13f340 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec5c60d96b0c216182891cdfd7832ac5)
(cherry picked from commit 2285afb32e71622b3dab5051247a1d099cfcbe85)
(cherry picked from commit 322520eb76cdcef25190495ccf98b3ca39907f58)
(cherry picked from commit 7985c5fdc9fe26e7771a86a5004bf90fcbd8af71)
 2018-03-20 14:03:17 +08:00
Inigo Goiri
7eb0bdbd32 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be48ef4f04ed96f96ac4caef4974944d)
 2018-03-19 17:20:36 -07:00
Jason Lowe
a4f0dbcb44 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 
(cherry picked from commit f480367af68e06ed17b8018092c9987a13bb9f63)
 2018-03-19 17:44:06 -05:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
Yufei Gu
49c747ab18 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi. 2018-03-16 16:25:33 -07:00
Inigo Goiri
08ff1586d5 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 10:29:19 -07:00
Weiwei Yang
154cfb2b62 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 18:57:31 +08:00
Xiao Chen
21c6661461 HADOOP-15234. Throw meaningful message on null when initializing KMSWebApp. Contributed by fang zhenyi. 2018-03-15 20:17:16 -07:00
Wangda Tan
4bf622043f YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda) 
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
 2018-03-15 13:26:45 -07:00
Wangda Tan
f47659fb97 MAPREDUCE-7047. Make HAR tool support IndexedLogAggregtionController. (Xuan Gong via wangda) 
Change-Id: Ice5ae1c706f2476361997dcbb29f2c33c77d4f0c
 2018-03-15 13:26:01 -07:00
Steve Loughran
1976e0066e HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories. 
Contributed by Steve Loughran.
 2018-03-15 18:05:14 +00:00
Xiaoyu Yao
78b05fde6c HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain. 2018-03-15 11:02:27 -07:00
Inigo Goiri
e71bc00a47 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 2018-03-15 10:32:30 -07:00
Xiaoyu Yao
da777a5498 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar. 2018-03-15 10:18:44 -07:00