Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,262 Commits 326 Branches 371 Tags
Commit Graph

2808 Commits

Author SHA1 Message Date
Subru Krishnan
656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure. 
(cherry picked from commit 0542e6f86e6734f8ceea00960bebe719827136db)
 2017-11-03 11:11:25 -07:00
Inigo Goiri
2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
 2017-11-02 21:34:34 -07:00
Eric Payne
1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001fc4eed9eb51c8653d8f931135e49eda)
 2017-11-02 12:56:41 -05:00
Jason Lowe
6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 
(cherry picked from commit b7dee1f0608006e776624a9e4de39811d8aebc97)
 2017-11-02 09:50:55 -05:00
Rohith Sharma K S
e53fcd52ee addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
 2017-11-02 14:07:28 +05:30
Haibo Chen
32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
 2017-11-01 14:19:59 -07:00
Daniel Templeton
956d814034 YARN-7146. Many RM unit tests failing with FairScheduler 
(Contributed by Robert Kanter via Daniel Templeton)
 2017-11-01 14:11:26 -07:00
Inigo Goiri
8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
 2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
 2017-10-27 23:11:34 -07:00
Jason Lowe
9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
 2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
 2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
 2017-10-27 21:11:48 +05:30
Subru Krishnan
a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
 2017-10-26 20:16:01 -07:00
Arun Suresh
f6fde85c5c YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
 2017-10-26 20:04:33 -07:00
Arun Suresh
098a6b8f19 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
 2017-10-26 20:04:19 -07:00
Robert Kanter
7c26ae506a YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f3e5e25d6f9d5eaf41925f22d212fb9)
 2017-10-26 17:51:05 -07:00
Robert Kanter
46783158f8 YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a436aae266c1fbdec5c1067da8d854e)
 2017-10-26 10:49:57 -07:00
Subru Krishnan
74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
 2017-10-25 15:32:03 -07:00
Carlo Curino
fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
Edited cherry-pick from 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9
 2017-10-25 13:56:35 -07:00
Eric Yang
f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri
89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter
85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:43:27 -07:00
Robert Kanter
1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:29:36 -07:00
Daniel Templeton
08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371d0d6c9a1f507c04fc6b88e6c587005)
 2017-10-23 13:52:15 -07:00
Eric Payne
ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86e7215b0c4b1efdf2daf9449fb12c7b)
 2017-10-23 11:58:04 -05:00
Subru Krishnan
9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Yufei Gu
378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
 2017-10-20 11:49:34 -07:00
Yufei Gu
4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
(cherry picked from commit 96106b8f5fe50e2d5c0c4df5dbddea4f89f278d9)
 2017-10-20 11:49:33 -07:00
Yufei Gu
f462461d4e YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b0187806601e33f5a88d48991e7c12ee4419f)
 2017-10-20 11:22:28 -07:00
Yufei Gu
1000811bcb YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef81a7e275c5d4f842cac5b81ff2f8c84)
 2017-10-20 11:22:28 -07:00
Wangda Tan
2f476f4b2c YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda) 2017-10-20 11:22:28 -07:00
Wangda Tan
6a3929f2b2 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-20 11:22:26 -07:00
vrushali
3a5f1a6c26 Fixing checktyle warnings during rebase 2017-10-18 02:06:49 +05:30
Wangda Tan
c0c124c2bf YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda) 2017-10-18 02:06:47 +05:30
Wangda Tan
e5c0219228 YARN-4849. Addendum patch to fix javadocs. (Sunil G via wangda) 2017-10-18 02:06:47 +05:30
Wangda Tan
bb606e3d4b YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda) 
YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda)
YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)
 2017-10-18 02:06:46 +05:30
Subru Krishnan
5e7491d532 YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fbc4211596a2c8fbb5e584f3183f742f)
 2017-10-17 12:43:36 -07:00
Haibo Chen
c0ee583656 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff5433f36ce1b238cecd3a3b5bbe87ae)
 2017-10-17 12:30:26 -07:00
Subru Krishnan
adf5ea73d6 YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit bac4e8cca8b54405f5e37b90e545b93bbadee0f4)
 2017-10-17 12:14:05 -07:00
Varun Saxena
56e0873e22 Fix javac, javadoc and checkstyle issues before branch-2 merge. 2017-10-17 23:36:41 +05:30
vrushali
8b98dba7ee YARN-7190 Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath (Contributed by Varun Saxena via Vrushali C) 2017-10-17 23:36:41 +05:30
Haibo Chen
572ebd1a95 YARN-7063. TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2. (Varun Saxena via Haibo Chen) 2017-10-17 23:36:41 +05:30
Haibo Chen
d77530b227 YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen) 
(cherry picked from commit 661f5eb0c6791148f2d15d5730635ccb668601e3)
 2017-10-17 23:36:41 +05:30
Haibo Chen
6e2de8b417 YARN-6435. [ATSv2] Can't retrieve more than 1000 versions of metrics in time series. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 461ee44d287b1fcf0bf15d662aebd3e6f2b83a72)
 2017-10-17 23:36:40 +05:30
bibinchundatt
f7637b55bb YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena 
(cherry picked from commit dcd0bedcc8113dd5e1d852c242ae9511d1b3d58e)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMHATimelineCollectors.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/reader/security/TimelineReaderWhitelistAuthorizationFilter.java
 2017-10-17 23:36:40 +05:30
Varun Saxena
1289b056ac YARN-6958. Addedndum for Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice 2017-10-17 23:36:40 +05:30
Varun Saxena
87713f41b6 YARN-6905. Addendum to fix TestTimelineReaderWebServicesHBaseStorage due to missing FastNumberFormat 
(cherry picked from commit e52f26e5cf0b7269635a685a0a70d20b190ce476)
 2017-10-17 23:36:40 +05:30