Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,331 Commits 326 Branches 371 Tags
Commit Graph

1411 Commits

Author SHA1 Message Date
Jason Lowe
e2917180ee YARN-4862. Handle duplicate completed containers in RMNodeImpl. Contributed by Rohith Sharma K S 
(cherry picked from commit 352cbaa7a54a94bad2bed131d6a250c5b21a7701)
 2016-11-03 14:03:56 +00:00
Varun Saxena
b818773919 YARN-5815. Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart (Bibin A Chundatt via Varun Saxena) 2016-11-03 00:41:53 +05:30
Varun Saxena
91ddea5bfb YARN-5788. Apps not activiated and AM limit resource in UI and REST not updated after -replaceLabelsOnNode (Bibin A Chundatt via Varun Saxena) 2016-11-01 16:26:38 +05:30
Karthik Kambatla
2226ae4924 YARN-4998. Minor cleanup to UGI use in AdminService. (Daniel Templeton via kasha) 
(cherry picked from commit 733aa993134ba324c712590fa92b8ef230b0839a)
 2016-10-31 16:26:15 -07:00
Wangda Tan
cef281abe6 YARN-2009. CapacityScheduler: Add intra-queue preemption for app priority support. (Sunil G via wangda) 
(cherry picked from commit 90dd3a8148468ac37a3f2173ad8d45e38bfcb0c9)
 2016-10-31 15:23:16 -07:00
Daniel Templeton
ce13463e7a YARN-4396. Log the trace information on FSAppAttempt#assignContainer (Contributed by Yiqun Li via Daniel Templeton) 
(cherry picked from commit 2528bea67ff80fae597f10e26c5f70d601af9fb1)
 2016-10-31 13:36:24 -07:00
Daniel Templeton
adceebc400 YARN-4907. Make all MockRM#waitForState consistent. (Contributed by Yufei Gu via Daniel Templeton) 
(cherry picked from commit 155f06e0c1a5a15365fb620f3802dca8aa46c287)
 2016-10-31 13:21:45 -07:00
Naganarasimha
e4023f0d81 YARN-4498. Application level node labels stats to be available in REST. Contributed by Bibin A Chundatt. 2016-10-31 19:07:56 +05:30
Varun Saxena
0e6fcd3bd2 YARN-5773. RM recovery too slow due to LeafQueue#activateApplications (Bibin A Chundatt via Varun Saxena) 2016-10-29 13:51:02 +05:30
Jason Lowe
b85b5c6b94 YARN-4963. capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable. Contributed by Nathan Roberts 
(cherry picked from commit 1eae719bcead45915977aa220324650eab3c1b9e)
 2016-10-28 17:31:29 +00:00
Karthik Kambatla
950bfed1d3 YARN-4743. FairSharePolicy breaks TimSort assumption. (Zephyr Guo and Yufei Gu via kasha) 
(cherry picked from commit 4df8ed63ed93f2542e4b48f521b0cc6624ab59c1)
 2016-10-27 17:48:24 -07:00
Subru Krishnan
334fd9e83f YARN-2306. Add test for leakage of reservation metrics in fair scheduler. (Hong Zhiguo and Yufei Gu via subru). 
(cherry picked from commit b2c4f24c31e73faa8f71d44db5de3aa91e3b7d5e)
 2016-10-27 17:44:05 -07:00
Carlo Curino
58ac40b552 YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
 2016-10-27 15:22:04 -07:00
Subru Krishnan
4274600b95 YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru). 
(cherry picked from commit 79ae78dcbec183ab53b26de408b4517e5a151878)
 2016-10-27 15:13:01 -07:00
Varun Saxena
c34bc3d661 YARN-5308. FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling (Kai Sasaki via Varun Saxena) 2016-10-28 02:23:25 +05:30
Naganarasimha
15f9c18ae4 YARN-5420. Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessary. Contributed by Sunil G. 
(cherry picked from commit b3c15e4ef763ebc4b033c686114fe627350824ac)
 2016-10-27 18:23:27 +05:30
Naganarasimha
3ff80a800d YARN-3848. TestNodeLabelContainerAllocation is timing out. Contributed by Varun Saxena 
(cherry picked from commit 6c8830992c734313fc95ac9988539c4d813c3581)
 2016-10-27 17:14:34 +05:30
Rohith Sharma K S
3a167669a5 YARN-4363. In TestFairScheduler, testcase should not create FairScheduler redundantly. Conntributed by Tao Jie. 
(cherry picked from commit e29cba61a0bec0629de287f67ae6eed526295ffb)
 2016-10-27 11:59:10 +05:30
Akira Ajisaka
e29d0a2fd8 YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton. 
(cherry picked from commit d3bb69a66776e9f410150c4030ddb15981f58fb9)
 2016-10-26 15:34:40 +09:00
Karthik Kambatla
aedd5c4c1b YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha) 2016-10-25 13:15:58 -07:00
Karthik Kambatla
ab9105d814 YARN-5754. Null check missing for earliest in FifoPolicy. (Yufei Gu via kasha) 
(cherry picked from commit a71fc81655cd5382d354674dd06570ba49753688)
 2016-10-24 22:19:56 -07:00
Jian He
bb8214cab8 Revert YARN-4126. RM should not issue delegation tokens in unsecure mode. 2016-10-23 15:56:22 -07:00
Karthik Kambatla
440a6326d1 YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha) 
(cherry picked from commit 754cb4e30fac1c5fe8d44626968c0ddbfe459335)
 2016-10-20 21:18:13 -07:00
Karthik Kambatla
c2cabce2e8 YARN-4911. Bad placement policy in FairScheduler causes the RM to crash 
(cherry picked from commit a064865abf7dceee46d3c42eca67a04a25af9d4e)
 2016-10-20 20:57:31 -07:00
Varun Saxena
e9a58691ab YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:32:29 +05:30
Naganarasimha
dc5f7a9d5e YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe. 
(cherry picked from commit 0773ffd0f8383384f8cf8599476565f78aae70c9)
 2016-10-10 18:06:28 -04:00
Rohith Sharma K S
94a6f65989 YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G. 
(cherry picked from commit 4d2f380d787a6145f45c87ba663079fedbf645b8)
 2016-10-06 20:43:47 +05:30
Jian He
caafa980af YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan 2016-10-06 07:55:14 -07:00
Karthik Kambatla
1578781fe9 YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha) 
(cherry picked from commit 736d33cddd88a0cec925a451940b2523999a9c51)
 2016-10-03 14:36:14 -07:00
Karthik Kambatla
f8c2c7b2c0 YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit 0da54e8848764c71a31473516d23ada582013f8c)
 2016-10-03 06:04:09 -07:00
Naganarasimha
04f594dbea YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 
(cherry picked from commit 6e130c308cf1b97e8386b6a43c26d72d2850119c)
 2016-10-03 02:13:46 -04:00
Karthik Kambatla
57726eed83 YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha) 
(cherry picked from commit 82857037b6e960dccdaf9e6b1b238411498a0dfe)
 2016-10-02 22:10:07 -07:00
Subru Krishnan
9f43f89899 YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru). 
(cherry picked from commit 3a3697deab3e3397082222deb66fb613d86ff9ae)
 2016-09-30 19:43:29 -07:00
Li Lu
919c0802fa YARN-4205. Addendum patch to fix branch-2. 2016-09-29 15:41:31 -07:00
Jian He
39f896e1a1 YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S 
(cherry picked from commit 2ae5a3a5bf5ea355370469a53eeccff0b5220081)
 2016-09-29 22:06:36 +08:00
Robert Kanter
4f8c7f819c YARN-5400. addendum patch to fix JDK 7 issue 2016-09-28 16:01:18 -07:00
Robert Kanter
bc91e33d5e YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter) 
(cherry picked from commit bcb2528a51c33e4caff8d744c5e14c1accfc47d0)
 2016-09-28 14:57:14 -07:00
Wangda Tan
379c2b3e5b YARN-3142. Improve locks in AppSchedulingInfo. (Varun Saxena via wangda) 
(cherry picked from commit 1831be8e737fd423a9f3d590767b944147e85641)
 2016-09-27 12:05:00 -07:00
Naganarasimha
86ec99e82d YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S 
(cherry picked from commit ebf528c443f3931c8b0f92ee76615fc203141675)
 2016-09-27 16:42:21 +05:30
Arun Suresh
7484d0b1b9 YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh 2016-09-26 23:55:13 +08:00
Akira Ajisaka
74f2df16a9 YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov. 
(cherry picked from commit 14a696f369f7e3802587f57c8fff3aa51b5ab576)
 2016-09-26 15:01:13 +09:00
Naganarasimha
0e4a5611ff YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-24 21:13:01 +05:30
Arun Suresh
2a9f809c96 YARN-5656. Fix ReservationACLsTestBase. (Sean Po via asuresh) 
(cherry picked from commit 9f03b403ec69658fc57bc0f6b832da0e3c746497)
 2016-09-20 12:27:50 -07:00
Wangda Tan
679652fcbd Addendum patch for fix javadocs failure which is caused by YARN-3141. (wangda) 
(cherry picked from commit e45307c9a063248fcfb08281025d87c4abd343b1)
 2016-09-20 11:21:47 -07:00
Jian He
3acd30df71 YARN-3140. Improve locks in AbstractCSQueue/LeafQueue/ParentQueue. Contributed by Wangda Tan 
(cherry picked from commit 2b66d9ec5bdaec7e6b278926fbb6f222c4e3afaa)
 2016-09-20 15:05:54 +08:00
Jason Lowe
035f5f8f1d YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 
(cherry picked from commit 7558dbbb481eab055e794beb3603bbe5671a4b4c)
 2016-09-19 20:33:59 +00:00
Jian He
9942ca2bf0 YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan 
(cherry picked from commit b8a30f2f170ffbd590e7366c3c944ab4919e40df)
 2016-09-19 17:08:57 +08:00
Naganarasimha
20729ead91 YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani 2016-09-17 10:37:42 +05:30
Wangda Tan
ee101e49fa YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge via wangda) 2016-09-15 14:49:03 -07:00
Karthik Kambatla
a064375e68 YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha) 
(cherry picked from commit c0e492e50fa98d423c8a61c94d2d1f9553558b6d)
 2016-09-06 22:40:49 -07:00