3131 Commits

Author SHA1 Message Date
Carlo Curino
58ac40b552 YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
2016-10-27 15:22:04 -07:00
Subru Krishnan
4274600b95 YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru).
(cherry picked from commit 79ae78dcbec183ab53b26de408b4517e5a151878)
2016-10-27 15:13:01 -07:00
Varun Saxena
f572448809 YARN-4388. Cleanup mapreduce.job.hdfs-servers from yarn-default.xml (Junping Du via Varun Saxena) 2016-10-28 02:24:24 +05:30
Varun Saxena
c34bc3d661 YARN-5308. FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling (Kai Sasaki via Varun Saxena) 2016-10-28 02:23:25 +05:30
Jason Lowe
e50215306d YARN-4831. Recovered containers will be killed after NM stateful restart. Contributed by Siqi Li
(cherry picked from commit 7e3c327d316b33d6a09bfd4e65e7e5384943bb1d)
2016-10-27 20:44:17 +00:00
Jason Lowe
8935b23706 YARN-5172. Update yarn daemonlog documentation due to HADOOP-12847. Contributed by Wei-Chiu Chuang
(cherry picked from commit b4a8fbcbbc5ea4ab3087ecf913839a53f32be113)
2016-10-27 19:45:00 +00:00
Robert Kanter
b7f7d42c27 YARN-4456. Clean up Lint warnings in nodemanager (templedf via rkanter)
(cherry picked from commit 6fbfb501f2e27045da5ce8f48dde881b29328b4a)
2016-10-27 12:37:20 -07:00
Naganarasimha
15f9c18ae4 YARN-5420. Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessary. Contributed by Sunil G.
(cherry picked from commit b3c15e4ef763ebc4b033c686114fe627350824ac)
2016-10-27 18:23:27 +05:30
Varun Saxena
65fa9827fc YARN-5757. RM REST API documentation is not up to date (Miklos Szegedi via Varun Saxena) 2016-10-27 17:24:24 +05:30
Naganarasimha
3ff80a800d YARN-3848. TestNodeLabelContainerAllocation is timing out. Contributed by Varun Saxena
(cherry picked from commit 6c8830992c734313fc95ac9988539c4d813c3581)
2016-10-27 17:14:34 +05:30
Varun Saxena
65c009ca00 YARN-5686. DefaultContainerExecutor random working dir algorigthm skews results (Vrushali C via Varun Saxena) 2016-10-27 14:03:02 +05:30
Varun Saxena
a8cfa5054c YARN-5710. Fix inconsistent naming in class ResourceRequest (Yufei Gu via Varun Saxena) 2016-10-27 13:56:59 +05:30
Varun Saxena
daf9a656b9 YARN-5752. TestLocalResourcesTrackerImpl#testLocalResourceCache times out (Eric Badger via Varun Saxena) 2016-10-27 13:46:13 +05:30
Rohith Sharma K S
3a167669a5 YARN-4363. In TestFairScheduler, testcase should not create FairScheduler redundantly. Conntributed by Tao Jie.
(cherry picked from commit e29cba61a0bec0629de287f67ae6eed526295ffb)
2016-10-27 11:59:10 +05:30
Rohith Sharma K S
07b531c10a YARN-4555. TestDefaultContainerExecutor#testContainerLaunchError fails on non-english locale environment. Contributed by Takashi Ohnishi.
(cherry picked from commit b110c4b5e82d8310f13a22bba1c8afbcca80144f)
2016-10-27 11:35:38 +05:30
Akira Ajisaka
e29d0a2fd8 YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton.
(cherry picked from commit d3bb69a66776e9f410150c4030ddb15981f58fb9)
2016-10-26 15:34:40 +09:00
Karthik Kambatla
e4ba92abee YARN-5388. Deprecate and remove DockerContainerExecutor. (Daniel Templeton via kasha) 2016-10-25 15:26:27 -07:00
Karthik Kambatla
aedd5c4c1b YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha) 2016-10-25 13:15:58 -07:00
Karthik Kambatla
ab9105d814 YARN-5754. Null check missing for earliest in FifoPolicy. (Yufei Gu via kasha)
(cherry picked from commit a71fc81655cd5382d354674dd06570ba49753688)
2016-10-24 22:19:56 -07:00
Subru Krishnan
81595a127f YARN-5711. Propogate exceptions back to client when using hedging RM failover provider.
(cherry picked from commit 0a166b13472213db0a0cd2dfdaddb2b1746b3957)
2016-10-24 19:02:03 -07:00
Jian He
bb8214cab8 Revert YARN-4126. RM should not issue delegation tokens in unsecure mode. 2016-10-23 15:56:22 -07:00
Karthik Kambatla
440a6326d1 YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha)
(cherry picked from commit 754cb4e30fac1c5fe8d44626968c0ddbfe459335)
2016-10-20 21:18:13 -07:00
Karthik Kambatla
c2cabce2e8 YARN-4911. Bad placement policy in FairScheduler causes the RM to crash
(cherry picked from commit a064865abf7dceee46d3c42eca67a04a25af9d4e)
2016-10-20 20:57:31 -07:00
Robert Kanter
e02c756f16 YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter)
(cherry picked from commit f5d92359145dfb820a9521e00e2d44c4ee96e67e)
2016-10-17 14:29:42 -07:00
Varun Saxena
e9a58691ab YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:32:29 +05:30
Chris Douglas
f0f2681b4f YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana
(cherry picked from commit cf3f43e95bf46030875137fc36da5c1fbe14250d)
2016-10-13 20:49:50 -07:00
Jason Lowe
28bd08798d YARN-5551. Ignore file backed pages from memory computation when smaps is enabled. Contributed by Rajesh Balamohan
(cherry picked from commit ecb51b857ac7faceff981b2b6f22ea1af0d42ab1)
2016-10-11 15:14:08 +00:00
Naganarasimha
dc5f7a9d5e YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe.
(cherry picked from commit 0773ffd0f8383384f8cf8599476565f78aae70c9)
2016-10-10 18:06:28 -04:00
Junping Du
8bee319130 YARN-5659. getPathFromYarnURL should use standard methods. Contributed by Sergey Shelukhin.
(cherry picked from commit 459a4833a90437a52787a41c2759a4b18cfe411c)
2016-10-07 07:47:16 -07:00
Rohith Sharma K S
94a6f65989 YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G.
(cherry picked from commit 4d2f380d787a6145f45c87ba663079fedbf645b8)
2016-10-06 20:43:47 +05:30
Jian He
caafa980af YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan 2016-10-06 07:55:14 -07:00
Akira Ajisaka
5f1432d98e MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel Templeton.
(cherry picked from commit 272a21747e8a89b6daccc19b71c21de3d17b8d62)
2016-10-06 15:59:19 +09:00
Chris Douglas
539c3e4dc0 YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. Contributed by Subru Krishnan
(cherry picked from commit d65b957776c4f055f82549a610fd1e8494580fe6)
2016-10-05 12:19:21 -07:00
Varun Vasudev
3ce02387ea YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana.
(cherry picked from commit 0992708d790b5bd3dab85987b7ad7c6fc2cc4b18)
2016-10-05 15:32:50 +05:30
Karthik Kambatla
1578781fe9 YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha)
(cherry picked from commit 736d33cddd88a0cec925a451940b2523999a9c51)
2016-10-03 14:36:14 -07:00
Karthik Kambatla
f8c2c7b2c0 YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha)
(cherry picked from commit 0da54e8848764c71a31473516d23ada582013f8c)
2016-10-03 06:04:09 -07:00
Naganarasimha
04f594dbea YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie
(cherry picked from commit 6e130c308cf1b97e8386b6a43c26d72d2850119c)
2016-10-03 02:13:46 -04:00
Karthik Kambatla
57726eed83 YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha)
(cherry picked from commit 82857037b6e960dccdaf9e6b1b238411498a0dfe)
2016-10-02 22:10:07 -07:00
Subru Krishnan
9f43f89899 YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru).
(cherry picked from commit 3a3697deab3e3397082222deb66fb613d86ff9ae)
2016-09-30 19:43:29 -07:00
Robert Kanter
56ec975ea9 YARN-5693. Reduce loglevel to Debug in ContainerManagementProtocolProxy and AMRMClientImpl (yufeigu via rkanter)
(cherry picked from commit 2549ee9d4c4ddd3ebccdebb8623df30c0a8f27d2)
2016-09-30 13:35:58 -07:00
Li Lu
919c0802fa YARN-4205. Addendum patch to fix branch-2. 2016-09-29 15:41:31 -07:00
Jian He
39f896e1a1 YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S
(cherry picked from commit 2ae5a3a5bf5ea355370469a53eeccff0b5220081)
2016-09-29 22:06:36 +08:00
Robert Kanter
4f8c7f819c YARN-5400. addendum patch to fix JDK 7 issue 2016-09-28 16:01:18 -07:00
Robert Kanter
bc91e33d5e YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter)
(cherry picked from commit bcb2528a51c33e4caff8d744c5e14c1accfc47d0)
2016-09-28 14:57:14 -07:00
Varun Vasudev
3f1d3e3177 YARN-5662. Provide an option to enable ContainerMonitor. Contributed by Jian He.
(cherry picked from commit bc2656f09f857fdbc39da6b060cee453d2dec4dc)
2016-09-28 15:27:09 +05:30
Wangda Tan
379c2b3e5b YARN-3142. Improve locks in AppSchedulingInfo. (Varun Saxena via wangda)
(cherry picked from commit 1831be8e737fd423a9f3d590767b944147e85641)
2016-09-27 12:05:00 -07:00
Wangda Tan
269401dc83 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
2016-09-27 11:27:25 -07:00
Naganarasimha
86ec99e82d YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S
(cherry picked from commit ebf528c443f3931c8b0f92ee76615fc203141675)
2016-09-27 16:42:21 +05:30
Arun Suresh
7484d0b1b9 YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh 2016-09-26 23:55:13 +08:00
Akira Ajisaka
74f2df16a9 YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.
(cherry picked from commit 14a696f369f7e3802587f57c8fff3aa51b5ab576)
2016-09-26 15:01:13 +09:00