1857 Commits

Author SHA1 Message Date
Christopher Douglas
f8969e2208 YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors.
Contributed by Carlo Curino. Backport by Ye Zhou.

(cherry picked from commit e07f3c87cd3542760efcf713f909375b69eec00f)
2017-06-05 16:35:00 -07:00
rohithsharmaks
647077f3f1 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
2017-06-03 14:04:49 -07:00
Wangda Tan
12f819a6b7 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) Backport by Jonathan Hung.
(cherry picked from commit def374e666ed0c1d665aeb1b7307e09769448138)
2017-06-03 13:59:36 -07:00
Naganarasimha
4f2ff8540b YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
(cherry picked from commit f04c81c9ce93512bc714531a7731debbe6b794ce)
2017-06-02 16:53:38 -07:00
Akira Ajisaka
fd834915f2
Update CHANGES.txt for YARN-6304. 2017-05-30 18:05:05 +09:00
Jason Lowe
f99a48aa63 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 7ef01c7c49e38529557322dbb6fce3e310cb7826)
2017-05-24 11:31:39 -05:00
Wangda Tan
cf3bf3c17b Update CHANGES.txt for YARN-6493
Change-Id: I61fbb26c4e7abb5ee4817856eb7c65f072e9d764
2017-05-22 22:22:42 -07:00
Xuan
43ea501e33 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979c361348612f817a3253be6d0de58f7)
2017-05-21 13:00:32 -07:00
Karthik Kambatla
94031b1978 YARN-4367. SLS webapp doesn't load. (kasha) 2017-05-21 11:42:38 -07:00
Varun Vasudev
6feef1b039 YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
(cherry picked from commit c28e16b40caf1e22f72cf2214ebc2fe2eaca4d03)
2017-05-21 11:31:23 -07:00
rohithsharmaks
0a4d8f6584 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit 8c180a13c82ab9d60f595e6942e35d51024dab53)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2017-05-18 17:26:30 -07:00
Min Shen
28b947603b YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen and Jonathan Hung.
(cherry picked from commit 2ada100da7cfe12946e43da2929bd80c2a8bd833)
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
2017-05-11 13:47:12 -07:00
Akira Ajisaka
9088f8358a
Update CHANGES.txt for YARN-6457 branch-2.7. 2017-05-09 11:41:08 -05:00
Varun Vasudev
0a149f3413 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
Added CHANGES.txt entry

(cherry picked from commit 07920acc165f17e8fe3ca9d21283a2123223f438)
(cherry picked from commit 4baee3eb674cfdab6e1bfa678211354656829ae3)
2017-05-09 10:51:31 +05:30
Jason Lowe
ef99e5ed89 YARN-6310. OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions. Contributed by Haibo Chen
(cherry picked from commit deb9f569465bb760e661e60a313dad1605635236)
2017-03-10 11:11:25 -06:00
Junping Du
086ee0adf8 YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
(cherry picked from commit d81109e588493cef31e68508a3d671203bd23e12)

(cherry picked from commit f40f17489cacb22eccc4c9fad66a03abebf9426b)
2017-02-02 09:57:14 -08:00
Varun Saxena
8517f34793 Updated CHANGES.txt for YARN-4328. 2016-11-15 18:57:39 +05:30
Naganarasimha
501e1e1f92 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung (addendum for changes.txt) 2016-11-15 18:25:52 +05:30
Jason Lowe
c1a6f4f2ee YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 2016-11-04 22:41:11 +00:00
Jason Lowe
5194a9bb6f YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen
(cherry picked from commit 76893a41003d57d94eb1a5f486010815266046af)
2016-11-01 20:26:07 +00:00
Carlo Curino
2de984ac3d YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
2016-10-30 23:28:13 +05:30
Brahma Reddy Battula
7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Jason Lowe
d6c36c2954 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:37:22 +00:00
Jason Lowe
c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Jason Lowe
f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe
5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S
(cherry picked from commit 26b5e6116f392b6be91dca57968259f87554ce33)
2016-08-09 22:20:22 +00:00
Jason Lowe
7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-05 20:12:23 +00:00
Jason Lowe
47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
2016-08-03 19:55:59 +00:00
Jason Lowe
22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
2016-08-03 19:37:23 +00:00
Jason Lowe
4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
2016-08-03 19:21:27 +00:00
Rohith Sharma K S
400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jason Lowe
9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
(cherry picked from commit 03af057a477b2a31b66831d66f8a38cff42f2201)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-21 18:17:29 +00:00
Varun Saxena
954dac6860 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:31:49 +05:30
Vinod Kumar Vavilapalli
c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Jason Lowe
f8f995629d YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
(cherry picked from commit 791c1639ae0b351e0bf0b2ecec854dc72ab07935)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-12 19:30:53 +00:00
Rohith Sharma K S
4a498f5fa1 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 2016-06-21 11:32:34 +05:30
Rohith Sharma K S
0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Eric Payne
577466c1f2 Added missing entries to hadoop-yarn-project/CHANGES.txt for YARN-5069 YARN-5009 YARN-5008 YARN-4751 YARN-3362 2016-06-09 16:28:37 +00:00
Jason Lowe
ab0679ed3f YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e78ce5e87669d17923ab84e494c4188)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-06-08 17:57:59 +00:00
Jason Lowe
fdea6ee0d1 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
2016-06-08 14:16:36 +00:00
Jason Lowe
f0520a2c94 YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong
(cherry picked from commit 1ba31fe9e906dbd093afd4b254216601967a4a7b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
2016-05-25 21:49:21 +00:00
Jason Lowe
27aeab63c7 YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger
(cherry picked from commit ac954486c5102b8fbbc4229a0d3a512bcc7013c0)
2016-05-23 15:57:54 +00:00
Jason Lowe
09fc02be67 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena
(cherry picked from commit b2ed6ae73197990a950ce71ece80c0f23221c384)
2016-05-06 23:03:23 +00:00
Jason Lowe
4311e5f353 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
(cherry picked from commit c6b48391680c1b81a86aabc3ad4c725bfade6d2e)
2016-05-03 17:38:19 +00:00
Jason Lowe
0ad4634585 YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee
(cherry picked from commit 69f3d428d5c3ab0c79cacffc22b1f59408622ae7)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
2016-04-15 20:52:11 +00:00
Jason Lowe
a996889313 YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee
(cherry picked from commit 9b5c5bd42f0cb240d0fe7754967765a99dd5be46)
2016-04-14 19:44:31 +00:00
Akira Ajisaka
c748ced474 YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.
(cherry picked from commit 1b78b2ba17cffdd19ae056555dd7f89b7a3eb06a)
(cherry picked from commit 88556294e20f118ecd8295f492b9617da413c83d)
2016-04-11 01:36:04 +09:00
Masatake Iwasaki
76e0bb7a19 YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims) 2016-04-06 04:03:01 +09:00
Masatake Iwasaki
6576fc6ccc YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims) 2016-04-06 03:50:01 +09:00
Jason Lowe
49428ab6bb YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 2016-04-05 13:51:46 +00:00