Commit Graph

2027 Commits

Author SHA1 Message Date
Jason Lowe c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Jason Lowe f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe 5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S
(cherry picked from commit 26b5e6116f)
2016-08-09 22:20:22 +00:00
Jason Lowe 7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit c01bee0108)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-05 20:12:23 +00:00
Jason Lowe 47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
(cherry picked from commit db4a61dc61)
2016-08-03 19:55:59 +00:00
Jason Lowe 22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe)
2016-08-03 19:37:23 +00:00
Jason Lowe 4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
(cherry picked from commit db646540f0)
2016-08-03 19:21:27 +00:00
Rohith Sharma K S 400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jason Lowe 9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
(cherry picked from commit 446d51591e)
(cherry picked from commit 03af057a47)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-21 18:17:29 +00:00
Varun Vasudev 1b8641a3c3 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:06:31 +05:30
Varun Saxena 954dac6860 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:31:49 +05:30
Vinod Kumar Vavilapalli c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Jason Lowe f8f995629d YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
(cherry picked from commit 791c1639ae)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-12 19:30:53 +00:00
Jason Lowe 6759cbc56a HADOOP-13362. DefaultMetricsSystem leaks the source name when a source unregisters. Contributed by Junping Du 2016-07-11 20:58:40 +00:00
Rohith Sharma K S 4a498f5fa1 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 2016-06-21 11:32:34 +05:30
Rohith Sharma K S 0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Vinod Kumar Vavilapalli f4b58eae94 Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7. 2016-06-14 19:14:02 -07:00
Eric Payne 577466c1f2 Added missing entries to hadoop-yarn-project/CHANGES.txt for YARN-5069 YARN-5009 YARN-5008 YARN-4751 YARN-3362 2016-06-09 16:28:37 +00:00
Jason Lowe ab0679ed3f YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-06-08 17:57:59 +00:00
Jason Lowe fdea6ee0d1 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
(cherry picked from commit 8c8a377cac)
2016-06-08 14:16:36 +00:00
Jason Lowe f0520a2c94 YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong
(cherry picked from commit 1ba31fe9e9)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
2016-05-25 21:49:21 +00:00
Naganarasimha 94a9a5d014 YARN-4751. In 2.7, Labeled queue usage not shown properly in capacity scheduler UI. Contributed by Eric Payne 2016-05-25 04:48:14 +08:00
Jason Lowe 27aeab63c7 YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger
(cherry picked from commit ac954486c5)
2016-05-23 15:57:54 +00:00
Eric Payne 0ee36fd511 YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger. 2016-05-16 21:12:26 +00:00
Naganarasimha 8f17395029 YARN-3362. Add node label usage in RM CapacityScheduler web UI. Contributed by Eric Payne. 2016-05-17 02:39:50 +08:00
Jason Lowe 09fc02be67 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena
(cherry picked from commit b2ed6ae731)
2016-05-06 23:03:23 +00:00
Robert Kanter b0bcb4e728 Remove parent's env vars from child processes 2016-05-06 09:33:36 -07:00
Jason Lowe 4311e5f353 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
(cherry picked from commit c6b4839168)
2016-05-03 17:38:19 +00:00
Jason Lowe e12c9e3348 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
(cherry picked from commit 4a8508501b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
2016-04-29 15:07:07 +00:00
Jason Lowe dbb7458735 Revert "YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe"
This reverts commit 77ef473981.
2016-04-29 14:38:30 +00:00
Jian He 77ef473981 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
(cherry picked from commit 4a8508501b)
2016-04-28 22:00:42 -07:00
Jian He d7b2da6518 YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe
(cherry picked from commit a9707dceaf)
2016-04-28 21:45:17 -07:00
Eric Payne 2ec33c4e3c YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda / Eric Badger 2016-04-26 16:14:07 +00:00
Jason Lowe 0ad4634585 YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee
(cherry picked from commit 69f3d428d5)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
2016-04-15 20:52:11 +00:00
Jason Lowe a996889313 YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee
(cherry picked from commit 9b5c5bd42f)
2016-04-14 19:44:31 +00:00
Rohith Sharma K S 3afdac6e2c YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He. 2016-04-13 11:13:42 +05:30
Akira Ajisaka c748ced474 YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.
(cherry picked from commit 1b78b2ba17)
(cherry picked from commit 88556294e2)
2016-04-11 01:36:04 +09:00
Wangda Tan 801c95c1cc MAPREDUCE-6302. Preempt reducers after a configurable timeout irrespective of headroom. (kasha via wangda) 2016-04-08 14:35:28 -07:00
Masatake Iwasaki 76e0bb7a19 YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims) 2016-04-06 04:03:01 +09:00
Masatake Iwasaki 6576fc6ccc YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims) 2016-04-06 03:50:01 +09:00
Jason Lowe 49428ab6bb YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 2016-04-05 13:51:46 +00:00
Li Lu f242b78fd9 YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9)
(cherry picked from commit f61de41736)
2016-04-04 14:46:28 -07:00
Allen Wittenauer 353f379168 YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)
(cherry picked from commit b1394d6307)
(cherry picked from commit 92a3dbe44f)
2016-04-01 16:58:33 -07:00
Sangjin Lee 856a131c65 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
(cherry picked from commit 6d67420dbc)
2016-03-31 10:52:39 -07:00
Eric Payne f0c278469b YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 2016-03-18 21:01:53 +00:00
Junping Du bb5749b1e0 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. Contributed by Varun Vasudev. 2016-03-17 09:44:06 -07:00
Jason Lowe 63b2019ab4 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger
(cherry picked from commit 4163e36c2b)
2016-03-07 15:59:45 +00:00
Zhihai Xu 274e182860 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee
(cherry picked from commit e1ccc9622b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
2016-03-06 20:46:56 -08:00
Jason Lowe f68e1401b8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 2016-02-26 20:28:29 +00:00
Sangjin Lee 8ceb9f38af YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba0)
2016-02-24 09:35:23 -08:00