Commit Graph

2758 Commits

Author SHA1 Message Date
Eric Payne 9849b5a489 YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
(cherry picked from commit 5578af8603)
2017-06-09 16:44:30 -05:00
Naganarasimha cdac9a4d9d YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp. 2017-06-09 11:59:01 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 396de0fd8f Preparing for 2.8.3 development 2017-06-07 15:38:20 -07:00
Karthik Kambatla 5410ec995d YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)
(cherry picked from commit ff95fd547b)
2017-06-05 21:46:59 +05:30
Sunil G 34958e358b YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:09:08 +05:30
Sunil G 13b4a6b2b9 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 2017-06-04 10:46:47 +05:30
Nathan Roberts 1f077f45f9 YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles.
(cherry picked from commit 4369690ce6)
2017-05-31 12:47:38 -05:00
Jason Lowe b89d59e21e YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla 2017-05-26 09:45:49 -05:00
Jason Lowe 8739c4d2f8 YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter
(cherry picked from commit 3fd6a2da4e)
2017-05-25 16:09:29 -05:00
Varun Vasudev c1f3cd765f Addendum patch to fix Docker sanitization.
(cherry picked from commit 2ff2a1f50e8c7c0f33676b010b256d6c8daf912d)
(cherry picked from commit 983c4437c2b1aaafddfc97b19371cdb992389a61)
2017-05-25 14:54:17 +05:30
Akira Ajisaka d50f240784
YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan.
(cherry picked from commit bc28da65fb)
(cherry picked from commit ca1c0cbc62)
2017-05-25 17:08:18 +09:00
Jason Lowe 7ef01c7c49 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 2017-05-24 11:27:21 -05:00
Wangda Tan 836e8f3e69 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: I3c5c012eb8d0887a4a37d58662bc37aac07ea86e
2017-05-22 14:57:54 -07:00
Eric Payne 71d91d53bf YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
(cherry picked from commit 19482e0d09)
2017-05-19 11:36:18 -05:00
Varun Vasudev 23bbbce63e Sanitize arguments before launching Docker containers. 2017-05-18 12:03:52 +05:30
Varun Vasudev 51e65cc710 Validate docker image name before launching container. 2017-05-18 11:53:16 +05:30
Chris Douglas 9791ecc9d8 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
(cherry picked from commit b23fcc86c6)
(cherry picked from commit 3d2afb209c)
2017-05-17 20:42:27 -07:00
Rohith Sharma K S c61956dd1e HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:26:17 +05:30
Jason Lowe c2d7c12477 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
(cherry picked from commit 489f85933c)
2017-05-16 09:29:18 -05:00
Jonathan Eagles c992cf638e YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-05-15 12:10:12 -05:00
Min Shen aae0600a67 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
(cherry picked from commit 2ada100da7)
2017-05-11 13:31:02 -07:00
Jason Lowe f32db1be1e YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 6099deebcb)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestLogsCLI.java
2017-05-10 08:53:33 -05:00
Haibo Chen 3799625e90 YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen)
(cherry picked from commit 1769b12a77)
(cherry picked from commit 86fcb8a66c)
2017-05-09 08:52:37 -07:00
Varun Vasudev 341457a0f2 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
(cherry picked from commit 07920acc16)
(cherry picked from commit 4baee3eb67)
2017-05-09 10:59:15 +05:30
Karthik Kambatla dd46bc0f54 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)
(cherry picked from commit 7992c0b42c)
2017-05-02 16:46:10 -05:00
Karthik Kambatla d382a21423 YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)
(cherry picked from commit f84af8bd58)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestContinuousScheduling.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
2017-05-02 16:40:46 -05:00
Steve Loughran 993ab15b39 YARN-524 TestYarnVersionInfo failing if generated properties doesn't include an SVN URL
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463300 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 7c65dbb938)

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 5ca4f0f82e)
2017-05-01 08:58:53 -05:00
Eric Payne 5b9460301a YARN-6536. TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently. Contributed by Jason Lowe.
(cherry picked from commit fdf5192bbb)
2017-04-28 15:23:05 -05:00
Robert Kanter 26492de185 YARN-5894. fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (haibochen via rkanter)
(cherry picked from commit 371b6467dc)
2017-04-28 09:21:41 -07:00
Eric Payne 73563bc9b6 YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe. 2017-04-26 14:33:27 -05:00
Junping Du 0de6f28020 YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S.
(cherry picked from commit 6ed9d36224)
(cherry picked from commit 9289f4527d)
2017-04-17 15:59:00 -07:00
Jason Lowe a61ec7c374 YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger
(cherry picked from commit 4168805502)
2017-04-14 17:18:08 -05:00
Eric Payne d27f74d915 YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger
(cherry picked from commit 157a9f3104)
2017-04-14 11:54:30 -05:00
Junping Du c43ee00587 YARN-3760. FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close(). Contributed by Haibo Chen.
(cherry picked from commit c26ccf1adb3a72df3f68e1150b86b813c691203a)
(cherry picked from commit 9d9087a67a)
(cherry picked from commit d77cada182)
2017-04-12 14:17:04 -07:00
Junping Du dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Jason Lowe c5b1a8910d YARN-6461. TestRMAdminCLI has very low test timeouts. Contributed by Eric Badger
(cherry picked from commit 90d97372ed)
2017-04-11 09:18:56 -05:00
Jason Lowe 6e41aec109 YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka 2017-04-06 16:26:24 -05:00
Varun Saxena bf2c63ce46 YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena)
(cherry picked from commit 7d963c477a)
2017-04-06 02:09:32 +05:30
Jason Lowe ab231f5e1c YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang 2017-04-05 12:36:26 -05:00
Karthik Kambatla 9c1cf63a2d YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha)
(cherry picked from commit 9cc04b4708)
2017-04-05 10:04:36 -05:00
Varun Saxena 4fb72699ff YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena)
(cherry picked from commit 19b89c4c7b)
2017-04-05 09:43:36 +05:30
Eric Payne 800d632caa YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe
(cherry picked from commit 318bfb01bc)
2017-03-31 12:37:15 -05:00
Varun Saxena a2020024e2 YARN-6352. Header injections are possible in application proxy servlet (Naganarasimha G R via Varun Saxena)
(cherry picked from commit 3fe7d36e72)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/WebAppProxyServlet.java
2017-03-30 04:06:54 +05:30
Varun Saxena 5e751f3367 YARN-5368. Memory leak in timeline server (Jonathan Eagles via Varun Saxena)
(cherry picked from commit 01aca54a22)
2017-03-29 02:01:53 +05:30
Jason Lowe b1f0bde5dc YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter
(cherry picked from commit bea8f8190f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRM.java
2017-03-28 09:54:55 -05:00
Wangda Tan b218676b15 YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda)
(cherry picked from commit cd014d57aa)
2017-03-27 14:05:54 -07:00
Junping Du 86800b30a9 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
(cherry picked from commit 6df029db36)
(cherry picked from commit 3ad4d37363)
2017-03-25 14:34:55 -07:00
Jason Lowe 6c8df1208a YARN-6217. TestLocalCacheDirectoryManager test timeout is too aggressive. Contributed by Miklos Szegedi
(cherry picked from commit 4a8e304502)
2017-03-17 14:08:14 -05:00
Jason Lowe 5d86ce7b0d YARN-4051. ContainerKillEvent lost when container is still recovering and application finishes. Contributed by sandflee
(cherry picked from commit a16ba4296e)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/container/Container.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/MockContainer.java
2017-03-16 09:36:34 -05:00
Jason Lowe dd7c688a94 YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger
(cherry picked from commit 9649c27864)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/resource/TestResources.java
2017-03-10 13:09:20 -06:00