Commit Graph

2631 Commits

Author SHA1 Message Date
Jason Lowe 515727f46f YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)
(cherry picked from commit ac68666803)
2016-10-03 16:06:17 +00:00
Wangda Tan 69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
(cherry picked from commit 875062b5bc)
(cherry picked from commit 269401dc83)
2016-09-27 11:46:49 -07:00
Rohith Sharma K S 4f6facb90d YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 2016-09-27 23:07:43 +05:30
Naganarasimha 63ca9f5441 YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S
(cherry picked from commit ebf528c443)
2016-09-27 16:46:52 +05:30
Akira Ajisaka ece3ca0cba YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.
(cherry picked from commit 14a696f369)
(cherry picked from commit 74f2df16a9)
2016-09-26 15:01:39 +09:00
Naganarasimha 4c2b20ca3e YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena
(cherry picked from commit e4e72db5f9)
2016-09-25 17:42:08 +05:30
Naganarasimha 41169b7c2b YARN-5664. Fix Yarn documentation to link to correct versions. Contributed by Xiao Chen
(cherry picked from commit 4d16d2d72f)
2016-09-24 23:24:56 +05:30
Naganarasimha fa2025316d YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-24 22:42:28 +05:30
Kihwal Lee 9269225522 YARN-5622. TestYarnCLI.testGetContainers fails due to mismatched date formats. Contributed by Eric Badger.
(cherry picked from commit 6e849cb658)
2016-09-23 14:15:31 -05:00
Varun Saxena 42f6f68c78 YARN-5539. TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out (Junping Du via Varun Saxena) 2016-09-23 13:34:18 +05:30
Wangda Tan 6f6e62ad86 YARN-4591. YARN Web UIs should provide a robots.txt. (Sidharta Seethana via wangda)
(cherry picked from commit 5a58bfee30)
2016-09-20 17:29:27 -07:00
Jason Lowe 4782390eb1 YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter
(cherry picked from commit c6d1d742e7)
2016-09-20 14:17:26 +00:00
Jason Lowe 564d9e6101 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:34:46 +00:00
Naganarasimha a1cc90bca1 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
(cherry picked from commit ade7c2bc9c)
2016-09-17 10:01:11 +05:30
Jason Lowe 1ac8206a85 YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe
(cherry picked from commit e793309735)
2016-09-13 14:43:55 +00:00
Varun Vasudev d5ea508ca2 YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne. 2016-09-10 18:28:38 +00:00
Jason Lowe 1742022390 YARN-5632. UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw. Contributed by Jason Lowe 2016-09-09 22:40:17 +00:00
Karthik Kambatla 7a27b2a82f YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. Addendum to fix test flakiness. (Robert Kanter via kasha) 2016-09-08 21:11:20 -07:00
Karthik Kambatla f9016dfec3 YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha) 2016-09-06 16:23:06 -07:00
Ray Chiang 02272a6a77 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)
(cherry picked from commit 4ee1729cb0)
2016-09-02 15:00:24 -07:00
Arun Suresh 979b29a03c YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
(cherry picked from commit d6d9cff21b)
(cherry picked from commit b279f42d79)
2016-08-31 20:06:49 -07:00
Zhe Zhang 765139e4da YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung.
(cherry picked from commit ed6ff5cd78)
(cherry picked from commit 3ad4f0823c)
2016-08-29 14:51:40 -07:00
Jason Lowe 09e585e30a YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po
(cherry picked from commit 4cbe61407d)
2016-08-29 16:20:04 +00:00
Naganarasimha b952ce854b YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt
(cherry picked from commit 46e02ab719)
2016-08-26 20:24:37 +05:30
Jason Lowe 8657dece8b YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po
(cherry picked from commit 4037b22b7c)
2016-08-25 15:11:47 +00:00
Rohith Sharma K S 71a3b01d51 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.
(cherry picked from commit 0d5997d2b9)
2016-08-23 14:40:05 +05:30
Wangda Tan 2e9d84d24c YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda)
(cherry picked from commit 2da32a6ef9)
(cherry picked from commit 3e511f39c2)
2016-08-19 16:55:40 -07:00
Wangda Tan 9bf420b3bc YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-08-19 16:55:34 -07:00
Wangda Tan 3bf2e16f76 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda)
(cherry picked from commit 444b2ea7af)
(cherry picked from commit c7d782d2f6)
2016-08-19 16:54:03 -07:00
Varun Vasudev 5b49bcaee3 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
(cherry picked from commit 308d63f382)
(cherry picked from commit 99966b1912)
2016-08-18 12:33:52 -07:00
Karthik Kambatla 42a88f9c58 YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)
(cherry picked from commit 9d04f26d4c)
(cherry picked from commit f0923819c3)
2016-08-18 12:30:39 -07:00
Jason Lowe 74831973cb YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit e0b14f26f5)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-15 19:45:45 +00:00
Junping Du 1a38dd9cee YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss.
(cherry picked from commit 0005816743)
2016-08-15 19:18:36 +00:00
Varun Saxena ca139a3f87 YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena) 2016-08-13 00:27:17 +05:30
Rohith Sharma K S f7cc0af611 YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C.
(cherry picked from commit 5199db387d)
2016-08-11 11:52:44 +05:30
Jason Lowe 69217ba813 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C
(cherry picked from commit 5c95bb315b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAuditLogger.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMAuditLogger.java
2016-08-10 19:15:12 +00:00
Jason Lowe e1845faeda YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee
(cherry picked from commit 3d401206cf)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
2016-08-10 18:09:11 +00:00
Rohith Sharma K S 3b4d6ece1a YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S
(cherry picked from commit 26b5e6116f)
2016-08-09 22:19:17 +00:00
Naganarasimha 16c8fd9dca YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang. 2016-08-09 17:34:48 +05:30
Naganarasimha e6a994badf YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula
(cherry picked from commit d81b8163b4)
(cherry picked from commit 991823482f)
2016-08-06 08:19:56 +05:30
Jason Lowe 470ea3da1f YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit c01bee0108)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-05 20:10:04 +00:00
Jason Lowe eef24f5d93 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
(cherry picked from commit db4a61dc61)
2016-08-03 19:54:00 +00:00
Jason Lowe 5883718eea YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe)
2016-08-03 19:33:58 +00:00
Jason Lowe c972498b74 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
(cherry picked from commit db646540f0)
2016-08-03 19:19:47 +00:00
Jason Lowe aca7eea611 YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla 2016-08-03 19:01:14 +00:00
Wangda Tan c322e749d6 YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda) 2016-08-03 11:29:12 -07:00
Junping Du bba06f4526 YARN-5434. Add -client|server argument for graceful decommmission. Contributed by Robert Kanter.
(cherry picked from commit 95f2b98597)
(cherry picked from commit 47dd871f96)
2016-07-29 10:31:17 -07:00
Jason Lowe 95fb2fe394 YARN-5438. TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM. Contributed by Rohith Sharma K S
(cherry picked from commit a1890c32c5)
2016-07-28 21:49:21 +00:00
Junping Du 08358c8d4e YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.
(cherry picked from commit 7f3c306e2e)
(cherry picked from commit 932bf79244)
2016-07-28 06:56:00 -07:00
mattf-horton c96cb3fd48 HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley. 2016-07-21 16:01:05 -07:00