Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,789 Commits 326 Branches 371 Tags
Commit Graph

2649 Commits

Author SHA1 Message Date
Varun Saxena
367cb029d4 YARN-5773. RM recovery too slow due to LeafQueue#activateApplications (Bibin A Chundatt via Varun Saxena) 2016-10-30 11:50:54 +05:30
Jason Lowe
93165c1ade YARN-4963. capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable. Contributed by Nathan Roberts 2016-10-28 17:44:56 +00:00
Jason Lowe
9cc7ab4e96 YARN-5767. Fix the order that resources are cleaned up from the local Public/Private caches. Contributed by Chris Trezzo 
(cherry picked from commit 1b79c417dca17bcd2e031864bc6ca07254c61b47)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
 2016-10-28 16:11:59 +00:00
Jason Lowe
83bb428e6c YARN-5027. NM should clean up app log dirs after NM restart. Contributed by sandflee 
(cherry picked from commit 7146359bfd436a76585fb1f3ea93716795308cec)
 2016-10-28 15:50:22 +00:00
Jason Lowe
558e53b10b HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang 
(cherry picked from commit c017171da00a6cd71a2901c84a0298ce14a49e23)
 2016-10-28 15:06:57 +00:00
Carlo Curino
b32f14d806 YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
(cherry picked from commit 58ac40b55296834a8e3f3375caddc03bee901e9a)
 2016-10-27 15:23:04 -07:00
Subru Krishnan
55ba220721 YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru). 
(cherry picked from commit 79ae78dcbec183ab53b26de408b4517e5a151878)
(cherry picked from commit 4274600b9527706259ec5df62a13a5a66adc3ff2)
 2016-10-27 15:19:01 -07:00
Jason Lowe
d21dc8aa6c YARN-4831. Recovered containers will be killed after NM stateful restart. Contributed by Siqi Li 
(cherry picked from commit 7e3c327d316b33d6a09bfd4e65e7e5384943bb1d)
 2016-10-27 20:45:18 +00:00
Naganarasimha
3b9df97158 YARN-3848. TestNodeLabelContainerAllocation is timing out. Contributed by Varun Saxena 
(cherry picked from commit 6c8830992c734313fc95ac9988539c4d813c3581)
 2016-10-27 17:16:34 +05:30
Jian He
dab611e605 Revert YARN-4126. RM should not issue delegation tokens in unsecure mode. 
(cherry picked from commit bb8214cab8a239385c2b06ad689d87b82abf6964)
 2016-10-23 16:56:12 -07:00
Rohith Sharma K S
34023ca418 YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 19ee1859071509bba9ecd0a8a7dc6a47e2979c88)
 2016-10-19 17:40:42 +00:00
Varun Saxena
28d75482ff YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:36:39 +05:30
Varun Vasudev
d1841b4750 YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana. 2016-10-09 13:22:01 +05:30
Varun Vasudev
50409404bf YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 8ed2e060e80c0def3fcb7604e0bd27c1c24d291e)
(cherry picked from commit 78919f8c341ec645cf9134991e3ae89a929b9184)
 2016-10-09 11:53:03 +05:30
Junping Du
2ff6ffe0ef YARN-5659. getPathFromYarnURL should use standard methods. Contributed by Sergey Shelukhin. 
(cherry picked from commit 459a4833a90437a52787a41c2759a4b18cfe411c)
(cherry picked from commit 8bee319130f0637ba88ce2e9da18571f9788d027)
 2016-10-07 07:51:01 -07:00
Rohith Sharma K S
319b101b7e YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G. 
(cherry picked from commit 4d2f380d787a6145f45c87ba663079fedbf645b8)
 2016-10-06 20:44:39 +05:30
Varun Saxena
3656b84085 YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit d677b68c2599445fff56db4df26448a8bad0f5dd)
 2016-10-04 20:57:01 +00:00
Naganarasimha
90443140a5 YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 2016-10-03 13:29:18 -04:00
Jason Lowe
515727f46f YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-10-03 16:06:17 +00:00
Wangda Tan
69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
(cherry picked from commit 269401dc83699e4de7b99e794eeb7646a7f3fc93)
 2016-09-27 11:46:49 -07:00
Rohith Sharma K S
4f6facb90d YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 2016-09-27 23:07:43 +05:30
Naganarasimha
63ca9f5441 YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S 
(cherry picked from commit ebf528c443f3931c8b0f92ee76615fc203141675)
 2016-09-27 16:46:52 +05:30
Akira Ajisaka
ece3ca0cba YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov. 
(cherry picked from commit 14a696f369f7e3802587f57c8fff3aa51b5ab576)
(cherry picked from commit 74f2df16a919711cbd10464d11851110c1728edf)
 2016-09-26 15:01:39 +09:00
Naganarasimha
4c2b20ca3e YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena 
(cherry picked from commit e4e72db5f9f305b493138ab36f073fe5d1750ad8)
 2016-09-25 17:42:08 +05:30
Naganarasimha
41169b7c2b YARN-5664. Fix Yarn documentation to link to correct versions. Contributed by Xiao Chen 
(cherry picked from commit 4d16d2d72f085e4efb6db27d397802b21df18815)
 2016-09-24 23:24:56 +05:30
Naganarasimha
fa2025316d YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-24 22:42:28 +05:30
Kihwal Lee
9269225522 YARN-5622. TestYarnCLI.testGetContainers fails due to mismatched date formats. Contributed by Eric Badger. 
(cherry picked from commit 6e849cb658438c0561de485e01f3de7df47bf9ad)
 2016-09-23 14:15:31 -05:00
Varun Saxena
42f6f68c78 YARN-5539. TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out (Junping Du via Varun Saxena) 2016-09-23 13:34:18 +05:30
Wangda Tan
6f6e62ad86 YARN-4591. YARN Web UIs should provide a robots.txt. (Sidharta Seethana via wangda) 
(cherry picked from commit 5a58bfee30a662b1b556048504f66f9cf00d182a)
 2016-09-20 17:29:27 -07:00
Jason Lowe
4782390eb1 YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter 
(cherry picked from commit c6d1d742e70e7b8f1d89cf9a4780657646e6a367)
 2016-09-20 14:17:26 +00:00
Jason Lowe
564d9e6101 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:34:46 +00:00
Naganarasimha
a1cc90bca1 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt 
(cherry picked from commit ade7c2bc9ccf09d843ccb3dfa56c1453a9e87318)
 2016-09-17 10:01:11 +05:30
Jason Lowe
1ac8206a85 YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe 
(cherry picked from commit e7933097354a246b080b46f1a4ca2ef0f39f3b38)
 2016-09-13 14:43:55 +00:00
Varun Vasudev
d5ea508ca2 YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne. 2016-09-10 18:28:38 +00:00
Jason Lowe
1742022390 YARN-5632. UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw. Contributed by Jason Lowe 2016-09-09 22:40:17 +00:00
Karthik Kambatla
7a27b2a82f YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. Addendum to fix test flakiness. (Robert Kanter via kasha) 2016-09-08 21:11:20 -07:00
Karthik Kambatla
f9016dfec3 YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha) 2016-09-06 16:23:06 -07:00
Ray Chiang
02272a6a77 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang) 
(cherry picked from commit 4ee1729cb04e72f3015666d750ad1e54257345d2)
 2016-09-02 15:00:24 -07:00
Arun Suresh
979b29a03c YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh) 
(cherry picked from commit d6d9cff21b7b6141ed88359652cf22e8973c0661)
(cherry picked from commit b279f42d79175bef6529dc1ac4216198a3aaee4d)
 2016-08-31 20:06:49 -07:00
Zhe Zhang
765139e4da YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung. 
(cherry picked from commit ed6ff5cd789cab621fbfb88c8e8de4f215cd2961)
(cherry picked from commit 3ad4f0823c22b686120e8fa06ac52d705defcc61)
 2016-08-29 14:51:40 -07:00
Jason Lowe
09e585e30a YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po 
(cherry picked from commit 4cbe61407dcb71f099bc7ec6ae87560d786ee714)
 2016-08-29 16:20:04 +00:00
Naganarasimha
b952ce854b YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt 
(cherry picked from commit 46e02ab719d06f2708c0a61e8011b8f261235193)
 2016-08-26 20:24:37 +05:30
Jason Lowe
8657dece8b YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 
(cherry picked from commit 4037b22b7cb2755df17a65b03f6c0b9f63a476cd)
 2016-08-25 15:11:47 +00:00
Rohith Sharma K S
71a3b01d51 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:40:05 +05:30
Wangda Tan
2e9d84d24c YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 
(cherry picked from commit 2da32a6ef9edebd86ca9672d10ce35b5a46818cc)
(cherry picked from commit 3e511f39c220ef65708125a37e630c495c450ad1)
 2016-08-19 16:55:40 -07:00
Wangda Tan
9bf420b3bc YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-08-19 16:55:34 -07:00
Wangda Tan
3bf2e16f76 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
(cherry picked from commit c7d782d2f6e61103f7a009c48b11dcd64e07c2ce)
 2016-08-19 16:54:03 -07:00
Varun Vasudev
5b49bcaee3 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R. 
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
(cherry picked from commit 99966b1912320326fb63be1ce6d4222d736ca365)
 2016-08-18 12:33:52 -07:00
Karthik Kambatla
42a88f9c58 YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha) 
(cherry picked from commit 9d04f26d4c42170ee3dab2f6fb09a94bbf72fc65)
(cherry picked from commit f0923819c35b8c499a9bcd0c6c78511f3a400fef)
 2016-08-18 12:30:39 -07:00
Jason Lowe
74831973cb YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit e0b14f26f5201a149218276469434df511697acc)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-08-15 19:45:45 +00:00