Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,689 Commits 326 Branches 371 Tags
Commit Graph

1387 Commits

Author SHA1 Message Date
Jason Lowe
f307b426f3 YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan 
(cherry picked from commit 81c9d17af84ed87b9ded7057cb726a3855ddd32d)

(cherry picked from commit 242fd0e39ad1c5d51719cd0f6c197166066e3288)
(cherry picked from commit a9d5acd898b34e1050a78f2d70ed62fdb82948a6)
 2015-08-27 18:36:50 -07:00
Jason Lowe
f83d898944 YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu 
(cherry picked from commit 49c38898b0be64fc686d039ed2fb2dea1378df02)

(cherry picked from commit ad140d1fc831735fb9335e27b38d2fc040847af1)
(cherry picked from commit 85b23c323c80c5303bd0b7bdb066258792ca67d8)
 2015-08-27 18:32:59 -07:00
Jian He
81ba30211e YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks 
(cherry picked from commit d005404ef7211fe96ce1801ed267a249568540fd)

(cherry picked from commit beb184ac580b0d89351a3f3a7201da34a26db1c1)
(cherry picked from commit 325bb33988743d60cb333002f9da60314241632e)
 2015-08-27 18:29:39 -07:00
Wangda Tan
881084fe5c YARN-3251. Fixed a deadlock in CapacityScheduler when computing absoluteMaxAvailableCapacity in LeafQueue (Craig Welch via wangda) 2015-02-26 17:05:25 -08:00
Tsuyoshi Ozawa
ca121a78fd Revert "YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du)" 
This reverts commit d79f63120e16cb03f3f85b5d79a84202881a95a5.
 2014-12-21 12:47:28 +09:00
Tsuyoshi Ozawa
d79f63120e YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du) 
(cherry picked from commit cf7fe583d14ebb16fc1b6e29dc2afbf67d24b9d1)
 2014-12-20 23:09:58 +09:00
Jonathan Eagles
a9b76813a2 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles) 
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-20 23:54:59 -06:00
Vinod Kumar Vavilapalli
56020955fd YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He. 
(cherry picked from commit 3651fe1b089851b38be351c00a9899817166bf3e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-13 10:40:09 -08:00
Karthik Kambatla
b579c3d405 YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha) 
(cherry picked from commit 80d11eb68e60f88e16d7d41edecbddfc935a6b10)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
 2014-11-13 10:36:13 -08:00
Jason Lowe
685790e027 YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du 
(cherry picked from commit 33ea5ae92b9dd3abace104903d9a94d17dd75af5)
 2014-11-13 16:12:30 +00:00
Zhijie Shen
1535e7211e YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He. 
(cherry picked from commit be7bf956e96dd0fd9b521ca71df9124b9cc5ebd0)
 2014-11-12 11:10:47 -08:00
Vinod Kumar Vavilapalli
7a8a413eb2 YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan. 
(cherry picked from commit 0fd97f9c1989a793b882e6678285607472a3f75a)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-12 10:44:08 -08:00
Xuan
a690629ffc YARN-2841. RMProxy should retry EOFException. Contributed by Jian He 2014-11-12 10:28:55 -08:00
Ravi Prakash
9613a57e83 YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN 2014-11-12 09:33:42 -08:00
Arun C. Murthy
60584c732f Preparing to release hadoop-2.6.0: Set version in branch-2.6 to 2.6.1-SNAPSHOT. 2014-11-09 19:21:11 -08:00
Vinod Kumar Vavilapalli
6a9534e9cf YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He. 
Fixed a minor import issue in the test during cherry-pick from trunk.

(cherry picked from commit e76faebc9589654e83c8244ef9aff88391e56b80)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestWorkPreservingRMRestart.java
 2014-11-09 19:09:48 -08:00
Karthik Kambatla
e9f7079c58 Fix broken download of directories 
(cherry picked from commit 745c9a01243b8eefc72d89d1164d7d010b80983b)
 2014-11-09 18:38:57 -08:00
Arun C. Murthy
c2cc879f01 YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles. 
(cherry picked from commit 43cd07b408c6613d2c9aa89203cfa3110d830538)
 2014-11-09 15:04:55 -08:00
Vinod Kumar Vavilapalli
f098b261fe YARN-2607. Fixed issues in TestDistributedShell. Contributed by Wangda Tan. 
(cherry picked from commit 737d9284c109dac20ff423f30c62f6abe2db10f7)
 2014-11-08 11:02:55 -08:00
Zhijie Shen
33da0f8ecf YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch. 
(cherry picked from commit 9a4e0d343e9e891c10ef6682e7b2231a59e69ade)
 2014-11-07 20:40:56 -08:00
Vinod Kumar Vavilapalli
6ff765bea2 YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan. 
(cherry picked from commit df36edf751202db00d8f43103d7120ec56d70a04)
 2014-11-07 19:45:23 -08:00
Xuan
629274c09b YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen 
(cherry picked from commit 4a114dd67aae83e5bb2d65470166de954acf36a2)
(cherry picked from commit 7d26cffb0cb21c16b335e8ae9b02523565ad3b5d)
 2014-11-07 16:13:38 -08:00
Jason Lowe
dcc1ab15ab YARN-2632. Document NM Restart feature. Contributed by Junping Du and Vinod Kumar Vavilapalli 
(cherry picked from commit 1e215e8ba2e801eb26f16c307daee756d6b2ca66)
 2014-11-07 23:42:26 +00:00
Jason Lowe
e5c0fa2c95 YARN-2825. Container leak on NM. Contributed by Jian He 
(cherry picked from commit c3d475070a1ec54c4b05923f4782cef204effd2c)
 2014-11-07 23:17:49 +00:00
Vinod Kumar Vavilapalli
6593aaf117 YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu. 
(cherry picked from commit 4cfd5bc7c18bb9a828f573b5c4d2b13fa28e732a)
 2014-11-07 14:17:23 -08:00
cnauroth
9adb31b6a8 YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch. 
(cherry picked from commit 06b797947c980d7d21864eb8b700cf565756aac1)
(cherry picked from commit c16f7182937dc4e8bbf46dfedd9db427a0a33357)
 2014-11-07 12:45:25 -08:00
Vinod Kumar Vavilapalli
326c722eb7 YARN-2827. Fixed bugs in "yarn queue" CLI. Contributed by Wangda Tan. 
(cherry picked from commit 7b190796578c55d1f282188a53ccfa2abd8cab21)
 2014-11-07 12:01:33 -08:00
Vinod Kumar Vavilapalli
71a18a5303 YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan. 
(cherry picked from commit 2ac1be7dec4aef001e3162e364249933b2c4a6c4)
 2014-11-07 10:45:01 -08:00
Xuan
09955ea2c3 YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev 
(cherry picked from commit 1e97f2f09464e871773188f642f3a01b744c580f)
(cherry picked from commit bf795418686e1559db4c37c0b107bb5c08bbf525)
 2014-11-07 09:46:53 -08:00
Vinod Kumar Vavilapalli
9f7396be55 YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He. 
(cherry picked from commit a5657182a7accebe08cd86e46b4cdeb163d4d1f2)
 2014-11-07 09:30:31 -08:00
Vinod Kumar Vavilapalli
8c3a0d5a98 YARN-2647. Added a queue CLI for getting queue information. Contributed by Sunil Govind. 
(cherry picked from commit 61effcbebc819ee1bd3d60f5444c39c972494a32)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn

(cherry picked from commit b1521c7c3ce7dfaabdb3fc1d74c10970dda57fe5)
 2014-11-06 22:22:16 -08:00
Vinod Kumar Vavilapalli
21ef5afafa YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan. 
(cherry picked from commit a3839a9fbfb8eec396b9bf85472d25e0ffc3aab2)
 2014-11-06 17:29:39 -08:00
Steve Loughran
e333584ca6 YARN-2768 Improved Yarn Registry service record structure (stevel) 2014-11-06 20:21:49 +00:00
Vinod Kumar Vavilapalli
b557f689b4 YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen. 
(cherry picked from commit f5b19bed7d71979dc8685b03152188902b6e45e9)
 2014-11-06 11:50:12 -08:00
Xuan
43854764a9 YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen 
(cherry picked from commit b0b52c4e11336ca2ad6a02d64c0b5d5a8f1339ae)
(cherry picked from commit 4aa98d599194a444c9d2e1fe95262e32bf744d35)
 2014-11-05 20:45:09 -08:00
Xuan
888fc4af4e YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen 2014-11-05 18:27:41 -08:00
Jian He
e29e864c51 YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks 
(cherry picked from commit 395275af8622c780b9071c243422b0780e096202)
 2014-11-05 17:03:26 -08:00
Vinod Kumar Vavilapalli
812ddc3991 YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan. 
(cherry picked from commit 834e931d8efe4d806347b266e7e62929ce05389b)
 2014-11-05 15:32:49 -08:00
Zhijie Shen
a1764e4d33 YARN-2767. Added a test case to verify that http static user cannot kill or submit apps in the secure mode. Contributed by Varun Vasudev. 
(cherry picked from commit 7a4c92a9d55fcecef066053ac30dff0fcd4ec90c)
 2014-11-05 11:04:38 -08:00
Vinod Kumar Vavilapalli
87e880b580 YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen. 
(cherry picked from commit b76179895dd2ef4d56e8de31e9f673375faa2afa)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-04 18:04:37 -08:00
Karthik Kambatla
36993e39d0 YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha) 
(cherry picked from commit b2cd2698028118b6384904732dbf94942f644732)
 2014-11-04 17:49:56 -08:00
Zhijie Shen
1550617e48 YARN-2752. Made ContainerExecutor append "nice -n" arg only when priority adjustment flag is set. Contributed by Xuan Gong. 
(cherry picked from commit e06c23a6c92ef783cdb45447fa2abd1ab48d166f)
 2014-11-04 15:54:28 -08:00
Vinod Kumar Vavilapalli
0b73606b1c YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi. 
(cherry picked from commit c5a46d4c8ca236ff641a309f256bbbdf4dd56db5)
 2014-11-03 16:41:21 -08:00
Vinod Kumar Vavilapalli
f2ef8c7b48 YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan. 
(cherry picked from commit ec6cbece8e7772868ce8ad996135d3136bd32245)
 2014-11-03 13:46:05 -08:00
Vinod Kumar Vavilapalli
c205841d49 YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong. 
(cherry picked from commit 58e9f24e0f06efede21085b7ffe36af042fa7b38)
 2014-11-03 13:20:01 -08:00
Vinod Kumar Vavilapalli
dd82a1eb75 YARN-2798. Fixed YarnClient to populate the renewer correctly for Timeline delegation tokens. Contributed by Zhijie Shen. 
(cherry picked from commit 71fbb474f531f60c5d908cf724f18f90dfd5fa9f)
 2014-11-03 12:51:30 -08:00
Jason Lowe
2098c68acb YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li 
(cherry picked from commit 6157ace5475fff8d2513fd3cd99134b532b0b406)
 2014-11-03 20:40:02 +00:00
Zhijie Shen
3e41828639 YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev. 
(cherry picked from commit 27715ec63bd77f1d31ee922b7daba85071da54ca)
 2014-11-02 15:24:07 -08:00
Vinod Kumar Vavilapalli
5a0aac5506 YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He. 
(cherry picked from commit 5c0381c96aa79196829edbca497c649eb6776944)
 2014-11-01 16:34:11 -07:00
Zhijie Shen
5492370a4c YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev. 
(cherry picked from commit 1cd088fd9dac3015df0b6281974fc6b6c3ece20d)
 2014-10-31 17:51:03 -07:00