Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,376 Commits 326 Branches 371 Tags
Commit Graph

1191 Commits

Author SHA1 Message Date
cnauroth
48302e687a YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma. 
(cherry picked from commit 6804d689019e4d2dfb2b35fd82f775a13e85960c)
 2015-02-13 21:59:14 -08:00
Jason Lowe
c9cd58d711 YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe 
(cherry picked from commit 1a0f508b6386b1c26ec606f6d73afddaa191b7d8)
 2015-02-13 20:22:12 +00:00
Tsuyoshi Ozawa
613065d75a YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang. 
(cherry picked from commit 110cf6b9a3b64cc2159e708967b854f5a419d438)
 2015-02-13 14:21:43 +09:00
Akira Ajisaka
9d8dbf8ea4 YARN-3191. Log object should be initialized with its own class. Contributed by Rohith. 
(cherry picked from commit 99c7f2b8fa417303e8f42ea3641c302135879280)
 2015-02-12 17:59:04 -08:00
Xuan
5f0495689f YARN-3158. Correct log messages in ResourceTrackerService. Contributed 
by Varun Saxena

(cherry picked from commit 99f6bd4f7ab1c5cac57362690c686139e73251d9)
 2015-02-12 16:43:28 -08:00
Jian He
b5d6f76c6a YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe 
(cherry picked from commit 18297e09727e4af95140084760ae1267e8fe51c4)
 2015-02-12 16:03:12 -08:00
Karthik Kambatla
fcfbdf6440 YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha) 
(cherry picked from commit c2b185def846f5577a130003a533b9c377b58fab)
 2015-02-12 15:39:50 -08:00
Jian He
1be2d64ddd YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan 
(cherry picked from commit 18a594257e052e8f10a03e5594e6cc6901dc56be)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-02-12 15:01:14 -08:00
Junping Du
380cc4dbed YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe) 
(cherry picked from commit 04f5ef18f7877ce30b12b1a3c1e851c420531b72)
 2015-02-12 11:48:24 -08:00
Xuan
58d9ce2ea1 YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran 
(cherry picked from commit 83be450acc7fc9bb9f7bbd006e7b0804bf10279c)
 2015-02-12 10:59:18 -08:00
Xuan
cac6fe217a YARN-3151. On Failover tracking url wrong in application cli for KILLED 
application. Contributed by Rohith

(cherry picked from commit 65c69e296edad48e50ef36e47803625ea46b51e1)
 2015-02-11 21:21:06 -08:00
Jason Lowe
38333c8f29 YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena 
(cherry picked from commit b379972ab39551d4b57436a54c0098a63742c7e1)
 2015-02-11 16:34:42 +00:00
Junping Du
f2c3058b8d YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu) 
(cherry picked from commit c541a374d88ffed6ee71b0e5d556939ccd2c5159)
 2015-02-11 03:46:40 -08:00
Zhijie Shen
fd75b8c9ca YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K. 
(cherry picked from commit d5855c0e46404cfc1b5a63e59015e68ba668f0ea)
 2015-02-10 15:29:09 -08:00
Jason Lowe
ca11ffa5de YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts 
(cherry picked from commit 3f5431a22fcef7e3eb9aceeefe324e5b7ac84049)
 2015-02-10 17:28:18 +00:00
Jason Lowe
9ffd985dc0 YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena 
(cherry picked from commit 4eb5f7fa32bab1b9ce3fb58eca51e2cd2e194cd5)
 2015-02-10 16:55:21 +00:00
Zhijie Shen
24d4d933f7 YARN-3100. Made YARN authorization pluggable. Contributed by Jian He. 
(cherry picked from commit 23bf6c72071782e3fd5a628e21495d6b974c7a9e)
 2015-02-09 20:37:58 -08:00
Jian He
6146680955 YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong 
(cherry picked from commit 0af6a99a3fcfa4b47d3bcba5e5cc5fe7b312a152)
 2015-02-09 13:47:33 -08:00
Karthik Kambatla
1cb1c8b615 YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha) 
(cherry picked from commit 7e42088abf230dce9c63497d0937fee4f9a1e4a5)
 2015-02-08 22:48:29 -08:00
Jason Lowe
61fdd862be YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe 
(cherry picked from commit da2fb2bc46bddf42d79c6d7664cbf0311973709e)
 2015-02-06 21:51:49 +00:00
Jason Lowe
83449a4e4d YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne 
(cherry picked from commit 4c484320b430950ce195cfad433a97099e117bad)
 2015-02-06 20:40:33 +00:00
Jian He
3ddafaa7c8 YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan 
(cherry picked from commit c1957fef29b07fea70938e971b30532a1e131fd0)
 2015-02-06 11:34:56 -08:00
Arun C. Murthy
92ff524182 YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong. 2015-02-05 23:59:34 -08:00
Arun C. Murthy
29c77de297 YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen. 2015-02-05 23:49:43 -08:00
Jian He
b109051145 YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 4641196fe02af5cab3d56a9f3c78875c495dbe03)
 2015-02-05 16:13:23 -08:00
Jason Lowe
ebdd88ec81 YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves 
(cherry picked from commit 69c8a7f45be5c0aa6787b07f328d74f1e2ba5628)
 2015-02-05 19:30:06 +00:00
Sandy Ryza
84df660af4 YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza) 2015-02-05 09:45:17 -08:00
Tsuyoshi Ozawa
cdd76d5922 YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu. 
(cherry picked from commit 26dee1486b70237a2a47f910472e9aa81ffad349)
 2015-02-04 11:41:48 +09:00
Zhijie Shen
3ab3caa9ea YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. 
(cherry picked from commit e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf)
 2015-02-03 17:35:40 -08:00
Xuan
c22dcdd191 YARN-3056. Add verification for containerLaunchDuration in 
TestNodeManagerMetrics. Contributed by zhihai Xu

(cherry picked from commit b73e776abc3e2479e397729c2bab9668f469e593)
 2015-02-03 15:14:23 -08:00
Wangda Tan
205e15c4a3 YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda) 
(cherry picked from commit 5bd984691b3e3df5d8aac910295138996e7a5839)
 2015-02-03 12:55:25 -08:00
Jian He
c0b1311a93 YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan 
(cherry picked from commit 21d80b3dd90a8e33e51701887c8d9369ed4ab17d)
 2015-02-03 11:43:40 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
 2015-02-03 10:39:51 -08:00
Jason Lowe
3828fb5fab YARN-3085. Application summary should include the application type. Contributed by Rohith 
(cherry picked from commit a761bf8726cb6285a505f1773ea3403eb985a65f)
 2015-02-03 14:57:25 +00:00
Jian He
4941b8f30d YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen 
(cherry picked from commit 054a947989d6ccbe54a803ca96dcebeba8328367)
 2015-01-30 17:35:26 -08:00
Jian He
cabf97ae4f YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan 
(cherry picked from commit 86358221fc85a7743052a0b4c1647353508bf308)
 2015-01-30 15:16:22 -08:00
Jonathan Eagles
d4ffca41d7 YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles) 
(cherry picked from commit 30a8778c632c0f57cdd005080a470065a60756a8)
 2015-01-29 16:52:37 -06:00
Akira Ajisaka
1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka) 
(cherry picked from commit 342efa110af9989829b8a8caa699658a2ba01607)
 2015-01-30 02:50:46 +09:00
Wangda Tan
58d7d1efc6 YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda) 
(cherry picked from commit 7882bc0f1433ae73361cab4207eb0c15abee4586)
 2015-01-28 21:56:17 -08:00
Wangda Tan
4718af4352 YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda) 
(cherry picked from commit 18741adf97f4fda5f8743318b59c440928e51297)
 2015-01-27 15:37:02 -08:00
Jonathan Eagles
c95e8951f8 YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles) 
(cherry picked from commit a8ad1e8089e4bf5854085d2d38d1c0133b5a41bc)
 2015-01-27 16:07:27 -06:00
Jian He
8100c8a68c YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena 
(cherry picked from commit 4e15fc08411318e11152fcd5a4648ed1d6fbb480)
 2015-01-27 13:31:48 -08:00
Tsuyoshi Ozawa
04ad500fac YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger. 
(cherry picked from commit f56da3ce040b16582ce8153df0d7cea00becd843)
 2015-01-28 00:16:07 +09:00
Jian He
61b4116b4b YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan 
(cherry picked from commit 6f9fe76918bbc79109653edc6cde85df05148ba3)
 2015-01-26 15:38:27 -08:00
Jason Lowe
07fe6a36cb YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne 
(cherry picked from commit 902c6ea7e4d3b49e49d9ce51ae9d12694ecfcf89)
 2015-01-26 15:41:23 +00:00
Xuan
a7696b3fbf YARN-3024. LocalizerRunner should give DIE action when all resources are 
localized. Contributed by Chengbing Liu

(cherry picked from commit 0d6bd62102f94c55d59f7a0a86a684e99d746127)
 2015-01-25 19:39:52 -08:00
Tsuyoshi Ozawa
25f2cf8a4e YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan. 
(cherry picked from commit 24aa462673d392fed859f8088acf9679ae62a129)
 2015-01-23 20:37:26 +09:00
Tsuyoshi Ozawa
ff627d94e7 YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot. 
(cherry picked from commit 3aab354e664a3ce09e0d638bf0c1e7d273d40579)
 2015-01-23 16:05:05 +09:00
Wangda Tan
ef6fc24dfb YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal 
(cherry picked from commit 0a2d3e717d9c42090a32ff177991a222a1e34132)
 2015-01-19 16:57:17 -08:00
Karthik Kambatla
4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba6028d51c1fcf9cdcb87f6ae6e08513)
 2015-01-17 06:26:47 +05:30