Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,444 Commits 326 Branches 371 Tags
Commit Graph

1603 Commits

Author SHA1 Message Date
Devaraj K
b9e82e27f5 YARN-2797. Add -help to yarn logs and nodes CLI command. Contributed by 
Jagadesh Kiran N.

(cherry picked from commit b610c68d4423a5a1ab342dc490cd0064f8983c07)
 2015-02-24 12:08:50 +05:30
Xuan
0ca974d0b0 YARN-2797. TestWorkPreservingRMRestart should use 
ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla

(cherry picked from commit fe7a302473251b7310105a936edf220e401c613f)
 2015-02-21 19:19:08 -08:00
Xuan
f8435c5d3d YARN-3236. Cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY. 
Contributed by zhihai xu

(cherry picked from commit e3d290244c8a39edc37146d992cf34e6963b6851)
 2015-02-21 16:20:33 -08:00
Xuan
fefeba4ac8 YARN-3238. Connection timeouts to nodemanagers are retried at multiple 
levels. Contributed by Jason Lowe

(cherry picked from commit 92d67ace3248930c0c0335070cc71a480c566a36)
 2015-02-21 16:07:28 -08:00
Xuan
9cbe9bcbaa YARN-3237. AppLogAggregatorImpl fails to log error cause. Contributed by 
Rushabh S Shah

(cherry picked from commit f56c65bb3eb9436b67de2df63098e26589e70e56)
 2015-02-20 14:03:46 -08:00
Wangda Tan
a1963968d2 YARN-3230. Clarify application states on the web UI. (Jian He via wangda) 
(cherry picked from commit ce5bf927c3d9f212798de1bf8706e5e9def235a1)
 2015-02-20 10:40:04 -08:00
Junping Du
4a87a61fe9 YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90. Contributed by Zhihai Xu 
(cherry picked from commit c33ae271c24f0770c9735ccd2086cafda4f4e0b2)
 2015-02-20 09:44:31 -08:00
Jason Lowe
3e8dfd1299 YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith 
(cherry picked from commit a64dd3d24bfcb9af21eb63869924f6482b147fd3)
 2015-02-20 15:12:08 +00:00
Jian He
eaeaf80d39 YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks 
(cherry picked from commit c0d9b93953767608dfe429ddb9bd4c1c3bd3debf)
 2015-02-19 15:43:14 -08:00
Wangda Tan
cd5eb9c1de YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda) 
(cherry picked from commit d49ae725d5fa3eecf879ac42c42a368dd811f854)
 2015-02-19 11:01:47 -08:00
Tsuyoshi Ozawa
fef5efa0cb YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka. 
(cherry picked from commit b8a14efdf535d42bcafa58d380bd2c7f4d36f8cb)
 2015-02-19 10:24:40 +09:00
Jian He
b8fe1a747e YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 1c03376300a46722d4147f5b8f37242f68dba0a2)
 2015-02-18 16:34:42 -08:00
Jian He
8f06eaa251 YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan 
(cherry picked from commit f5da5566d9c392a5df71a2dce4c2d0d50eea51ee)
 2015-02-18 11:52:28 -08:00
Xuan
ba18adbb27 YARN-3207. Secondary filter matches entites which do not have the key 
being filtered for. Contributed by Zhijie Shen

(cherry picked from commit 57db50cbe3ce42618ad6d6869ae337d15b261f4e)
 2015-02-17 18:18:56 -08:00
Tsuyoshi Ozawa
fabac2ff30 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K. 
(cherry picked from commit 556386a07084b70a5d2ae0c2bd4445a348306db8)
 2015-02-17 01:54:09 +09:00
Tsuyoshi Ozawa
42368b91c4 Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj." 
This reverts commit 67e3a77720cfcb0fc540e8e0c80a5d42b8140fcc.
 2015-02-17 01:53:58 +09:00
Tsuyoshi Ozawa
67e3a77720 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj. 
(cherry picked from commit 9aae81c93421874b726c7b6ff970895c429e502d)
 2015-02-17 01:48:53 +09:00
Tsuyoshi Ozawa
fd8f7e2c7d YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 447bd7b5a61a5788dc2a5d29cedfc19f0e99c0f5)
 2015-02-16 23:56:32 +09:00
Junping Du
eee89bd18c YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong) 
(cherry picked from commit ab0b958a522d502426b91b6e4ab6dd29caccc372)
 2015-02-15 06:48:29 -08:00
cnauroth
48302e687a YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma. 
(cherry picked from commit 6804d689019e4d2dfb2b35fd82f775a13e85960c)
 2015-02-13 21:59:14 -08:00
Jason Lowe
c9cd58d711 YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe 
(cherry picked from commit 1a0f508b6386b1c26ec606f6d73afddaa191b7d8)
 2015-02-13 20:22:12 +00:00
Xuan
3c4b5606dc YARN-3164. RMAdmin command usage prints incorrect command name. 
Contributed by Bibin A Chundatt

(cherry picked from commit 253035491ce208a8c9b50a20da91f5b8e679eebf)
 2015-02-12 21:40:42 -08:00
Tsuyoshi Ozawa
613065d75a YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang. 
(cherry picked from commit 110cf6b9a3b64cc2159e708967b854f5a419d438)
 2015-02-13 14:21:43 +09:00
Tsuyoshi Ozawa
43429cd33a YARN-2994. Document work-preserving RM restart. Contributed by Jian He. 
(cherry picked from commit b0d81e05abd730a923aed4727a8191650aebd2f9)
 2015-02-13 13:08:37 +09:00
Akira Ajisaka
9d8dbf8ea4 YARN-3191. Log object should be initialized with its own class. Contributed by Rohith. 
(cherry picked from commit 99c7f2b8fa417303e8f42ea3641c302135879280)
 2015-02-12 17:59:04 -08:00
Xuan
df6bee5a75 YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and 
CommonNodeLabelsManager. Contributed by Ray Chiang

(cherry picked from commit 2586915bb3178d26ad692f93d53aaffbb55d9ed9)
 2015-02-12 17:32:58 -08:00
Xuan
5f0495689f YARN-3158. Correct log messages in ResourceTrackerService. Contributed 
by Varun Saxena

(cherry picked from commit 99f6bd4f7ab1c5cac57362690c686139e73251d9)
 2015-02-12 16:43:28 -08:00
Jian He
b5d6f76c6a YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe 
(cherry picked from commit 18297e09727e4af95140084760ae1267e8fe51c4)
 2015-02-12 16:03:12 -08:00
Karthik Kambatla
fcfbdf6440 YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha) 
(cherry picked from commit c2b185def846f5577a130003a533b9c377b58fab)
 2015-02-12 15:39:50 -08:00
Jian He
1be2d64ddd YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan 
(cherry picked from commit 18a594257e052e8f10a03e5594e6cc6901dc56be)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-02-12 15:01:14 -08:00
Junping Du
380cc4dbed YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe) 
(cherry picked from commit 04f5ef18f7877ce30b12b1a3c1e851c420531b72)
 2015-02-12 11:48:24 -08:00
Xuan
58d9ce2ea1 YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran 
(cherry picked from commit 83be450acc7fc9bb9f7bbd006e7b0804bf10279c)
 2015-02-12 10:59:18 -08:00
Tsuyoshi Ozawa
dc14f2772f YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt. 
(cherry picked from commit 7bc492adab90c4533c20d48c004e92cb917cd199)
 2015-02-12 23:49:27 +09:00
Junping Du
634cc297ba YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du) 
(cherry picked from commit 46c7577b9843766b8cc3e81eae1100d4c194286a)
 2015-02-12 03:40:57 -08:00
Tsuyoshi Ozawa
c9c1d9a5a6 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-12 19:03:24 +09:00
Tsuyoshi Ozawa
fd047702e4 YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b3bcbaf277ec389ec048a4b5cd59b2e90781a30b)
 2015-02-12 15:19:54 +09:00
Xuan
cac6fe217a YARN-3151. On Failover tracking url wrong in application cli for KILLED 
application. Contributed by Rohith

(cherry picked from commit 65c69e296edad48e50ef36e47803625ea46b51e1)
 2015-02-11 21:21:06 -08:00
Jason Lowe
38333c8f29 YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena 
(cherry picked from commit b379972ab39551d4b57436a54c0098a63742c7e1)
 2015-02-11 16:34:42 +00:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Steve Loughran
4241c2be3d YARN-2616 [YARN-913] Add CLI client to the registry to list, view and manipulate entries. (Akshay Radia via stevel) 2015-02-11 14:18:46 +00:00
Junping Du
f2c3058b8d YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu) 
(cherry picked from commit c541a374d88ffed6ee71b0e5d556939ccd2c5159)
 2015-02-11 03:46:40 -08:00
Zhijie Shen
fd75b8c9ca YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K. 
(cherry picked from commit d5855c0e46404cfc1b5a63e59015e68ba668f0ea)
 2015-02-10 15:29:09 -08:00
Jason Lowe
ca11ffa5de YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts 
(cherry picked from commit 3f5431a22fcef7e3eb9aceeefe324e5b7ac84049)
 2015-02-10 17:28:18 +00:00
Jason Lowe
9ffd985dc0 YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena 
(cherry picked from commit 4eb5f7fa32bab1b9ce3fb58eca51e2cd2e194cd5)
 2015-02-10 16:55:21 +00:00
Zhijie Shen
24d4d933f7 YARN-3100. Made YARN authorization pluggable. Contributed by Jian He. 
(cherry picked from commit 23bf6c72071782e3fd5a628e21495d6b974c7a9e)
 2015-02-09 20:37:58 -08:00
Wangda Tan
4d4442cb39 YARN-3155. Refactor the exception handling code for TimelineClientImpl's retryOn method (Li Lu via wangda) 
(cherry picked from commit 00a748d24a565bce0cc8cfa2bdcf165778cea395)
 2015-02-09 17:30:59 -08:00
Jonathan Eagles
c0e14d546e YARN-2971. RM uses conf instead of token service address to renew timeline delegation tokens (jeagles) 
(cherry picked from commit af0842589359ad800427337ad2c84fac09907f72)
 2015-02-09 17:56:59 -06:00
Jian He
6146680955 YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong 
(cherry picked from commit 0af6a99a3fcfa4b47d3bcba5e5cc5fe7b312a152)
 2015-02-09 13:47:33 -08:00
Karthik Kambatla
1cb1c8b615 YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha) 
(cherry picked from commit 7e42088abf230dce9c63497d0937fee4f9a1e4a5)
 2015-02-08 22:48:29 -08:00
Jason Lowe
61fdd862be YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe 
(cherry picked from commit da2fb2bc46bddf42d79c6d7664cbf0311973709e)
 2015-02-06 21:51:49 +00:00