Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,891 Commits 326 Branches 371 Tags
Commit Graph

1845 Commits

Author SHA1 Message Date
Wangda Tan
d0ea982e64 YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda) 
(cherry picked from commit 44872b76fcc0ddfbc7b0a4e54eef50fe8708e0f5)
 2015-04-20 17:13:01 -07:00
Jian He
6b454aacc3 YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe 
(cherry picked from commit f967fd2f21791c5c4a5a090cc14ee88d155d2e2b)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-04-20 10:40:09 -07:00
Jian He
6f70f1b1af YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G 
(cherry picked from commit 497c86b485b1bb8a2eba52308646d8e1ee76bce3)
 2015-04-18 12:47:30 -07:00
Wangda Tan
3316cd4357 YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda) 
(cherry picked from commit f47a5763acd55cb0b3f16152c7f8df06ec0e09a9)
 2015-04-17 17:23:00 -07:00
Wangda Tan
e7cbecddc3 YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda) 
(cherry picked from commit f65eeb412d140a3808bcf99344a9f3a965918f70)
 2015-04-17 17:15:16 -07:00
Jian He
9827da95bc YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks 
(cherry picked from commit 6779467ab6fcc6a02d0e8c80b138cc9df1aa831e)
 2015-04-17 15:57:36 -07:00
Jian He
57eb07d34b YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan 
(cherry picked from commit d573f09fb93dbb711d504620af5d73840ea063a6)
 2015-04-17 13:37:34 -07:00
Junping Du
b244701fad YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong. 
(cherry picked from commit 1db355a875c3ecc40a244045c6812e00c8d36ef1)
 2015-04-17 13:20:27 -07:00
Jian He
42cf8e0554 YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang 
(cherry picked from commit bb6dde68f19be1885a9e7f7949316a03825b6f3e)
 2015-04-16 19:44:32 -07:00
Akira Ajisaka
51c458a5c4 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
 2015-04-16 10:06:03 -05:00
Jian He
6fed2c2a79 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan 
(cherry picked from commit 1b89a3e173f8e905074ed6714a7be5c003c0e2c4)
 2015-04-15 14:03:29 -07:00
Jian He
58f99b740a YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi 
(cherry picked from commit b2e6cf607f1712d103520ca6b3ff21ecc07cd265)
 2015-04-15 13:53:24 -07:00
Tsuyoshi Ozawa
e977247f3e YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R. 
(cherry picked from commit e48cedc663b8a26fd62140c8e2907f9b4edd9785)
 2015-04-15 14:04:24 -05:00
Wangda Tan
89a7c98436 YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda) 
(cherry picked from commit 5004e753322084e42dfda4be1d2db66677f86a1e)
 2015-04-15 09:57:52 -07:00
Harsh J
01af29106a YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R. 2015-04-15 09:41:43 +05:30
Tsuyoshi Ozawa
3daca4f040 YARN-3436. Fix URIs in documantion of YARN web service REST APIs. Contributed by Bibin A Chundatt. 
(cherry picked from commit 05007b45e58bd9052f503cfb8c17bcfd22a686e3)
 2015-04-14 14:14:17 -05:00
Jian He
9ebbf1bfce YARN-3361. CapacityScheduler side changes to support non-exclusive node labels. Contributed by Wangda Tan 
(cherry picked from commit 0fefda645bca935b87b6bb8ca63e6f18340d59f5)
 2015-04-14 11:46:35 -07:00
Jian He
81bbee6852 YARN-3266. RMContext#inactiveNodes should have NodeId as map key. Contributed by Chengbing Liu 
(cherry picked from commit b46ee1e7a31007985b88072d9af3d97c33a261a7)
 2015-04-14 11:31:42 -07:00
Junping Du
7c072bf092 YARN-3443. Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM. Contributed by Sidharta Seethana. 
(cherry picked from commit 838b06ac87339494cea706d4a97e7f5383bdc442)
 2015-04-13 18:37:39 -07:00
Junping Du
a64b8915de YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong. 
(cherry picked from commit a77d628339afaf2f5a085c73fd81a805b18348c9)
 2015-04-13 17:41:02 -07:00
Jian He
1afea8a15a YARN-3394. Enrich WebApplication proxy documentation. Contributed by Naganarasimha G R 
(cherry picked from commit 7b4671490ae4c4ac524925e9c3c686cbf6cabd73)
 2015-04-13 17:05:58 -07:00
Jian He
d58f5c8894 YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks 
(cherry picked from commit a1afbc48b53f6bdbd30dc8eb56a7621d49c5d6db)
 2015-04-13 14:07:51 -07:00
Karthik Kambatla
fa12700379 Fix up author name to Jun Gong in CHANGES.txt for YARN-3469 
(cherry picked from commit 5cda6fffd39fcb997b6e3cbcd0a2e2dce07153e1)
 2015-04-13 13:52:44 -07:00
Jian He
32b01263d3 YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal 
(cherry picked from commit 944a16579fdb54c1c420162ef830ef2ac5451c69)
 2015-04-13 10:54:15 -07:00
Karthik Kambatla
ad99d268e5 YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha) 
(cherry picked from commit e516706b896743e47e2852be81944eb5613e3e76)
 2015-04-10 11:21:30 -07:00
Jian He
d3daf9665c YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev 2015-04-10 10:40:31 -07:00
Junping Du
0891de0712 YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong. 
(cherry picked from commit 92431c961741747b5d6442f4025016d48d9a6863)
 2015-04-10 08:58:07 -07:00
Xuan
f5b49160d9 YARN-3293. Track and display capacity scheduler health metrics in web 
UI. Contributed by Varun Vasudev

(cherry picked from commit afa5d4715a3aea2a6e93380b014c7bb8f0880383)
 2015-04-09 23:40:02 -07:00
Vinod Kumar Vavilapalli
aec1c5ec7d Adding release 2.7.1 to CHANGES.txt 
(cherry picked from commit 623fd46c1eac057ea9bc4b503a47ad1a831cdacf)
 2015-04-09 13:56:14 -07:00
Vinod Kumar Vavilapalli
1ff3fd33ed YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp. 
(cherry picked from commit 9c5911294e0ba71aefe4763731b0e780cde9d0ca)
 2015-04-09 13:10:06 -07:00
Wangda Tan
73d9e4c77b YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda) 
(cherry picked from commit 1885141e90837252934192040a40047c7adbc1b5)
 2015-04-09 10:36:10 -07:00
Karthik Kambatla
53e0bf5c17 YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha) 
(cherry picked from commit 6495940eae09418a939882a8955845f9241a6485)
 2015-04-09 00:10:23 -07:00
Hitesh Shah
55b794e7fa YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai. 
(cherry picked from commit 265ed1fe804743601a8b62cabc1e4dc2ec8e502f)
 2015-04-08 14:14:06 -07:00
Wangda Tan
5f59e621ba YARN-2901 addendum: Fixed findbugs warning caused by previously patch 
(cherry picked from commit ba9ee22ca4ed2c5ff447b66b2e2dfe25f6880fe0)
 2015-04-08 11:02:54 -07:00
Wangda Tan
97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda) 
(cherry picked from commit 7af086a515d573dc90ea4deec7f4e3f23622e0e8)
 2015-04-08 10:58:38 -07:00
Tsuyoshi Ozawa
ac32fa187c YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt. 
(cherry picked from commit dd852f5b8c8fe9e52d15987605f36b5b60f02701)
 2015-04-08 15:56:33 +09:00
Robert Kanter
b584ce6c0a YARN-3429. Fix incorrect CHANGES.txt 
(cherry picked from commit 5b8a3ae366294aec492f69f1a429aa7fce5d13be)
 2015-04-07 16:16:08 -07:00
Xuan
0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for 
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8676a0edb2d35453cac5f9495fcd605)
 2015-04-07 09:54:29 -07:00
Xuan
7941cc554b YARN-3110. Few issues in ApplicationHistory web ui. Contributed by Naganarasimha G R 
(cherry picked from commit 19a4feaf6fcf42ebbfe98b8a7153ade96d37fb14)
 2015-04-07 08:24:09 -07:00
Zhijie Shen
735e4f15ab Move YARN-3273 from 2.8 to 2.7. 
(cherry picked from commit 5e9f4099de4b949c838a6224442f335c67d80936)
 2015-04-06 14:15:23 -07:00
Robert Kanter
354d2c75cf YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter) 
(cherry picked from commit 99b08a748e7b00a58b63330b353902a6da6aae27)
 2015-04-06 14:11:50 -07:00
Tsuyoshi Ozawa
d2b2d76cce TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu. 
(cherry picked from commit 53959e69f7ef4442324627fbfb159012968a2092)
 2015-04-06 20:19:47 +09:00
Xuan
1eb6d74967 YARN-3435. AM container to be allocated Appattempt AM container shown as 
null. Contributed by Bibin A Chundatt

(cherry picked from commit 96d72118f5c81aa4e0dca0dc0241fbf1a3fff4d2)
 2015-04-05 00:43:22 -07:00
Wangda Tan
405aead879 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda) 
(cherry picked from commit bad070fe15a642cc6f3a165612fbd272187e03cb)
 2015-04-02 17:23:44 -07:00
Vinod Kumar Vavilapalli
d8e17c58bc YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. 
(cherry picked from commit b21c72777ae664b08fd1a93b4f88fa43f2478d94)
 2015-04-02 16:55:00 -07:00
Sandy Ryza
6286cfd711 YARN-3415. Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue (Zhihai Xu via Sandy Ryza) 2015-04-02 13:57:53 -07:00
Zhijie Shen
6d0bebc912 YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong. 
(cherry picked from commit 8366a36ad356e6318b8ce6c5c96e201149f811bd)
 2015-04-01 13:49:00 -07:00
Wangda Tan
865be70b02 YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda) 
(cherry picked from commit 492239424a3ace9868b6154f44a0f18fa5318235)
 2015-04-01 10:15:47 -07:00
Xuan
5e4d457674 YARN-3248. Correct fix version from branch-2.7 to branch-2.8 in the change log. 
(cherry picked from commit 2e79f1c2125517586c165a84e99d3c4d38ca0938)
 2015-04-01 04:33:32 -07:00
Xuan
e26b6e55e9 YARN-3248. Display count of nodes blacklisted by apps in the web UI. 
Contributed by Varun Vasudev

(cherry picked from commit 4728bdfa15809db4b8b235faa286c65de4a48cf6)
 2015-04-01 04:20:37 -07:00