Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,904 Commits 326 Branches 371 Tags
Commit Graph

3763 Commits

Author SHA1 Message Date
Robert Kanter
6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a615259281511de639c1f9aa719a842e34a523f)
 2017-10-16 15:34:50 -07:00
Nathan Roberts
a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Junping Du
26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f2f7c609cd4158912f151848268ca9e)
 2017-10-16 13:57:41 -07:00
Arun Suresh
2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f432f50c940b66d12c7de87b95ea47c0)
 2017-10-16 13:23:58 -07:00
Wangda Tan
41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c431fb88e064e497b35fc17c65f1d53)
 2017-10-14 10:45:12 -07:00
Haibo Chen
1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb47188867124bf18fb798b460928b3557ab9a1)
 2017-10-13 15:52:09 -07:00
Robert Kanter
b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48ac4dc675516a57c06a29890b5138548)
 2017-10-13 13:57:40 -07:00
Yufei Gu
dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367518e1bf6ee393391a2f9b412113819)
 2017-10-13 13:06:16 -07:00
Carlo Curino
97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46ee7a0d606b4bb221d1cd66ef2a5a7c)
 2017-10-12 10:40:44 -07:00
Jason Lowe
44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053ee93296412591f83a776846765fda5)
 2017-10-11 10:32:23 -05:00
Jonathan Hung
043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung
168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung
d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung
5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan
e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan
4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan
0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan
e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan
3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan
5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan
d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung
28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan
c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung
72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Daniel Templeton
bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923142a893870fc8a6309c02f60dc2d24)
 2017-10-09 14:15:52 +02:00
Sunil G
84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f4367974bf1883f1982e31ab2865107)
 2017-10-09 14:40:44 +05:30
Yufei Gu
4cfc7d0af6 YARN-7207. Cache the RM proxy server address. (Yufei Gu) 
(cherry picked from commit 72d22b753abde4d07a727479d3f3d5d84d5dd6b2)

# Conflicts:
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContext.java
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
 2017-10-06 10:03:48 -07:00
Yufei Gu
9bb9831347 YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-06 00:29:15 -07:00
Haibo Chen
c021c8a19f YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen) 
(cherry picked from commit c071aad5da6f6601978e73d38ce5813958848bc4)
 2017-10-05 15:51:08 -07:00
Chris Trezzo
e5af16cf6c YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 11:15:39 -07:00
Chris Trezzo
4b9b66f921 Revert "YARN-2960. Add documentation for the YARN shared cache." 
This reverts commit 54a01c28cc153872aa7eed68000ab0ddf010054a.
 2017-10-05 11:11:02 -07:00
Chris Trezzo
54a01c28cc YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 10:54:44 -07:00
Arun Suresh
b61d12e300 YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh). 
(cherry picked from commit b733348dde18a242e6c9074c512116a8baf1d281)
 2017-10-05 10:06:30 -07:00
Sunil G
807d8b41ad YARN-6182. Fix alignment issues and missing information in new YARN UI's Queue page. Contributed by Akhil PB. 
(cherry picked from commit f702c9575495e3af99d4b5cae9f73969e1a6dfc2)
 2017-10-05 11:35:36 +05:30
Sunil G
6a152b3e91 YARN-7279. Fix typo in helper message of ContainerLauncher. Contributed by Elek, Marton. 
(cherry picked from commit 592bf2d550a07ea5c5df3ba0ab2952c34d941b4b)
 2017-10-05 10:52:49 +05:30
Subru Krishnan
829a8e26b9 YARN-5329. Placement Agent enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit e6e614e380ed1d746973b50f666a9c40d272073e)
 2017-10-04 19:29:03 -07:00
Subru Krishnan
8d59b1fbee YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit fa6137501c1499ae33f6e0e2adc31671a7e782dc)
 2017-10-04 16:41:18 -07:00
Subru Krishnan
eb0a00c9b5 YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem. 
(cherry picked from commit b6e7d1369690eaf50ce9ea7968f91a72ecb74de0)
 2017-10-04 16:41:18 -07:00
Subru Krishnan
b5acbfef48 YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru). 
(cherry picked from commit d4d2fd1acd2fdddf04f45e67897804eea30d79a1)
 2017-10-04 16:33:39 -07:00
Akira Ajisaka
fe0d6f5b1c
YARN-7044. TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails. 
(cherry picked from commit 2df1b2ac0509ba10fff606ada7e9b3562c12dd16)
 2017-10-05 06:08:05 +09:00
Akira Ajisaka
7ba174791b
YARN-6975. Moving logging APIs over to slf4j in hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy and hadoop-yarn-server-router. Contributed by Yeliang Cang. 
(cherry picked from commit acf5b880d8283f5a96455c89a6b1b548d0d8c0e7)
 2017-10-04 14:54:15 +09:00
Ray Chiang
01b047b41b YARN-7219. Make AllocateRequestProto compatible with branch-2/branch-2.8. (rchiang) 
(cherry picked from commit 67e12169b0ae8f3a9edb6511d3ea7ffd57b82e75)
 2017-10-03 15:16:31 -07:00
Akira Ajisaka
b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari. 
(cherry picked from commit c9b525bd943fe7e098e72fb9be5623862c7ab5ff)
 2017-10-04 07:02:31 +09:00
Akira Ajisaka
2fa1d39952
YARN-6916. Moving logging APIs over to slf4j in hadoop-yarn-server-common. Contributed by Bibin A Chundatt and Akira Ajisaka. 
(cherry picked from commit 4a877737182808fe3392a116762ba59973a477a6)
 2017-10-04 06:08:00 +09:00
Jian He
d2c3b93ee5 YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. Contributed by Wangda Tan 
(cherry picked from commit 4111e6c7819d66e17e0932302c589777a355dbae)
 2017-10-03 12:23:03 -07:00
Sidharta S
dcc454b4a0 YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe 
(cherry picked from commit 7eb8499996869cdb63743f1c9eca2ba91d57ad08)
 2017-10-02 19:32:19 -07:00
Wangda Tan
c2f751cb0f YARN-7259. Add size-based rolling policy to LogAggregationIndexedFileController. (xgong via wangda) 
Change-Id: Ifaf82c0aee6b73b9b6ebf103aa72e131e3942f31
(cherry picked from commit 280080fad01304c85a9ede4d4f7b707eb36c0155)
 2017-10-02 16:37:27 -07:00
Junping Du
aef3e4b6af YARN-7194. Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat. Contributed by Xuan Gong. 
(cherry picked from commit c92c1d521eadfd8a4cd8205cc6aee74816f353f4)
 2017-10-02 16:35:27 -07:00