Subru Krishnan
|
58e2458c2e
|
Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase.
(cherry picked from commit f1eff212c5 )
(cherry picked from commit 712e97d4cf )
|
2017-09-21 16:55:41 -07:00 |
Subru Krishnan
|
fdbd214d4a
|
YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin.
(cherry picked from commit cd9db822f0 )
(cherry picked from commit 3e1dc7ece0 )
|
2017-09-21 16:55:40 -07:00 |
Subru Krishnan
|
055138c5c4
|
YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not.
(cherry picked from commit 8820693cd7 )
(cherry picked from commit 825108d08a )
|
2017-09-21 16:55:40 -07:00 |
Subru Krishnan
|
d3fb1711a4
|
YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru).
(cherry picked from commit b4ac9d1b63 )
(cherry picked from commit f427e4201f )
|
2017-09-21 16:55:39 -07:00 |
Subru Krishnan
|
169037cbb4
|
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 52daa6d971 )
(cherry picked from commit 43a97174fe )
|
2017-09-21 16:55:33 -07:00 |
Subru Krishnan
|
8ed4daddc4
|
YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit f8e5de5969 )
(cherry picked from commit 4cfec943b1 )
|
2017-09-21 16:55:01 -07:00 |
Subru Krishnan
|
35a38330ef
|
YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru).
(cherry picked from commit 8c988d235e )
(cherry picked from commit 70b1a757f1 )
|
2017-09-21 16:49:55 -07:00 |
Subru Krishnan
|
7ede8c1a53
|
YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru).
(cherry picked from commit 2399eb8200 )
(cherry picked from commit bed1832c93 )
|
2017-09-21 16:49:54 -07:00 |
Subru Krishnan
|
7dd6caff9e
|
YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru).
(cherry picked from commit 749ca890e6 )
(cherry picked from commit d6c29b2f5b )
|
2017-09-21 16:49:54 -07:00 |
Subru Krishnan
|
b9fdc24e43
|
YARN-6666. Fix unit test failure in TestRouterClientRMService. (Botong Huang via Subru).
(cherry picked from commit e750907d0a )
(cherry picked from commit 42949a6e01 )
|
2017-09-21 16:49:48 -07:00 |
Subru Krishnan
|
e4832bef6d
|
Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4 post rebase.
(cherry picked from commit bd9c7b1bec )
(cherry picked from commit f317e0cb48 )
|
2017-09-21 16:47:50 -07:00 |
Subru Krishnan
|
9476d86ce8
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce )
(cherry picked from commit 859aa1f9d6 )
|
2017-09-21 16:47:43 -07:00 |
Subru Krishnan
|
7f00f938f2
|
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 67846a5519 )
(cherry picked from commit 7444406d6d )
|
2017-09-21 16:47:14 -07:00 |
Subru Krishnan
|
dc0a2e6c59
|
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 4846069061 )
(cherry picked from commit 80e1904000 )
|
2017-09-21 16:43:08 -07:00 |
Carlo Curino
|
3c5dfa0fe5
|
YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino).
(cherry picked from commit be99c1fe2e )
(cherry picked from commit 5272af8c7e )
|
2017-09-21 16:33:31 -07:00 |
Carlo Curino
|
c38ac05bb4
|
YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino)
(cherry picked from commit 121d55bd29 )
(cherry picked from commit c4bbdfeb66 )
|
2017-09-21 16:25:11 -07:00 |
Subru Krishnan
|
b9dcf9283e
|
YARN-5602. Utils for Federation State and Policy Store. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 326a2e6bde )
(cherry picked from commit e1da8f0667 )
|
2017-09-21 16:25:10 -07:00 |
Carlo Curino
|
b40bdafe31
|
YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino).
(cherry picked from commit ce419881c3 )
(cherry picked from commit 1c64e1709b )
|
2017-09-21 16:25:10 -07:00 |
Subru Krishnan
|
61c07e4f3f
|
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
(cherry picked from commit 51aeb2ce0c )
(cherry picked from commit 86b2bec56e )
|
2017-09-21 16:25:09 -07:00 |
Carlo Curino
|
6191fac914
|
YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino)
(cherry picked from commit 5c486961cd )
(cherry picked from commit 8623644f45 )
|
2017-09-21 16:25:08 -07:00 |
Subru Krishnan
|
2dca88b924
|
YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 04f111394b )
(cherry picked from commit 193ec456d6 )
|
2017-09-21 16:25:02 -07:00 |
Subru Krishnan
|
ce9110ab5c
|
YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru).
(cherry picked from commit 66500f4fa6 )
(cherry picked from commit 98b45b0ed3 )
|
2017-09-21 16:23:47 -07:00 |
Subru Krishnan
|
002a77dcce
|
YARN-5872. Add AlwayReject policies for router and amrmproxy. (Carlo Curino via Subru).
(cherry picked from commit db26bade05 )
(cherry picked from commit 91803305e5 )
|
2017-09-21 16:23:46 -07:00 |
Subru Krishnan
|
e933a1790c
|
YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP.
(cherry picked from commit e0f0e7afed )
(cherry picked from commit 78032e51d9 )
|
2017-09-21 16:23:45 -07:00 |
Subru Krishnan
|
d32ffa9e5e
|
YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru).
(cherry picked from commit 575137f41c )
(cherry picked from commit 4128c9522d )
|
2017-09-21 16:23:45 -07:00 |
Subru Krishnan
|
d87d2b546e
|
YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru).
(cherry picked from commit d7672ce2bd )
(cherry picked from commit 083a05bc14 )
|
2017-09-21 16:23:44 -07:00 |
Subru Krishnan
|
b3a1ab711c
|
YARN-5391. PolicyManager to tie together Router/AMRM Federation policies. (Carlo Curino via Subru).
(cherry picked from commit 20893682ec )
(cherry picked from commit 93d9fdeca6 )
|
2017-09-21 16:23:43 -07:00 |
Subru Krishnan
|
5c5ab53f3d
|
YARN-5325. Stateless ARMRMProxy policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 11c5336522 )
(cherry picked from commit 1dadd0b45a )
|
2017-09-21 16:23:42 -07:00 |
Subru Krishnan
|
f792f7b068
|
YARN-5324. Stateless Federation router policies implementation. (Carlo Curino via Subru).
(cherry picked from commit 1298127bda )
(cherry picked from commit 0662996b6a )
|
2017-09-21 16:23:42 -07:00 |
Subru Krishnan
|
23c42408ba
|
YARN-5323. Policies APIs for Federation Router and AMRMProxy policies. (Carlo Curino via Subru).
(cherry picked from commit f8208fe0b5 )
(cherry picked from commit 81472778d7 )
|
2017-09-21 16:23:41 -07:00 |
Jian He
|
aac8755125
|
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
(cherry picked from commit 9ca2aba9cc )
(cherry picked from commit 2797507d51 )
|
2017-09-21 16:23:40 -07:00 |
Subru Krishnan
|
8409fef0d9
|
YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit ac1ba2a304 )
(cherry picked from commit 1882bc10fb )
|
2017-09-21 16:23:39 -07:00 |
Jian He
|
ea2ecdb796
|
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
(cherry picked from commit 8573c286e2 )
(cherry picked from commit 94a24567d6 )
|
2017-09-21 16:23:33 -07:00 |
Jian He
|
615c912b61
|
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
(cherry picked from commit 3307564a5f )
(cherry picked from commit bdfad4523f )
|
2017-09-21 16:13:06 -07:00 |
Subru Krishnan
|
32a8618f39
|
YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru)
(cherry picked from commit bd44182e70 )
(cherry picked from commit cfafd173bd )
|
2017-09-21 16:13:06 -07:00 |
Jian He
|
fb3f9b48fb
|
YARN-3674. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan
(cherry picked from commit 5e976cd2b9 )
(cherry picked from commit 5c84382397 )
|
2017-09-21 16:12:34 -07:00 |
Subru Krishnan
|
1889dfe409
|
YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover. (Ellen Hui via Subru)
(cherry picked from commit e4f928cf9c )
(cherry picked from commit 52558df620 )
|
2017-09-21 16:00:40 -07:00 |
Subru Krishnan
|
cf15768f45
|
YARN-5407. In-memory based implementation of the FederationApplicationStateStore/FederationPolicyStateStore. (Ellen Hui via Subru)
(cherry picked from commit b747d59f41 )
(cherry picked from commit 0733088c29 )
|
2017-09-21 16:00:39 -07:00 |
Subru Krishnan
|
4c3d45a1cf
|
YARN-5408. Compose Federation membership/application/policy APIs into an uber FederationStateStore API. (Ellen Hui via Subru).
(cherry picked from commit 268389d021 )
(cherry picked from commit e0c3a44396 )
|
2017-09-21 16:00:38 -07:00 |
Subru Krishnan
|
d0dddb4ebd
|
YARN-3664. Federation PolicyStore internal APIs
(cherry picked from commit 2f377263a1 )
(cherry picked from commit f1a508bdef )
|
2017-09-21 16:00:38 -07:00 |
Subru Krishnan
|
07834ad678
|
YARN-5307. Federation Application State Store internal APIs
(cherry picked from commit 1af5292042 )
(cherry picked from commit 047a16bf15 )
|
2017-09-21 16:00:37 -07:00 |
Subru Krishnan
|
31d92378ba
|
YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui.
(cherry picked from commit d3dc461a93 )
(cherry picked from commit d19b677301 )
|
2017-09-21 16:00:36 -07:00 |
Subru Krishnan
|
8b6a2afa6e
|
YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui.
(cherry picked from commit 20d1d2be91 )
(cherry picked from commit dcf8c52d80 )
|
2017-09-21 16:00:35 -07:00 |
Subru Krishnan
|
a939d2fdb8
|
YARN-3662. Federation Membership State Store internal APIs.
(cherry picked from commit 5424d0899c )
(cherry picked from commit 3e22896f86 )
|
2017-09-21 16:00:35 -07:00 |
Subru Krishnan
|
194524bdf8
|
YARN-5300. Exclude generated federation protobuf sources from YARN Javadoc/findbugs build
(cherry picked from commit 9d23570172 )
(cherry picked from commit dd75ffb26b )
|
2017-09-21 16:00:34 -07:00 |
Jason Lowe
|
fc6d9612c7
|
YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger.
(cherry picked from commit bfd1a72ba8 )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
|
2017-09-21 17:52:11 -05:00 |
Junping Du
|
e67c8347c4
|
YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi.
|
2017-09-21 14:12:57 -07:00 |
Yufei Gu
|
c3c8b0ffab
|
YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu)
(cherry picked from commit a92ef030a2 )
|
2017-09-21 12:40:37 -07:00 |
Arpit Agarwal
|
18e5f2068b
|
HDFS-12496. Make QuorumJournalManager timeout properties configurable. Contributed by Ajay Kumar.
|
2017-09-21 08:53:27 -07:00 |
Jason Lowe
|
cf2615961a
|
MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
(cherry picked from commit b9db0afa1e )
|
2017-09-21 09:39:46 -05:00 |