Commit Graph

16360 Commits

Author SHA1 Message Date
Carlo Curino 874ddbf0b5 YARN-6853. Add MySql Scripts for FederationStateStore. (Contributed by Giovanni Matteo Fumarola via curino) 2017-08-01 17:22:13 -07:00
Subru Krishnan c581e94384 YARN-6902. Update Microsoft JDBC Driver for SQL Server version in License.txt. (Botong Huang via Subru). 2017-08-01 17:22:13 -07:00
Carlo Curino b6240b92ab YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino) 2017-08-01 17:22:13 -07:00
Subru Krishnan 40453879ec YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru). 2017-08-01 17:22:13 -07:00
Subru Krishnan 69e3ed2680 Bumping up hadoop-yarn-server-router module to 3.0.0-beta1 post rebase. 2017-08-01 17:22:13 -07:00
Subru Krishnan f1eff212c5 Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase. 2017-08-01 17:22:13 -07:00
Subru Krishnan cd9db822f0 YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin. 2017-08-01 17:22:13 -07:00
Subru Krishnan 8820693cd7 YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not. 2017-08-01 17:22:13 -07:00
Subru Krishnan b4ac9d1b63 YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan 52daa6d971 YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan f8e5de5969 YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:12 -07:00
Arun Suresh 790cba7ab9 YARN-6691. Update YARN daemon startup/shutdown scripts to include Router service. (Giovanni Matteo Fumarola via asuresh). 2017-08-01 17:22:12 -07:00
Subru Krishnan 8c988d235e YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan 2399eb8200 YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan 749ca890e6 YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan e750907d0a YARN-6666. Fix unit test failure in TestRouterClientRMService. (Botong Huang via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan bd9c7b1bec Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4 post rebase. 2017-08-01 17:22:12 -07:00
Subru Krishnan 73bb2102ce YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru). 2017-08-01 17:22:12 -07:00
Subru Krishnan 67846a5519 YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:11 -07:00
Subru Krishnan 4846069061 YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:11 -07:00
Carlo Curino be99c1fe2e YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino). 2017-08-01 17:22:11 -07:00
Carlo Curino 121d55bd29 YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino) 2017-08-01 17:22:11 -07:00
Subru Krishnan 326a2e6bde YARN-5602. Utils for Federation State and Policy Store. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:11 -07:00
Carlo Curino ce419881c3 YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino). 2017-08-01 17:22:11 -07:00
Subru Krishnan 51aeb2ce0c YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru) 2017-08-01 17:22:11 -07:00
Carlo Curino 5c486961cd YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino) 2017-08-01 17:22:11 -07:00
Subru Krishnan 04f111394b YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 66500f4fa6 YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan db26bade05 YARN-5872. Add AlwayReject policies for router and amrmproxy. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan e0f0e7afed YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP. 2017-08-01 17:22:10 -07:00
Subru Krishnan 575137f41c YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan d7672ce2bd YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 20893682ec YARN-5391. PolicyManager to tie together Router/AMRM Federation policies. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 11c5336522 YARN-5325. Stateless ARMRMProxy policies implementation. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 1298127bda YARN-5324. Stateless Federation router policies implementation. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan f8208fe0b5 YARN-5323. Policies APIs for Federation Router and AMRMProxy policies. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Jian He 9ca2aba9cc YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan ac1ba2a304 YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:09 -07:00
Jian He 8573c286e2 YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Jian He 3307564a5f YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan bd44182e70 YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru) 2017-08-01 17:22:09 -07:00
Jian He 5e976cd2b9 YARN-3672. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan e4f928cf9c YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan b747d59f41 YARN-5407. In-memory based implementation of the FederationApplicationStateStore/FederationPolicyStateStore. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan 268389d021 YARN-5408. Compose Federation membership/application/policy APIs into an uber FederationStateStore API. (Ellen Hui via Subru). 2017-08-01 17:22:09 -07:00
Subru Krishnan 2f377263a1 YARN-3664. Federation PolicyStore internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan 1af5292042 YARN-5307. Federation Application State Store internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan d3dc461a93 YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 20d1d2be91 YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 5424d0899c YARN-3662. Federation Membership State Store internal APIs. 2017-08-01 17:22:08 -07:00