Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,337 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

16337 Commits

Author SHA1 Message Date
Carlo Curino ce419881c3 YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino). 2017-08-01 17:22:11 -07:00
Subru Krishnan 51aeb2ce0c YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru) 2017-08-01 17:22:11 -07:00
Carlo Curino 5c486961cd YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino) 2017-08-01 17:22:11 -07:00
Subru Krishnan 04f111394b YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 66500f4fa6 YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan db26bade05 YARN-5872. Add AlwayReject policies for router and amrmproxy. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan e0f0e7afed YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP. 2017-08-01 17:22:10 -07:00
Subru Krishnan 575137f41c YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan d7672ce2bd YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 20893682ec YARN-5391. PolicyManager to tie together Router/AMRM Federation policies. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 11c5336522 YARN-5325. Stateless ARMRMProxy policies implementation. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan 1298127bda YARN-5324. Stateless Federation router policies implementation. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Subru Krishnan f8208fe0b5 YARN-5323. Policies APIs for Federation Router and AMRMProxy policies. (Carlo Curino via Subru). 2017-08-01 17:22:10 -07:00
Jian He 9ca2aba9cc YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan ac1ba2a304 YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:09 -07:00
Jian He 8573c286e2 YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Jian He 3307564a5f YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan bd44182e70 YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru) 2017-08-01 17:22:09 -07:00
Jian He 5e976cd2b9 YARN-3672. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan e4f928cf9c YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan b747d59f41 YARN-5407. In-memory based implementation of the FederationApplicationStateStore/FederationPolicyStateStore. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan 268389d021 YARN-5408. Compose Federation membership/application/policy APIs into an uber FederationStateStore API. (Ellen Hui via Subru). 2017-08-01 17:22:09 -07:00
Subru Krishnan 2f377263a1 YARN-3664. Federation PolicyStore internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan 1af5292042 YARN-5307. Federation Application State Store internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan d3dc461a93 YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 20d1d2be91 YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 5424d0899c YARN-3662. Federation Membership State Store internal APIs. 2017-08-01 17:22:08 -07:00
Subru Krishnan 9d23570172 YARN-5300. Exclude generated federation protobuf sources from YARN Javadoc/findbugs build 2017-08-01 17:22:08 -07:00
Junping Du cf6794ebe9 HADOOP-14683. FileStatus.compareTo binary compatible issue. Contributed by Akira Ajisaka. 2017-08-01 17:13:02 -07:00
Manoj Govindassamy 52d7bafcf4 HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted. 2017-08-01 16:28:20 -07:00
Lei Xu 02cd71ba9d HADOOP-14495. Add set options interface to FSDataOutputStreamBuilder. (Lei (Eddy) Xu) 2017-08-01 16:00:53 -07:00
Andrew Wang a11c230236 HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman. 2017-08-01 15:13:29 -07:00
Steve Loughran 778d4edd9a
HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded. 
Contributed by Thomas Marquardt.
 2017-08-01 21:36:28 +01:00
Sean Mackrory 7774759830 HDFS-12151. Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes. 2017-08-01 14:34:25 -06:00
Arpit Agarwal 72eba25e09 HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng. 2017-08-01 13:31:44 -07:00
Jian He 91f120f743 YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G 2017-08-01 09:56:33 -07:00
Akira Ajisaka b38a1eea8e
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor. 2017-08-01 15:15:43 +09:00
Akira Ajisaka ceacadc51e
MAPREDUCE-6921. TestUmbilicalProtocolWithJobToken#testJobTokenRpc fails. 2017-08-01 14:56:42 +09:00
Akira Ajisaka a4aa1cb405
Revert "YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang." 
This reverts commit 1a78c0ff01.
 2017-08-01 12:15:03 +09:00
Lei Xu 9586b0e24f HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu) 2017-07-31 20:12:40 -07:00
Andras Bokor abbf4129a2
HADOOP-14343. Wrong pid file name in error message when starting secure daemon 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-07-31 20:03:43 -07:00
Akira Ajisaka 1a78c0ff01
YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang. 2017-08-01 10:53:32 +09:00
Weiwei Yang ea568123fa HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar. 2017-07-31 17:02:44 -07:00
Andrew Wang 2be9412b73 HADOOP-14644. Increase max heap size of Maven javadoc plugin. Contributed by Andras Bokor. 2017-07-31 15:09:34 -07:00
Andrew Wang a7d858668a HADOOP-14420. generateReports property is not applicable for maven-site-plugin:attach-descriptor goal. Contributed by Andras Bokor. 2017-07-31 15:07:22 -07:00
Junping Du fbb7d6bcbb Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)" 
This reverts commit e8a31f2e1c.
 2017-07-31 14:09:16 -07:00
Arpit Agarwal 3e23415a92 HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang. 2017-07-31 11:33:55 -07:00
Akira Ajisaka 0fd6d0f2d3
HADOOP-14677. mvn clean compile fails. Contributed by Andras Bokor. 2017-07-31 17:00:10 +09:00
Junping Du 481385ea8a HADOOP-14672. Shaded Hadoop-client-minicluster include unshaded classes, like: javax, sax, dom, etc. Contributed by Bharat Viswanadham. 2017-07-30 22:15:48 -07:00
Akira Ajisaka f14be0d241
HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang. 2017-07-31 14:08:30 +09:00