Commit Graph

16324 Commits

Author SHA1 Message Date
Jian He 9ca2aba9cc YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan ac1ba2a304 YARN-5612. Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover. (Giovanni Matteo Fumarola via Subru). 2017-08-01 17:22:09 -07:00
Jian He 8573c286e2 YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Jian He 3307564a5f YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan bd44182e70 YARN-5467. InputValidator for the FederationStateStore internal APIs. (Giovanni Matteo Fumarola via Subru) 2017-08-01 17:22:09 -07:00
Jian He 5e976cd2b9 YARN-3672. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan 2017-08-01 17:22:09 -07:00
Subru Krishnan e4f928cf9c YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan b747d59f41 YARN-5407. In-memory based implementation of the FederationApplicationStateStore/FederationPolicyStateStore. (Ellen Hui via Subru) 2017-08-01 17:22:09 -07:00
Subru Krishnan 268389d021 YARN-5408. Compose Federation membership/application/policy APIs into an uber FederationStateStore API. (Ellen Hui via Subru). 2017-08-01 17:22:09 -07:00
Subru Krishnan 2f377263a1 YARN-3664. Federation PolicyStore internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan 1af5292042 YARN-5307. Federation Application State Store internal APIs 2017-08-01 17:22:08 -07:00
Subru Krishnan d3dc461a93 YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 20d1d2be91 YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui. 2017-08-01 17:22:08 -07:00
Subru Krishnan 5424d0899c YARN-3662. Federation Membership State Store internal APIs. 2017-08-01 17:22:08 -07:00
Subru Krishnan 9d23570172 YARN-5300. Exclude generated federation protobuf sources from YARN Javadoc/findbugs build 2017-08-01 17:22:08 -07:00
Junping Du cf6794ebe9 HADOOP-14683. FileStatus.compareTo binary compatible issue. Contributed by Akira Ajisaka. 2017-08-01 17:13:02 -07:00
Manoj Govindassamy 52d7bafcf4 HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted. 2017-08-01 16:28:20 -07:00
Lei Xu 02cd71ba9d HADOOP-14495. Add set options interface to FSDataOutputStreamBuilder. (Lei (Eddy) Xu) 2017-08-01 16:00:53 -07:00
Andrew Wang a11c230236 HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman. 2017-08-01 15:13:29 -07:00
Steve Loughran 778d4edd9a
HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded.
Contributed by Thomas Marquardt.
2017-08-01 21:36:28 +01:00
Sean Mackrory 7774759830 HDFS-12151. Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes. 2017-08-01 14:34:25 -06:00
Arpit Agarwal 72eba25e09 HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng. 2017-08-01 13:31:44 -07:00
Jian He 91f120f743 YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G 2017-08-01 09:56:33 -07:00
Akira Ajisaka b38a1eea8e
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor. 2017-08-01 15:15:43 +09:00
Akira Ajisaka ceacadc51e
MAPREDUCE-6921. TestUmbilicalProtocolWithJobToken#testJobTokenRpc fails. 2017-08-01 14:56:42 +09:00
Akira Ajisaka a4aa1cb405
Revert "YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang."
This reverts commit 1a78c0ff01.
2017-08-01 12:15:03 +09:00
Lei Xu 9586b0e24f HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu) 2017-07-31 20:12:40 -07:00
Andras Bokor abbf4129a2
HADOOP-14343. Wrong pid file name in error message when starting secure daemon
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-07-31 20:03:43 -07:00
Akira Ajisaka 1a78c0ff01
YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang. 2017-08-01 10:53:32 +09:00
Weiwei Yang ea568123fa HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar. 2017-07-31 17:02:44 -07:00
Andrew Wang 2be9412b73 HADOOP-14644. Increase max heap size of Maven javadoc plugin. Contributed by Andras Bokor. 2017-07-31 15:09:34 -07:00
Andrew Wang a7d858668a HADOOP-14420. generateReports property is not applicable for maven-site-plugin:attach-descriptor goal. Contributed by Andras Bokor. 2017-07-31 15:07:22 -07:00
Junping Du fbb7d6bcbb Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)"
This reverts commit e8a31f2e1c.
2017-07-31 14:09:16 -07:00
Arpit Agarwal 3e23415a92 HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang. 2017-07-31 11:33:55 -07:00
Akira Ajisaka 0fd6d0f2d3
HADOOP-14677. mvn clean compile fails. Contributed by Andras Bokor. 2017-07-31 17:00:10 +09:00
Junping Du 481385ea8a HADOOP-14672. Shaded Hadoop-client-minicluster include unshaded classes, like: javax, sax, dom, etc. Contributed by Bharat Viswanadham. 2017-07-30 22:15:48 -07:00
Akira Ajisaka f14be0d241
HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang. 2017-07-31 14:08:30 +09:00
Akira Ajisaka f8bed5e9a7
YARN-5728. TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout. 2017-07-31 11:09:13 +09:00
Arun Suresh 890e14c02a YARN-6870. Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker. (Brook Zhou via asuresh) 2017-07-28 16:32:43 -07:00
Subru Krishnan bcde66bed1 YARN-6897. Refactoring RMWebServices by moving some util methods to RMWebAppUtil. (Giovanni Matteo Fumarola via Subru). 2017-07-28 15:44:36 -07:00
Junping Du 713349a9af Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)"
This reverts commit 390a7c12f5.
2017-07-28 14:21:04 -07:00
Junping Du e15f928295 Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu."
This reverts commit 433542904a.
2017-07-28 14:06:59 -07:00
Ravi Prakash 746189ad8c HADOOP-14229. hadoop.security.auth_to_local example is incorrect in the documentation. Contributed by Andras Bokor. 2017-07-28 11:43:36 -07:00
Andrew Wang 480c8db40c HDFS-12206. Rename the split EC / replicated block metrics. 2017-07-28 11:24:44 -07:00
Lei Xu 77791e4c36 HDFS-12044. Mismatch between BlockManager.maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery. (Contributed by Lei (Eddy) Xu) 2017-07-28 10:50:49 -07:00
Yufei Gu 9ea01fd956 YARN-6802. Add max AM resource and AM resource usage to leaf queue view in FairScheduler WebUI. (YunFan Zhou via Yufei Gu) 2017-07-28 09:52:53 -07:00
John Zhuge f735ad1b67 HADOOP-14678. AdlFilesystem#initialize swallows exception when getting user name. Contributed by John Zhuge. 2017-07-28 09:46:54 -07:00
Wei-Chiu Chuang 369f731264 HDFS-12062. removeErasureCodingPolicy needs super user permission. Contributed by Wei-Chiu Chuang. 2017-07-28 00:51:03 -07:00
Yufei Gu 9902be72cb YARN-6864. FSPreemptionThread cleanup for readability. (Daniel Templeton via Yufei Gu) 2017-07-27 23:19:39 -07:00
Akira Ajisaka 38c6fa5c7a
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier. 2017-07-28 09:10:52 +09:00