Commit Graph

17181 Commits

Author SHA1 Message Date
Kihwal Lee 4d2dce40bb HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. Contributed by Kuhu Shukla. 2017-11-03 15:16:46 -05:00
Xiao Chen 299d38295d HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. Contributed by Huafeng Wang. 2017-11-03 12:05:45 -07:00
Sunil G c41728486b YARN-7392. Render cluster information on new YARN web ui. Contributed by Vasudevan Skm. 2017-11-03 11:45:50 +05:30
Xiao Chen b00f828d84 HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven racks. 2017-11-02 21:53:13 -07:00
Inigo Goiri 6fc09beac4 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 2017-11-02 21:29:53 -07:00
Xiao Chen e565b5277d HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED. 2017-11-02 21:27:35 -07:00
Sunil G 1700adc6f7 YARN-7410. Cleanup FixedValueResource to avoid dependency to ResourceUtils. Contributed by Wangda Tan. 2017-11-03 07:25:29 +05:30
Subru Krishnan ad0fff2b41 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 2017-11-02 17:39:23 -07:00
Arun Suresh 53c0fb7efe HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) 2017-11-02 17:15:33 -07:00
Eric Payne e6ec02001f YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 2017-11-02 12:37:33 -05:00
Wangda Tan 04c604cf1d YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f)
2017-11-02 09:51:28 -07:00
Jason Lowe d00b6f7c1f YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 2017-11-02 09:37:17 -05:00
Akira Ajisaka cc3f3eca40
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi. 2017-11-02 18:32:24 +09:00
Sammi Chen cde56b9cef HADOOP-14997. Add hadoop-aliyun as dependency of hadoop-cloud-storage. Contributed by Genmao Yu 2017-11-02 17:12:04 +08:00
Akira Ajisaka 178751ed8c
MAPREDUCE-6983. Moving logging APIs over to slf4j in hadoop-mapreduce-client-core. Contributed by Jinjiang Ling. 2017-11-02 17:43:08 +09:00
Rohith Sharma K S 940ffe3f9c addendum patch for YARN-7289. 2017-11-02 13:55:19 +05:30
Jian He 0cc98ae0ec YARN-7396. NPE when accessing container logs due to null dirsHandler. Contributed by Jonathan Hung 2017-11-01 17:00:32 -07:00
Eric Yang 7a49ddfdde YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger) 2017-11-01 18:39:56 -04:00
Junping Du d57dba9942 YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 2017-11-01 14:48:16 -07:00
Inigo Goiri 70f1a9470c YARN-7276 addendum to add timeline service depencies. Contributed by Inigo Goiri. 2017-11-01 13:26:37 -07:00
Weiwei Yang 56b88b0670 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 2017-11-01 16:41:45 +08:00
Yiqun Lin 20304b91cc HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen. 2017-11-01 14:37:08 +08:00
John Zhuge b8c8b5bc27 HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe McDonnell. 2017-10-31 22:44:16 -07:00
Lei Xu 9367c25dbd HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei) 2017-10-31 21:58:14 -07:00
Subru Krishnan ed24da3dd7 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 2017-10-31 12:05:43 -07:00
Andrew Wang 5f681fa821 Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham."
This reverts commit b922ba7393.
2017-10-31 10:46:10 -07:00
Arpit Agarwal b922ba7393 HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:23:00 -07:00
Inigo Goiri 982bd2a5bf HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 2017-10-31 10:21:42 -07:00
Chris Douglas d015e0bbd5 HDFS-7878. API - expose a unique file identifier. 2017-10-31 09:44:01 -07:00
Sean Mackrory 81225430d0 HDFS-206. Support for head in FSShell. Contributed by Gabor Bota. 2017-10-31 08:34:01 -06:00
Jason Lowe 2fae63aa60 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 2017-10-31 09:30:13 -05:00
Akira Ajisaka c02d2ba50d
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang. 2017-10-31 17:09:45 +09:00
Akira Ajisaka 785f1b0d11
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 2017-10-31 16:36:02 +09:00
Akira Ajisaka fad22d8ab4
HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by ligongyi. 2017-10-31 13:51:26 +09:00
Akira Ajisaka 60503f9d4f
Revert "HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by liyunzhang."
This reverts commit b59e92551d.
2017-10-31 13:50:28 +09:00
Akira Ajisaka b59e92551d
HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by liyunzhang. 2017-10-31 13:49:15 +09:00
Junping Du a8083aaa6f HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 2017-10-30 15:16:51 -07:00
Daniel Templeton d64736d589 YARN-7336. Unsafe cast from long to int Resource.hashCode() method
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-10-30 12:41:28 -07:00
Daniel Templeton 9a7e810838 YARN-6927. Add support for individual resource types requests in MapReduce
(Contributed by Gergo Repas via Daniel Templeton)
2017-10-30 11:04:22 -07:00
Chris Douglas e4878a59b3 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 2017-10-30 09:49:22 -07:00
Daniel Templeton 9711b78998 YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler 2017-10-29 18:54:33 -07:00
Yufei Gu d4811c8cfa YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 2017-10-29 16:44:16 -07:00
Sunil G 9114d7a5a0 YARN-7224. Support GPU isolation for docker container. Contributed by Wangda Tan. 2017-10-29 11:08:44 +05:30
Daniel Templeton e62bbbca7a YARN-7397. Reduce lock contention in FairScheduler#getAppWeight() 2017-10-28 09:13:13 -07:00
Arun Suresh 9c5c68745e YARN-7299. Fix TestDistributedScheduler. (asuresh) 2017-10-27 23:08:18 -07:00
Arun Suresh 24f8c5cce3 YARN-7178. Add documentation for Container Update API. (asuresh) 2017-10-27 22:56:41 -07:00
Chris Douglas 139cc752d2 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 2017-10-27 21:59:27 -07:00
Chris Douglas b50def3697 HADOOP-14986. Enforce JDK limitations. 2017-10-27 18:47:45 -07:00
Inigo Goiri 8be5707067 YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-10-27 16:46:05 -07:00
Chris Douglas d55a84951a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 2017-10-27 15:36:03 -07:00