Commit Graph

16990 Commits

Author SHA1 Message Date
Carlo Curino 1fbc72704e YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino)
(cherry picked from commit ceca9694f9)
2017-10-31 13:42:36 -07:00
Haibo Chen e785e83270 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b)
2017-10-31 13:41:44 -07:00
Wei-Chiu Chuang cba1fa496b HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
(cherry picked from commit 97c70c7ac6)
2017-10-31 12:54:53 -07:00
Chen Liang af52a585f0 HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.
(cherry picked from commit 563dcdfc1d)
2017-10-31 12:54:28 -07:00
Wei-Chiu Chuang 0b3e3e4895 HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
(cherry picked from commit e906108fc9)
2017-10-31 12:54:03 -07:00
Wei-Chiu Chuang 1347e83c90 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 8dbc8909c9)
2017-10-31 12:52:58 -07:00
Manoj Govindassamy 166c75a0eb HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory.
(cherry picked from commit 075dd45a24)
2017-10-31 12:50:54 -07:00
Manoj Govindassamy 1375c7205f HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma.
(cherry picked from commit 78af6cdc53)
2017-10-31 12:50:21 -07:00
Manoj Govindassamy 014184127e HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured.
(cherry picked from commit b406d8e375)
2017-10-31 12:49:41 -07:00
Wei-Chiu Chuang 579612c9d2 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4ab0c8f96a)
2017-10-31 12:49:08 -07:00
Akira Ajisaka 143dbf8497 HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin.
(cherry picked from commit dc63a6a52b)
2017-10-31 12:48:29 -07:00
Subru Krishnan 0d9503d6b5 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd7)
2017-10-31 12:08:32 -07:00
Andrew Wang ae08fe518b Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham."
This reverts commit f09725537e.
2017-10-31 10:46:19 -07:00
Inigo Goiri e259030066 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bf)
2017-10-31 10:23:06 -07:00
Arpit Agarwal f09725537e HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:08:05 -07:00
Chris Douglas 1ce0eb7d23 HDFS-7878. API - expose a unique file identifier.
(cherry picked from commit d015e0bbd5)
2017-10-31 09:46:39 -07:00
Jason Lowe 75605766fd HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60)
2017-10-31 09:32:02 -05:00
Akira Ajisaka da6ab7727c
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang.
(cherry picked from commit c02d2ba50d)
2017-10-31 17:11:18 +09:00
Akira Ajisaka 6bbfa158d7
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang.
(cherry picked from commit 785f1b0d11)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
2017-10-31 16:45:12 +09:00
Junping Du b9a4bf0c46 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f)
2017-10-30 15:28:58 -07:00
Chris Douglas 85be67ebe4 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham
(cherry picked from commit e4878a59b3)
2017-10-30 09:49:34 -07:00
Yufei Gu d9f027adbc YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfa)
2017-10-29 16:48:07 -07:00
Arun Suresh 6b4319cc50 YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745e)
2017-10-27 23:15:37 -07:00
Arun Suresh b30eb17c75 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3)
2017-10-27 22:58:34 -07:00
Chris Douglas 77ad73501c HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li
(cherry picked from commit 139cc752d2)
2017-10-27 22:00:44 -07:00
Chris Douglas 1660a638f0 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
2017-10-27 21:39:27 -07:00
Chris Douglas 34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham
(cherry picked from commit d55a84951a)
2017-10-27 15:36:18 -07:00
Jason Lowe 00345eed50 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa)
2017-10-27 17:00:31 -05:00
Rohith Sharma K S d9b636f2f4 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
(cherry picked from commit 5c799ecf09)
2017-10-27 23:14:55 +05:30
Sunil G e084d43550 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
(cherry picked from commit 792388e1c0)
2017-10-27 20:54:58 +05:30
Arpit Agarwal 2510fc1801 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:49:18 -07:00
Junping Du ce10c1ef05 Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:18:50 -07:00
Junping Du 3760f9cfb3 Set jdiff stable version to 2.8.2.
(cherry picked from commit 06b56f6493)
2017-10-26 23:18:37 -07:00
Junping Du f36b2c6990 Update CHANGES.md and RELEASENOTES for 2.8.2 release.
(cherry picked from commit 1ad863e220)
2017-10-26 23:18:23 -07:00
Robert Kanter aa65f6c1ad YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
(cherry picked from commit b1de78619f)
2017-10-26 17:47:51 -07:00
Robert Kanter cd9078df68 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Addendum (misha@cloudera.com via rkanter)
(cherry picked from commit 088ffee716)
2017-10-26 15:55:23 -07:00
Subru Krishnan 9665971a65 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
(cherry picked from commit 25932da6d1)
2017-10-26 12:11:08 -07:00
Robert Kanter d92dddaf7c YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter)
(cherry picked from commit 2da654e34a)
2017-10-26 10:45:23 -07:00
Subru Krishnan 82c9b3bbb5 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru).
(cherry picked from commit 625039ef20)
2017-10-25 16:01:13 -07:00
Subru Krishnan 926b188871 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru).
(cherry picked from commit 3fae675383)
2017-10-25 15:08:19 -07:00
Xiao Chen e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
2017-10-25 14:11:38 -07:00
Akira Ajisaka 20ca6773f1 HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-10-25 08:10:26 -07:00
Akira Ajisaka ed93af8965
HADOOP-14979. Upgrade maven-dependency-plugin to 3.0.2. Contributed by liyunzhang.
(cherry picked from commit 54b72acd77)
2017-10-25 23:42:02 +09:00
Akira Ajisaka 79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4c970088af)
2017-10-25 17:18:49 +09:00
Zhe Zhang f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
This reverts commit aecf6c50d3.
2017-10-24 15:06:01 -07:00
Varun Saxena 5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
(cherry picked from commit 67e7673750)
2017-10-25 03:22:18 +05:30
Eric Yang 107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu 6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu)
(cherry picked from commit a92ef030a2)
2017-10-24 13:52:02 -07:00
Robert Kanter c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter)
(cherry picked from commit 03af442e76)
2017-10-24 13:40:06 -07:00
Carlo Curino 8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino)
(cherry picked from commit 1c5c2b5dde)
2017-10-24 10:53:08 -07:00