Commit Graph

20299 Commits

Author SHA1 Message Date
Steve Loughran 1ee09906ce
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys.
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718)
2018-10-10 17:02:00 +01:00
Jason Lowe 145c7aa663 YARN-7644. NM gets backed up deleting docker containers. Contributed by Chandni Singh
(cherry picked from commit 5ce70e1211)
2018-10-10 10:01:52 -05:00
Jason Lowe 5f97c0cd76 HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe
(cherry picked from commit f13e231025)
2018-10-10 07:00:19 -07:00
Weiwei Yang eb0147a4c7 YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan.
(cherry picked from commit edce866489)
2018-10-10 09:42:45 +08:00
Inigo Goiri bc400c8a33 HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena. 2018-10-09 17:04:17 -07:00
Eric Yang 614d6cf99c YARN-8845. Removed unused hadoop.registry.rm reference.
Contributed by Íñigo Goiri

(cherry picked from commit bf04f19456)
2018-10-09 15:56:04 -04:00
Wangda Tan 8e8b748724 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda)
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
(cherry picked from commit a23ea68b97)
2018-10-09 10:19:16 -07:00
Sunil G f6a73d181f YARN-8853. [UI2] Application Attempts tab is not shown correctly when there are no attempts. Contributed by Akhil PB.
(cherry picked from commit 6f11919beb)
2018-10-09 22:05:53 +05:30
Vidura Mudalige 71faacd175
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module
This closes #425

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824)
2018-10-09 12:57:06 +09:00
Hrishikesh Gadre a99658cd85 HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
Contributed by Xiao Chen, Hrishikesh Gadre.

Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 08bb6c49a5)
2018-10-08 20:39:48 -07:00
Yiqun Lin b6698e2a82 HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 1043795f7f)
2018-10-09 10:35:08 +08:00
Inigo Goiri 21553e22b6 YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R.
(cherry picked from commit 745f64012a)
2018-10-08 10:40:59 -07:00
Sunil G 50acba2e39 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB.
(cherry picked from commit 228dc192f1)
2018-10-08 11:55:50 +05:30
Inigo Goiri 52f9759bf2 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena.
(cherry picked from commit 3bfff0f79e)
2018-10-06 10:41:17 -07:00
Vidura Mudalige 843e7f81fe
YARN-8819. Fix findbugs warnings in YarnServiceUtils
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b85ee0d75d)
2018-10-07 00:55:08 +09:00
Sunil G 2c392da8aa HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton. 2018-10-05 16:10:47 +05:30
Steve Loughran 83b9b25c51
HADOOP-15809. ABFS: better exception handling when making getAccessToken call.
Contributed by Da Zhou

(cherry picked from commit 273cc2d4e9)
2018-10-05 11:29:43 +01:00
Sunil G a7711073ac YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB.
(cherry picked from commit 94d82f4162)
2018-10-05 14:33:47 +05:30
Sunil G 8957a61ed9 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB.
(cherry picked from commit 751f626e50)
2018-10-05 12:29:08 +05:30
Takanobu Asanuma df189bf50e HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka.
(cherry picked from commit 241cbec2da)
2018-10-05 15:33:03 +09:00
Yiqun Lin 62d02eecd0 HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap.
(cherry picked from commit 619e490333)
2018-10-05 10:09:22 +08:00
Wangda Tan b3ac886933 YARN-8844. TestNMProxy unit test is failing. (Eric Yang via wangda)
Change-Id: I241fa8701b6f1dbcad87fd2e9a429e32e7aa40f5
2018-10-04 10:48:47 -07:00
Wangda Tan abe4a8e5d8 YARN-8758. Support getting PreemptionMessage when using AMRMClientAsyn. (Zian Chen via wangda)
Change-Id: Ibf5d165f49957b582eeadeb41dc285c84d2f05e7
(cherry picked from commit 6926fd0ec6)
2018-10-04 10:43:16 -07:00
Yiqun Lin e185ae2d17 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
(cherry picked from commit 81f635f47f)
2018-10-04 11:04:39 +08:00
Akira Ajisaka 4de3cf1968
YARN-8840. Add missing cleanupSSLConfig() call for TestTimelineClient test. Contributed by Aki Tanaka.
(cherry picked from commit 39b35036ba)
2018-10-04 09:52:50 +09:00
Steve Loughran c6942a315b
HADOOP-15792. typo in AzureBlobFileSystem.getIsNamespaceEnabeld.
Contributed by Abhishek Modi.

(cherry picked from commit e8b8604314)
2018-10-03 12:59:16 +01:00
Steve Loughran e5e9d7b595
HADOOP-15795. Make HTTPS the default protocol for ABFS.
Contributed by Da Zhou.

(cherry picked from commit 7051bd78b1)
2018-10-03 12:53:56 +01:00
Takanobu Asanuma 1b9bea0973 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 2626f46691)
2018-10-03 16:40:49 +09:00
Nanda kumar a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Márton Elek 81072d5e3d HDDS-560. Create Generic exception class to be used by S3 rest services. Contributed by Bharat Viswanadham. 2018-10-02 10:00:10 -04:00
Shane Kumpf 5edb9d3b97 YARN-8785. Improve the error message when a bind mount is not whitelisted. Contributed by Simon Prewo 2018-10-02 07:16:29 -06:00
Ewan Higgs 6fab6886f6 HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs. 2018-10-02 14:05:35 +02:00
Steve Loughran a383ac47ca
HADOOP-15801. ABFS: Fixing skipUserGroupMetadata in AzureBlobFileSystemStore.
Contributed by Da Zhou
2018-10-02 11:42:52 +01:00
Steve Loughran 43bc984891
HADOOP-15793. ABFS: Skip unsupported test cases when non namespace enabled in ITestAzureBlobFileSystemAuthorization
Contributed by Yuan Gao.
2018-10-02 11:37:28 +01:00
Yiqun Lin 5689355783 HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore. 2018-10-02 09:43:14 +08:00
Takanobu Asanuma f6c5ef9903 HDFS-13943. [JDK10] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Akira Ajisaka. 2018-10-02 09:49:48 +09:00
Bharat Viswanadham 7d082193d2 HDDS-562. Create acceptance test to test aws cli with the s3 gateway. Contributed by Elek Marton. 2018-10-01 15:04:20 -07:00
Haibo Chen d0ee6fbe28 YARN-8621. Add test coverage of custom Resource Types for the apps/<appId> REST API endpoint. (Contributed by Szilard Nemeth) 2018-10-01 14:46:42 -07:00
Bharat Viswanadham 4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Giovanni Matteo Fumarola 59d5af21b7 YARN-8760. [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang. 2018-10-01 13:12:38 -07:00
Ajay Kumar cc80ac2315 HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar. 2018-10-01 11:21:26 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Weiwei Yang fd6be5898a YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach. 2018-09-29 17:47:12 +08:00
Anu Engineer 0da03f8b14 HDDS-391. Simplify Audit Framework to make audit logging easier to use.
Contributed by Dinesh Chitlangia.
2018-09-28 14:00:24 -07:00
Hanisha Koneru 35c7351f4b HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia. 2018-09-28 13:06:50 -07:00
Sunil G 19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Hanisha Koneru 72891fc9be HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. 2018-09-28 11:24:42 -07:00
Ajay Kumar 3c798c1e3c HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. 2018-09-28 10:33:17 -07:00
Billie Rinaldi d1c1dde309 YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang 2018-09-28 09:40:48 -07:00
Takanobu Asanuma e2113500df HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki. 2018-09-29 00:53:35 +09:00