20193 Commits

Author SHA1 Message Date
Wangda Tan
8e8b748724 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda)
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
(cherry picked from commit a23ea68b9747eae9b176f908bb04b76d30fe3795)
2018-10-09 10:19:16 -07:00
Sunil G
f6a73d181f YARN-8853. [UI2] Application Attempts tab is not shown correctly when there are no attempts. Contributed by Akhil PB.
(cherry picked from commit 6f11919beb71f3bab7a49f2866c03bca5a4afc3b)
2018-10-09 22:05:53 +05:30
Vidura Mudalige
71faacd175
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module
This closes #425

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824201df45535706462505f07bb9776eb)
2018-10-09 12:57:06 +09:00
Hrishikesh Gadre
a99658cd85 HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
Contributed by Xiao Chen, Hrishikesh Gadre.

Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 08bb6c49a5aec32b7d9f29238560f947420405d6)
2018-10-08 20:39:48 -07:00
Yiqun Lin
b6698e2a82 HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 1043795f7fe44c98a34f8ea3cea708c801c3043b)
2018-10-09 10:35:08 +08:00
Inigo Goiri
21553e22b6 YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R.
(cherry picked from commit 745f64012a2a912d5f0a36bbda89dc638e1715cb)
2018-10-08 10:40:59 -07:00
Sunil G
50acba2e39 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB.
(cherry picked from commit 228dc192f1108438e2a221ec2ed7b6fd44080295)
2018-10-08 11:55:50 +05:30
Inigo Goiri
52f9759bf2 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena.
(cherry picked from commit 3bfff0f79e7246cbb2989c720c14cfa2566a9d1a)
2018-10-06 10:41:17 -07:00
Vidura Mudalige
843e7f81fe
YARN-8819. Fix findbugs warnings in YarnServiceUtils
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b85ee0d75d450f1c695cec1bebac627f66a97c98)
2018-10-07 00:55:08 +09:00
Sunil G
2c392da8aa HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton. 2018-10-05 16:10:47 +05:30
Steve Loughran
83b9b25c51
HADOOP-15809. ABFS: better exception handling when making getAccessToken call.
Contributed by Da Zhou

(cherry picked from commit 273cc2d4e972dc7cc371761a4ab2d1bc20dd5ca0)
2018-10-05 11:29:43 +01:00
Sunil G
a7711073ac YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB.
(cherry picked from commit 94d82f416258b65c8ab7849a459af78abebdf7d0)
2018-10-05 14:33:47 +05:30
Sunil G
8957a61ed9 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB.
(cherry picked from commit 751f626e506b6cf8cc87ca65b65550871dca74fb)
2018-10-05 12:29:08 +05:30
Takanobu Asanuma
df189bf50e HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka.
(cherry picked from commit 241cbec2dab3c3d49b48f42b86e8bd85cd1f08f3)
2018-10-05 15:33:03 +09:00
Yiqun Lin
62d02eecd0 HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap.
(cherry picked from commit 619e490333fa89601fd476dedac6d16610e9a52a)
2018-10-05 10:09:22 +08:00
Wangda Tan
b3ac886933 YARN-8844. TestNMProxy unit test is failing. (Eric Yang via wangda)
Change-Id: I241fa8701b6f1dbcad87fd2e9a429e32e7aa40f5
2018-10-04 10:48:47 -07:00
Wangda Tan
abe4a8e5d8 YARN-8758. Support getting PreemptionMessage when using AMRMClientAsyn. (Zian Chen via wangda)
Change-Id: Ibf5d165f49957b582eeadeb41dc285c84d2f05e7
(cherry picked from commit 6926fd0ec634df2576bbc9f45e9636b99260db72)
2018-10-04 10:43:16 -07:00
Yiqun Lin
e185ae2d17 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
(cherry picked from commit 81f635f47f0737eb551bef1aa55afdf7b268253d)
2018-10-04 11:04:39 +08:00
Akira Ajisaka
4de3cf1968
YARN-8840. Add missing cleanupSSLConfig() call for TestTimelineClient test. Contributed by Aki Tanaka.
(cherry picked from commit 39b35036ba47064149003046a7b59feb01575d1e)
2018-10-04 09:52:50 +09:00
Steve Loughran
c6942a315b
HADOOP-15792. typo in AzureBlobFileSystem.getIsNamespaceEnabeld.
Contributed by Abhishek Modi.

(cherry picked from commit e8b8604314a2ea894b1f24939c42e782b83335aa)
2018-10-03 12:59:16 +01:00
Steve Loughran
e5e9d7b595
HADOOP-15795. Make HTTPS the default protocol for ABFS.
Contributed by Da Zhou.

(cherry picked from commit 7051bd78b17b2666c2fa0f61823920285a060a76)
2018-10-03 12:53:56 +01:00
Takanobu Asanuma
1b9bea0973 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 2626f46691e1e1ad09967d0931a79b95e308c8b8)
2018-10-03 16:40:49 +09:00
Nanda kumar
a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Márton Elek
81072d5e3d HDDS-560. Create Generic exception class to be used by S3 rest services. Contributed by Bharat Viswanadham. 2018-10-02 10:00:10 -04:00
Shane Kumpf
5edb9d3b97 YARN-8785. Improve the error message when a bind mount is not whitelisted. Contributed by Simon Prewo 2018-10-02 07:16:29 -06:00
Ewan Higgs
6fab6886f6 HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs. 2018-10-02 14:05:35 +02:00
Steve Loughran
a383ac47ca
HADOOP-15801. ABFS: Fixing skipUserGroupMetadata in AzureBlobFileSystemStore.
Contributed by Da Zhou
2018-10-02 11:42:52 +01:00
Steve Loughran
43bc984891
HADOOP-15793. ABFS: Skip unsupported test cases when non namespace enabled in ITestAzureBlobFileSystemAuthorization
Contributed by Yuan Gao.
2018-10-02 11:37:28 +01:00
Yiqun Lin
5689355783 HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore. 2018-10-02 09:43:14 +08:00
Takanobu Asanuma
f6c5ef9903 HDFS-13943. [JDK10] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Akira Ajisaka. 2018-10-02 09:49:48 +09:00
Bharat Viswanadham
7d082193d2 HDDS-562. Create acceptance test to test aws cli with the s3 gateway. Contributed by Elek Marton. 2018-10-01 15:04:20 -07:00
Haibo Chen
d0ee6fbe28 YARN-8621. Add test coverage of custom Resource Types for the apps/<appId> REST API endpoint. (Contributed by Szilard Nemeth) 2018-10-01 14:46:42 -07:00
Bharat Viswanadham
4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Giovanni Matteo Fumarola
59d5af21b7 YARN-8760. [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang. 2018-10-01 13:12:38 -07:00
Ajay Kumar
cc80ac2315 HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar. 2018-10-01 11:21:26 -07:00
Nanda kumar
f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Weiwei Yang
fd6be5898a YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach. 2018-09-29 17:47:12 +08:00
Anu Engineer
0da03f8b14 HDDS-391. Simplify Audit Framework to make audit logging easier to use.
Contributed by Dinesh Chitlangia.
2018-09-28 14:00:24 -07:00
Hanisha Koneru
35c7351f4b HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia. 2018-09-28 13:06:50 -07:00
Sunil G
19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Hanisha Koneru
72891fc9be HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. 2018-09-28 11:24:42 -07:00
Ajay Kumar
3c798c1e3c HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. 2018-09-28 10:33:17 -07:00
Billie Rinaldi
d1c1dde309 YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang 2018-09-28 09:40:48 -07:00
Takanobu Asanuma
e2113500df HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki. 2018-09-29 00:53:35 +09:00
Eric E Payne
8598b498bc YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. 2018-09-28 15:32:07 +00:00
bibinchundatt
7093afd874 YARN-8829. Cluster metrics can fail with IndexOutOfBoundsException. Contributed by Akshay Agarwal. 2018-09-28 12:35:33 +05:30
Akira Ajisaka
284aca8b63
HDFS-13938. Add a missing break in BaseTestHttpFSWith. Contributed by Siyao Meng. 2018-09-28 15:44:46 +09:00
Akira Ajisaka
5c8d90763c
HADOOP-15764. Addendum patch: Fix NPE in SecurityUtil. 2018-09-28 10:03:22 +09:00
Hanisha Koneru
2a5d4315bf HDDS-551. Fix the close container status check in CloseContainerCommandHandler. Contributed by Shashikant Banerjee. 2018-09-27 16:03:49 -07:00
Vrushali C
90e2e493b3 YARN-8270 Adding JMX Metrics for Timeline Collector and Reader. Contributed by Sushil Ks. 2018-09-27 15:53:39 -07:00