Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,413 Commits 326 Branches 371 Tags
Commit Graph

20413 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinayakumar B
8a41edb089 Fix potential FSImage corruption. Contributed by Daryn Sharp. 
(cherry picked from commit b60ca37914b22550e3630fa02742d40697decb31)
 2018-10-15 15:49:56 +05:30
Xiao Chen
9cb0654fbb HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445cc492f52c33639efb6a09a0d2f27475)
 2018-10-12 12:08:08 -07:00
Inigo Goiri
65c1469b1a HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 
(cherry picked from commit f63ee083db7c261207b726f0f44be2e5a92124f3)
 2018-10-12 10:10:52 -07:00
Vinayakumar B
b185964b15 HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena. 
(cherry picked from commit 6e0e6daaf3215213c32cdffa79f3730d40e981ea)
 2018-10-12 17:34:28 +05:30
Vinayakumar B
d838d39a2c HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena. 
(cherry picked from commit de44e1064f051248934ceffdd98a3cc13653d886)
 2018-10-12 17:28:48 +05:30
Vrushali C
62d329cac0 YARN-5742 Serve aggregated logs of historical apps from timeline service. Contributed by Rohith Sharma KS 
(cherry picked from commit 8d1981806feb8278966c02a9eff42d72541bb35e)
 2018-10-12 07:18:13 +05:30
Siyao Meng
551e911493 HDFS-13878. HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 6dcfef79afe97eda6d09fe2567bb4d4074223141)
 2018-10-11 15:04:02 -07:00
Siyao Meng
15e0ba3fb4 HDFS-13877. HttpFS: Implement GETSNAPSHOTDIFF. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 396ce0d9f470a5e8af03987ad6396d0f08b3d225)
 2018-10-11 15:03:55 -07:00
Jason Lowe
cdbca8b133 YARN-8861. executorLock is misleading in ContainerLaunch. Contributed by Chandni Singh 
(cherry picked from commit e787d65a08f5d5245d2313fc34f2dde518bfaa5b)
 2018-10-11 10:58:48 -05:00
Steve Loughran
70d39c74d9
HADOOP-15837. DynamoDB table Update can fail S3A FS init. 
Contributed by Steve Loughran.

(cherry picked from commit ee816f1fd78b029b9efa567e8b1b62391563de14)
 2018-10-11 14:58:37 +01:00
Sunil G
f29a7fdb14 YARN-8753. [UI2] Lost nodes representation missing from Nodemanagers Chart. Contributed by Yesha Vora. 
(cherry picked from commit 8a379839909197690af170afc13c49ef7aa54286)
 2018-10-11 16:16:05 +05:30
Sunil G
0bf0fb5499 YARN-8666. [UI2] Remove application tab from YARN Queue Page. Contributed by Yesha Vora. 
(cherry picked from commit d3da741fa27c14f3d1391a76d6ade5d1a8365aa5)
 2018-10-11 16:07:08 +05:30
Hrishikesh Gadre
90a9837c9d HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit bf3d591f0cb0fedeab5d89cc8d2270d3b9a70313)
 2018-10-10 10:24:23 -07:00
Weiwei Yang
966d94ea2f HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3ead525c71cba068e7abf1c76ad629bfeec10852)
 2018-10-10 10:14:57 -07:00
Steve Loughran
1ee09906ce
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys. 
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718055189fef8c70e31314607001d4009)
 2018-10-10 17:02:00 +01:00
Jason Lowe
145c7aa663 YARN-7644. NM gets backed up deleting docker containers. Contributed by Chandni Singh 
(cherry picked from commit 5ce70e1211e624d58e8bb1181aec00729ebdc085)
 2018-10-10 10:01:52 -05:00
Jason Lowe
5f97c0cd76 HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe 
(cherry picked from commit f13e231025333ebf80b30bbdce1296cef554943b)
 2018-10-10 07:00:19 -07:00
Weiwei Yang
eb0147a4c7 YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan. 
(cherry picked from commit edce866489d83744f3f47a3b884b0c6136885e4a)
 2018-10-10 09:42:45 +08:00
Inigo Goiri
bc400c8a33 HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena. 2018-10-09 17:04:17 -07:00
Eric Yang
614d6cf99c YARN-8845. Removed unused hadoop.registry.rm reference. 
Contributed by Íñigo Goiri

(cherry picked from commit bf04f194568f9e81f5481b25a84ad903e3c307cf)
 2018-10-09 15:56:04 -04:00
Wangda Tan
8e8b748724 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda) 
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
(cherry picked from commit a23ea68b9747eae9b176f908bb04b76d30fe3795)
 2018-10-09 10:19:16 -07:00
Sunil G
f6a73d181f YARN-8853. [UI2] Application Attempts tab is not shown correctly when there are no attempts. Contributed by Akhil PB. 
(cherry picked from commit 6f11919beb71f3bab7a49f2866c03bca5a4afc3b)
 2018-10-09 22:05:53 +05:30
Vidura Mudalige
71faacd175
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module 
This closes #425

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824201df45535706462505f07bb9776eb)
 2018-10-09 12:57:06 +09:00
Hrishikesh Gadre
a99658cd85 HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads. 
Contributed by Xiao Chen, Hrishikesh Gadre.

Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 08bb6c49a5aec32b7d9f29238560f947420405d6)
 2018-10-08 20:39:48 -07:00
Yiqun Lin
b6698e2a82 HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 1043795f7fe44c98a34f8ea3cea708c801c3043b)
 2018-10-09 10:35:08 +08:00
Inigo Goiri
21553e22b6 YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R. 
(cherry picked from commit 745f64012a2a912d5f0a36bbda89dc638e1715cb)
 2018-10-08 10:40:59 -07:00
Sunil G
50acba2e39 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB. 
(cherry picked from commit 228dc192f1108438e2a221ec2ed7b6fd44080295)
 2018-10-08 11:55:50 +05:30
Inigo Goiri
52f9759bf2 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 
(cherry picked from commit 3bfff0f79e7246cbb2989c720c14cfa2566a9d1a)
 2018-10-06 10:41:17 -07:00
Vidura Mudalige
843e7f81fe
YARN-8819. Fix findbugs warnings in YarnServiceUtils 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b85ee0d75d450f1c695cec1bebac627f66a97c98)
 2018-10-07 00:55:08 +09:00
Sunil G
2c392da8aa HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton. 2018-10-05 16:10:47 +05:30
Steve Loughran
83b9b25c51
HADOOP-15809. ABFS: better exception handling when making getAccessToken call. 
Contributed by Da Zhou

(cherry picked from commit 273cc2d4e972dc7cc371761a4ab2d1bc20dd5ca0)
 2018-10-05 11:29:43 +01:00
Sunil G
a7711073ac YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB. 
(cherry picked from commit 94d82f416258b65c8ab7849a459af78abebdf7d0)
 2018-10-05 14:33:47 +05:30
Sunil G
8957a61ed9 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB. 
(cherry picked from commit 751f626e506b6cf8cc87ca65b65550871dca74fb)
 2018-10-05 12:29:08 +05:30
Takanobu Asanuma
df189bf50e HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 
(cherry picked from commit 241cbec2dab3c3d49b48f42b86e8bd85cd1f08f3)
 2018-10-05 15:33:03 +09:00
Yiqun Lin
62d02eecd0 HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap. 
(cherry picked from commit 619e490333fa89601fd476dedac6d16610e9a52a)
 2018-10-05 10:09:22 +08:00
Wangda Tan
b3ac886933 YARN-8844. TestNMProxy unit test is failing. (Eric Yang via wangda) 
Change-Id: I241fa8701b6f1dbcad87fd2e9a429e32e7aa40f5
 2018-10-04 10:48:47 -07:00
Wangda Tan
abe4a8e5d8 YARN-8758. Support getting PreemptionMessage when using AMRMClientAsyn. (Zian Chen via wangda) 
Change-Id: Ibf5d165f49957b582eeadeb41dc285c84d2f05e7
(cherry picked from commit 6926fd0ec634df2576bbc9f45e9636b99260db72)
 2018-10-04 10:43:16 -07:00
Yiqun Lin
e185ae2d17 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles. 
(cherry picked from commit 81f635f47f0737eb551bef1aa55afdf7b268253d)
 2018-10-04 11:04:39 +08:00
Akira Ajisaka
4de3cf1968
YARN-8840. Add missing cleanupSSLConfig() call for TestTimelineClient test. Contributed by Aki Tanaka. 
(cherry picked from commit 39b35036ba47064149003046a7b59feb01575d1e)
 2018-10-04 09:52:50 +09:00
Steve Loughran
c6942a315b
HADOOP-15792. typo in AzureBlobFileSystem.getIsNamespaceEnabeld. 
Contributed by Abhishek Modi.

(cherry picked from commit e8b8604314a2ea894b1f24939c42e782b83335aa)
 2018-10-03 12:59:16 +01:00
Steve Loughran
e5e9d7b595
HADOOP-15795. Make HTTPS the default protocol for ABFS. 
Contributed by Da Zhou.

(cherry picked from commit 7051bd78b17b2666c2fa0f61823920285a060a76)
 2018-10-03 12:53:56 +01:00
Takanobu Asanuma
1b9bea0973 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 2626f46691e1e1ad09967d0931a79b95e308c8b8)
 2018-10-03 16:40:49 +09:00
Nanda kumar
a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Márton Elek
81072d5e3d HDDS-560. Create Generic exception class to be used by S3 rest services. Contributed by Bharat Viswanadham. 2018-10-02 10:00:10 -04:00
Shane Kumpf
5edb9d3b97 YARN-8785. Improve the error message when a bind mount is not whitelisted. Contributed by Simon Prewo 2018-10-02 07:16:29 -06:00
Ewan Higgs
6fab6886f6 HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs. 2018-10-02 14:05:35 +02:00
Steve Loughran
a383ac47ca
HADOOP-15801. ABFS: Fixing skipUserGroupMetadata in AzureBlobFileSystemStore. 
Contributed by Da Zhou
 2018-10-02 11:42:52 +01:00
Steve Loughran
43bc984891
HADOOP-15793. ABFS: Skip unsupported test cases when non namespace enabled in ITestAzureBlobFileSystemAuthorization 
Contributed by Yuan Gao.
 2018-10-02 11:37:28 +01:00
Yiqun Lin
5689355783 HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore. 2018-10-02 09:43:14 +08:00
Takanobu Asanuma
f6c5ef9903 HDFS-13943. [JDK10] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Akira Ajisaka. 2018-10-02 09:49:48 +09:00