Commit Graph

4933 Commits

Author SHA1 Message Date
Jason Lowe 6236de9e23 Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
This reverts commit 1f39eae7e6.
2019-01-09 17:41:52 -06:00
Eric Yang febafd0e4f HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
Contributed by Bolke de Bruin

(cherry picked from commit d43af8b3db)
2019-01-04 18:02:30 -05:00
Sunil G 7d752c1b9b HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 51427cbdfb)
2019-01-04 21:49:59 +05:30
Pranay Singh 1f39eae7e6 HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit ecdeaa7e6a)
2019-01-03 09:57:08 -08:00
Surendra Singh Lilhore 5ab79f6377 HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan.
(cherry picked from commit 763e96ea2b)
2018-12-22 12:39:51 +05:30
Jason Lowe 9c89e2ea76 HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne
(cherry picked from commit 3961690037)
2018-12-20 09:33:22 -06:00
Takanobu Asanuma 1b941a680d HDFS-13661. Ls command with e option fails when the filesystem is not HDFS.
(cherry picked from commit d963575918)
2018-12-20 10:05:02 +09:00
Steve Loughran bbe1ddd309
HADOOP-15808. Harden Token service loader use.
Contributed by Steve Loughran.

(cherry picked from commit 202926ac33)
2018-12-11 17:34:16 +00:00
Steve Loughran 05e41dd4fe
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset.
Contributed by Steve Loughran

(cherry picked from commit db2d8b01c6)
2018-12-04 15:36:50 +00:00
Giovanni Matteo Fumarola 7cfcabc473 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:44:19 -08:00
Eric Yang 69be6e7352 HADOOP-15922. Revert patch 004.
(cherry picked from commit 38ea3814bd)
2018-11-30 12:51:58 -05:00
Akira Ajisaka b722bfd6f5
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.
(cherry picked from commit c9bfca217f)
2018-11-30 13:30:32 +09:00
Steve Loughran 1a448565a8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple"
This reverts commit 829a2e4d27.

(cherry picked from commit d0edd37269)
2018-11-29 17:53:23 +00:00
Eric Yang f089796251 HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter.
Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ed)
2018-11-26 13:52:42 -05:00
Vinayakumar B 1b937d701d HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena.
(cherry picked from commit 23b441c225)
2018-11-26 18:13:09 +05:30
Akira Ajisaka f6227367fb
Add 2.9.2 release notes and changes documents.
(cherry picked from commit 1a00b4e325)
2018-11-20 14:25:48 +09:00
Surendra Singh Lilhore 86deff0a06 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore
(cherry picked from commit 75291e6d53)
2018-11-13 21:26:22 +05:30
Steve Loughran d4afeac285
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
Contributed by LiXin Ge.

(cherry picked from commit 3c9d97b8f7)
2018-11-12 12:58:53 +00:00
Jason Lowe 9265934201 YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
(cherry picked from commit ab6aa4c726)
2018-11-06 08:47:30 -06:00
Lars Francke a15bcf97a4
HADOOP-15687. Credentials class should allow access to aliases.
Author:    Lars Francke <lars.francke@gmail.com>

(cherry picked from commit cb8d679c95)
2018-11-03 16:29:56 +00:00
Steve Loughran d79ea3844c
HADOOP-15855. Review hadoop credential doc, including object store details.
Contributed by Steve Loughran.

(cherry picked from commit 62d98ca92a)
2018-10-30 15:58:44 +00:00
Wei-Chiu Chuang 5f8dd40647 Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit fd02c501c0.
2018-10-28 17:05:45 -07:00
Wei-Chiu Chuang fd02c501c0 HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
(cherry picked from commit fb2b72e6fc)
2018-10-25 09:36:28 -07:00
Akira Ajisaka 63396beab4
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
(cherry picked from commit 8f97d6f2cd)
2018-10-24 13:50:30 +09:00
Steve Loughran 85bf008405
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
Contributed by Wei-Chiu Chuang.

(cherry picked from commit cb8d11e7bf5055508949a6a4f074efacc8cb1305)
2018-10-22 11:08:30 +01:00
Sunil G bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Jason Lowe 30fc5966a2 HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe
(cherry picked from commit 9abda83947)
2018-10-17 14:40:57 -05:00
Steve Loughran 88ea877ac0
HADOOP-15861. Move DelegationTokenIssuer to the right path.
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 41b3603b5b)
2018-10-17 11:02:47 +01:00
Márton Elek 7b06383163 HADOOP-15857. Addendum. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 15:51:59 +02:00
Sunil G c5bf07154f HADOOP-15857. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 18:56:49 +05:30
Xiao Chen ced2596094 HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
(cherry picked from commit b6fc72a025)
2018-10-15 11:00:21 -07:00
Xiao Chen 9cb0654fbb HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445c)
2018-10-12 12:08:08 -07:00
Steve Loughran 1ee09906ce
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys.
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718)
2018-10-10 17:02:00 +01:00
Jason Lowe 5f97c0cd76 HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe
(cherry picked from commit f13e231025)
2018-10-10 07:00:19 -07:00
Eric Yang 614d6cf99c YARN-8845. Removed unused hadoop.registry.rm reference.
Contributed by Íñigo Goiri

(cherry picked from commit bf04f19456)
2018-10-09 15:56:04 -04:00
Vidura Mudalige 71faacd175
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module
This closes #425

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824)
2018-10-09 12:57:06 +09:00
Sunil G 2c392da8aa HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton. 2018-10-05 16:10:47 +05:30
Yiqun Lin e185ae2d17 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
(cherry picked from commit 81f635f47f)
2018-10-04 11:04:39 +08:00
Ewan Higgs 6fab6886f6 HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs. 2018-10-02 14:05:35 +02:00
Akira Ajisaka 5c8d90763c
HADOOP-15764. Addendum patch: Fix NPE in SecurityUtil. 2018-09-28 10:03:22 +09:00
Akira Ajisaka c62b440421
HADOOP-15693. Typo in Secure Mode documentation. Contributed by Thomas Levine. 2018-09-26 10:30:43 +09:00
Akira Ajisaka 93b0f540ed
HADOOP-15783. [JDK10] TestSFTPFileSystem.testGetModifyTime fails. 2018-09-25 16:03:28 +09:00
Sunil G d060cbea48 HDFS-13937. Multipart Uploader APIs to be marked as private/unstable in 3.2.0. Contributed by Steve Loughran. 2018-09-24 21:19:47 +05:30
Sean Mackrory 0def61482b Merge branch 'HADOOP-15407' into trunk 2018-09-22 21:19:12 -06:00
Ewan Higgs 429a07e08c HADOOP-15764. [JDK10] Migrate from sun.net.dns.ResolverConfiguration to the replacement. Contributed by Akira Ajisaka. 2018-09-20 15:13:55 +02:00
Ewan Higgs 3da94a36e2 HADOOP-15756. [JDK10] Migrate from sun.net.util.IPAddressUtil to the replacement. Contributed by Akira Ajisaka. 2018-09-20 14:53:21 +02:00
Steve Loughran 646874c326
HADOOP-15748. S3 listing inconsistency can raise NPE in globber.
Contributed by Steve Loughran.
2018-09-20 13:04:52 +01:00
Vinayakumar B 7ad27e97f0 HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena. 2018-09-20 09:31:35 +05:30
Chen Liang a30b4f9e71 HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen. 2018-09-19 13:22:37 -07:00
Jason Lowe e71f61ecb8 HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia 2018-09-18 15:57:33 -05:00