Commit Graph

4815 Commits

Author SHA1 Message Date
Eric Yang 20a7f3b50d HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter.
Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ed)
2018-11-26 13:53:16 -05:00
Vinayakumar B 07529a209d HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena.
(cherry picked from commit 23b441c225)
2018-11-26 18:11:55 +05:30
Surendra Singh Lilhore c97f8b6d95 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore
(cherry picked from commit 75291e6d53)
2018-11-13 21:40:00 +05:30
Steve Loughran 29752ed580
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
Contributed by LiXin Ge.

(cherry picked from commit 3c9d97b8f7)
2018-11-12 12:59:15 +00:00
Jason Lowe 7335d940de YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
(cherry picked from commit ab6aa4c726)
2018-11-06 08:52:29 -06:00
Xiaoyu Yao 0577c89015 HADOOP-15339. Support additional key/value propereties in JMX bean registration. Contributed by Elek Marton. 2018-11-02 10:44:41 +01:00
Steve Loughran e060e90baa
HADOOP-15855. Review hadoop credential doc, including object store details.
Contributed by Steve Loughran.

(cherry picked from commit 62d98ca92a)
2018-10-30 15:59:00 +00:00
Wei-Chiu Chuang 35e09fe594 Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit ef9f8ca13d.
2018-10-28 17:06:40 -07:00
Wei-Chiu Chuang ef9f8ca13d HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
(cherry picked from commit fb2b72e6fc)
(cherry picked from commit fd02c501c0)
2018-10-25 09:37:31 -07:00
Akira Ajisaka 080e9d0f9b
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
(cherry picked from commit 8f97d6f2cd)

Conflicts:
	dev-support/docker/Dockerfile
2018-10-24 13:54:30 +09:00
Steve Loughran f8c7073bd0
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
Contributed by Wei-Chiu Chuang.

(cherry picked from commit cb8d11e7bf5055508949a6a4f074efacc8cb1305)
2018-10-22 11:08:47 +01:00
Jason Lowe 65b27f8ed2 HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe
(cherry picked from commit 9abda83947)
2018-10-17 14:43:19 -05:00
Steve Loughran 9c350785d4
HADOOP-15861. Move DelegationTokenIssuer to the right path.
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 41b3603b5b)
2018-10-17 11:03:22 +01:00
Xiao Chen d1749fbaae HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
(cherry picked from commit b6fc72a025)
2018-10-15 11:00:30 -07:00
Xiao Chen 6a1ce74fb1 HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445c)
(cherry picked from commit e93e401f492c7fc112da3d0c63b3b186c1b196ec)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java
2018-10-12 12:08:26 -07:00
Steve Loughran 2a305efd4e
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys.
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718)
2018-10-10 17:03:06 +01:00
Eric Yang 5813c1de56 YARN-8845. Removed unused hadoop.registry.rm reference.
Contributed by Íñigo Goiri

(cherry picked from commit bf04f19456)
2018-10-09 15:56:38 -04:00
Todd Lipcon 89d4481020 HADOOP-15550. Avoid static initialization of ObjectMappers
(cherry picked from commit 7a3c6e9c3c)
2018-10-09 13:50:00 -05:00
Jason Lowe df7ec58ced HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe
(cherry picked from commit f13e231025)
2018-10-05 09:27:23 -05:00
Yiqun Lin 1a890b17b9 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
(cherry picked from commit 81f635f47f)
2018-10-04 10:35:16 +08:00
Steve Loughran 9dc180d14a
HADOOP-15748. S3 listing inconsistency can raise NPE in globber.
Contributed by Steve Loughran.

(cherry picked from commit 646874c326)
2018-09-20 13:05:46 +01:00
Vinayakumar B 2aa3854633 HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena.
(cherry picked from commit 7ad27e97f0)
2018-09-20 09:33:22 +05:30
Chen Liang b4069343bb HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen. 2018-09-19 14:28:35 -07:00
Jason Lowe 610b00bdf4 HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia
(cherry picked from commit e71f61ecb8)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestStringUtils.java
2018-09-18 16:00:48 -05:00
Brahma Reddy Battula c7973292bb HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena
(cherry picked from commit ef5c776a42)
2018-09-14 07:33:24 +05:30
Inigo Goiri a400ed3aab HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
(cherry picked from commit 527288ef89)
2018-09-06 16:48:44 -07:00
Wei-Chiu Chuang d1ea7df43d HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
(cherry picked from commit e780556ae9)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
2018-09-05 10:17:58 -07:00
Steve Loughran 142d878c90 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns.
Contributed by Kihwal Lee and Lukas Majercak.

(cherry picked from commit 9e96ac666d)
2018-09-04 12:00:31 -07:00
Daniel Templeton 68301ad7d3 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec2)
2018-08-30 09:14:29 -07:00
Kitti Nanasi 12eb9cc3bb HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.
(cherry picked from commit 781437c219)
2018-08-29 22:09:05 -07:00
Daniel Templeton 90c8cca783 HADOOP-15705. Typo in the definition of "stable" in the interface classification
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a5)
2018-08-29 14:00:42 -07:00
John Zhuge 84d761d49c
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
(cherry picked from commit f9c6fd9471)
2018-08-27 15:21:39 -07:00
Konstantin V Shvachko 60fd202a59 HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
(cherry picked from commit a4121c71c2)
2018-08-24 18:44:04 -07:00
Takanobu Asanuma 4fa97013a9 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
(cherry picked from commit bed8cb6979)
2018-08-23 21:55:40 +09:00
Steve Loughran 95fcdc0435
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran.
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
2018-08-20 18:48:49 -07:00
Xiao Chen 3712b79b38 HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-20 14:59:14 -07:00
Xiao Chen a630a27c53 HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi. 2018-08-20 14:57:51 -07:00
Xiao Chen c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Yiqun Lin e4b75ad583 HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun. 2018-08-20 14:50:47 -07:00
Xiao Chen 7556b09e9a HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
(cherry picked from commit 8d7c93186e)
2018-08-17 10:20:12 -07:00
Xiao Chen 1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b94c8874e2)
2018-08-13 10:41:07 -07:00
Wangda Tan 781620a44d Make 3.1.1 awared by other branches
(cherry picked from commit 49c687608b)
2018-08-08 13:04:05 -07:00
Arpit Agarwal c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Wangda Tan 5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Chen Liang 5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang 46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen."
This reverts commit 6812535b0b.
2018-07-30 12:05:08 -07:00
Chen Liang 6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Eric Yang a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds.
Contributed by Gabor Bota

(cherry picked from commit 77721f39e2)
2018-07-26 18:47:58 -04:00
Gera Shegalov 1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
(cherry picked from commit 6bec03cfc8)
2018-07-24 23:05:34 -07:00
Xiao Chen 40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
(cherry picked from commit 81d59506e5)
2018-07-24 21:46:21 -07:00