Commit Graph

198 Commits

Author SHA1 Message Date
Wei-Chiu Chuang 13768fe6f0 HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout (#2533)
(cherry picked from commit 2b4febcf57)
(cherry picked from commit 94c126cc9e)
(cherry picked from commit 8af0fcf628)
2021-01-04 21:00:29 -08:00
Jim Brennan 486da59e1f HADOOP-17389. KMS should log full UGI principal. (#2476) Contributed by Ahmed Hussein
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
    Reviewed-by: Jim Brennan <jbrennan@apache.org>
2020-12-07 17:57:28 +00:00
Akira Ajisaka f9c251badc
HADOOP-17204. Fix typo in Hadoop KMS document. Contributed by Xieming Li.
(cherry picked from commit 141c62584b)
2020-08-12 16:09:52 +09:00
Akira Ajisaka 416edc5a7b
HADOOP-17147. Dead link in hadoop-kms/index.md.vm. Contributed by Xieming Li.
(cherry picked from commit d5b4766158)
2020-07-23 00:41:22 +09:00
Ayush Saxena 4592af898b HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-22 19:05:13 +05:30
Gabor Bota ec6d2a8402 Preparing for 3.1.5 development
Change-Id: Iabc64aba7392e3b6f9e4e18109fcaa2cfc01d1f9
2020-04-29 11:18:18 +02:00
Wei-Chiu Chuang 286c94f13d HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
(cherry picked from commit 6b86a5110e)
(cherry picked from commit aa3c96474f)
2020-01-13 10:49:39 -08:00
Wei-Chiu Chuang 0807cb2485 HADOOP-15686. Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr. Contributed by Wei-Chiu Chuang.
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 9664b9c7a6)
(cherry picked from commit bd2f79cfd8)
2019-11-20 13:08:52 -08:00
Wei-Chiu Chuang 57ed0ff225 HADOOP-15418. Hadoop KMSAuthenticationFilter needs to use getPropsByPrefix instead of iterator to avoid ConcurrentModificationException. Contributed by lqjack and Suma Shivaprasad
(cherry picked from commit cd2158456d)
(cherry picked from commit ab3fb28d47)
2019-10-01 09:03:01 -07:00
Zsombor Gegesy db5b8358ca HADOOP-15014. Addendum: KMS should log the IP address of the clients. Contributed by Zsombor Gegesy.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit b0131bc265)
2019-09-30 17:15:51 -07:00
Zsombor Gegesy b59911d841 HADOOP-15014. KMS should log the IP address of the clients. Contributed by Zsombor Gegesy.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 008766c119)
2019-09-30 17:15:43 -07:00
Zhankun Tang ef79d98788 Preparing for 3.1.4 development 2019-09-04 16:11:36 +08:00
Takanobu Asanuma 8098ddaf40 HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:39:49 +09:00
Akira Ajisaka f8bd5deec1
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:28:21 +09:00
Eric Yang ba3f559724 HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user.
Contributed by He Xiaoqiao

(cherry picked from commit 0dd35e218f)
2019-01-22 19:39:39 -05:00
Wangda Tan 31ea2f7806 Preparing for 3.1.3 development
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
2019-01-07 10:04:58 -08:00
Eric Yang e534be892c HADOOP-15922. Revert patch 004.
(cherry picked from commit 38ea3814bd)
2018-11-30 12:52:36 -05:00
Eric Yang 20a7f3b50d HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter.
Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ed)
2018-11-26 13:53:16 -05:00
Xiao Chen 6a1ce74fb1 HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445c)
(cherry picked from commit e93e401f492c7fc112da3d0c63b3b186c1b196ec)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java
2018-10-12 12:08:26 -07:00
Todd Lipcon 89d4481020 HADOOP-15550. Avoid static initialization of ObjectMappers
(cherry picked from commit 7a3c6e9c3c)
2018-10-09 13:50:00 -05:00
Yiqun Lin 1a890b17b9 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
(cherry picked from commit 81f635f47f)
2018-10-04 10:35:16 +08:00
Wei-Chiu Chuang d1ea7df43d HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
(cherry picked from commit e780556ae9)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
2018-09-05 10:17:58 -07:00
Kitti Nanasi 12eb9cc3bb HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.
(cherry picked from commit 781437c219)
2018-08-29 22:09:05 -07:00
Xiao Chen 1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b94c8874e2)
2018-08-13 10:41:07 -07:00
Wangda Tan 5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Xiao Chen 752092a860 Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah."
This reverts commit 583fa6ed48.

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit a3a1552c33)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2018-05-07 13:47:52 -07:00
Xiao Chen 6d6f65f224 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.
(cherry picked from commit 583fa6ed48)
2018-04-10 15:45:35 -07:00
Xiao Chen 96af1af28f HADOOP-15313. TestKMS should close providers.
(cherry picked from commit c22d62b338)
2018-04-10 15:45:34 -07:00
Wangda Tan 25bf1d3ac6 Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
2018-04-09 10:58:50 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
Xiao Chen 21c6661461 HADOOP-15234. Throw meaningful message on null when initializing KMSWebApp. Contributed by fang zhenyi. 2018-03-15 20:17:16 -07:00
Xiao Chen a906a22645 HADOOP-15280. TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk. Contributed by Bharat Viswanadham. 2018-03-08 10:17:02 -08:00
Ajay Kumar 3dc30bc24e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-04 07:12:52 -08:00
Ray Chiang 923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Arpit Agarwal 2fa7963c3d HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:41:55 -08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Steve Loughran 996796f104 HADOOP-15214. Make Hadoop compatible with Guava 21.0.
Contributed by Igor Dvorzhak
2018-02-08 10:55:54 -08:00
Jason Lowe f8af0e2feb HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 2017-12-14 10:18:08 -06:00
Wei-Chiu Chuang 97c70c7ac6 HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 2017-10-19 06:02:13 -07:00
Xiao Chen 86ee0c5e4e HADOOP-14944. Add JvmMetrics to KMS. 2017-10-17 19:06:45 -07:00
Xiao Chen b7ff624c76 HADOOP-14949. TestKMS#testACLs fails intermittently. 2017-10-16 14:19:31 -07:00
Akira Ajisaka c9b525bd94
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari. 2017-10-04 07:01:54 +09:00
Xiao Chen 06df6ab254 HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS. 2017-09-29 19:34:29 -07:00
Andrew Wang 0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Allen Wittenauer a3fee475f7
HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw) 2017-09-01 08:38:30 -07:00
Xiao Chen 4ec5acc704 HADOOP-14705. Add batched interface reencryptEncryptedKeys to KMS. 2017-08-22 07:47:39 -07:00
Sean Mackrory 1a1bf6b7d0 HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer. 2017-08-02 12:25:05 -06:00
John Zhuge 946dd25675 HADOOP-14608. KMS JMX servlet path not backwards compatible. Contributed by John Zhuge. 2017-07-05 11:16:56 -07:00
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Xiao Chen fb5ee3fafb HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 2017-06-27 23:49:09 -07:00