Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,535 Commits 326 Branches 371 Tags
Commit Graph

4953 Commits

Author SHA1 Message Date
Steve Loughran
9c350785d4
HADOOP-15861. Move DelegationTokenIssuer to the right path. 
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 41b3603b5bcb74a7d78a314a4a5c177d941af27f)
 2018-10-17 11:03:22 +01:00
Xiao Chen
d1749fbaae HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
(cherry picked from commit b6fc72a0250ac3f2341ebe8a14d19b073e6224c8)
 2018-10-15 11:00:30 -07:00
Xiao Chen
6a1ce74fb1 HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445cc492f52c33639efb6a09a0d2f27475)
(cherry picked from commit e93e401f492c7fc112da3d0c63b3b186c1b196ec)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java
 2018-10-12 12:08:26 -07:00
Steve Loughran
2a305efd4e
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys. 
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718055189fef8c70e31314607001d4009)
 2018-10-10 17:03:06 +01:00
Eric Yang
5813c1de56 YARN-8845. Removed unused hadoop.registry.rm reference. 
Contributed by Íñigo Goiri

(cherry picked from commit bf04f194568f9e81f5481b25a84ad903e3c307cf)
 2018-10-09 15:56:38 -04:00
Todd Lipcon
89d4481020 HADOOP-15550. Avoid static initialization of ObjectMappers 
(cherry picked from commit 7a3c6e9c3cd9ffdc71946fd12f5c3d59718c4939)
 2018-10-09 13:50:00 -05:00
Jason Lowe
df7ec58ced HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe 
(cherry picked from commit f13e231025333ebf80b30bbdce1296cef554943b)
 2018-10-05 09:27:23 -05:00
Yiqun Lin
1a890b17b9 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles. 
(cherry picked from commit 81f635f47f0737eb551bef1aa55afdf7b268253d)
 2018-10-04 10:35:16 +08:00
Steve Loughran
9dc180d14a
HADOOP-15748. S3 listing inconsistency can raise NPE in globber. 
Contributed by Steve Loughran.

(cherry picked from commit 646874c326139457b79cf8cfa547b3c91a78c7b4)
 2018-09-20 13:05:46 +01:00
Vinayakumar B
2aa3854633 HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena. 
(cherry picked from commit 7ad27e97f05b13b33fdcef9cb63ace9c1728bfb5)
 2018-09-20 09:33:22 +05:30
Chen Liang
b4069343bb HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen. 2018-09-19 14:28:35 -07:00
Jason Lowe
610b00bdf4 HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia 
(cherry picked from commit e71f61ecb87e04727a5a76e578a75714c9db6706)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestStringUtils.java
 2018-09-18 16:00:48 -05:00
Brahma Reddy Battula
c7973292bb HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena 
(cherry picked from commit ef5c776a42697fb3958a77646b759e2a6edfe48e)
 2018-09-14 07:33:24 +05:30
Inigo Goiri
a400ed3aab HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng. 
(cherry picked from commit 527288ef891dc26019d003bd85ddfd50eb4f3b7b)
 2018-09-06 16:48:44 -07:00
Wei-Chiu Chuang
d1ea7df43d HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit e780556ae9229fe7a90817eb4e5449d7eed35dd8)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
 2018-09-05 10:17:58 -07:00
Steve Loughran
142d878c90 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns. 
Contributed by Kihwal Lee and Lukas Majercak.

(cherry picked from commit 9e96ac666d783376a8cdea9c3cc84098c5bdcb56)
 2018-09-04 12:00:31 -07:00
Daniel Templeton
68301ad7d3 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD 
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec208f640e778fc41f95f0284fcc44729)
 2018-08-30 09:14:29 -07:00
Kitti Nanasi
12eb9cc3bb HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi. 
(cherry picked from commit 781437c219dc3422797a32dc7ba72cd4f5ee38e2)
 2018-08-29 22:09:05 -07:00
Daniel Templeton
90c8cca783 HADOOP-15705. Typo in the definition of "stable" in the interface classification 
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a552155de700e396fd7f450a4c5f9c22)
 2018-08-29 14:00:42 -07:00
John Zhuge
84d761d49c
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui. 
(cherry picked from commit f9c6fd94711458b77ecf3fa425aad7fda5089376)
 2018-08-27 15:21:39 -07:00
Konstantin V Shvachko
60fd202a59 HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko. 
(cherry picked from commit a4121c71c29d13866a605d9c0d013e5de9c147c3)
 2018-08-24 18:44:04 -07:00
Takanobu Asanuma
4fa97013a9 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao. 
(cherry picked from commit bed8cb6979e0460141ed77e3b15d4f18db098a8e)
 2018-08-23 21:55:40 +09:00
Steve Loughran
95fcdc0435
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran. 
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
 2018-08-20 18:48:49 -07:00
Xiao Chen
3712b79b38 HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-20 14:59:14 -07:00
Xiao Chen
a630a27c53 HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi. 2018-08-20 14:57:51 -07:00
Xiao Chen
c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Yiqun Lin
e4b75ad583 HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun. 2018-08-20 14:50:47 -07:00
Xiao Chen
7556b09e9a HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth. 
(cherry picked from commit 8d7c93186e3090b19aa59006bb6b32ba929bd8e6)
 2018-08-17 10:20:12 -07:00
Xiao Chen
1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b94c8874e2a634637b1ef5d837f05bc5c5e8e6a6)
 2018-08-13 10:41:07 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
 2018-08-08 13:04:05 -07:00
Arpit Agarwal
c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Chen Liang
5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang
46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen." 
This reverts commit 6812535b0b4a0ec212e174637e5aedd3ff582f4c.
 2018-07-30 12:05:08 -07:00
Chen Liang
6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Eric Yang
a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. 
Contributed by Gabor Bota

(cherry picked from commit 77721f39e26b630352a1f4087524a3fbd21ff06e)
 2018-07-26 18:47:58 -04:00
Gera Shegalov
1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera) 
(cherry picked from commit 6bec03cfc8bdcf6aa3df9c22231ab959ba31f2f5)
 2018-07-24 23:05:34 -07:00
Xiao Chen
40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi. 
(cherry picked from commit 81d59506e539673edde12e19c0df5c2edd9d02ad)
 2018-07-24 21:46:21 -07:00
Daniel Templeton
00c476abd8 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db187224095b13fe297a4d7377fbb9d2cd)
 2018-07-24 16:12:43 -07:00
bibinchundatt
0710107f8d YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt. 
(cherry picked from commit 84612788339392fcda1aef0e27c43f5c6b2a19e5)
 2018-07-24 13:11:31 +05:30
Kihwal Lee
a147098c4f HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang. 
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
 2018-07-19 11:19:19 -05:00
Wei-Chiu Chuang
34f1dd03ee HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran. 
(cherry picked from commit 0c7a578927032d5d1ef3469283d7d1fb7dee2a56)
 2018-07-16 11:33:43 -07:00
Wei-Chiu Chuang
f9fa3cb157 HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng. 
(cherry picked from commit 162228e8db937d4bdb9cf61d15ed555f1c96368f)
 2018-07-11 10:04:07 -07:00
Xiaoyu Yao
ffe2019887 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 629f7008b531bad469903e6a1f6f8cb4be691f36)
 2018-07-06 11:56:51 -07:00
Andrew Wang
9f2d57697a HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon. 
(cherry picked from commit f51da9c4d1423c2ac92eb4f40e973264e7e968cc)
 2018-07-02 18:31:27 +02:00
Nanda kumar
e1cd5732a6 HADOOP-15574: Suppress build error if there are no docs after excluding private annotations. Contributed by Takanobu Asanuma. 
(cherry picked from commit d40121845e0e1ace6b349180ced53292353dbb7c)
 2018-07-01 17:16:48 +05:30
Eric E Payne
012baf4313 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan. 
(cherry picked from commit d36f6b9e93e4c30d24d0e837cb00bd24ffa8f274)
 2018-06-29 18:22:51 +00:00
Eric Yang
3ce3571a34 YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService. 
Contributed by Chandni Singh
 2018-06-28 13:11:56 -04:00
Bharat Viswanadham
8fa530746f HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee. 
(cherry picked from commit d3fa83a44b01c85f39bfb4deaf2972912ac61ca3)
 2018-06-28 09:26:58 -07:00
Inigo Goiri
cbe15066c8 HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit abc3e4bad905efde5a4881e8a072c68f6e910ade)
 2018-06-25 09:51:01 -07:00