Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,483 Commits 326 Branches 371 Tags
Commit Graph

3845 Commits

Author SHA1 Message Date
Rushabh Shah
734cbdd6b2 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp 
(cherry picked from commit 73e9120ad79c73703de21e0084591861813f3279)
 2018-05-21 12:53:54 -05:00
Inigo Goiri
c4d4ae62cb HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack. 
(cherry picked from commit 8783613696674aba4ae1739c6e8f48cda0d1c386)
 2018-05-17 19:28:28 -07:00
Inigo Goiri
a5ec44c655 HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 53b807a6a8486cefe0b036f7893de9f619bd44a1)
 2018-05-17 17:04:59 -07:00
Sammi Chen
eabc588d22 Add 2.9.1 release notes and changes documents 2018-05-14 15:36:30 +08:00
Rushabh Shah
1bc12310d8 HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota 
(cherry picked from commit a5449d36312c3de953e05ba8b3b5acf818a0c7e7)
 2018-05-12 12:30:59 -05:00
Inigo Goiri
ed592a210a HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 1da8d4190d6e574347ab9d3380513e9401569573)
 2018-05-10 09:42:39 -07:00
Xiao Chen
723afa0978 Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah." 
This reverts commit 95cedc5587a495b46748973218454be87ba8b92e.

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
 2018-05-07 14:11:13 -07:00
Robert Kanter
312462532e HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
(cherry picked from commit 74e5b4b437a0005676d51e770f7dd5110893e356)
 2018-05-07 12:39:57 -07:00
Rushabh Shah
d261645177 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah 
(cherry picked from commit 4cdbdce752e192b45c2b9756c2d4bd24ceffdabd)
 2018-05-04 15:55:12 -05:00
Brahma Reddy Battula
cbcd16e6b7 HADOOP-15180. branch-2 : daemon processes' sysout overwrites 'ulimit -a' in daemon's out file. Contributed by Ranith Sardar 2018-04-18 23:01:50 +05:30
Inigo Goiri
7a2edb588c HADOOP-15394. Backport PowerShell NodeFencer HADOOP-14309 to branch-2. Contributed by Inigo Goiri. 2018-04-17 11:33:09 -07:00
Virajith Jalaparti
b9dc0e597e HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:08:36 -07:00
Xiao Chen
95cedc5587 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 2018-04-10 15:46:46 -07:00
Jason Lowe
0fb1457d86 HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 2018-04-10 16:59:31 -05:00
Wei Yan
689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:23:07 -07:00
Xiao Chen
b8d8c25a18 HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen. 
(cherry picked from commit 59d78a5088700350a5122c3a3ba5e76cd26d6a80)
 2018-04-03 11:14:26 -07:00
Xiao Chen
117a8d6573 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge. 
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
 2018-04-02 23:10:35 -07:00
Xiao Chen
251fc1fb40 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:55:03 -07:00
Konstantin V Shvachko
de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 19:08:12 -07:00
Konstantin V Shvachko
c138682e04 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko. 
(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)
 2018-03-29 18:03:32 -07:00
Wei-Chiu Chuang
827d2015c4 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
(cherry picked from commit 1176a128d632925749db0a81a719fd8141c3cbb6)
(cherry picked from commit c6939e933055cbe08c4d4f0a5d4bac152c953e35)
 2018-03-27 13:38:06 -07:00
Inigo Goiri
d6df90f7b5 HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972a299a74c16a6a20ddd85ea16486b1e)
 2018-03-20 11:21:44 -07:00
Inigo Goiri
30d9a5db29 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be48ef4f04ed96f96ac4caef4974944d)
 2018-03-19 17:21:55 -07:00
Inigo Goiri
36451f2d54 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a353f665846f43dfd73faf7561fedc07)
 2018-03-13 20:06:07 -07:00
Chris Douglas
340cd5f1b1 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
(cherry picked from commit 09940b1eb3b7ed764149f4a993c1857e9c6ad938)
(cherry picked from commit a03c8ea61f6e30a9d462571ace23858b6e0fd1c9)
 2018-03-12 20:08:46 -07:00
Ajay Kumar
d5d38918d7
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e50343efe1f514b923d27a0786d3ac1)
 2018-03-04 07:20:40 -08:00
Nanda kumar
45ec3e18e3
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:57 +09:00
Arpit Agarwal
0945f0eb23 HADOOP-15266. [branch-2] Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar. 2018-02-26 13:45:51 -08:00
Ray Chiang
eeb731307f HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-22 18:08:52 +05:30
Robert Kanter
14f5797eff HADOOP-15235. Authentication Tokens should use HMAC instead of MAC (rkanter) 
(cherry picked from commit 324e5a7cf2bdb6f93e7c6fd9023817528f243dcf)
 2018-02-20 17:25:12 -08:00
Jason Lowe
b1d5e73c1f HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9e5c53f2fce7ccdeb4e1cd7d0f123b3)
 2018-02-16 15:00:10 -06:00
Kihwal Lee
56b950d777 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)" 
This reverts commit 577a267198b1d745eee85d1ad9af64d4506bbd0a.
 2018-02-14 15:20:45 -06:00
Ray Chiang
577a267198 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-14 00:07:09 +05:30
Kihwal Lee
34466c6b16 HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp. 
(cherry picked from commit 2dd960de983a30bf0d9ee957bdb09f825f9d40a3)
 2018-02-06 15:36:32 -06:00
Xiao Chen
0922ea0aaf HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi. 
(cherry picked from commit b63dcd583f0b98e785831004f41bd7c7de8b3c18)
(cherry picked from commit 75be15cf021e31d167570b3038060ddce62e2120)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/EncryptionFaultInjector.java
 2018-01-28 22:30:14 -08:00
Steve Loughran
312c571694 HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common 
Contributed by Genmao Yu
 2018-01-27 20:31:21 -08:00
Chris Douglas
9bd439e2c5 MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine 
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
(cherry picked from commit 7f354877889b343878a8a09792d5cec8d2846a50)
 2018-01-26 09:15:53 -08:00
Wei Yan
cefe4b7bb6 HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 2018-01-25 12:58:16 -08:00
Masahiro Tanaka
ab482ebe73
HADOOP-15181. Typo in SecureMode.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d695ed94bd44c60f191cfbb5cdb32e2)
 2018-01-22 17:15:31 +09:00
Brahma Reddy Battula
8181367c62 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d055d85472f0c9371fefe9b56bfea1ed)
 2018-01-18 10:56:58 +05:30
Miklos Szegedi
679ad2ced0 HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi. 
(cherry picked from commit 12d0645)
 2018-01-10 11:15:58 -08:00
Jitendra Pandey
cb60c05c3a HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh. 2018-01-01 21:51:48 -08:00
Xiao Chen
e20173d557 HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c571b7cd25686e60a1105f96ca0626b7)
(cherry picked from commit 8c275c63ffd06db2cde26cbadc6a2ce4195c7b43)
 2017-12-29 13:57:39 -08:00
Steve Loughran
1ef906e29e HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG. 
Contributed by Vipin Rathor.
 2017-12-18 18:48:32 +00:00
Jason Lowe
93fdc3d935 HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 2017-12-15 17:17:25 -06:00
Yiqun Lin
22bc62058b HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:03:34 +08:00
John Zhuge
5e0f4f212d HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30240a251caaefdf7fec9ff8ad177a7c)
(cherry picked from commit fc9e156484824fcb59faef2b2914f3cb53901b87)
 2017-12-07 21:26:12 -08:00
Xiao Chen
31436a12d5 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
(cherry picked from commit 1d1401ad3898834a740f4b9bfcea83d28635a3b6)
 2017-12-07 21:20:33 -08:00
Xiao Chen
c9d48352c2 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 2017-12-07 21:20:33 -08:00
Chris Douglas
afc606c3aa HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 2017-12-07 00:43:21 -08:00