Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,509 Commits 326 Branches 371 Tags
Commit Graph

4630 Commits

Author SHA1 Message Date
Rushabh Shah
d9fae993b4 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah 
(cherry picked from commit 4cdbdce752e192b45c2b9756c2d4bd24ceffdabd)
 2018-05-04 15:43:24 -05:00
Daniel Templeton
184ecec29c HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently 
(Contributed by Gabor Bota via Daniel Templeton)

Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
(cherry picked from commit 87c23ef643393c39e8353ca9f495b0c8f97cdbd9)
(cherry picked from commit 57e41154365aa260ad2b2117779a77196c918eb0)
 2018-05-02 17:18:59 -07:00
Jason Lowe
e5ef506dc1
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e07156e8b07552b877a22565641465e211144f6f)
 2018-05-02 17:32:26 +09:00
Wangda Tan
e6de818ef6 HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda) 
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
(cherry picked from commit 3559d8b1dacf5cf207424de37cb6ba8865d26ffe)
 2018-04-25 22:21:51 -07:00
Robert Kanter
101d9005dd HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 15:53:53 -07:00
Lei Xu
463fcfb50a Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. 
(cherry picked from commit f6ecb76d0b919b9836600fe28ec9e637b223cd54)

Conflicts:
	hadoop-project-dist/pom.xml
 2018-04-23 14:17:29 -07:00
Virajith Jalaparti
f06b55bbf1 HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:05:17 -07:00
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Xiao Chen
72acda1449 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 
(cherry picked from commit 583fa6ed48ad3df40bcaa9c591d5ccd07ce3ea81)
 2018-04-10 15:45:48 -07:00
Xiao Chen
46edbedd99 HADOOP-15313. TestKMS should close providers. 
(cherry picked from commit c22d62b338cb16d93c4576a9c634041e3610a116)
 2018-04-10 15:45:47 -07:00
Jason Lowe
eef5d1947e HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 
(cherry picked from commit e81397545a273cf9a090010eb644b836e0ef8c7b)
 2018-04-10 16:54:17 -05:00
Manoj Govindassamy
218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem 
(cherry picked from commit 133d7ca76e3d4b60292d57429d4259e80bec650a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
 2018-04-06 15:19:01 -07:00
Arpit Agarwal
492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh. 
(cherry picked from commit b91305119b434d23b99ae7e755aea6639f48b6ab)
 2018-04-06 15:19:01 -07:00
Wei Yan
9638c3fe67 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:19:05 -07:00
Xiao Chen
973a7b16b9 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge. 
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
 2018-04-02 23:10:26 -07:00
Xiao Chen
ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:49:03 -07:00
Konstantin V Shvachko
4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 19:05:01 -07:00
Konstantin V Shvachko
3912bdb2b0 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko. 
(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)
 2018-03-29 17:22:53 -07:00
Wei-Chiu Chuang
c6939e9330 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
(cherry picked from commit 1176a128d632925749db0a81a719fd8141c3cbb6)
 2018-03-27 13:37:14 -07:00
Lei Xu
7b47400ce0 Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:51:32 -07:00
Inigo Goiri
981fda128f HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972a299a74c16a6a20ddd85ea16486b1e)
 2018-03-20 11:21:09 -07:00
Inigo Goiri
a97fe585b3 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be48ef4f04ed96f96ac4caef4974944d)
 2018-03-19 17:21:20 -07:00
Wangda Tan
78f103d6e6 Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" 
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
(cherry picked from commit 252c2b4d52e0dd8984d6f2a8f292f40e1c347fab)
 2018-03-14 13:40:46 -07:00
Inigo Goiri
95a4665ad5 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a353f665846f43dfd73faf7561fedc07)
 2018-03-13 20:02:06 -07:00
Chris Douglas
9889e55e5a HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen 
(cherry picked from commit 9d6994da1964c1125a33b3a65e7a7747e2d0bc59)
(cherry picked from commit 80641508c721fe49c8ace4730b647efd3ce84fbd)
 2018-03-13 14:20:44 -07:00
Xiaoyu Yao
2a93ba690c HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar. 
(cherry picked from commit 107c177782a24a16c66113841f2fc5144f56207b)
 2018-03-12 20:23:52 -07:00
Chris Douglas
a03c8ea61f HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
(cherry picked from commit 09940b1eb3b7ed764149f4a993c1857e9c6ad938)
 2018-03-12 20:06:22 -07:00
Owen O'Malley
0f3b6102ef Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e64c6edb11d852b91f2c816b1253eb3.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServerWithSpengo.java
 2018-03-10 13:35:47 -08:00
Owen O'Malley
0f106df4d6 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33554b7d58fd41b022d983bcc2433da7.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-10 13:33:52 -08:00
Steve Loughran
ca5c4d454e HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.
 2018-03-09 10:50:04 +00:00
Steve Loughran
a5cb7f3616 HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffee2b89108eea2565e7ad955ea1fabe7)
 2018-03-06 10:08:28 +00:00
Nanda kumar
7193c95584
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:41 +09:00
Xiaoyu Yao
908ca63c03 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd59f99d9af009bbbb60a067b9893e69)
 2018-02-28 09:48:12 -08:00
Arpit Agarwal
e22a731070 MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:28:03 -08:00
Kihwal Lee
107efcdc5d HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 
(cherry picked from commit 1f0952bfc734f82339d555e764e454d5594bb84f)
 2018-02-23 13:14:44 -06:00
Steve Loughran
c2bbe22c5a HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. 
Contributed by Andras Bokor.
 2018-02-21 11:11:28 +00:00
Jason Lowe
f173e9cc04 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9e5c53f2fce7ccdeb4e1cd7d0f123b3)
 2018-02-16 14:54:55 -06:00
Anu Engineer
4b4157441f HADOOP-15204. Add Configuration API for parsing storage sizes. Contributed by Anu Engineer. 
(cherry picked from commit 8f66affd6265c9e4231e18d7ca352fb3035dae9a)
 2018-02-14 13:30:33 -08:00
Xiao Chen
2f3415a4d6 Revert "HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar." 
This reverts commit 16b2cad8e8f5215325c51eb582f58640a386b06b.
 2018-02-14 10:25:15 -08:00
Arpit Agarwal
16b2cad8e8 HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar. 2018-02-13 10:14:29 -08:00
Anu Engineer
2d6ab20007 HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 
(cherry picked from commit 4304fcd5bdf9fb7aa9181e866eea383f89bf171f)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestGetConf.java

(cherry picked from commit 9264f10bb35dbe30c75c648bf759e8aeb715834a)
 2018-02-07 11:16:53 -08:00
Kihwal Lee
d436c403b2 HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp. 
(cherry picked from commit 2dd960de983a30bf0d9ee957bdb09f825f9d40a3)
 2018-02-06 15:34:52 -06:00
Lei Xu
7b377f43d0 Preparing for 3.0.2 development 2018-02-06 10:50:37 -08:00
Xiao Chen
abdf8abf1a HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle. 
(cherry picked from commit 09dd709d6e4022cd68187c4da1483d98ffc7e15a)
 2018-02-01 15:35:27 -08:00
Xiaoyu Yao
e260a0af24 HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver. Contributed by Ajay Kumar. 
(cherry picked from commit b3ac6f7ce3f5e014af7ad6bf882431a97716e020)
 2018-01-31 22:40:13 -08:00
Xiao Chen
75be15cf02 HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi. 
(cherry picked from commit b63dcd583f0b98e785831004f41bd7c7de8b3c18)
 2018-01-28 22:24:00 -08:00
Steve Loughran
ec4f5f0f0d HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common 
Contributed by Genmao Yu
 2018-01-26 15:23:08 -08:00
Chris Douglas
7f35487788 MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine 
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
 2018-01-26 09:15:03 -08:00
Wei Yan
c5c042135d HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 
(cherry picked from commit 0c139d5bcfbcd62fc69111ee6204926c57d57bf1)
 2018-01-25 12:52:45 -08:00
Hanisha Koneru
304642322f HADOOP-15121. Encounter NullPointerException when using DecayRpcScheduler. Contributed by Tao Jie. 
(cherry picked from commit 3fde0f1db599227773c0cd537b33312d368ad4d9)
 2018-01-22 16:26:23 -08:00