Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,567 Commits 326 Branches 371 Tags
Commit Graph

2967 Commits

Author SHA1 Message Date
Andrew Wang
6a8d3233fc HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d830c3f2b16c4b8abf68729c7aba6cb)
 2016-06-13 11:43:56 -07:00
Karthik Kambatla
63da641910 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha) 
(cherry picked from commit 49b4064644b242921af4ddf1de9932bc7bcf5f0e)
 2016-06-12 14:28:19 -07:00
Jing Zhao
9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076)
 2016-06-10 10:40:53 -07:00
Chris Nauroth
1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane." 
This reverts commit a8f03ef7ea8163c00ce5d72a4e1c77284befe5aa.
 2016-06-09 15:17:18 -07:00
Chris Nauroth
a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 
(cherry picked from commit 9581fb715cbc8a6ad28566e83c6d0242a7306688)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2016-06-09 14:49:05 -07:00
Steve Loughran
6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Steve Loughran
df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Junping Du
19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e29e799f7c8f15ff24d7eba6e0cd39b)
 2016-06-07 09:20:51 -07:00
Tsz-Wo Nicholas Sze
074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5bfadb8e6bd9af791890da84707f4ebee0f664d8.
 2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze
09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 071aeab5853087314efd6252b9b7e4b64979a0fd.
 2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze
7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 7d4c16bae9b69a722807b3ca200f97bb8cc95f61.
 2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze
c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit c11c2ee649a186d211cea0b85cb33dab0b3f96db.
 2016-06-06 16:51:41 +08:00
Andrew Wang
c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit d316f44059c4417ed30064470a590991dd160857.
 2016-06-03 18:11:12 -07:00
Andrew Wang
7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 7e0824faa9970de608fabd8101bdb2652db4362b.
 2016-06-03 18:10:49 -07:00
Andrew Wang
071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 658072d62e856c65632f1a66b10808de625649f1.
 2016-06-03 18:10:49 -07:00
Andrew Wang
5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit f7189d6a1c08075920bb6f8efd41a8730a4eb7c7.
 2016-06-03 18:10:47 -07:00
Andrew Wang
03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820ad94a5436f35824d07aa12fcba5cc6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:01:11 -07:00
Chris Nauroth
5e6ee5aafb HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc8501869be78780fc09752dbf7af918c14af)
 2016-06-03 16:38:38 -07:00
Jian He
7f865bf438 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29794f8e61bebe03b2a7ca4b6743ec92)
 2016-06-03 11:11:20 -07:00
Chris Nauroth
043a0c2e6c HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:07 -07:00
Akira Ajisaka
b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00
Masatake Iwasaki
3740974413 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412ab9d4ad05a0bd8b37d547ba5adad03)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-06-02 20:59:40 +09:00
Akira Ajisaka
6843e55208 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df65e84dcc02082b795f1f93c90b794e)
 2016-06-02 19:15:48 +09:00
Andrew Wang
55eda958cc HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba1cad0fa469ff546263290109c61b77)
 2016-06-01 13:13:28 -07:00
Steve Loughran
b29bf5d335 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:50 +01:00
Colin Patrick Mccabe
a64e1425ed HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e2392763726210f96bb1c176e6a9fe7b53)
 2016-05-31 18:05:28 -07:00
Tsz-Wo Nicholas Sze
f7189d6a1c HADOOP-13226 Support async call retry and failover. 2016-05-31 17:01:43 -07:00
Andrew Wang
cbf87869b8 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276ccf7d02b13f25d43c81cca0b0b905b)
 2016-05-31 09:35:28 -07:00
Xiaoyu Yao
001c8f5d7b HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4ca8859583839761663fc1fc1de1b3ce2e3fc5b5)
 2016-05-27 18:48:55 -07:00
Yongjun Zhang
41c02757a5 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:54:07 -07:00
Karthik Kambatla
b4c8729cf9 HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:39:07 -07:00
Kai Zheng
4c8ab5e162 HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang 2016-05-27 17:16:32 +08:00
Karthik Kambatla
afe603d973 HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha) 
(cherry picked from commit 57c31a3fef625f1ec609d7e8873d4941f7ed5cbc)
 2016-05-24 16:34:45 -07:00
Steve Loughran
15f997cca6 HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran) 2016-05-21 14:19:56 +01:00
Chris Nauroth
d38f2090fa HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 
(cherry picked from commit bcde1562d25c4f5595f4e3436dc3630315b1ceed)
 2016-05-20 12:47:52 -07:00
Steve Loughran
eb160561e0 HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong. 2016-05-20 13:52:30 +01:00
Tsz-Wo Nicholas Sze
658072d62e HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-19 15:58:15 -07:00
Jian He
2d846fdcbd YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong 
(cherry picked from commit feb90ffcca536e7deac50976b8a8774450fe089f)
 2016-05-19 13:02:05 -07:00
Steve Loughran
151ecdf26d HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel. 2016-05-19 14:44:44 +01:00
Andrew Wang
686691df60 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 2016-05-18 14:55:31 -07:00
Chris Nauroth
42f64b3bcc HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B. 
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
 2016-05-18 09:32:15 -07:00
Colin Patrick Mccabe
feabfe9cda HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe) 
(cherry picked from commit f2c1d9181f80e53890b50309b15c9ea37cb24987)
 2016-05-18 09:19:45 -07:00
Akira Ajisaka
e9dd0d84e5 Revert "HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder." 
This reverts commit e205421555841dbf482d6aa1464cc15788b2b1fb.
 2016-05-18 17:57:46 +09:00
Andrew Wang
e205421555 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 
(cherry picked from commit 7154ace71212e9fb9dd6209a92165fb075df7806)
 2016-05-17 17:44:34 -07:00
Xiaoyu Yao
937bc924cb HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 94784848456a92a6502f3a3c0074e44fba4b19c9)
(cherry picked from commit 744d5edc87686a0e70e6a78a67ee55723e1cf26a)
 2016-05-17 15:51:47 -07:00
Akira Ajisaka
7f03c1c90e HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 
(cherry picked from commit 9fe5828f05accc6746cb08a43916f7557dac533a)
 2016-05-17 15:56:21 +09:00
Sangjin Lee
9330a7b4de HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee) 
(cherry picked from commit 61f46be071e42f9eb49a54b1bd2e54feac59f808)
 2016-05-16 18:59:19 -07:00
Jing Zhao
af70fc42e7 HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit a9a8297cad4122961b34265c0a31d87134a4a028)
 2016-05-16 15:26:48 -07:00
Sangjin Lee
8a316676b7 HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale) 
(cherry picked from commit 1f2794b4faf119a1ab66c8184ac84cec710d52a0)
 2016-05-13 10:02:47 -07:00
Andrew Wang
d6f6b99c83 HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu. 
(cherry picked from commit 3bfd29949fef6d8fb5df4c6398e77cde320d8c2d)
 2016-05-12 23:48:58 -07:00