Masatake Iwasaki
3c9d31c55a
HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki.
...
(cherry picked from commit 20b13d109a
)
2016-06-14 19:52:48 +09:00
Vinayakumar B
3bf5379adb
HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma)
...
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
(cherry picked from commit 06b76f1586
)
2016-06-14 15:59:36 +05:30
Akira Ajisaka
8295351e54
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
...
(cherry picked from commit e3ba9ad3f1
)
(cherry picked from commit d219550e8b
)
2016-06-14 10:24:53 +09:00
Andrew Wang
08ff8d7482
HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge.
...
(cherry picked from commit 0accc3306d
)
(cherry picked from commit 6a8d3233fc
)
2016-06-13 11:44:08 -07:00
Akira Ajisaka
f5cdf94725
HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis.
...
This closes #97 .
(cherry picked from commit 8a1dccecce
)
(cherry picked from commit 035eea4d12
)
2016-06-11 03:33:40 +09:00
Wangda Tan
9436548152
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
2016-06-10 09:56:18 -07:00
Steve Loughran
faf9a9f4e0
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
2016-06-09 20:58:30 +01:00
Steve Loughran
7e09601a90
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
2016-06-09 16:36:51 +01:00
Junping Du
333490ba45
HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe.
...
(cherry picked from commit c14c1b298e
)
(cherry picked from commit 19eb997f67
)
2016-06-07 09:26:05 -07:00
Tsz-Wo Nicholas Sze
49535c0683
Revert "Revert "HADOOP-13226 Support async call retry and failover.""
...
This reverts commit 886e239606
.
2016-06-06 16:54:02 +08:00
Tsz-Wo Nicholas Sze
c949001eee
Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls.""
...
This reverts commit 308d28640d
.
2016-06-06 16:53:41 +08:00
Tsz-Wo Nicholas Sze
8ccc8aeb6c
Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
...
This reverts commit 8a07026e77
.
2016-06-06 16:53:31 +08:00
Tsz-Wo Nicholas Sze
2cf663bb59
Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit d740a90260
.
2016-06-06 16:53:24 +08:00
Andrew Wang
d740a90260
Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit bdc45bef64
.
2016-06-03 18:17:33 -07:00
Andrew Wang
8a07026e77
Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
...
This reverts commit a1ba6eee38
.
2016-06-03 18:17:33 -07:00
Andrew Wang
308d28640d
Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
...
This reverts commit fa7c7f2510
.
2016-06-03 18:12:31 -07:00
Andrew Wang
886e239606
Revert "HADOOP-13226 Support async call retry and failover."
...
This reverts commit a8941d7790
.
2016-06-03 18:12:30 -07:00
Andrew Wang
d712b2ee3b
HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
...
(cherry picked from commit 713cb71820
)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
(cherry picked from commit 03c4724c88
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
2016-06-03 17:03:40 -07:00
Chris Nauroth
e54f073cfe
HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu.
...
(cherry picked from commit d82bc85018
)
(cherry picked from commit 5e6ee5aafb
)
Conflicts:
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestLdapGroupsMapping.java
2016-06-03 16:40:48 -07:00
Jian He
3c2bd19fa5
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
...
(cherry picked from commit 99cc439e29
)
2016-06-03 11:11:49 -07:00
Chris Nauroth
b8216c10d8
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
2016-06-03 08:56:36 -07:00
Akira Ajisaka
d0dc5aaa2d
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka)
...
(cherry picked from commit b6d5546e24
)
2016-06-03 16:04:40 +09:00
Masatake Iwasaki
5b3d9ca0cd
HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit aadb77e412
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
(cherry picked from commit 3740974413
)
2016-06-02 21:04:48 +09:00
Akira Ajisaka
f7e1a1eaa7
HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou.
...
(cherry picked from commit 99675e00df
)
(cherry picked from commit 6843e55208
)
2016-06-02 19:15:57 +09:00
Andrew Wang
4ad9ca85fb
HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen.
...
(cherry picked from commit 35356de1ba
)
(cherry picked from commit 55eda958cc
)
2016-06-01 13:13:38 -07:00
Steve Loughran
809e359d2d
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
2016-06-01 14:17:18 +01:00
Colin Patrick Mccabe
6fe1c67fa1
HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
...
(cherry picked from commit 8ceb06e239
)
(cherry picked from commit a64e1425ed
)
2016-05-31 18:26:37 -07:00
Tsz-Wo Nicholas Sze
a8941d7790
HADOOP-13226 Support async call retry and failover.
2016-05-31 17:16:44 -07:00
Jing Zhao
03c4491d89
HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
2016-05-31 17:16:26 -07:00
Andrew Wang
63f73d78a1
HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit bca31fe276
)
2016-05-31 09:35:30 -07:00
Xiaoyu Yao
1d2928ece7
HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 4ca8859583
)
(cherry picked from commit 001c8f5d7b
)
2016-05-27 18:51:46 -07:00
Tsz-Wo Nicholas Sze
fa7c7f2510
HADOOP-13168. Support Future.get with timeout in ipc async calls.
2016-05-26 12:22:57 -07:00
Steve Loughran
f2aef95bd3
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
2016-05-21 14:20:19 +01:00
Chris Nauroth
877af3ec7e
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
...
(cherry picked from commit bcde1562d2
)
(cherry picked from commit d38f2090fa
)
2016-05-20 12:50:23 -07:00
Steve Loughran
f32b37ec89
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
2016-05-20 13:51:56 +01:00
Jian He
61fa9256c5
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
...
(cherry picked from commit feb90ffcca
)
2016-05-19 13:02:24 -07:00
Steve Loughran
7a001ae19b
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:47:46 +01:00
Andrew Wang
64e75c34a3
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-18 14:57:17 -07:00
Chris Nauroth
4ce5a58ca9
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
...
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
(cherry picked from commit 42f64b3bcc
)
2016-05-18 09:32:24 -07:00
Colin Patrick Mccabe
7bbf42b82f
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
...
(cherry picked from commit f2c1d9181f
)
(cherry picked from commit feabfe9cda
)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
2016-05-18 09:20:31 -07:00
Xiaoyu Yao
744d5edc87
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 9478484845
)
2016-05-17 15:44:28 -07:00
Akira Ajisaka
388b2010ae
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 9fe5828f05
)
(cherry picked from commit 7f03c1c90e
)
2016-05-17 15:56:36 +09:00
Sangjin Lee
29699d8e7e
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
...
(cherry picked from commit 1f2794b4fa
)
2016-05-13 10:03:06 -07:00
Andrew Wang
5da54eb3d4
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
...
(cherry picked from commit 3bfd29949f
)
(cherry picked from commit d6f6b99c83
)
2016-05-12 23:49:00 -07:00
Steve Loughran
8d74a58042
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:18 +01:00
Steve Loughran
af5e5d6d47
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:56:48 +01:00
Colin Patrick Mccabe
5f04795aed
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
...
(cherry picked from commit 687233f20d
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
(cherry picked from commit 15bfcde238
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
2016-05-11 14:24:51 -07:00
Varun Vasudev
4d275d0a25
HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
...
(cherry picked from commit d37eb828ff
)
(cherry picked from commit 2451a0a8e0
)
2016-05-11 14:12:18 -07:00
Larry McCay
ee2c2afdc3
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:39:13 -04:00
Chris Nauroth
e9ee258d04
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
...
(cherry picked from commit dee279b532
)
(cherry picked from commit 31279ae45e
)
2016-05-11 10:58:56 -07:00