Chris Nauroth
|
763f0497bb
|
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
|
2016-08-19 10:48:10 -07:00 |
|
Chris Nauroth
|
ae4db25443
|
HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss.
|
2016-08-18 10:44:36 -07:00 |
Junping Du
|
0da69c324d
|
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
(cherry picked from commit d464483bf7)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
|
2016-08-18 07:27:23 -07:00 |
Steve Loughran
|
040c185d62
|
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
|
2016-08-18 14:36:55 +01:00 |
|
Chris Nauroth
|
822d661b8f
|
HADOOP-13208. S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories. Contributed by Steve Loughran.
|
2016-08-17 14:54:54 -07:00 |
|
Chris Nauroth
|
3808876c73
|
HADOOP-13324. s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints). Contributed by Steve Loughran.
|
2016-08-16 17:05:52 -07:00 |
|
Chris Nauroth
|
2ed58c40e5
|
HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka.
|
2016-08-08 12:28:40 -07:00 |
|
Chris Nauroth
|
4ef1bc0bdb
|
HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth.
|
2016-08-02 22:32:21 -07:00 |
|
Chris Nauroth
|
b43de80031
|
HADOOP-13354. Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage Clients. Contributed by Sivaguru Sankaridurg.
|
2016-07-27 15:50:38 -07:00 |
Akira Ajisaka
|
54fe17a607
|
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
|
2016-07-27 19:41:09 +09:00 |
|
Steve Loughran
|
86ae218893
|
HADOOP-13188 S3A file-create should throw error rather than overwrite directories. Contributed by Steve Loughran
|
2016-07-25 15:50:23 +01:00 |
|
Steve Loughran
|
be9e46b42d
|
HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and mkdirs(). Contributed by Rajesh Balamohan
|
2016-07-25 14:45:03 +01:00 |
|
Steve Loughran
|
7052ca8804
|
HADOOP-13389 TestS3ATemporaryCredentials.testSTS error when using IAM credentials. Contributed by Steven K. Wong
|
2016-07-23 18:00:08 +01:00 |
|
Chris Nauroth
|
c60a68ce1d
|
HADOOP-13392. [Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured. Contributed by Vishwajeet Dusane and Chris Douglas.
|
2016-07-22 09:16:38 -07:00 |
Chris Douglas
|
dca6335dbc
|
HADOOP-13393. Omit unsupported fs.defaultFS setting in ADLS documentation
|
2016-07-21 23:21:47 -07:00 |
mattf-horton
|
12aa184479
|
HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley.
|
2016-07-21 14:43:57 -07:00 |
|
Steve Loughran
|
37362c2f92
|
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan)
|
2016-07-20 13:42:51 +01:00 |
Andrew Wang
|
da456ffd62
|
Preparing for 3.0.0-alpha2 development
|
2016-07-15 19:04:17 -07:00 |
Jitendra Pandey
|
c2f9cd584c
|
HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu.
|
2016-07-15 14:28:53 -07:00 |
Jian He
|
819224dcf9
|
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
|
2016-07-11 22:36:20 -07:00 |
|
Andrew Wang
|
f292624bd8
|
HDFS-10300. TestDistCpSystem should share MiniDFSCluster. Contributed by John Zhuge.
|
2016-07-11 18:06:28 -07:00 |
|
Jitendra Pandey
|
6e597600f7
|
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
|
2016-07-07 14:58:19 -07:00 |
|
Jitendra Pandey
|
aa42c7a6dd
|
HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu.
|
2016-07-01 15:34:03 -07:00 |
|
Steve Loughran
|
96fa0f848b
|
HADOOP-12709 Cut s3:// from trunk. Contributed by Mingliang Liu.
|
2016-06-29 16:04:50 +01:00 |
|
Akira Ajisaka
|
8d202f1258
|
HADOOP-13235. Use Date and Time API in KafkaSink.
|
2016-06-29 07:40:12 -07:00 |
Yongjun Zhang
|
8113855b3a
|
HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang.
|
2016-06-28 23:15:13 -07:00 |
Allen Wittenauer
|
422c73a865
|
HADOOP-13034. Log message about input options in distcp lacks some items (Takashi Ohnishi via aw)
|
2016-06-28 07:21:04 -07:00 |
|
Steve Loughran
|
4ee3543625
|
HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel.
|
2016-06-22 15:45:25 +01:00 |
|
Chris Nauroth
|
b2c596cdda
|
HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth.
|
2016-06-21 11:28:52 -07:00 |
|
Jitendra Pandey
|
b7c4cf7129
|
HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu.
|
2016-06-20 16:25:30 -07:00 |
|
Chris Nauroth
|
51d16e7b38
|
HADOOP-13242. Authenticate to Azure Data Lake using client ID and keys. Contributed by Atul Sikaria.
|
2016-06-16 23:35:20 -07:00 |
|
Chris Nauroth
|
127d2c7281
|
HADOOP-13241. document s3a better. Contributed by Steve Loughran.
|
2016-06-16 11:18:02 -07:00 |
Ravi Prakash
|
4aefe119a0
|
HADOOP-3733. "s3x:" URLs break when Secret Key contains a slash, even if encoded. Contributed by Steve Loughran.
|
2016-06-16 11:13:35 -07:00 |
|
Chris Nauroth
|
c9e71382a5
|
HADOOP-12875. [Azure Data Lake] Support for contract test and unit test cases. Contributed by Vishwajeet Dusane.
|
2016-06-16 09:46:05 -07:00 |
Wangda Tan
|
c77a1095dc
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:06:38 -07:00 |
|
Chris Nauroth
|
9581fb715c
|
HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane.
|
2016-06-09 14:33:31 -07:00 |
|
Andrew Wang
|
58c3486850
|
HADOOP-13175. Remove hadoop-ant from hadoop-tools. Contributed by Chris Douglas.
|
2016-06-09 13:49:52 -07:00 |
|
Steve Loughran
|
31ffaf76f2
|
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
|
2016-06-09 21:00:47 +01:00 |
|
Steve Loughran
|
656c460c0e
|
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
|
2016-06-09 17:28:49 +01:00 |
|
Steve Loughran
|
a3f78d8fa8
|
HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker.
|
2016-06-06 23:42:36 +02:00 |
|
Chris Nauroth
|
c58a59f708
|
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
|
2016-06-03 08:55:33 -07:00 |
|
Chris Nauroth
|
16b1cc7af9
|
HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran.
|
2016-06-01 14:49:22 -07:00 |
|
Steve Loughran
|
5870611030
|
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
|
2016-06-01 14:18:20 +01:00 |
Varun Vasudev
|
42f90ab885
|
YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 21:24:16 +05:30 |
|
Yongjun Zhang
|
cfb860dee7
|
HADOOP-13199. Add doc for distcp -filters. (John Zhuge via Yongjun Zhang)
|
2016-05-26 23:30:31 -07:00 |
|
Steve Loughran
|
39ec1515a2
|
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
|
2016-05-21 16:39:31 +01:00 |
|
Steve Loughran
|
757050ff35
|
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
|
2016-05-20 13:52:15 +01:00 |
|
Steve Loughran
|
c918286b17
|
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
|
2016-05-20 12:21:59 +01:00 |
|
Chris Nauroth
|
93258459fa
|
HADOOP-13183. S3A proxy tests fail after httpclient/httpcore upgrade. Contributed by Steve Loughran.
|
2016-05-19 22:00:21 -07:00 |
Jing Zhao
|
03788d3015
|
HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.
|
2016-05-17 15:46:30 -07:00 |