Steve Loughran
|
6a7ce4ee52
|
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
|
2016-09-14 15:44:20 +01:00 |
Steve Loughran
|
5706754f77
|
HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran
|
2016-09-09 18:54:56 +01:00 |
Steve Loughran
|
c45f1ec858
|
HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran
|
2016-09-07 12:19:05 +01:00 |
Arun Suresh
|
979b29a03c
|
YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
(cherry picked from commit d6d9cff21b )
(cherry picked from commit b279f42d79 )
|
2016-08-31 20:06:49 -07:00 |
Chris Nauroth
|
dd6c149c4a
|
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
(cherry picked from commit 763f0497bb )
(cherry picked from commit 6dba38f08b )
|
2016-08-19 12:55:57 -07:00 |
Chris Nauroth
|
1c4e039ba7
|
HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss.
(cherry picked from commit ae4db25443 )
(cherry picked from commit 804a40720b )
|
2016-08-18 10:45:20 -07:00 |
Steve Loughran
|
c09797ce9f
|
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
|
2016-08-18 14:35:26 +01:00 |
Chris Nauroth
|
ac779f2554
|
HADOOP-13324. s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints). Contributed by Steve Loughran.
(cherry picked from commit 3808876c73 )
(cherry picked from commit 555a57adf2 )
|
2016-08-16 17:11:12 -07:00 |
Chris Nauroth
|
5c0db4e522
|
HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth.
(cherry picked from commit 4ef1bc0bdb )
(cherry picked from commit 8ec3d702a3 )
|
2016-08-02 22:32:44 -07:00 |
Steve Loughran
|
71c8bdd50c
|
HADOOP-13188 S3A file-create should throw error rather than overwrite directories. Contributed by Steve Loughran
|
2016-07-25 15:48:49 +01:00 |
Steve Loughran
|
5f9bffbb66
|
HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and mkdirs(). Contributed by Rajesh Balamohan
|
2016-07-25 14:43:45 +01:00 |
Steve Loughran
|
7c46303de3
|
HADOOP-13389 TestS3ATemporaryCredentials.testSTS error when using IAM credentials. Contributed by Steven K. Wong
|
2016-07-23 17:58:46 +01:00 |
mattf-horton
|
c96cb3fd48
|
HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley.
|
2016-07-21 16:01:05 -07:00 |
Steve Loughran
|
c177823ebe
|
HADOOP-13387 users always get told off for using S3 —even when not using it. Contributed by stevel.
|
2016-07-20 14:01:17 +01:00 |
Steve Loughran
|
0f1e02a298
|
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan)
|
2016-07-20 13:42:19 +01:00 |
Jitendra Pandey
|
a363277be5
|
HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu.
|
2016-07-15 14:32:20 -07:00 |
Jian He
|
23eb3c7ceb
|
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
|
2016-07-11 22:38:35 -07:00 |
Andrew Wang
|
4e7e48cdc1
|
HDFS-10300. TestDistCpSystem should share MiniDFSCluster. Contributed by John Zhuge.
(cherry picked from commit f292624bd8 )
(cherry picked from commit 38b1eafdbc )
|
2016-07-11 18:06:45 -07:00 |
Steve Loughran
|
310c08454f
|
HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse.
|
2016-07-11 17:21:14 +01:00 |
Akira Ajisaka
|
a8cfcce542
|
Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f .
|
2016-07-09 21:01:07 -07:00 |
Jitendra Pandey
|
9c7ce389c7
|
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
|
2016-07-07 15:04:47 -07:00 |
Jitendra Pandey
|
bc7fd76a1f
|
HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu.
|
2016-07-01 15:37:32 -07:00 |
Steve Loughran
|
f4f0c5074d
|
HADOOP-13239 Deprecate s3:// in branch-2
|
2016-06-29 13:16:10 +01:00 |
Yongjun Zhang
|
4a57c03f30
|
HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang.
(cherry picked from commit 8113855b3a )
|
2016-06-28 23:34:44 -07:00 |
Jing Zhao
|
d17265f467
|
HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu.
(cherry picked from commit 856bc4e28b )
|
2016-06-22 15:22:54 -07:00 |
Steve Loughran
|
1eb45180a6
|
HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel.
|
2016-06-22 15:41:52 +01:00 |
Chris Nauroth
|
e30b7112ed
|
HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth.
(cherry picked from commit b2c596cdda )
(cherry picked from commit e6ebe9ab4e )
|
2016-06-21 11:34:46 -07:00 |
Jitendra Pandey
|
2f95d22b17
|
HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu.
|
2016-06-20 16:31:54 -07:00 |
Ravi Prakash
|
605443c913
|
HADOOP-3733. "s3x:" URLs break when Secret Key contains a slash, even if encoded. Contributed by Steve Loughran.
|
2016-06-16 20:45:59 +01:00 |
Chris Nauroth
|
eddefbd01b
|
HADOOP-13241. document s3a better. Contributed by Steve Loughran.
(cherry picked from commit 127d2c7281 )
(cherry picked from commit e4b63ed7b4 )
|
2016-06-16 11:19:00 -07:00 |
Wangda Tan
|
d838c6443d
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:21:41 -07:00 |
Steve Loughran
|
faf9a9f4e0
|
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
|
2016-06-09 20:58:30 +01:00 |
Steve Loughran
|
7e09601a90
|
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
|
2016-06-09 16:36:51 +01:00 |
Wangda Tan
|
19e578870d
|
YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. (wangda)
|
2016-06-07 12:41:50 -07:00 |
Steve Loughran
|
f9478c95bd
|
HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker.
|
2016-06-06 23:40:49 +02:00 |
Chris Nauroth
|
b8216c10d8
|
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
|
2016-06-03 08:56:36 -07:00 |
Chris Nauroth
|
3ab0e8d500
|
HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran.
(cherry picked from commit 16b1cc7af9 )
(cherry picked from commit e9942c5b34 )
|
2016-06-01 14:49:41 -07:00 |
Steve Loughran
|
809e359d2d
|
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
|
2016-06-01 14:17:18 +01:00 |
Wangda Tan
|
2f3e1d965d
|
Revert "YARn-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan."
This reverts commit 457884737f .
|
2016-05-31 22:16:53 -07:00 |
Varun Vasudev
|
457884737f
|
YARn-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 20:57:56 +05:30 |
Yongjun Zhang
|
3fc4d4a369
|
HADOOP-13199. Add doc for distcp -filters. (John Zhuge via Yongjun Zhang)
(cherry picked from commit cfb860dee7 )
|
2016-05-26 23:34:32 -07:00 |
Steve Loughran
|
5930e813c5
|
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
|
2016-05-21 19:10:16 +01:00 |
Steve Loughran
|
f2aef95bd3
|
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
|
2016-05-21 14:20:19 +01:00 |
Steve Loughran
|
ce17c9fd51
|
Revert "HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth."
This reverts commit edb912c571 .
|
2016-05-20 14:00:26 +01:00 |
Steve Loughran
|
f32b37ec89
|
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
|
2016-05-20 13:51:56 +01:00 |
Steve Loughran
|
edb912c571
|
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
|
2016-05-20 12:21:35 +01:00 |
Chris Nauroth
|
dbff8f2932
|
HADOOP-13183. S3A proxy tests fail after httpclient/httpcore upgrade. Contributed by Steve Loughran.
(cherry picked from commit 93258459fa )
(cherry picked from commit 60e5397a9b )
|
2016-05-19 22:00:42 -07:00 |
Jing Zhao
|
8755905e30
|
HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.
(cherry picked from commit 03788d3015 )
(cherry picked from commit dd7f5a3b88 )
|
2016-05-17 15:55:31 -07:00 |
Steve Loughran
|
42d9beaa1d
|
HADOOP-13158 S3AFileSystem#toString might throw NullPointerException due to null cannedACL. (Chris Nauroth via stevel)
|
2016-05-17 13:18:51 +01:00 |
Steve Loughran
|
b44ecfff12
|
HADOOP-13163 Reuse pre-computed filestatus in Distcp-CopyMapper (Rajesh Balamohan via stevel)
|
2016-05-17 13:02:22 +01:00 |