Akira Ajisaka
|
21f210bada
|
HADOOP-13798. TestHadoopArchives times out.
(cherry picked from commit b970446b2c59f8897bb2c3a562fa192ed3452db5)
(cherry picked from commit 3b279fe4260d99f95787ea5cce428f9ef337a3cb)
|
2016-11-07 19:55:10 +09:00 |
|
Steve Loughran
|
a83f10c90d
|
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
|
2016-10-31 20:53:22 +00:00 |
|
Masatake Iwasaki
|
6d9b6fac86
|
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
(cherry picked from commit 0bdd263d82a4510f16df49238d57c9f78ac28ae7)
|
2016-10-27 15:55:35 +09:00 |
|
Chris Nauroth
|
4df1780991
|
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
(cherry picked from commit 1f8490a5bacd98d0d371447ada3b31f93ca40a4e)
(cherry picked from commit 082d69ee663d5c1a59f32c40b9fbde9996886de9)
|
2016-10-26 08:57:46 -07:00 |
|
Chris Nauroth
|
c940c68c79
|
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
(cherry picked from commit 9cad3e235026dbe4658705ca85d263d0edf14521)
(cherry picked from commit 67e01f7218e592d7b18316d65f7b22ae8b9ad7a6)
|
2016-10-26 08:27:39 -07:00 |
|
Chris Nauroth
|
3d5f41544a
|
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
(cherry picked from commit 309a43925c078ff51cdb6bd1273e6f91f43311cb)
(cherry picked from commit 05d772e297fa3738b3fdddfa666bd6e23688f2b6)
|
2016-10-25 09:03:19 -07:00 |
|
Chris Nauroth
|
02f0472d1e
|
HADOOP-12774. s3a should use UGI.getCurrentUser.getShortname() for username. Contributed by Steve Loughran.
(cherry picked from commit 3372e940303149d6258e0b72c54d72f080f0daa2)
(cherry picked from commit 5c2f67bdae208ea14c518af58e551d563b2bf8cd)
|
2016-10-24 21:54:25 -07:00 |
|
Chris Nauroth
|
78970e0db3
|
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
(cherry picked from commit d8fa1cfa6722cbf7a4ec3d6b9c44b034da9aa351)
(cherry picked from commit 5b7cbb5a3c1877e51f63f6d6dfb201afa55dc4da)
|
2016-10-24 21:23:00 -07:00 |
|
Steve Loughran
|
4b56954fea
|
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
|
2016-10-21 19:12:03 +01:00 |
|
Steve Loughran
|
da7e2f08f1
|
Revert "HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran."
This reverts commit 671d219c9cda32cfe7b7165dd1a9e174952f20e1.
|
2016-10-20 22:49:11 +01:00 |
|
Anu Engineer
|
671d219c9c
|
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
|
2016-10-20 12:50:49 -07:00 |
|
Steve Loughran
|
769babf470
|
HADOOP-13735 ITestS3AFileContextStatistics.testStatistics() failing. Contributed by Pieter Reuse
|
2016-10-20 14:50:44 +01:00 |
|
Steve Loughran
|
1ecbf323ba
|
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
|
2016-10-18 19:34:07 +01:00 |
|
Andrew Wang
|
15ff590c37
|
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
(cherry picked from commit 987ee51141a15d3f4d1df4dc792a192b92b87b5f)
(cherry picked from commit 4ed7cf3b362f94367c57d012608213f46f0e16e8)
|
2016-10-17 13:32:52 -07:00 |
|
Jing Zhao
|
d3c4465147
|
HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin.
(cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178)
(cherry picked from commit ad69baf6a9139c0af81e9f72e41c1e3aeb119ebc)
|
2016-10-13 13:28:05 -07:00 |
|
Chris Nauroth
|
67d8301e55
|
HADOOP-13447. Refactor S3AFileSystem to support introduction of separate metadata repository and tests. Contributed by Chris Nauroth.
(cherry picked from commit d152557cf7f4d2288524c222fcbaf152bdc038b0)
(cherry picked from commit e28930a38b3868bc701aeef229831292320b4a3a)
|
2016-10-10 14:01:19 -07:00 |
|
Chris Nauroth
|
027d76fa8c
|
HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth.
(cherry picked from commit cda68de9b913878210118a6637a1d0eb950c26ad)
|
2016-10-10 14:01:13 -07:00 |
|
Chris Nauroth
|
d29dc39791
|
HADOOP-13208. S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories. Contributed by Steve Loughran.
(cherry picked from commit 822d661b8fcc42bec6eea958d9fd02ef1aaa4b6c)
(cherry picked from commit 986162f9776837b1343073d721f89be8f3362085)
|
2016-10-10 14:01:07 -07:00 |
|
Chris Nauroth
|
c6e69f6fb5
|
HADOOP-13692. hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. Contributed by Chris Nauroth.
(cherry picked from commit 69620f955997250d1b543d86d4907ee50218152a)
(cherry picked from commit 2de2d0df1d4e7f5f965d787d53a44db5acefcde9)
|
2016-10-07 11:41:40 -07:00 |
|
Steve Loughran
|
96cc056cb7
|
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
|
2016-10-07 13:22:20 +01:00 |
|
Steve Loughran
|
d24933ad3a
|
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
|
2016-10-07 13:12:04 +01:00 |
|
Steve Loughran
|
f66863f848
|
HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean Mackrory
|
2016-10-05 15:01:52 +01:00 |
|
Chris Nauroth
|
4ea1e73e5b
|
HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth.
(cherry picked from commit 88b9444a81081da9b168d2e290f9552b58a4d8c6)
(cherry picked from commit 213f0ad7f0e846cf8023b12cf8e5f804950b1aa1)
|
2016-10-04 10:37:10 -07:00 |
|
Chris Nauroth
|
b7b06a5f34
|
HADOOP-13599. s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown. Contributed by Steve Loughran.
(cherry picked from commit 47f80922dc7cb2fa6d084e6fb1f354c4ec1d4c69)
(cherry picked from commit 1f1e47e41198760b0ddddceb489f2de2b569f38a)
|
2016-09-28 16:21:10 -07:00 |
|
Brahma Reddy Battula
|
686cbf45d4
|
HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore
(cherry picked from commit e17a4970bea8213660bb6c550104783069153236)
|
2016-09-27 10:49:04 +05:30 |
|
Steve Loughran
|
a2ce4d0503
|
HADOOP-13643. Math error in AbstractContractDistCpTest. Contributed by Aaron Fabbri.
|
2016-09-23 10:00:54 +01:00 |
|
Chris Nauroth
|
911ae15f69
|
HADOOP-13169. Randomize file list in SimpleCopyListing. Contributed by Rajesh Balamohan.
(cherry picked from commit 98bdb5139769eb55893971b43b9c23da9513a784)
(cherry picked from commit e19f910245cd42c6caa88fea5930f446ab618c94)
|
2016-09-19 15:17:50 -07:00 |
|
Steve Loughran
|
6a7ce4ee52
|
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
|
2016-09-14 15:44:20 +01:00 |
|
Steve Loughran
|
5706754f77
|
HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran
|
2016-09-09 18:54:56 +01:00 |
|
Steve Loughran
|
c45f1ec858
|
HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran
|
2016-09-07 12:19:05 +01:00 |
|
Arun Suresh
|
979b29a03c
|
YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
(cherry picked from commit d6d9cff21b7b6141ed88359652cf22e8973c0661)
(cherry picked from commit b279f42d79175bef6529dc1ac4216198a3aaee4d)
|
2016-08-31 20:06:49 -07:00 |
|
Chris Nauroth
|
dd6c149c4a
|
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
(cherry picked from commit 763f0497bb996e331e40caed9ca0af966f5b3fac)
(cherry picked from commit 6dba38f08ba84109b01c8ce8d30c71354d089dbe)
|
2016-08-19 12:55:57 -07:00 |
|
Chris Nauroth
|
1c4e039ba7
|
HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss.
(cherry picked from commit ae4db2544346370404826d5b55b2678f5f92fe1f)
(cherry picked from commit 804a40720bd5cf04415831b7bb33e98d11b2046e)
|
2016-08-18 10:45:20 -07:00 |
|
Steve Loughran
|
c09797ce9f
|
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
|
2016-08-18 14:35:26 +01:00 |
|
Chris Nauroth
|
ac779f2554
|
HADOOP-13324. s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints). Contributed by Steve Loughran.
(cherry picked from commit 3808876c7397ea68906bc5cc18fdf690c9c42131)
(cherry picked from commit 555a57adf2fa5f2d50c1141da907ae4ca032db2c)
|
2016-08-16 17:11:12 -07:00 |
|
Chris Nauroth
|
5c0db4e522
|
HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth.
(cherry picked from commit 4ef1bc0bdb6b2c907431492e4c8395035fa96c84)
(cherry picked from commit 8ec3d702a38fdf0cd8b0b85cbe82c475ab2eaa8f)
|
2016-08-02 22:32:44 -07:00 |
|
Steve Loughran
|
71c8bdd50c
|
HADOOP-13188 S3A file-create should throw error rather than overwrite directories. Contributed by Steve Loughran
|
2016-07-25 15:48:49 +01:00 |
|
Steve Loughran
|
5f9bffbb66
|
HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and mkdirs(). Contributed by Rajesh Balamohan
|
2016-07-25 14:43:45 +01:00 |
|
Steve Loughran
|
7c46303de3
|
HADOOP-13389 TestS3ATemporaryCredentials.testSTS error when using IAM credentials. Contributed by Steven K. Wong
|
2016-07-23 17:58:46 +01:00 |
|
mattf-horton
|
c96cb3fd48
|
HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley.
|
2016-07-21 16:01:05 -07:00 |
|
Steve Loughran
|
c177823ebe
|
HADOOP-13387 users always get told off for using S3 —even when not using it. Contributed by stevel.
|
2016-07-20 14:01:17 +01:00 |
|
Steve Loughran
|
0f1e02a298
|
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan)
|
2016-07-20 13:42:19 +01:00 |
|
Jitendra Pandey
|
a363277be5
|
HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu.
|
2016-07-15 14:32:20 -07:00 |
|
Jian He
|
23eb3c7ceb
|
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
|
2016-07-11 22:38:35 -07:00 |
|
Andrew Wang
|
4e7e48cdc1
|
HDFS-10300. TestDistCpSystem should share MiniDFSCluster. Contributed by John Zhuge.
(cherry picked from commit f292624bd8dbdc1841f225a34346d0392fa76a47)
(cherry picked from commit 38b1eafdbcbd91bd806b842729b84d84f3600524)
|
2016-07-11 18:06:45 -07:00 |
|
Steve Loughran
|
310c08454f
|
HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse.
|
2016-07-11 17:21:14 +01:00 |
|
Akira Ajisaka
|
a8cfcce542
|
Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f80a066a6de71213392d288329d837f.
|
2016-07-09 21:01:07 -07:00 |
|
Jitendra Pandey
|
9c7ce389c7
|
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
|
2016-07-07 15:04:47 -07:00 |
|
Jitendra Pandey
|
bc7fd76a1f
|
HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu.
|
2016-07-01 15:37:32 -07:00 |
|
Steve Loughran
|
f4f0c5074d
|
HADOOP-13239 Deprecate s3:// in branch-2
|
2016-06-29 13:16:10 +01:00 |
|