Steve Loughran
|
851c0df5d3
|
HADOOP-14113. Review ADL Docs. Contributed by Steve Loughran
(cherry picked from commit e60c6543d57611039b0438d5dcb4cb19ee239bb6)
|
2017-03-10 13:22:02 -08:00 |
|
John Zhuge
|
f298b992f4
|
HADOOP-14123. Remove misplaced ADL service provider config file for FileSystem. Contributed by John Zhuge.
Change-Id: Ic956e2eb8189625916442eaffdc69163d32f730e
(cherry picked from commit c5ee7fded46dcb1ac1ea4c1ada4949c50bc89afb)
|
2017-03-09 19:53:23 -08:00 |
|
Mingliang Liu
|
acf20c8318
|
HADOOP-14017. User friendly name for ADLS user and group. Contributed by Vishwajeet Dusane
(cherry picked from commit 924def78544a64449785f305cb6984c3559aea4d)
|
2017-03-09 15:16:28 -08:00 |
|
Mingliang Liu
|
a146866802
|
HADOOP-14049. Honour AclBit flag associated to file/folder permission for Azure datalake account. Contributed by Vishwajeet Dusane
(cherry picked from commit f4329990250bed62efdebe3ce2bc740092cf9573)
|
2017-03-09 15:16:28 -08:00 |
|
Lei Xu
|
ed4388f903
|
HADOOP-13929. ADLS connector should not check in contract-test-options.xml. (John Zhuge via lei)
(cherry picked from commit 71c23c9fc94cfdf58de80effbc3f51c0925d0cfe)
|
2017-03-09 15:16:28 -08:00 |
|
Lei Xu
|
d3a6124ffa
|
HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei)
(cherry picked from commit ccf2d662443fc169835d66b715441529658b245c)
|
2017-03-09 15:16:28 -08:00 |
|
Lei Xu
|
01624f0c1b
|
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
(cherry picked from commit e015b563197a475e354bf84fd27e7bbcc67e00a4)
|
2017-03-09 15:16:28 -08:00 |
|
Mingliang Liu
|
881b63499e
|
HADOOP-13900. Remove snapshot version of SDK dependency from Azure Data Lake Store File System. Contributed by Vishwajeet Dusane
(cherry picked from commit ef34bf2bb92a4e8def6617b185ae72db81450de8)
|
2017-03-09 15:16:28 -08:00 |
|
Mingliang Liu
|
7fd0556b2b
|
HADOOP-13257. Improve Azure Data Lake contract tests. Contributed by Vishwajeet Dusane
(cherry picked from commit 4113ec5fa5ca049ebaba039b1faf3911c6a34f7b)
|
2017-03-09 15:16:28 -08:00 |
|
Chris Douglas
|
edf149b979
|
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
|
2017-03-09 15:16:28 -08:00 |
|
John Zhuge
|
f1fd20be82
|
Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
This reverts commit 53a12fa721bb431f7d481aac7d245c93efb56153.
(cherry picked from commit 98142d2f722e82d57b0e2bae6276f7c17fd99598)
Change-Id: Ia5fa901fa97391cd46d41f59cd05f7a19c7c7532
|
2017-03-08 11:46:27 -08:00 |
|
Mingliang Liu
|
d0e26075b8
|
HADOOP-14150. Implement getHomeDirectory() method in NativeAzureFileSystem. Contributed by Santhosh G Nayak
(cherry picked from commit 28daaf0eb206d723d2baf0f9d91e43d98bb2fd26)
|
2017-03-07 14:57:41 -08:00 |
|
Akira Ajisaka
|
d2d0872f4d
|
HADOOP-14087. S3A typo in pom.xml test exclusions. Contributed by Aaron Fabbri.
(cherry picked from commit f597f4c43e0a6e2304b9bcaf727d6d8d15a365f9)
|
2017-03-07 15:16:18 +09:00 |
|
Mingliang Liu
|
ff050866bf
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
(cherry picked from commit 686823529be09bea2a6cecb3503ef722017475bc)
|
2017-03-06 17:35:06 -08:00 |
|
Mingliang Liu
|
8323e651a1
|
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
This reverts commit b26870c58ec6f88c6a3722c5fc856bbbd60c5550.
|
2017-03-06 17:18:36 -08:00 |
|
Mingliang Liu
|
2d059b5a40
|
HADOOP-14048. REDO operation of WASB#AtomicRename should create placeholder blob for destination folder. Contributed by NITIN VERMA
(cherry picked from commit c571cda5c7d929477961dfff4176d7de4944d874)
|
2017-03-06 17:01:01 -08:00 |
|
Mingliang Liu
|
b26870c58e
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
|
2017-03-03 17:09:05 -08:00 |
|
Steve Loughran
|
51fefbe38b
|
HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on existing core-default entry.
Contributed by Steve Loughran
|
2017-03-02 21:41:49 +00:00 |
|
Yongjun Zhang
|
16ca70553c
|
HADOOP-14127. Add log4j configuration to enable logging in hadoop-distcp's tests. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit d235dcdf0b6f36162280e32c7c0342b7970c9b7b)
|
2017-02-27 20:46:17 -08:00 |
|
Steve Loughran
|
29fe5af017
|
HADOOP-14028. S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failures.
Contributed by Steve Loughran.
|
2017-02-25 15:31:26 +00:00 |
|
Steve Loughran
|
c6d7da2112
|
HADOOP-14114 S3A can no longer handle unencoded + in URIs. Contributed by Sean Mackrory.
(cherry picked from commit ff87ca84418a710c6dc884fe8c70947fcc6489d5)
|
2017-02-24 10:40:58 +00:00 |
|
Wangda Tan
|
650ff95e00
|
YARN-5959. RM changes to support change of container ExecutionType. (Arun Suresh via wangda)
(cherry picked from commit 0a55bd841ec0f2eb89a0383f4c589526e8b138d4)
|
2017-02-23 17:22:25 -08:00 |
|
Mingliang Liu
|
b0f8de184a
|
HADOOP-14091. AbstractFileSystem implementaion for 'wasbs' scheme. Contributed Varada Hemeswari.
(cherry picked from commit 82607fce39151fc6ba5bced738088e2bc176dc77)
|
2017-02-23 14:11:08 -08:00 |
|
Mingliang Liu
|
db955f0844
|
HADOOP-14102. Relax error message assertion in S3A test ITestS3AEncryptionSSEC. Contributed by Mingliang Liu
(cherry picked from commit 0013090fb4340eadf147054e65a73de20a62c1c1)
|
2017-02-22 14:38:57 -08:00 |
|
Steve Loughran
|
171b18693a
|
HADOOP-14099 Split S3 testing documentation out into its own file. Contributed by Steve Loughran.
|
2017-02-22 11:41:24 +00:00 |
|
Steve Loughran
|
6843659689
|
HADOOP-13826. S3A Deadlock in multipart copy due to thread pool limits. Contributed by Sean Mackrory.
|
2017-02-21 18:29:30 +00:00 |
|
Steve Loughran
|
274c02d2fa
|
HADOOP-14081. S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock). Contributed by Rajesh Balamohan
|
2017-02-20 16:21:00 +00:00 |
|
Steve Loughran
|
8a88e8ea57
|
HADOOP-14092. Typo in hadoop-aws index.md. Contributed by John Zhuge
(cherry picked from commit b1c1f05b1dc997906390d653dfafb4f0d7e193c4)
|
2017-02-18 18:17:54 +00:00 |
|
Mingliang Liu
|
b23e93d465
|
HADOOP-14040. Use shaded aws-sdk uber-JAR 1.11.86. Contributed by Steve Loughran and Sean Mackrory
(cherry picked from commit 658702efffdf52cf5ddf8e92f959f1157c95a348)
|
2017-02-16 16:59:31 -08:00 |
|
Mingliang Liu
|
29e1007172
|
HADOOP-14019. Fix some typos in the s3a docs. Contributed by Steve Loughran
(cherry picked from commit bdad8b7b97d7f48119f016d68f32982d680c8796)
|
2017-02-16 16:42:56 -08:00 |
|
Akira Ajisaka
|
25ac54a52e
|
HADOOP-14058. Fix NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorks. Contributed by Yiqun Lin.
(cherry picked from commit b9f8491252f5a23a91a1d695d748556a0fd803ae)
|
2017-02-15 01:46:59 +09:00 |
|
Lei Xu
|
6d62d0ea87
|
HADOOP-13204. Add support for SSE-KMS and SSE-C in s3a filesystem. (Steve Moist via lei)
|
2017-02-11 15:02:19 -08:00 |
|
Arpit Agarwal
|
c88ec54588
|
HADOOP-14055. SwiftRestClient includes pass length in exception if auth fails. Contributed by Marcell Hegedus.
|
2017-02-10 10:09:39 -08:00 |
|
Akira Ajisaka
|
b204a1eb5f
|
HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows.
(cherry picked from commit 98c35bb1a4faf794060612bee7494d501701b698)
|
2017-01-21 17:35:57 +09:00 |
|
Steve Loughran
|
b2704702f9
|
HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu
(cherry picked from commit 77401bd5fcca5127c9908156971eeec468371f47)
|
2017-01-19 11:25:20 +00:00 |
|
Steve Loughran
|
ec2f5b18ab
|
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
|
2017-01-11 17:24:25 +00:00 |
|
Wangda Tan
|
447f71326b
|
YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)
(cherry picked from commit 287d3d6804a869723ae36605a3c2d2b3eae3941e)
|
2017-01-09 08:42:38 -08:00 |
|
Arun Suresh
|
7437252102
|
YARN-2995. Enhance UI to show cluster resource utilization of various container Execution types. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 0aafc122d401a2f49d0f9ca556343f9ba871e979)
(cherry picked from commit 25598b6e7118bacd33a167fb496e9cda5e9f9ad0)
|
2017-01-06 11:15:09 -08:00 |
|
Chris Nauroth
|
9c61858ee7
|
HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 4c8f9e130230457fc897ed7a2a09e14d078be90a)
|
2017-01-05 15:05:01 -08:00 |
|
Akira Ajisaka
|
3e2d26a97f
|
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
(cherry picked from commit 01d31fe9389ccdc153d7f4bf6574bf8e509867c1)
|
2017-01-04 14:15:00 +09:00 |
|
Mingliang Liu
|
ec646b1a9d
|
HADOOP-13942. Build failure due to errors of javadoc build in hadoop-azure. Contributed by Kai Sasaki
(cherry picked from commit c6a5b689db573046819f0e9193cb042e6c7298f4)
|
2016-12-29 16:24:38 -08:00 |
|
Mingliang Liu
|
edac82737a
|
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
(cherry picked from commit e92a77099b91620cee84513cc879089907468075)
|
2016-12-22 20:33:51 -08:00 |
|
Akira Ajisaka
|
522bc98026
|
YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.
(cherry picked from commit ae401539eaf7745ec8690f9281726fb4cdcdbe94)
|
2016-12-23 04:06:53 +09:00 |
|
Mingliang Liu
|
867389247f
|
HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade
(cherry picked from commit f92913c35bfda0d565606f9fb9a301ddd4105fd8)
|
2016-12-15 12:38:31 -08:00 |
|
Mingliang Liu
|
2dbd86bcf4
|
HADOOP-13871. ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful. Contributed by Steve Loughran
(cherry picked from commit c6a39232456fa0c98b2b9b6dbeaec762294ca01e)
|
2016-12-12 15:06:39 -08:00 |
|
Mingliang Liu
|
89eaa94c59
|
HADOOP-13675. Bug in return value for delete() calls in WASB. Contributed by Dushyanth
(cherry picked from commit 15dd1f3381069c5fdc6690e3ab1907a133ba14bf)
|
2016-12-05 12:06:35 -08:00 |
|
Mingliang Liu
|
c37e814fae
|
HADOOP-13855. Fix a couple of the s3a statistic names to be consistent with the rest. Contributed by Steve Loughran
(cherry picked from commit 6b6bc4705d2b608e810ae7d1912eac49bfd4c6ca)
|
2016-12-02 13:48:38 -08:00 |
|
Mingliang Liu
|
a4e0539636
|
HADOOP-13857. S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEs. Contributed by Steve Loughran
(cherry picked from commit 2ff84a00405e977b1fd791cfb974244580dd5ae8)
|
2016-12-02 13:39:23 -08:00 |
|
Mingliang Liu
|
39b74b6f9e
|
HADOOP-13830. Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: "Can not create a Path from an empty string". Contributed by Steve Loughran
(cherry picked from commit 3fd844b99fdfae6be6e5e261f371d175aad14229)
|
2016-11-30 13:04:44 -08:00 |
|
Mingliang Liu
|
1b831d8e01
|
HADOOP-13823. s3a rename: fail if dest file exists. Contributed by Steve Loughran
(cherry picked from commit d60a60be8aa450c44d3be69d26c88025e253ac0c)
|
2016-11-28 16:35:18 -08:00 |
|