Commit Graph

9 Commits

Author SHA1 Message Date
Sammi Chen e30abdaaae HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)
(cherry picked from commit 9195a6e302)
(cherry picked from commit 91184299c5)
(cherry picked from commit 2816bd1f43)
2018-01-30 17:15:12 +08:00
Jason Lowe 98835e14ae Revert "HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)"
This reverts commit 622f6b65d6.
2018-01-17 09:59:31 -06:00
Sammi Chen 622f6b65d6 HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)
(cherry picked from commit 9195a6e302)
(cherry picked from commit 55142849db)
(cherry picked from commit 082a707bae)
(cherry picked from commit 896dc7c780)
2018-01-17 16:37:25 +08:00
Sammi Chen 6af3ea58c9 HADOOP-15111. Aliyun OSS: backport HADOOP-14993 to branch-2. Contributed by Genmao Yu.
(cherry picked from commit 1fee447bf2)
2017-12-15 14:45:32 +08:00
Sammi Chen b2b9e0da6c HADOOP-15104. Aliyun OSS: change the default value of max error retry. Contributed by Jinhu Wu.
(cherry picked from commit ce04340ec7)
(cherry picked from commit 27807e4ccb)
2017-12-15 13:56:44 +08:00
Sammi Chen 4a064dd644 HADOOP-15024. AliyunOSS: Support user agent configuration and include that & Hadoop version information to oss server.
(cherry picked from commit 94390fcd52)
2017-12-08 22:37:17 +08:00
Sammi Chen b756beb679 HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2. Contributed by Sammi Chen.
The consolidated commits in this backport are as follows:
        HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.
        HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang)
        HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu
        HADOOP-14466. Remove useless document from TestAliyunOSSFileSystemContract.java. Contributed by Chen Liang.
        HADOOP-14458. Add missing imports to TestAliyunOSSFileSystemContract.java. Contributed by Mingliang Liu.
        HADOOP-14192. AliyunOSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu
        HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu
        HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu
        HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui
        HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu
        HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui
        HADOOP-14045. Aliyun OSS documentation missing from website. Contributed by Yiqun Lin.
        HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu
        HADOOP-13624.  Rename TestAliyunOSSContractDispCp. Contributed by Genmao Yu
        HADOOP-13591. Unit test failure in TestOSSContractGetFileStatus and TestOSSContractRootDir. Contributed by Genmao Yu
        HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu.
        HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou

 (cherry picked from commit 30ab9b6aef)
2017-11-27 11:35:17 +08:00
Sammi Chen 12901cdcee Revert "HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches. Contributed by Sammi Chen."
This reverts commit 32a88442d0.
2017-11-27 10:46:15 +08:00
Sammi Chen 32a88442d0 HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches. Contributed by Sammi Chen. 2017-11-24 14:06:01 +08:00