Steve Loughran
|
1de0712578
|
HADOOP-15185. Update adls connector to use the current version of ADLS SDK.
Contributed by Atul Sikaria.
(cherry picked from commit f63d13f10d)
|
2018-01-23 11:37:33 -08:00 |
Jason Lowe
|
b1cc14e9cb
|
Revert "HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)"
This reverts commit 55142849db.
|
2018-01-17 09:53:24 -06:00 |
Sammi Chen
|
55142849db
|
HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)
(cherry picked from commit 9195a6e302)
|
2018-01-17 16:12:23 +08:00 |
Kai Zheng
|
539fa11325
|
HADOOP-15104. AliyunOSS: change the default value of max error retry. Contributed by Jinhu Wu
(cherry picked from commit ce04340ec7)
|
2018-01-09 15:41:12 +08:00 |
|
Steve Loughran
|
72a49503fe
|
HADOOP-15086. NativeAzureFileSystem file rename is not atomic.
Contributed by Thomas Marquardt
(cherry picked from commit 52babbb4a0)
|
2017-12-22 14:31:20 +00:00 |
|
Steve Loughran
|
11f577f3e6
|
HADOOP-14965. S3a input stream "normal" fadvise mode to be adaptive
(cherry picked from commit 1ba491ff90)
|
2017-12-22 11:41:45 +00:00 |
|
Sammi Chen
|
abaabb5dec
|
HADOOP-15024. AliyunOSS: Support user agent configuration and include that & Hadoop version information to oss server.
(cherry picked from commit c326fc89b0)
|
2017-12-08 21:28:19 +08:00 |
|
Sammi Chen
|
fb809e05dc
|
HADOOP-14993. AliyunOSS: Override listFiles and listLocatedStatus. Contributed Genmao Yu.
(cherry picked from commit 18621af7ae)
|
2017-12-08 20:40:14 +08:00 |
John Zhuge
|
9942952dd8
|
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
(cherry picked from commit bf6a660232)
|
2017-12-07 21:06:25 -08:00 |
|
Steve Loughran
|
8bf74f325a
|
HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0.
Contributed by Rajesh Balamohan
(cherry picked from commit 0ea182d0fa)
|
2017-11-28 11:57:12 +00:00 |
Andrew Wang
|
1c8d334287
|
Preparing for 3.0.1 development
|
2017-11-14 11:17:18 -08:00 |
Daniel Templeton
|
38f5d4cbba
|
YARN-7413. Support resource type in SLS (Contributed by Yufei Gu via Daniel Templeton)
Change-Id: Ic0a897c123c5d2f57aae757ca6bcf1dad7b90d2b
(cherry picked from commit ba8136615a)
|
2017-11-09 13:39:08 -08:00 |
Yufei Gu
|
ddef7d05a4
|
YARN-6505. Define the strings used in SLS JSON input file format. (Contributed by Gergely Novak)
(cherry picked from commit 99880d0a16)
|
2017-11-09 13:38:57 -08:00 |
Subru Krishnan
|
7441d14f1c
|
HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru).
(cherry picked from commit f2df6b8983)
|
2017-11-08 18:08:09 -08:00 |
Arun Suresh
|
cbd81f305b
|
HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh)
(cherry picked from commit 53c0fb7efe)
|
2017-11-02 17:17:27 -07:00 |
Akira Ajisaka
|
2ba71afcd5
|
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi.
(cherry picked from commit cc3f3eca40)
|
2017-11-02 18:32:57 +09:00 |
Chris Douglas
|
77ad73501c
|
HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li
(cherry picked from commit 139cc752d2)
|
2017-10-27 22:00:44 -07:00 |
|
Subru Krishnan
|
82c9b3bbb5
|
HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru).
(cherry picked from commit 625039ef20)
|
2017-10-25 16:01:13 -07:00 |
Wangda Tan
|
881263260c
|
YARN-7318. Fix shell check warnings of SLS. (Gergely Novák via wangda)
(cherry picked from commit 281d83604d)
|
2017-10-20 16:02:04 -07:00 |
|
Steve Loughran
|
2bacb429a1
|
HADOOP-14942. DistCp#cleanup() should check whether jobFS is null.
Contributed by Andras Bokor.
(cherry picked from commit f36cbc8475)
|
2017-10-20 22:29:22 +01:00 |
Haibo Chen
|
175c4472d5
|
YARN-6546. SLS is slow while loading 10k queues. (Yufei Gu via Haibo Chen)
(cherry picked from commit 46eb1033a8)
|
2017-10-17 16:04:49 -07:00 |
|
Haibo Chen
|
c021c8a19f
|
YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen)
(cherry picked from commit c071aad5da)
|
2017-10-05 15:51:08 -07:00 |
|
Yufei Gu
|
f982ffe336
|
YARN-7211. AMSimulator in SLS does't work due to responseId refactoring.(Contributed by Botong Huang via Yufei Gu)
(cherry picked from commit 79e37dc6db)
|
2017-10-03 15:12:09 -07:00 |
|
Akira Ajisaka
|
b658ae002f
|
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
(cherry picked from commit c9b525bd94)
|
2017-10-04 07:02:31 +09:00 |
|
Andrew Wang
|
5a4f37019a
|
Preparing for 3.0.0 GA development
|
2017-09-28 11:32:01 -07:00 |
Aaron Fabbri
|
60b966cb45
|
HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests. Contributed by Steve Loughran
|
2017-09-25 16:01:15 -07:00 |
|
Jason Lowe
|
0eb0298027
|
MAPREDUCE-6967. gridmix/SleepReducer should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
(cherry picked from commit b133dc5700)
|
2017-09-22 15:30:20 -05:00 |
|
Steve Loughran
|
9f6b08f840
|
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure
Contributed by Steve Loughran
(cherry picked from commit 2d2d97fa7d)
|
2017-09-15 17:04:43 +01:00 |
|
Aaron Fabbri
|
62e8a5ceed
|
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran.
|
2017-09-14 16:12:29 -07:00 |
Kai Zheng
|
b873b1395e
|
HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen
|
2017-09-14 09:22:00 +08:00 |
|
John Zhuge
|
bb107f5d28
|
HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
(cherry picked from commit a4661850c1)
|
2017-09-08 12:57:58 -07:00 |
|
Steve Loughran
|
70c95d15e3
|
HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A.
Contributed by Aaron Fabbri
(cherry picked from commit 5bbca80428)
|
2017-09-08 12:08:36 +01:00 |
|
Steve Loughran
|
5757600b8d
|
HADOOP-14774. S3A case "testRandomReadOverBuffer" failed due to improper range parameter.
Contributed by Yonger.
(cherry picked from commit 83449abb40)
|
2017-09-07 19:58:03 +01:00 |
|
Steve Loughran
|
e5bb78d3d9
|
HADOOP-14520. WASB: Block compaction for Azure Block Blobs.
Contributed by Georgi Chalakov
(cherry picked from commit 13eda50003)
|
2017-09-07 18:38:24 +01:00 |
|
John Zhuge
|
3dd5444b4d
|
HADOOP-14103. Sort out hadoop-aws contract-test-options.xml. Contributed by John Zhuge.
(cherry picked from commit 50506e90a8)
|
2017-09-06 11:33:43 -07:00 |
Xiaoyu Yao
|
fd951e3a37
|
HADOOP-14839. DistCp log output should contain copied and deleted files and directories. Contributed by Yiqun Lin.
(cherry picked from commit 7ba61235dba87bc292134194044d54d9a12a4d7c)
|
2017-09-05 23:35:39 -07:00 |
|
Steve Loughran
|
727e79a78e
|
HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS.
Contributed by Sivaguru Sankaridurg
(cherry picked from commit 792eff9ea7)
|
2017-09-05 14:21:16 -07:00 |
Allen Wittenauer
|
a3fee475f7
|
HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw)
|
2017-09-01 08:38:30 -07:00 |
|
Steve Loughran
|
621b43e254
|
HADOOP-13345 HS3Guard: Improved Consistency for S3A.
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
|
2017-09-01 14:13:41 +01:00 |
|
John Zhuge
|
7ecc6dbed6
|
HADOOP-14824. Update ADLS SDK to 2.2.2 for MSI fix. Contributed by Atul Sikaria.
|
2017-08-31 21:13:22 -07:00 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Haibo Chen
|
d04f85f387
|
MAPREDUCE-6892. Issues with the count of failed/killed tasks in the jhist file. (Peter Bacsko via Haibo Chen)
|
2017-08-30 10:07:48 -07:00 |
|
Yufei Gu
|
26fafc3597
|
YARN-7077. TestAMSimulator and TestNMSimulator fail. (Contributed by Akira Ajisaka via Yufei Gu)
|
2017-08-29 16:33:51 -07:00 |
|
Steve Loughran
|
9374f38820
|
HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory
Contributed by Esfandiar Manii and Thomas Marquardt.
|
2017-08-29 19:03:44 +01:00 |
|
Steve Loughran
|
021974f4cb
|
HADOOP-14802. Add support for using container saskeys for all accesses.
Contributed by Sivaguru Sankaridurg
|
2017-08-29 19:02:43 +01:00 |
|
Andrew Wang
|
f29a0fc288
|
HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou.
|
2017-08-25 14:14:23 -07:00 |
Arpit Agarwal
|
8b7cbe3840
|
HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.
|
2017-08-25 09:55:46 -07:00 |
|
Steve Loughran
|
27ab5f7385
|
HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.
Contributed by Genmao Yu
|
2017-08-22 11:55:48 +01:00 |
|
Kai Zheng
|
267e19a09f
|
HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu
|
2017-08-21 13:36:28 +08:00 |
|
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |