Thomas Marquardt
6801b30733
HADOOP-15728. ABFS: Add backward compatibility to handle Unsupported Operation
...
for storage account with no namespace feature.
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
347a52a866
Fixing findbugs and license issues related to:
...
HADOOP-15703. ABFS - Implement client-side throttling.
Contributed by Sneha Varma and Thomas Marquardt.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
97f06b3fc7
HADOOP-15703. ABFS - Implement client-side throttling.
...
Contributed by Sneha Varma and Thomas Marquardt.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
4410eacba7
HADOOP-15664. ABFS: Reduce test run time via parallelization and grouping.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
81dc4a995c
HADOOP-15663. ABFS: Simplify configuration.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
df57c6c3b1
HADOOP-15692. ABFS: extensible support for custom oauth.
...
Contributed by Junhua Gu and Rajeev Bansal.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
dd2b22fa31
HADOOP-15682. ABFS: Add support for StreamCapabilities. Fix javadoc and checkstyle.
...
Contributed by Thomas Marquardt.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
6b6f8cc2be
HADOOP 15688. ABFS: InputStream wrapped in FSDataInputStream twice.
...
Contributed by Sean Mackrory.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
9c1e4e8139
HADOOP-15661. ABFS: Add support for ACL.
...
Contributed by Junhua Gu and Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
9149b9703e
HADOOP-15660. ABFS: Add support for OAuth
...
Contributed by Da Zhou, Rajeev Bansal, and Junhua Gu.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
d6a4f39bd5
HADOOP-15669. ABFS: Improve HTTPS Performance.
...
Contributed by Vishwajeet Dusane.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
cc5cc60c41
Fixing issue due to commit 2b2399d6
after rebase onto trunk.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
b54b0c1b67
HADOOP-15659. Code changes for bug fix and new tests.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
ce03a93f78
HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests.
...
Contributed by Steve Loughran and Da Zhou.
2018-09-17 19:54:01 +00:00
Steve Loughran
a271fd0eca
HADOOP-15560. ABFS: removed dependency injection and unnecessary dependencies.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Steve Loughran
f044deedbb
HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
...
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2018-09-17 19:54:01 +00:00
Steve Loughran
d7c0a08a1c
HADOOP-15426 Make S3guard client resilient to DDB throttle events and network failures (Contributed by Steve Loughran)
2018-09-12 21:04:49 -07:00
Aaron Fabbri
d32a8d5d58
HADOOP-14734 add option to tag DDB table(s) created. (Contributed by Gabor Bota and Abe Fine)
2018-09-12 16:36:01 -07:00
Mingliang Liu
1f6c4545cf
HADOOP-15750. Remove obsolete S3A test ITestS3ACredentialsInURL. Contributed by Steve Loughran
2018-09-12 10:58:39 -07:00
Sean Mackrory
47b72c87eb
HADOOP-15635. s3guard set-capacity command to fail fast if bucket is unguarded.
...
Contributed by Gabor Bota.
2018-09-12 09:12:38 -06:00
bibinchundatt
c44088ac19
YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.
2018-09-12 16:01:01 +05:30
Naganarasimha
eb08543c7a
YARN-8103. Add CLI interface to query node attributes. Contributed by Bibin A Chundatt.
2018-09-12 16:01:01 +05:30
Sunil G
89b3ebd11e
YARN-8092. Expose Node Attributes info via RM nodes REST API. Contributed by Weiwei Yang.
2018-09-12 16:01:00 +05:30
Mingliang Liu
87f63b6479
HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran
2018-09-11 17:18:42 -07:00
Steve Loughran
1eef0acfe5
HADOOP-15677. WASB: Add support for StreamCapabilities.
...
Contributed by Thomas Marquardt.
2018-09-10 14:24:41 +01:00
Gabor Bota
36c7c78260
HADOOP-15709 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants (Contributed by Gabor Bota)
2018-09-07 10:25:20 -07:00
Steve Loughran
5a0babf765
HADOOP-15107. Stabilize/tune S3A committers; review correctness & docs.
...
Contributed by Steve Loughran.
2018-08-30 14:49:53 +01:00
Steve Loughran
e8d138ca7c
HADOOP-15680. ITestNativeAzureFileSystemConcurrencyLive times out.
...
Contributed by Andras Bokor.
2018-08-30 14:36:00 +01:00
Steve Loughran
2e6c1109dc
HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length.
...
Contributed by Ewan Higgs
2018-08-30 14:33:16 +01:00
Yufei Gu
8563fd67be
YARN-8632. Threads in SLS quit without logging exception. Contributed by Xianghao Lu.
2018-08-24 11:23:17 -07:00
Surendra Singh Lilhore
96c4575d73
HDFS-13805. Journal Nodes should allow to format non-empty directories with -force option. Contributed by Surendra Singh Lilhore.
2018-08-24 08:14:57 +05:30
Aaron Fabbri
d7232857d8
HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore (Contributed by Gabor Bota)
2018-08-17 10:15:39 -07:00
Steve Loughran
0e832e7a74
HADOOP-15642. Update aws-sdk version to 1.11.375.
...
Contributed by Steve Loughran.
2018-08-16 09:58:46 -07:00
Akira Ajisaka
3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
2018-08-16 00:31:59 +09:00
Ewan Higgs
a13929ddcb
HADOOP-15645. ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB. Contributed by Steve Loughran.
2018-08-13 12:57:45 +02:00
Steve Loughran
da9a39eed1
HADOOP-15583. Stabilize S3A Assumed Role support.
...
Contributed by Steve Loughran.
2018-08-08 22:57:24 -07:00
Ewan Higgs
2ec97abb2e
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
2018-08-08 13:50:23 +02:00
Sean Mackrory
7862f1523f
HADOOP-15400. Improve S3Guard documentation on Authoritative Mode implementation. (Contributed by Gabor Bota)
2018-08-07 20:13:09 -06:00
Steve Loughran
48673bc2a8
HADOOP-15626. FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.
...
Contributed by Steve Loughran.
2018-08-03 16:06:00 -07:00
Inigo Goiri
9fea5c9ee7
YARN-8175. Add support for Node Labels in SLS. Contributed by Abhishek Modi.
2018-07-31 09:36:34 -07:00
Sammi Chen
0857f116b7
HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu.
2018-07-30 10:53:44 +08:00
Sean Mackrory
59adeb8d7f
HADOOP-15636. Follow-up from HADOOP-14918; restoring test under new name. Contributed by Gabor Bota.
2018-07-27 18:23:29 -06:00
bibinchundatt
3d3158cea4
YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang.
2018-07-25 18:59:05 +05:30
Steve Loughran
45d9568aaa
HADOOP-15547/ WASB: improve listStatus performance.
...
Contributed by Thomas Marquardt.
(cherry picked from commit 749fff577e
)
2018-07-19 12:31:19 -07:00
Wangda Tan
752dcce5f4
YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda)
...
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
2018-07-16 10:54:41 -07:00
Sean Mackrory
a08812a1b1
HADOOP-15349. S3Guard DDB retryBackoff to be more informative on limits exceeded. Contributed by Gabor Bota.
2018-07-12 17:24:01 +02:00
Sean Mackrory
d503f65b66
HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting
...
connection in case of timeout.
2018-07-10 17:52:57 +02:00
Steve Loughran
ca8b80bf59
HADOOP-15384. distcp numListstatusThreads option doesn't get to -delete scan.
...
Contributed by Steve Loughran.
2018-07-10 10:43:59 +01:00
Aaron Fabbri
93ac01cb59
HADOOP-15215 s3guard set-capacity command to fail on read/write of 0 (Gabor Bota)
2018-07-03 13:50:11 -07:00
Inigo Goiri
1804a31515
HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti.
2018-07-02 10:48:20 -07:00
Inigo Goiri
73746c5da7
HDFS-13707. [PROVIDED Storage] Fix failing integration tests in ITestProvidedImplementation. Contributed by Virajith Jalaparti.
2018-06-29 09:56:13 -07:00
Akira Ajisaka
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
2018-06-28 14:37:22 +09:00
Todd Lipcon
7a3c6e9c3c
HADOOP-15550. Avoid static initialization of ObjectMappers
2018-06-25 15:36:45 -07:00
Sean Mackrory
c687a6617d
HADOOP-15423. Merge fileCache and dirCache into ine single cache in LocalMetadataStore. Contributed by Gabor Bota.
2018-06-25 14:59:41 -06:00
Anu Engineer
e16e5b307d
HDDS-177. Create a releasable ozonefs artifact
...
Contributed by Marton, Elek.
2018-06-24 01:05:04 -07:00
Anu Engineer
ca14fec02f
HDDS-184. Upgrade common-langs version to 3.7 in hadoop-tools/hadoop-ozone.
...
Contributed by Takanobu Asanuma.
2018-06-23 15:49:44 -07:00
Sean Mackrory
55fad6a3de
HADOOP-15416. Clear error message in S3Guard diff if source not found. Contributed by Gabor Bota.
2018-06-22 11:36:56 -06:00
Sean Mackrory
b089a06793
HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota.
2018-06-20 16:45:08 -06:00
Chris Douglas
f34744603e
HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii
2018-06-17 23:12:18 -07:00
Chris Douglas
980031bb04
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
2018-06-17 11:54:26 -07:00
Jitendra Pandey
f4c7c91123
HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan.
2018-06-13 00:36:02 -07:00
Inigo Goiri
c35481594f
YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni Matteo Fumarola.
2018-06-12 10:59:50 -07:00
Steve Loughran
d901be6795
HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks.
...
Contributed by Esfandiar Manii.
2018-06-06 18:28:14 +01:00
Anu Engineer
3b34148c4f
HDDS-88. Create separate message structure to represent ports in DatanodeDetails.
...
Contributed by Nanda Kumar.
2018-05-30 08:52:07 -07:00
Aaron Fabbri
5f6769f796
HADOOP-15480 AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo (Gabor Bota)
2018-05-29 19:20:22 -07:00
Aaron Fabbri
30284d020d
HADOOP-14946 S3Guard testPruneCommandCLI can fail. Contributed by Gabor Bota.
2018-05-29 13:38:15 -07:00
Inigo Goiri
8fdc993a99
HADOOP-15498. TestHadoopArchiveLogs (#testGenerateScript, #testPrepareWorkingDir) fails on Windows. Contributed by Anbang Hu.
2018-05-28 16:45:42 -07:00
Johan Gustavsson
d14e26b31f
HADOOP-15477. Make unjar in RunJar overrideable
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 17:29:59 +09:00
Steve Loughran
ba842847c9
HADOOP-15478. WASB: hflush() and hsync() regression.
...
Contributed by Thomas Marquardt.
2018-05-21 11:12:34 +01:00
Steve Loughran
cc3600aabd
HADOOP-15469. S3A directory committer commit job fails if _temporary directory created under dest.
...
Contributed by Steve Loughran.
(cherry picked from commit 170f1040d4
)
2018-05-17 19:08:55 +01:00
Steve Loughran
b670837469
HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics source's name.
...
Contributed by Sean Mackrory.
2018-05-15 16:13:56 +01:00
Steve Loughran
ba051b0686
HADOOP-15354. hadoop-aliyun & hadoop-azure modules to mark hadoop-common as provided
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-10 18:38:08 +09:00
Anu Engineer
46e0f27862
HDDS-18. Ozone Shell should use RestClient and RpcClient. Contributed by Lokesh Jain.
2018-05-09 23:00:13 -07:00
Sean Mackrory
1cfe7506f7
HADOOP-15356. Make HTTP timeout configurable in ADLS connector. Contributed by Atul Sikaria and Sean Mackrory.
2018-05-09 15:15:51 -06:00
Mukul Kumar Singh
343b51dcf4
HDDS-28. Ozone:Duplicate declaration in hadoop-tools/hadoop-ozone/pom.xml. Contributed by Tsz Wo Nicholas Sze.
2018-05-09 20:20:21 +05:30
Mukul Kumar Singh
208b97e969
HDDS-20. Ozone: Add support for rename key within a bucket for rpc client. Contributed by Lokesh Jain.
2018-05-09 19:06:07 +05:30
Aaron Fabbri
8981674bbc
HADOOP-15420 s3guard ITestS3GuardToolLocal failures in diff tests (Gabor Bota)
2018-05-08 18:58:42 -07:00
Aaron Fabbri
69aac696d9
HADOOP-13649 s3guard: implement time-based (TTL) expiry for LocalMetadataStore (Gabor Bota)
2018-05-08 15:29:54 -07:00
Steve Loughran
5b11b9fd41
HADOOP-15446. WASB: PageBlobInputStream.skip breaks HBASE replication.
...
Contributed by Thomas Marquardt
2018-05-07 11:54:08 +01:00
Aaron Fabbri
96c843f64b
HADOOP-15444 ITestS3GuardToolDynamo should only run with -Ddynamo (Aaron Fabbri)
2018-05-04 11:34:45 -07:00
Sean Mackrory
85381c7b60
HADOOP-15434. Upgrade to ADLS SDK that exposes current timeout.
2018-05-02 21:30:31 -06:00
Aaron Fabbri
919865a34b
HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. Contributed by Gabor Bota.
2018-04-30 16:02:57 -07:00
Weiwei Yang
ba2db39c65
YARN-8152. Add chart in SLS to illustrate the throughput of the scheduler. Contributed by Tao Yang.
2018-04-27 15:36:21 +08:00
Aaron Fabbri
7d8bcf534a
HADOOP-13756 LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. (Gabor Bota)
2018-04-26 20:41:29 -07:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup
...
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Mukul Kumar Singh
ae8ac7f082
HDFS-13424. Ozone: Refactor MiniOzoneClassicCluster. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
Nanda kumar
025058f251
HDFS-13446. Ozone: Fix OzoneFileSystem contract test failures. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
8b832f3c35
HDFS-13405. Ozone: Rename HDSL to HDDS.
...
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
2018-04-26 05:36:04 -07:00
Nanda kumar
7ae9543a57
HDFS-13391. Ozone: Make dependency of internal sub-module scope as provided in maven. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
04e1287771
HDFS-13298. Ozone: Make ozone/hdsl/cblock modules turned off by default. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
4e61bc431e
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
...
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
5e7164c614
HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key.
...
Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
61651dcf5c
HDFS-13108. Ozone: OzoneFileSystem: Simplified url schema for Ozone File System. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
cd807c9890
HDFS-13133. Ozone: OzoneFileSystem: Calling delete with non-existing path shouldn't be logged on ERROR level. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
9272e1021d
HDFS-12636. Ozone: OzoneFileSystem: Implement seek functionality for rpc client. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
Anu Engineer
4460ac9c57
HDFS-12756. Ozone: Add datanodeID to heartbeat responses and container protocol. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
Anu Engineer
740a06cdd7
HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Chen Liang
e395244e95
HDFS-12758. Ozone: Correcting assertEquals argument order in test cases. Contributed by Bharat Viswanadham.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
2ec24a7542
HDFS-12774. Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
Chen Liang
895a4cc60a
HDFS-12632. Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
d90ab3365d
HDFS-12608. Ozone: Remove Warnings when building. Contributed by Bharat Viswanadham.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
9445a9267f
HDFS-12572. Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
0b3270a8de
HDFS-12513. Ozone: Create UI page to show Ozone configs by tag. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
5e4a6b686c
HDFS-12425. Ozone: OzoneFileSystem: read/write/create/open/getFileInfo APIs. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
f2d9360b9d
HDFS-12199. Ozone: OzoneFileSystem: OzoneFileystem initialization code. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Akira Ajisaka
3e2ca23a53
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
Aaron Fabbri
989a3929a9
HADOOP-14756 S3Guard: expose capability query in MetadataStore and add tests of authoritative mode (Gabor Bota)
2018-04-23 15:26:53 -07:00
Inigo Goiri
fd24fd0ff7
YARN-8137. Parallelize node addition in SLS. Contributed by Abhishek Modi.
2018-04-20 09:09:12 -07:00
Yiqun Lin
1312f9ae4c
HADOOP-15391. Add missing css file in hadoop-aws, hadoop-aliyun, hadoop-azure and hadoop-azure-datalake modules.
2018-04-18 16:04:00 +08:00
Inigo Goiri
78860372bd
YARN-8134. Support specifying node resources in SLS. Contributed by Abhishek Modi.
2018-04-17 13:11:34 -07:00
Aaron Fabbri
b0aff8a962
HADOOP-15346 S3ARetryPolicy for 400/BadArgument to be "fail". Contributed by Steve Loughran.
2018-04-10 23:55:38 -07:00
Xiao Chen
7c9cdad6d0
HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.
2018-04-10 21:31:48 -07:00
Aaron Fabbri
ea3849f0cc
HADOOP-14759 S3GuardTool prune to prune specific bucket entries. Contributed by Gabor Bota.
2018-04-05 20:23:17 -07:00
Steve Loughran
5a174f8ac6
HADOOP-14758. S3GuardTool.prune to handle UnsupportedOperationException.
...
Contributed by Gabor Bota.
2018-04-03 16:31:34 +01:00
Sammi Chen
6542d17ea4
HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
2018-03-30 20:23:05 +08:00
Sean Mackrory
9d7a9031a5
HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
2018-03-29 10:13:40 -06:00
Chris Douglas
081c350188
HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao
2018-03-28 11:58:59 -07:00
Haibo Chen
fcea5a4d79
YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen)
2018-03-26 14:30:11 -07:00
Sean Mackrory
82665a7887
HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x.
2018-03-26 14:05:15 -06:00
Sean Mackrory
7ce6b41509
HADOOP-15332. Fix typos in hadoop-aws markdown docs. Contributed by Gabor Bota.
2018-03-20 21:12:20 -07:00
Sammi Chen
d67a5e2dec
HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu.
2018-03-19 15:02:37 +08:00
Wangda Tan
f47659fb97
MAPREDUCE-7047. Make HAR tool support IndexedLogAggregtionController. (Xuan Gong via wangda)
...
Change-Id: Ice5ae1c706f2476361997dcbb29f2c33c77d4f0c
2018-03-15 13:26:01 -07:00
Steve Loughran
1976e0066e
HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories.
...
Contributed by Steve Loughran.
2018-03-15 18:05:14 +00:00
fang zhenyi
5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00
Chris Douglas
45cccadd2e
HDFS-12780. Fix spelling mistake in DistCpUtils.java. Contributed by Jianfei Jiang
2018-03-13 11:08:11 -07:00
Chris Douglas
45d1b0fdcc
HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
2018-03-12 20:05:39 -07:00
Steve Loughran
dd05871b8b
HADOOP-15297. Make S3A etag => checksum feature optional.
...
Contributed by Steve Loughran.
2018-03-12 14:01:42 +00:00
Steve Loughran
7ef4d942dd
HADOOP-15273.distcp can't handle remote stores with different checksum algorithms.
...
Contributed by Steve Loughran.
2018-03-08 11:24:06 +00:00
Steve Loughran
3bd6b1fd85
HADOOP-15292. Distcp's use of pread is slowing it down.
...
Contributed by Virajith Jalaparti.
2018-03-08 11:15:46 +00:00
Steve Loughran
e0307e53e2
HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled.
...
Contributed by Anis Elleuch.
(cherry picked from commit 1dedc68f9d
)
2018-03-07 18:51:10 +00:00
Steve Loughran
2e1e049bd0
HADOOP-15288. TestSwiftFileSystemBlockLocation doesn't compile.
...
Contributed by Steve Loughran.
2018-03-05 18:12:38 +00:00
Steve Loughran
8110d6a0d5
HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions.
...
Contributed by Aaron Fabbri.
2018-03-05 14:06:20 +00:00
Gergely Novák
e99a1e7767
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-02 16:15:04 -08:00
Ray Chiang
923e1773e1
HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang)
2018-03-01 15:36:10 -08:00
fang zhenyi
29233c3c4a
HADOOP-15274. Move hadoop-openstack to slf4j
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 15:08:30 -08:00
Steve Loughran
edc9f1451b
HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
...
Contributed by Steve Loughran
2018-02-28 14:42:25 +00:00
Weiwei Yang
7af4f34de5
YARN-7929. Support to set container execution type in SLS. (Jiandan Yang via Weiwei Yang)
2018-02-28 17:58:09 +08:00
Arpit Agarwal
2fa7963c3d
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
2018-02-24 14:41:55 -08:00
Xuan Gong
68ce193efc
MAPREDUCE-7027: HadoopArchiveLogs shouldn't delete the original logs if the HAR creation fails. Contributed by Gergely Novák
2018-02-23 14:37:26 -08:00
Carlo Curino
84cea0011f
YARN-7732. Support Generic AM Simulator from SynthGenerator. (Contributed by Young Chen via curino)
2018-02-20 17:00:34 -08:00
fang zhenyi
4d4dde5112
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-02-18 22:19:39 +09:00
Steve Loughran
7ac88244c5
HADOOP-14507. Extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key.
...
Contributed by Steve Loughran.
2018-02-16 16:37:06 +00:00
Steve Loughran
481d79fedc
HADOOP-13972. ADLS to support per-store configuration.
...
Contributed by Sharad Sonker.
(cherry picked from commit 050f5287b7
)
2018-02-15 16:27:31 +00:00
Steve Loughran
9a013b255f
HADOOP-15176. Enhance IAM Assumed Role support in S3A client.
...
Contributed by Steve Loughran
(cherry picked from commit 96c047fbb9
)
2018-02-15 15:57:10 +00:00
Steve Loughran
b27ab7dd81
HADOOP-15076. Enhance S3A troubleshooting documents and add a performance document.
...
Contributed by Steve Loughran.
(cherry picked from commit c761e658f6
)
2018-02-15 14:57:56 +00:00
Steve Loughran
c9a373fb14
HADOOP-15090. Add ADL troubleshooting doc.
...
Contributed by Steve Loughran.
(cherry picked from commit 58a2120e8a
)
2018-02-15 14:26:00 +00:00
Steve Loughran
f20dc0d577
HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions.
...
Contributed by Andras Bokor.
2018-02-14 16:20:14 +00:00
Steve Loughran
8cf88fcd1f
HADOOP-15187. Remove ADL mock test dependency on REST call invoked from Java SDK.
...
Contributed by Vishwajeet Dusane.
(cherry picked from commit bd5ab59125
)
2018-02-12 15:13:00 +00:00
Wangda Tan
60f9e60b3b
Preparing for 3.2.0 development
...
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Anu Engineer
4304fcd5bd
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
2018-02-06 13:43:45 -08:00