Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,189 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

808 Commits

Author SHA1 Message Date
Weiwei Yang 5d46b06d1f HADOOP-16840. AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket. Contributed by wujinhu. 
(cherry picked from commit 6dfe00c71e)
 2020-03-08 22:03:32 -07:00
Akira Ajisaka 0c0be3b9f0
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li. 
(cherry picked from commit f6d20daf40)
 2020-01-21 18:05:46 +09:00
Mingliang Liu a8044c75ad
HADOOP-16758. Refine testing.md to tell user better how to use auth-keys.xml (#1753) 
Contributed by Mingliang Liu
 2019-12-11 11:56:46 -08:00
Jonathan Hung d74f64aa99 Setting version to 2.10.1-SNAPSHOT after branch-2 to branch-2.10 rename 2019-12-09 11:49:59 -08:00
Mingliang Liu cdb0cafff5
HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN. Contributed by Mingliang Liu 
This closes #1733
 2019-12-05 17:56:02 -08:00
Da Zhou 7f71473888
HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI 
(cherry picked from commit 9a8edb0aed)
 2019-10-16 22:04:36 -07:00
Bilahari T H 6cb9ee32e1
HADOOP-16652. Backport of HADOOP-16587: Make ABFS AAD endpoints configurable 2019-10-16 15:39:39 -07:00
Jonathan Hung 108127238b Preparing for 2.11.0 development 2019-10-15 10:01:45 -07:00
Sneha Vijayarajan 27d7d09fa4
HADOOP-16630 : Backport of Hadoop-16548 : Disable Flush() over config 2019-10-09 16:50:06 -07:00
Sneha Vijayarajan 2ccb1683ba
HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists 2019-10-09 16:23:25 -07:00
Jonathan Hung 493b36279b YARN-9806. TestNMSimulator#testNMSimulator fails in branch-2 2019-09-03 11:06:51 -07:00
Da Zhou 6cb74629ec HADOOP-16315. ABFS: transform full UPN for named user in AclStatus 
Contributed by Da Zhou

Change-Id: Ibc78322415fcbeff89c06c8586c53f5695550290
 2019-08-28 22:42:28 +00:00
bilaharith 1376f2ed3d HADOOP-16479. ABFS FileStatus.getModificationTime returns localized time instead of UTC. 
Contributed by Bilahari T H

Change-Id: I532055baaadfd7c324710e4b25f60cdf0378bdc0
 2019-08-28 22:42:28 +00:00
Arun Singh 8044415ea1 HADOOP-16404. ABFS default blocksize change(256MB from 512MB) 
Contributed by: Arun Singh
 2019-08-28 22:42:28 +00:00
Da Zhou 42816bf698 HADOOP-16376. ABFS: Override access() to no-op. 
Contributed by Da Zhou.

Change-Id: Ia0024bba32250189a87eb6247808b2473c331ed0
 2019-08-28 22:42:28 +00:00
Aaron Fabbri 67fe5398fd Revert "HADOOP-16251. ABFS: add FSMainOperationsBaseTest" 
This reverts commit 7c2d7c05a9.

Git Commit name and email were incorrect. Will re-commit.
 2019-08-28 22:42:28 +00:00
DadanielZ 605c812749 HADOOP-16251. ABFS: add FSMainOperationsBaseTest 
Author: Da Zhou
 2019-08-28 22:42:28 +00:00
Da Zhou 50953c586b HADOOP-16269. ABFS: add listFileStatus with StartFrom. 
Author:    Da Zhou
 2019-08-28 22:42:28 +00:00
Da Zhou e5bb8498df HADOOP-16242. ABFS: add bufferpool to AbfsOutputStream. 
Contributed by Da Zhou.
 2019-08-28 22:42:28 +00:00
Takanobu Asanuma e3d4f6bfed HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka. 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-05-29 17:41:21 +09:00
Akira Ajisaka cea1b0000c
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:28:54 +09:00
Weiwei Yang 11fb89bd68 HADOOP-16306. AliyunOSS: Remove temporary files when upload small files to OSS. Contributed by wujinhu. 
(cherry picked from commit 2d8282bb82)
 2019-05-14 14:09:12 -07:00
Yuan Gao 18f66a05cf
HADOOP-16205 Backport ABFS driver from trunk to branch 2.0: Fix build and test failures. 
Contributed by Yuan Gao.
 2019-04-25 18:36:14 +01:00
Vishwajeet Dusane 662a75d65b HADOOP-16182. Update abfs storage back-end with "close" flag when application is done writing to a file. 
Contributed by Vishwajeet Dusane.
 2019-04-24 21:46:25 +00:00
Da Zhou 024a694684 HADOOP-16169. ABFS: Bug fix for getPathProperties. 
Author:    Da Zhou <da.zhou@microsoft.com>
 2019-04-24 21:46:25 +00:00
Da Zhou c2d7429691 HADOOP-16136. ABFS: Should only transform username to short name 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 80c8b77cec HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth. 
Contributed by Da Zhou and Junhua Gu.
 2019-04-24 21:46:25 +00:00
Shweta Yakkali 0bbbb9c4b9 HADOOP-16041. Include Hadoop version in User-Agent string for ABFS. Contributed by Shweta Yakkali. 
Signed-off-by: Sean Mackrory <mackrorysd@apache.org>
 2019-04-24 21:46:25 +00:00
Da Zhou f799c4644d HADOOP-16048. ABFS: Fix Date format parser. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 00b990d0b6 HADOOP-16044. ABFS: Better exception handling of DNS errors followup 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 34dbac8347 HADOOP-15975. ABFS: remove timeout check for DELETE and RENAME. 
Contributed by Da Zhou.

(cherry picked from commit 8b5fbe7a12)
 2019-04-24 21:46:25 +00:00
Da Zhou a0b99f42e5 HADOOP-15662. Better exception handling of DNS errors. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 4a1761067d HADOOP-16040. ABFS: Bug fix for tolerateOobAppends configuration. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Sean Mackrory 175a69e863 HADOOP-15860. ABFS: Throw exception when directory / file name ends with a period (.). Contributed by Shweta Yakkali. 2019-04-24 21:46:25 +00:00
Da Zhou eaaf2839a5 HADOOP-16004. ABFS: Convert 404 error response in AbfsInputStream and AbfsOutPutStream to FileNotFoundException. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 38a36d4dec HADOOP-15972 ABFS: reduce list page size to to 500. 
Contributed by Da Zhou.

(cherry picked from commit d09dbcc8fb)
 2019-04-24 21:46:25 +00:00
Da Zhou 06e6a677f3 HADOOP-15969. ABFS: getNamespaceEnabled can fail blocking user access thru ACLs. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 6f200a61b9 HADOOP-15968. ABFS: add try catch for UGI failure when initializing ABFS. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 9cf1fb6e95 HADOOP-15940. ABFS: For HNS account, avoid unnecessary get call when doing Rename. 
Contributed by Da Zhou <da.zhou@microsoft.com>

(cherry picked from commit 1a3a4960d9)
 2019-04-24 21:46:25 +00:00
Da Zhou afa5705ff7 HADOOP-15872. ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2. 
Contributed by Junhua Gu and Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 9e1d39bbae HADOOP-15876. Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Da Zhou 9f220c41c4 HADOOP-15812. ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console. 
Author:    Da Zhou <da.zhou@microsoft.com>
 2019-04-24 21:46:25 +00:00
Junhua Gu d37098196d HADOOP-15846. ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries. 
Contributed by Junhua Gu.

(cherry picked from commit 66715005f9)
 2019-04-24 21:46:25 +00:00
Daniel Templeton 8330f182dd HADOOP-15823. ABFS: Stop requiring client ID and tenant ID for MSI 
(Contributed by Da Zhou via Daniel Templeton)

Change-Id: I546ab3a1df1efec635c08c388148e718dc4a9843
 2019-04-24 21:46:25 +00:00
Steve Loughran 885c726d38 HADOOP-15825. ABFS: Enable some tests for namespace not enabled account using OAuth. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Steve Loughran 73bbada59a HADOOP-15809. ABFS: better exception handling when making getAccessToken call. 
Contributed by Da Zhou
 2019-04-24 21:46:25 +00:00
Steve Loughran 1b08e8d537 HADOOP-15795. Make HTTPS the default protocol for ABFS. 
Contributed by Da Zhou.
 2019-04-24 21:46:25 +00:00
Steve Loughran e3033a5ba8 HADOOP-15792. typo in AzureBlobFileSystem.getIsNamespaceEnabeld. 
Contributed by Abhishek Modi.
 2019-04-24 21:46:25 +00:00
Steve Loughran d5e4c40760 HADOOP-15801. ABFS: Fixing skipUserGroupMetadata in AzureBlobFileSystemStore. 
Contributed by Da Zhou
 2019-04-24 21:46:25 +00:00
Steve Loughran 0c5074a228 HADOOP-15793. ABFS: Skip unsupported test cases when non namespace enabled in ITestAzureBlobFileSystemAuthorization 
Contributed by Yuan Gao.
 2019-04-24 21:46:25 +00:00