Steve Loughran
|
48f4a229a9
|
HADOOP-14461 Azure: handle failure gracefully in case of missing account access key.
Contributed by Mingliang Liu.
|
2017-06-26 13:39:47 +01:00 |
|
Steve Loughran
|
c6bd73c6c5
|
HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations.
Contributed by Thomas.
|
2017-06-23 21:38:41 +01:00 |
Akira Ajisaka
|
3369540653
|
HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools.
|
2017-06-20 13:18:26 +09:00 |
Mingliang Liu
|
325163f23f
|
HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu
|
2017-06-09 13:07:11 -07:00 |
|
Mingliang Liu
|
df35e4cc3b
|
HADOOP-14500. Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails. Contributed by Rajesh Balamohan
|
2017-06-07 13:54:52 -07:00 |
|
Mingliang Liu
|
536f057158
|
HADOOP-14491. Azure has messed doc structure. Contributed by Mingliang Liu
|
2017-06-06 11:09:28 -07:00 |
|
Mingliang Liu
|
6b5285bbcb
|
HADOOP-14472. Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently. Contributed by Mingliang Liu
|
2017-06-06 11:06:49 -07:00 |
|
Mingliang Liu
|
5fd9742c83
|
HADOOP-14478. Optimize NativeAzureFsInputStream for positional reads. Contributed by Rajesh Balamohan
|
2017-06-05 15:56:43 -07:00 |
|
Mingliang Liu
|
ece33208b8
|
HADOOP-14460. Azure: update doc for live and contract tests. Contributed by Mingliang Liu
|
2017-06-01 11:52:11 -07:00 |
|
Mingliang Liu
|
89bb8bfe58
|
HADOOP-14442. Owner support for ranger-wasb integration. Contributed by Varada Hemeswari
|
2017-05-26 17:54:00 -07:00 |
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
|
Akira Ajisaka
|
6a52b5e144
|
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
|
2017-05-25 15:36:44 +09:00 |
|
Mingliang Liu
|
b415c6fe74
|
HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg
|
2017-05-16 11:22:32 -07:00 |
|
Akira Ajisaka
|
0d5c8ed8e0
|
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor.
|
2017-05-11 16:37:32 -05:00 |
|
Mingliang Liu
|
eed731496f
|
HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak
|
2017-05-10 15:05:11 -07:00 |
|
Akira Ajisaka
|
2ba9903932
|
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
|
2017-05-10 05:57:12 -05:00 |
|
Andrew Wang
|
54fd0e44b7
|
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
|
2017-05-08 21:59:49 -07:00 |
|
Mingliang Liu
|
8b5f2c372e
|
HADOOP-14351. Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cache. Contributed by Santhosh G Nayak
|
2017-04-26 13:47:18 -07:00 |
|
Mingliang Liu
|
0cab57223e
|
HADOOP-14274. Azure: Simplify Ranger-WASB policy model. Contributed by Sivaguru Sankaridurg
|
2017-04-12 16:07:10 -07:00 |
|
Mingliang Liu
|
56ab02eed9
|
HADOOP-14273. Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flag. Contributed by Santhosh G Nayak
|
2017-04-04 11:10:28 -07:00 |
|
Mingliang Liu
|
27a44b60c1
|
HADOOP-14272. Azure: WasbRemoteCallHelper should use String equals for comparison. Contributed by Santhosh G Nayak
|
2017-04-04 11:03:59 -07:00 |
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
|
Mingliang Liu
|
8e15e24059
|
HADOOP-13945. Azure: Add Kerberos and Delegation token support to WASB client. Contributed by Santhosh G Nayak
Change-Id: I39fb0a3b0491bf2160571366939a0502a0045429
|
2017-03-20 16:31:24 -07:00 |
|
Mingliang Liu
|
28daaf0eb2
|
HADOOP-14150. Implement getHomeDirectory() method in NativeAzureFileSystem. Contributed by Santhosh G Nayak
|
2017-03-07 14:55:52 -08:00 |
|
Mingliang Liu
|
686823529b
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
|
2017-03-06 17:16:36 -08:00 |
|
Mingliang Liu
|
52d7d5aa1a
|
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
This reverts commit 6b7cd62b8c.
|
2017-03-06 17:10:11 -08:00 |
|
Mingliang Liu
|
c571cda5c7
|
HADOOP-14048. REDO operation of WASB#AtomicRename should create placeholder blob for destination folder. Contributed by NITIN VERMA
|
2017-03-06 17:00:13 -08:00 |
|
Mingliang Liu
|
6b7cd62b8c
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
|
2017-03-03 17:09:12 -08:00 |
|
Mingliang Liu
|
82607fce39
|
HADOOP-14091. AbstractFileSystem implementaion for 'wasbs' scheme. Contributed Varada Hemeswari.
|
2017-02-23 13:48:44 -08:00 |
|
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |
|
Mingliang Liu
|
c6a5b689db
|
HADOOP-13942. Build failure due to errors of javadoc build in hadoop-azure. Contributed by Kai Sasaki
|
2016-12-29 16:24:06 -08:00 |
|
Mingliang Liu
|
e92a77099b
|
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
|
2016-12-22 20:15:18 -08:00 |
|
Mingliang Liu
|
f92913c35b
|
HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade
|
2016-12-15 12:35:08 -08:00 |
|
Mingliang Liu
|
15dd1f3381
|
HADOOP-13675. Bug in return value for delete() calls in WASB. Contributed by Dushyanth
|
2016-12-05 12:04:07 -08:00 |
Wei-Chiu Chuang
|
c0b1a44f6c
|
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
|
2016-11-17 22:48:35 -06:00 |
|
Mingliang Liu
|
5af572b644
|
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
|
2016-11-15 10:57:00 -08:00 |
Xiao Chen
|
20c4d8efab
|
HADOOP-13787. Azure testGlobStatusThrowsExceptionForUnreadableDir fails. Contributed by John Zhuge.
|
2016-11-03 11:16:07 -07:00 |
Robert Kanter
|
5877f20f9c
|
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
|
2016-10-27 16:09:00 -07:00 |
|
Steve Loughran
|
2cc841f16e
|
HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. Contributed by Akira Ajisaka.
|
2016-10-06 16:31:00 +01:00 |
Xiaoyu Yao
|
8b57be108f
|
HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
(cherry picked from commit a65e159c59)
|
2016-08-29 15:30:49 -07:00 |
Chris Nauroth
|
ae4db25443
|
HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss.
|
2016-08-18 10:44:36 -07:00 |
|
Chris Nauroth
|
2ed58c40e5
|
HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka.
|
2016-08-08 12:28:40 -07:00 |
|
Chris Nauroth
|
4ef1bc0bdb
|
HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth.
|
2016-08-02 22:32:21 -07:00 |
|
Chris Nauroth
|
b43de80031
|
HADOOP-13354. Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage Clients. Contributed by Sivaguru Sankaridurg.
|
2016-07-27 15:50:38 -07:00 |
|
Akira Ajisaka
|
54fe17a607
|
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
|
2016-07-27 19:41:09 +09:00 |
|
Andrew Wang
|
da456ffd62
|
Preparing for 3.0.0-alpha2 development
|
2016-07-15 19:04:17 -07:00 |
|
Steve Loughran
|
c918286b17
|
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
|
2016-05-20 12:21:59 +01:00 |
|
Andrew Wang
|
3c5c57af28
|
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
|
2016-05-12 18:27:28 -07:00 |
|
Andrew Wang
|
ca5613af91
|
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
This reverts commit 6b53802cba.
|
2016-05-12 15:32:45 -07:00 |
|
Andrew Wang
|
6b53802cba
|
Update project version to 3.0.0-alpha1-SNAPSHOT.
|
2016-05-12 11:05:05 -07:00 |
|
Chris Nauroth
|
843ee8d59d
|
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
|
2016-04-08 13:36:58 -07:00 |
Allen Wittenauer
|
738155063e
|
HADOOP-12857. rework hadoop-tools (aw)
|
2016-03-23 13:46:38 -07:00 |
|
Chris Nauroth
|
c50aad0f85
|
HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade.
|
2016-03-04 22:57:43 -08:00 |
|
Chris Nauroth
|
f98dff329b
|
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
|
2016-03-01 13:18:42 -08:00 |
|
Chris Nauroth
|
7634d404b7
|
HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
|
2016-02-28 11:22:55 -08:00 |
|
cnauroth
|
3369a4f691
|
HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
|
2016-02-23 21:37:50 -08:00 |
|
cnauroth
|
27b77751c1
|
HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
|
2016-02-22 17:30:13 -08:00 |
|
cnauroth
|
d4f5fc23b2
|
HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
|
2016-02-22 13:39:38 -08:00 |
|
cnauroth
|
91a96eaa53
|
HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
|
2016-02-12 15:50:10 -08:00 |
|
cnauroth
|
8bc93db2e7
|
HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
|
2016-01-18 09:08:58 -08:00 |
|
cnauroth
|
0e76f1fcea
|
HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
|
2016-01-09 22:18:11 -08:00 |
|
cnauroth
|
f0fa6d869b
|
HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
|
2016-01-08 20:18:59 -08:00 |
|
cnauroth
|
978bbdfeb2
|
HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
|
2016-01-06 11:15:59 -08:00 |
|
cnauroth
|
0fb1867fd6
|
HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
|
2015-11-04 10:28:44 -08:00 |
|
cnauroth
|
9e7dcab185
|
HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
|
2015-11-02 10:21:39 -08:00 |
|
cnauroth
|
3ce0a6502e
|
HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
|
2015-11-02 10:17:41 -08:00 |
|
cnauroth
|
2d10cb8e00
|
HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
|
2015-10-28 09:44:10 -07:00 |
|
cnauroth
|
1f7ecb0c84
|
HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
|
2015-10-27 22:56:22 -07:00 |
|
cnauroth
|
73822de7c3
|
HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
|
2015-10-27 22:48:56 -07:00 |
|
cnauroth
|
cb282d5b89
|
HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
|
2015-10-22 14:29:57 -07:00 |
|
cnauroth
|
47641fcbc9
|
HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
|
2015-10-22 12:21:32 -07:00 |
|
cnauroth
|
5f6edb30c2
|
HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
|
2015-10-05 20:11:41 -07:00 |
Kihwal Lee
|
3abbdc929b
|
HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
|
2015-09-28 17:31:51 -05:00 |
|
cnauroth
|
3da0bedaec
|
HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
|
2015-08-05 14:56:41 -07:00 |
|
cnauroth
|
efa97243ec
|
HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-07-22 11:16:49 -07:00 |
|
cnauroth
|
460e98f7b3
|
HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-06-29 13:48:02 -07:00 |
|
cnauroth
|
c45784bc90
|
HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic.
|
2015-06-08 22:42:14 -07:00 |
|
cnauroth
|
94e7d49a6d
|
HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic.
|
2015-05-28 12:31:06 -07:00 |
|
cnauroth
|
cb8e69a80c
|
HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth.
|
2015-05-14 22:22:24 -07:00 |
Vinayakumar B
|
f33efbc827
|
HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak)
|
2015-05-08 10:22:11 +05:30 |
Jonathan Eagles
|
2d7363b273
|
HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles)
|
2015-05-01 13:11:50 -05:00 |
Tsuyoshi Ozawa
|
ef9946cd52
|
HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
|
2015-03-17 16:09:21 +09:00 |
|
cnauroth
|
7a346bcb4f
|
HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu.
|
2015-03-11 14:36:51 -07:00 |
|
cnauroth
|
608ebd52ba
|
HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic.
|
2015-03-06 15:25:01 -08:00 |
|
Tsuyoshi Ozawa
|
d1c6accb6f
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-03-03 14:17:52 +09:00 |
|
cnauroth
|
5731c0e0d0
|
HADOOP-11629. WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true. Contributed by Shanyu Zhao.
|
2015-02-25 09:08:55 -08:00 |
|
Tsuyoshi Ozawa
|
9cedad11d8
|
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
This reverts commit 946456c6d8.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
|
2015-02-25 00:32:04 +09:00 |
|
Tsuyoshi Ozawa
|
946456c6d8
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-02-19 13:06:53 +09:00 |
|
Tsuyoshi Ozawa
|
ba58da29f4
|
HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa)
|
2015-02-05 00:42:14 +09:00 |
|
cnauroth
|
1c09ca2ba4
|
HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal.
|
2015-02-02 11:50:43 -08:00 |
|
cnauroth
|
f2c91098c4
|
HADOOP-11523. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-01-29 17:02:38 -08:00 |
|
cnauroth
|
ad55083f75
|
HADOOP-11441. Hadoop-azure: Change few methods scope to public. Contributed by Shashank Khandelwal.
|
2015-01-29 13:07:51 -08:00 |
arp
|
c1f857b0b4
|
HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth)
|
2014-12-19 18:54:22 -08:00 |
Haohui Mai
|
efe6357748
|
HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy.
|
2014-12-18 16:23:35 -08:00 |
|
Steve Loughran
|
07bb0b0bbb
|
HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel)
|
2014-12-16 11:04:36 +00:00 |
|
Haohui Mai
|
2e98ad34ce
|
HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu.
|
2014-12-09 20:45:21 -08:00 |
|
cnauroth
|
734eeb4f35
|
HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao.
|
2014-11-03 14:29:18 -08:00 |
|
cnauroth
|
f4b7e99f4e
|
HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson.
|
2014-10-10 15:05:52 -07:00 |
|
cnauroth
|
2217e2f8ff
|
HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell.
|
2014-10-08 14:20:23 -07:00 |
|
Allen Wittenauer
|
9f03a7c018
|
HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)
|
2014-09-19 11:33:07 -07:00 |