127 Commits

Author	SHA1	Message	Date
Chris Douglas	081c350188	HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao	2018-03-28 11:58:59 -07:00
fang zhenyi	5e013d50d1	HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings. ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-15 16:12:07 +09:00
Steve Loughran	52babbb4a0	HADOOP-15086. NativeAzureFileSystem file rename is not atomic. ... Contributed by Thomas Marquardt	2017-12-22 11:39:55 +00:00
Steve Loughran	0ea182d0fa	HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0. ... Contributed by Rajesh Balamohan	2017-11-28 11:52:59 +00:00
John Zhuge	bf6a660232	HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.	2017-11-09 10:16:12 -08:00
Steve Loughran	9fcc3a1fc8	HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled. ... Contributed by Santhosh G Nayak	2017-10-16 16:01:47 +01:00
Steve Loughran	3de574413c	HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. ... Contributed by Varada Hemeswari.	2017-10-11 18:06:43 +01:00
Steve Loughran	572cdb5463	HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB ... Contributed by Kannapiran Srinivasan.	2017-10-06 17:43:38 +01:00
Steve Loughran	9288206cb3	HADOOP-14845. Azure wasb: getFileStatus not making any auth check. ... Contributed by Sivaguru Sankaridurg	2017-10-05 15:05:23 +01:00
Steve Loughran	a530e7ab3b	HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB ... Contributed by Varada Hemeswari	2017-09-28 19:52:56 +01:00
Steve Loughran	2d2d97fa7d	HADOOP-14553. Add (parallelized) integration tests to hadoop-azure ... Contributed by Steve Loughran	2017-09-15 17:03:01 +01:00
Steve Loughran	13eda50003	HADOOP-14520. WASB: Block compaction for Azure Block Blobs. ... Contributed by Georgi Chalakov	2017-09-07 18:35:03 +01:00
Steve Loughran	792eff9ea7	HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS. ... Contributed by Sivaguru Sankaridurg	2017-09-05 14:16:57 +01:00
Steve Loughran	9374f38820	HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory ... Contributed by Esfandiar Manii and Thomas Marquardt.	2017-08-29 19:03:44 +01:00
Steve Loughran	021974f4cb	HADOOP-14802. Add support for using container saskeys for all accesses. ... Contributed by Sivaguru Sankaridurg	2017-08-29 19:02:43 +01:00
Steve Loughran	c6b4e656b7	HADOOP-14769. WASB: delete recursive should not fail if a file is deleted. ... Contributed by Thomas Marquardt	2017-08-18 14:13:40 +01:00
Chris Douglas	645a8f2a4d	HADOOP-14726. Mark FileStatus::isDir as final	2017-08-14 21:57:20 -07:00
Steve Loughran	54356b1e83	HADOOP-14183. Remove service loader config file for wasb fs. ... Contributed by Esfandiar Manii.	2017-08-10 16:46:33 +01:00
Steve Loughran	f4e1aa0508	HADOOP-14715. TestWasbRemoteCallHelper failing. ... Contributed by Esfandiar Manii.	2017-08-08 23:37:47 +01:00
Steve Loughran	d91b7a8451	HADOOP-14722. Azure: BlockBlobInputStream position incorrect after seek. ... Contributed by Thomas Marquardt	2017-08-06 20:19:23 +01:00
Steve Loughran	778d4edd9a	HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded. ... Contributed by Thomas Marquardt.	2017-08-01 21:36:28 +01:00
Jitendra Pandey	a92bf39e23	HADOOP-14680. Azure: IndexOutOfBoundsException in BlockBlobInputStream. Contributed by Thomas Marquardt.	2017-07-25 16:26:48 -07:00
Jitendra Pandey	f2921e51f0	HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.	2017-07-24 23:01:01 -07:00
Jitendra Pandey	2843c688bc	HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.	2017-07-19 00:13:06 -07:00
Jitendra Pandey	b0e78ae085	HADOOP-14640. Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak.	2017-07-17 02:27:55 -07:00
Steve Loughran	7d272ea124	HADOOP-14581. Restrict setOwner to list of user when security is enabled in wasb. ... Contributed by Varada Hemeswari (cherry picked from commit 1e69e52603)	2017-07-12 10:37:39 +01:00
Steve Loughran	d670c3a4da	HADOOP-14535 wasb: implement high-performance random access and seek of block blobs. ... Contributed by Thomas Marquardt	2017-07-11 21:34:27 +01:00
Mingliang Liu	38996fdcf0	HADOOP-14443. Azure: Support retry and client side failover for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak	2017-06-30 16:53:48 -07:00
Mingliang Liu	b08cc97396	HADOOP-14601. Azure: Reuse ObjectMapper. Contributed by Mingliang Liu	2017-06-29 09:22:00 -07:00
Mingliang Liu	990aa34de2	HADOOP-14609. NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code. Contributed by Steve Loughran	2017-06-28 14:18:59 -07:00
Mingliang Liu	7e031c2c18	HADOOP-14546. Azure: Concurrent I/O does not work when secure.mode is enabled. Contributed by Thomas	2017-06-27 17:32:07 -07:00
Mingliang Liu	686a634f01	HADOOP-14573. regression: Azure tests which capture logs failing with move to SLF4J. Contributed by Steve Loughran	2017-06-27 16:48:47 -07:00
Steve Loughran	48f4a229a9	HADOOP-14461 Azure: handle failure gracefully in case of missing account access key. ... Contributed by Mingliang Liu.	2017-06-26 13:39:47 +01:00
Steve Loughran	c6bd73c6c5	HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations. ... Contributed by Thomas.	2017-06-23 21:38:41 +01:00
Akira Ajisaka	3369540653	HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools.	2017-06-20 13:18:26 +09:00
Mingliang Liu	325163f23f	HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu	2017-06-09 13:07:11 -07:00
Mingliang Liu	df35e4cc3b	HADOOP-14500. Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails. Contributed by Rajesh Balamohan	2017-06-07 13:54:52 -07:00
Mingliang Liu	536f057158	HADOOP-14491. Azure has messed doc structure. Contributed by Mingliang Liu	2017-06-06 11:09:28 -07:00
Mingliang Liu	6b5285bbcb	HADOOP-14472. Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently. Contributed by Mingliang Liu	2017-06-06 11:06:49 -07:00
Mingliang Liu	5fd9742c83	HADOOP-14478. Optimize NativeAzureFsInputStream for positional reads. Contributed by Rajesh Balamohan	2017-06-05 15:56:43 -07:00
Mingliang Liu	ece33208b8	HADOOP-14460. Azure: update doc for live and contract tests. Contributed by Mingliang Liu	2017-06-01 11:52:11 -07:00
Mingliang Liu	89bb8bfe58	HADOOP-14442. Owner support for ranger-wasb integration. Contributed by Varada Hemeswari	2017-05-26 17:54:00 -07:00
Akira Ajisaka	6a52b5e144	HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.	2017-05-25 15:36:44 +09:00
Mingliang Liu	b415c6fe74	HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg	2017-05-16 11:22:32 -07:00
Mingliang Liu	eed731496f	HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak	2017-05-10 15:05:11 -07:00
Akira Ajisaka	2ba9903932	HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.	2017-05-10 05:57:12 -05:00
Andrew Wang	54fd0e44b7	HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.	2017-05-08 21:59:49 -07:00
Mingliang Liu	8b5f2c372e	HADOOP-14351. Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cache. Contributed by Santhosh G Nayak	2017-04-26 13:47:18 -07:00
Mingliang Liu	0cab57223e	HADOOP-14274. Azure: Simplify Ranger-WASB policy model. Contributed by Sivaguru Sankaridurg	2017-04-12 16:07:10 -07:00
Mingliang Liu	56ab02eed9	HADOOP-14273. Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flag. Contributed by Santhosh G Nayak	2017-04-04 11:10:28 -07:00