766 Commits

Author	SHA1	Message	Date
John Zhuge	a4661850c1	HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.	2017-09-08 11:51:03 -07:00
Steve Loughran	5bbca80428	HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A. ... Contributed by Aaron Fabbri	2017-09-08 12:07:02 +01:00
Steve Loughran	83449abb40	HADOOP-14774. S3A case "testRandomReadOverBuffer" failed due to improper range parameter. ... Contributed by Yonger.	2017-09-07 19:55:56 +01:00
Steve Loughran	13eda50003	HADOOP-14520. WASB: Block compaction for Azure Block Blobs. ... Contributed by Georgi Chalakov	2017-09-07 18:35:03 +01:00
Xiaoyu Yao	63720ef574	HADOOP-14839. DistCp log output should contain copied and deleted files and directories. Contributed by Yiqun Lin.	2017-09-05 23:34:55 -07:00
John Zhuge	50506e90a8	HADOOP-14103. Sort out hadoop-aws contract-test-options.xml. Contributed by John Zhuge.	2017-09-05 23:26:57 -07:00
Steve Loughran	792eff9ea7	HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS. ... Contributed by Sivaguru Sankaridurg	2017-09-05 14:16:57 +01:00
Andrew Wang	0d419c984f	Preparing for 3.1.0 development	2017-09-01 11:53:48 -07:00
Allen Wittenauer	a3fee475f7	HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw)	2017-09-01 08:38:30 -07:00
Steve Loughran	621b43e254	HADOOP-13345 HS3Guard: Improved Consistency for S3A. ... Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu, Sean Mackrory, Steve Loughran and others.	2017-09-01 14:13:41 +01:00
John Zhuge	7ecc6dbed6	HADOOP-14824. Update ADLS SDK to 2.2.2 for MSI fix. Contributed by Atul Sikaria.	2017-08-31 21:13:22 -07:00
Allen Wittenauer	71bbb86d69	HADOOP-14670. Increase minimum cmake version for all platforms ... Signed-off-by: Chris Douglas <cdouglas@apache.org>	2017-08-30 21:47:24 -07:00
Haibo Chen	d04f85f387	MAPREDUCE-6892. Issues with the count of failed/killed tasks in the jhist file. (Peter Bacsko via Haibo Chen)	2017-08-30 10:07:48 -07:00
Yufei Gu	26fafc3597	YARN-7077. TestAMSimulator and TestNMSimulator fail. (Contributed by Akira Ajisaka via Yufei Gu)	2017-08-29 16:33:51 -07:00
Steve Loughran	9374f38820	HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory ... Contributed by Esfandiar Manii and Thomas Marquardt.	2017-08-29 19:03:44 +01:00
Steve Loughran	021974f4cb	HADOOP-14802. Add support for using container saskeys for all accesses. ... Contributed by Sivaguru Sankaridurg	2017-08-29 19:02:43 +01:00
Andrew Wang	f29a0fc288	HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou.	2017-08-25 14:14:23 -07:00
Arpit Agarwal	8b7cbe3840	HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.	2017-08-25 09:55:46 -07:00
Steve Loughran	27ab5f7385	HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator. ... Contributed by Genmao Yu	2017-08-22 11:55:48 +01:00
Kai Zheng	267e19a09f	HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu	2017-08-21 13:36:28 +08:00
Arun Suresh	8410d862d3	YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)	2017-08-20 07:54:09 -07:00
Steve Loughran	c6b4e656b7	HADOOP-14769. WASB: delete recursive should not fail if a file is deleted. ... Contributed by Thomas Marquardt	2017-08-18 14:13:40 +01:00
Andrew Wang	dd7916d3cd	HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.	2017-08-17 09:35:36 -07:00
Chris Douglas	645a8f2a4d	HADOOP-14726. Mark FileStatus::isDir as final	2017-08-14 21:57:20 -07:00
John Zhuge	7769e96149	HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.	2017-08-13 00:22:34 -07:00
Allen Wittenauer	4222c97108	HADOOP-10392. Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) (ajisakaa via aw)	2017-08-11 09:25:56 -07:00
Steve Loughran	54356b1e83	HADOOP-14183. Remove service loader config file for wasb fs. ... Contributed by Esfandiar Manii.	2017-08-10 16:46:33 +01:00
Steve Loughran	f4e1aa0508	HADOOP-14715. TestWasbRemoteCallHelper failing. ... Contributed by Esfandiar Manii.	2017-08-08 23:37:47 +01:00
Chris Douglas	55a181f845	HADOOP-14730. Support protobuf FileStatus in AdlFileSystem.	2017-08-07 21:31:28 -07:00
Steve Loughran	d91b7a8451	HADOOP-14722. Azure: BlockBlobInputStream position incorrect after seek. ... Contributed by Thomas Marquardt	2017-08-06 20:19:23 +01:00
Steve Loughran	7fc324aabd	HADOOP-14126. Remove jackson, joda and other transient aws SDK dependencies from hadoop-aws. ... Contributed by Steve Loughran (cherry picked from commit ced547d5f0)	2017-08-04 11:09:08 +01:00
Sean Mackrory	1a1bf6b7d0	HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.	2017-08-02 12:25:05 -06:00
Steve Loughran	778d4edd9a	HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded. ... Contributed by Thomas Marquardt.	2017-08-01 21:36:28 +01:00
John Zhuge	f735ad1b67	HADOOP-14678. AdlFilesystem#initialize swallows exception when getting user name. Contributed by John Zhuge.	2017-07-28 09:46:54 -07:00
Jitendra Pandey	a92bf39e23	HADOOP-14680. Azure: IndexOutOfBoundsException in BlockBlobInputStream. Contributed by Thomas Marquardt.	2017-07-25 16:26:48 -07:00
Jitendra Pandey	f2921e51f0	HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.	2017-07-24 23:01:01 -07:00
Ravi Prakash	94ca52ae9e	HADOOP-14597. Native compilation broken with OpenSSL-1.1.0. Contributed by Ravi Prakash.	2017-07-24 16:01:45 -07:00
Wei-Chiu Chuang	44350fdf49	HADOOP-14557. Document HADOOP-8143 (Change distcp to have -pb on by default). Contributed by Bharat Viswanadham.	2017-07-20 18:23:13 -07:00
Haibo Chen	0ba8cda135	YARN-6685. Add job count in to SLS JSON input format. (Yufei Gu via Haibo Chen)	2017-07-20 08:15:46 -07:00
Jitendra Pandey	2843c688bc	HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.	2017-07-19 00:13:06 -07:00
Jitendra Pandey	b0e78ae085	HADOOP-14640. Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak.	2017-07-17 02:27:55 -07:00
Steve Loughran	7d272ea124	HADOOP-14581. Restrict setOwner to list of user when security is enabled in wasb. ... Contributed by Varada Hemeswari (cherry picked from commit 1e69e52603)	2017-07-12 10:37:39 +01:00
Steve Loughran	d670c3a4da	HADOOP-14535 wasb: implement high-performance random access and seek of block blobs. ... Contributed by Thomas Marquardt	2017-07-11 21:34:27 +01:00
Haibo Chen	147df300bf	YARN-5067 Support specifying resources for AM containers in SLS. (Yufei Gu via Haibo Chen)	2017-06-30 17:03:44 -07:00
Mingliang Liu	38996fdcf0	HADOOP-14443. Azure: Support retry and client side failover for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak	2017-06-30 16:53:48 -07:00
Andrew Wang	af2773f609	Updating version for 3.0.0-beta1 development	2017-06-29 17:57:40 -07:00
Mingliang Liu	72993b33b7	HADOOP-14596. AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error. Contributed by Steve Loughran ... Change-Id: I49173bf6163796903d64594a8ca8a4bd26ad2bfc	2017-06-29 17:07:52 -07:00
Mingliang Liu	b08cc97396	HADOOP-14601. Azure: Reuse ObjectMapper. Contributed by Mingliang Liu	2017-06-29 09:22:00 -07:00
Allen Wittenauer	20ba86d66a	MAPREDUCE-6536. hadoop-pipes doesn't use maven properties for openssl ... Signed-off-by: Ravi Prakash <raviprak@apache.org>	2017-06-28 17:33:44 -07:00
Mingliang Liu	990aa34de2	HADOOP-14609. NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code. Contributed by Steve Loughran	2017-06-28 14:18:59 -07:00