52 Commits

Author SHA1 Message Date
Yongjun Zhang
f0de11ba98 Preparing for 3.0.4 development 2018-05-29 23:40:26 -07:00
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Steve Loughran
a3945e4cf1 HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge.
(cherry picked from commit 8aca46e53f5962217851dc2103211f99a4ef7258)
2018-04-02 16:38:19 +01:00
Sean Mackrory
ca92d1810b HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
(cherry picked from commit 9d7a9031a5978efc8d97566e35ebaace20db2353)
2018-03-29 14:05:42 -06:00
Steve Loughran
3c03672e87 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b4af79069cd4b1d608b0fa68648ee72)
(cherry picked from commit abfe1eaf29a31d96f63022a59e29392b773e6bc1)
2018-02-28 15:33:21 +00:00
Steve Loughran
b302f728f8 HADOOP-13972. ADLS to support per-store configuration.
Contributed by Sharad Sonker.

(cherry picked from commit 050f5287b79324b7f6231b879c0bfc608203b980)
2018-02-15 16:29:30 +00:00
Steve Loughran
1888b94806 HADOOP-15090. Add ADL troubleshooting doc.
Contributed by Steve Loughran.

(cherry picked from commit 58a2120e8a31307f19551f87be4e81d4fb626de1)
2018-02-15 14:26:18 +00:00
Lei Xu
7b377f43d0 Preparing for 3.0.2 development 2018-02-06 10:50:37 -08:00
Steve Loughran
95a96b13e2 HADOOP-15186. Allow Azure Data Lake SDK dependency version to be set on the command line.
Contributed by Vishwajeet Dusane.
2018-01-29 09:46:53 -08:00
Steve Loughran
1de0712578 HADOOP-15185. Update adls connector to use the current version of ADLS SDK.
Contributed by Atul Sikaria.

(cherry picked from commit f63d13f10db708228482b53883863c873c89f69c)
2018-01-23 11:37:33 -08:00
Andrew Wang
1c8d334287 Preparing for 3.0.1 development 2017-11-14 11:17:18 -08:00
Andrew Wang
5a4f37019a Preparing for 3.0.0 GA development 2017-09-28 11:32:01 -07:00
John Zhuge
bb107f5d28 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
(cherry picked from commit a4661850c1e0794baf493a468191e12681d68ab4)
2017-09-08 12:57:58 -07:00
John Zhuge
7ecc6dbed6 HADOOP-14824. Update ADLS SDK to 2.2.2 for MSI fix. Contributed by Atul Sikaria. 2017-08-31 21:13:22 -07:00
Andrew Wang
dd7916d3cd HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas. 2017-08-17 09:35:36 -07:00
John Zhuge
7769e96149 HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria. 2017-08-13 00:22:34 -07:00
Chris Douglas
55a181f845 HADOOP-14730. Support protobuf FileStatus in AdlFileSystem. 2017-08-07 21:31:28 -07:00
John Zhuge
f735ad1b67 HADOOP-14678. AdlFilesystem#initialize swallows exception when getting user name. Contributed by John Zhuge. 2017-07-28 09:46:54 -07:00
Andrew Wang
af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Andrew Wang
16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Akira Ajisaka
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu. 2017-05-25 15:36:44 +09:00
Akira Ajisaka
0d5c8ed8e0
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-05-11 16:37:32 -05:00
Mingliang Liu
e4c32bccde HADOOP-14349. Rename ADLS CONTRACT_ENABLE_KEY. Contributed by Mingliang Liu 2017-04-25 20:54:56 -07:00
John Zhuge
56e81f2a20 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
Andrew Wang
4966a6e26e HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy. 2017-03-29 14:37:21 -07:00
John Zhuge
253e3e78ab HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 2017-03-27 23:05:57 -07:00
John Zhuge
d1b7439b48 HADOOP-14230. TestAdlFileSystemContractLive fails to clean up. Contributed by John Zhuge. 2017-03-24 13:37:04 -07:00
Andrew Wang
52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Chris Douglas
c55195588f HADOOP-14197. Fix ADLS doc for credential provider. Contributed by John Zhuge 2017-03-23 12:17:27 -07:00
Chris Douglas
03955612b7 HADOOP-14196. Azure Data Lake doc is missing required config entry. Contributed by Atul Sikaria 2017-03-23 12:13:23 -07:00
John Zhuge
5a40bafdae HADOOP-14173. Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE. Contributed by John Zhuge.
Change-Id: I5dc6f885816b8834f718874542dfa373458b0333
2017-03-13 08:11:25 -07:00
Mingliang Liu
881ec4d97b HADOOP-14153. ADL module has messed doc structure. Contributed by Mingliang Liu 2017-03-10 00:16:09 -08:00
John Zhuge
c5ee7fded4 HADOOP-14123. Remove misplaced ADL service provider config file for FileSystem. Contributed by John Zhuge.
Change-Id: Ic956e2eb8189625916442eaffdc69163d32f730e
2017-03-09 18:30:17 -08:00
Steve Loughran
e60c6543d5
HADOOP-14113. Review ADL Docs. Contributed by Steve Loughran 2017-02-24 13:24:59 +00:00
Mingliang Liu
924def7854 HADOOP-14017. User friendly name for ADLS user and group. Contributed by Vishwajeet Dusane 2017-02-21 13:44:42 -08:00
Mingliang Liu
f432999025 HADOOP-14049. Honour AclBit flag associated to file/folder permission for Azure datalake account. Contributed by Vishwajeet Dusane 2017-02-16 15:14:25 -08:00
Lei Xu
71c23c9fc9 HADOOP-13929. ADLS connector should not check in contract-test-options.xml. (John Zhuge via lei) 2017-02-13 13:33:13 -08:00
Lei Xu
ccf2d66244 HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei) 2017-01-21 10:52:40 +08:00
Lei Xu
e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Andrew Wang
5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Mingliang Liu
ef34bf2bb9 HADOOP-13900. Remove snapshot version of SDK dependency from Azure Data Lake Store File System. Contributed by Vishwajeet Dusane 2016-12-13 10:34:32 -08:00
Mingliang Liu
4113ec5fa5 HADOOP-13257. Improve Azure Data Lake contract tests. Contributed by Vishwajeet Dusane 2016-12-02 15:54:57 -08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Chris Douglas
5c61ad2488 HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane 2016-11-11 11:15:07 -08:00
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Steve Loughran
2cc841f16e HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. Contributed by Akira Ajisaka. 2016-10-06 16:31:00 +01:00
Chris Nauroth
c60a68ce1d HADOOP-13392. [Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured. Contributed by Vishwajeet Dusane and Chris Douglas. 2016-07-22 09:16:38 -07:00
Chris Douglas
dca6335dbc HADOOP-13393. Omit unsupported fs.defaultFS setting in ADLS documentation 2016-07-21 23:21:47 -07:00
Andrew Wang
da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Chris Nauroth
51d16e7b38 HADOOP-13242. Authenticate to Azure Data Lake using client ID and keys. Contributed by Atul Sikaria. 2016-06-16 23:35:20 -07:00