Commit Graph

117 Commits

Author SHA1 Message Date
Shashikant Banerjee d4e4a7d456 HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee. 2019-03-25 15:41:20 +05:30
Xiaoyu Yao 6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
This closes #627.
2019-03-23 09:22:34 -07:00
Xiaoyu Yao dea6f2a065 HDDS-1291. Set OmKeyArgs#refreshPipeline flag properly to avoid reading from stale pipeline. Contributed by Xiaoyu Yao. (#639) 2019-03-22 15:08:28 -07:00
Xiaoyu Yao 5cfb88a225 HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. (#594) 2019-03-15 16:08:30 -07:00
Xiaoyu Yao d1afa03804
HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh.
Closes #585
2019-03-15 10:41:06 -07:00
Shashikant Banerjee 155ab6d5d8 HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee. 2019-03-15 15:40:59 +05:30
Márton Elek 3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
Closes #588
2019-03-14 12:01:25 +01:00
Xiaoyu Yao 2778259b88 HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#593)
Closes PR #593
2019-03-12 09:34:18 -07:00
Shashikant Banerjee b4aa24d3c5 HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee. 2019-03-11 23:15:49 +05:30
Xiaoyu Yao 4fc493e511 HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573) 2019-03-11 09:19:19 -07:00
Márton Elek 45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
Closes #490
2019-03-06 18:22:22 +01:00
Hanisha Koneru 12402b7a74 HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-05 09:24:22 -08:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
This reverts commit 8e1225991d.
2019-03-04 16:58:59 +09:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Hanisha Koneru 8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00
Anu Engineer 8387bbdfb5 HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
Bharat Viswanadham 106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read. 2019-02-23 21:37:55 -08:00
Hanisha Koneru b1397ff9e4 HDDS-1109. Setup Failover Proxy Provider for OM client. 2019-02-20 14:49:59 -08:00
Anu Engineer 02d04bd107 HDDS-1121. Key read failure when data is written parallel in to Ozone.
Contributed by Bharat Viswanadham.
2019-02-19 11:07:17 -08:00
Anu Engineer 7ea91494ce HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Contributed by Xiaoyu Yao.
2019-02-16 10:23:10 -08:00
Anu Engineer 75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer 0395f22145 HDDS-1068. Improve the error propagation for ozone sh.
Contributed by Elek, Marton.
2019-02-14 22:51:46 -08:00
Yiqun Lin 26e60135f5 HDDS-1074. Remove dead variable from KeyOutputStream#addKeyLocationInfo. Contributed by Siddharth Wagle. 2019-02-12 16:28:50 +08:00
Márton Elek e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Márton Elek 9ace37b119 HDDS-987. MultipartUpload: S3API for list parts of a object. Contributed by Bharat Viswanadham. 2019-02-05 13:08:36 +01:00
Shashikant Banerjee 4123353151 HDDS-1037. Fix the block discard logic in Ozone client. Contributed by Shashikant Banerjee. 2019-02-01 20:44:48 +05:30
Márton Elek 033d97abac HDDS-956. MultipartUpload: List Parts for a Multipart upload key. Contributed by Bharat Viswanadham. 2019-01-31 14:51:31 +01:00
Yiqun Lin 8326450bca HDDS-974. Add getServiceAddress method to ServiceInfo and use it in TestOzoneShell. Contributed by Doroszlai, Attila. 2019-01-28 17:03:12 +08:00
Xiaoyu Yao 9fc7df8afb HDDS-793. Support custom key/value annotations on volume/bucket/key. Contributed by Elek, Marton. 2019-01-24 23:24:09 -08:00
Shashikant Banerjee f3d8265582 HDDS-996. Incorrect data length gets updated in OM by client in case it hits exception in multiple successive block writes. Contributed by Shashikant Banerjee. 2019-01-24 16:37:05 +05:30
Ajay Kumar dcbc8b86ed HDDS-975. Manage ozone security tokens with ozone shell cli. Contributed by Ajay Kumar. 2019-01-23 15:34:20 -08:00
Xiaoyu Yao 751bc62df7 Merge branch 'HDDS-4' into trunk 2019-01-18 14:44:24 -08:00
Mukul Kumar Singh 4ac0404fe0 HDDS-959. KeyOutputStream should handle retry failures. Contributed by Lokesh Jain. 2019-01-18 11:08:43 -08:00
Anu Engineer 1d5734e341 HDDS-938. Add Client APIs for using S3 Auth interface.
Contributed by  Dinesh Chitlangia.
2019-01-16 16:18:39 -07:00
Ajay Kumar 50c4045fde HDDS-805. Block token: Client api changes for block token. Contributed by Ajay Kumar. 2019-01-16 13:38:27 -07:00
Ajay Kumar bb4a26ca32 HDDS-8. Add OzoneManager Delegation Token support. Contributed by Ajay Kumar. 2019-01-16 01:06:59 -07:00
Xiaoyu Yao e47135d9d9 HDDS-70. Fix config names for secure ksm and scm. Contributed by Ajay Kumar. 2019-01-15 22:53:55 -07:00
Xiaoyu Yao 914e93beeb HDDS-7. Enable kerberos auth for Ozone client in hadoop rpc. Contributed by Ajay Kumar. 2019-01-15 22:44:45 -07:00
Xiaoyu Yao ff61931f91 HDDS-6. Enable SCM kerberos auth. Contributed by Ajay Kumar. 2019-01-15 22:16:58 -07:00
Bharat Viswanadham 2091d1a4af HDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to BlockInputStream. Contributed by Shashikant Banerjee. 2019-01-09 20:02:36 -08:00
Márton Elek 32cf0412ce HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton. 2019-01-08 22:27:19 +01:00
Bharat Viswanadham cdfbec47ce HDDS-930. Multipart Upload: Abort multiupload request. Contributed by Bharat Viswanadham. 2019-01-07 11:09:14 -08:00
Márton Elek d14c56d150 HDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat Viswanadham. 2019-01-07 11:27:36 +01:00
Bharat Viswanadham 13d3f99b37 HDDS-881.009. Encapsulate all client to OM requests into one request message. Contributed by Hanisha Koneru. 2018-12-20 09:12:42 -08:00
Shashikant Banerjee 4ff1c46d95 HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and ChunkOutputStream to BlockOutputStream. Contributed by Shashikant Banerjee. 2018-12-18 18:03:46 +05:30
Márton Elek d44b37d7ac HDDS-889. MultipartUpload: Support uploading a part file in ozone. Contributed by Bharat Viswanadham. 2018-12-12 14:16:21 +01:00
Márton Elek 17a8708039 HDDS-879. MultipartUpload: Add InitiateMultipartUpload in ozone. Contributed by Bharat Viswanadham. 2018-12-10 10:05:38 +01:00
Jitendra Pandey 1afba83f2c HDDS-870. Avoid creating block sized buffer in ChunkGroupOutputStream. Contributed by Shashikant Banerjee. 2018-12-08 09:23:10 -08:00
Bharat Viswanadham ef3b03b75a HDDS-885. Fix test failures due to ChecksumData. Contributed by Hanisha Koneru. 2018-12-03 10:52:49 -08:00
Hanisha Koneru 64a4b6b08b HDDS-284. Checksum for ChunksData. 2018-11-28 10:53:12 -08:00