Commit Graph

150 Commits

Author SHA1 Message Date
Ajay Yadav 447d53476a
HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. (#634)
(cherry picked from commit 82d477293c)
2019-03-26 09:02:15 -07:00
Xiaoyu Yao 8d1c218428
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
This closes #627.

(cherry picked from commit 6a34c9bb29)
2019-03-23 09:36:56 -07:00
Xiaoyu Yao b2c63c3ce1
HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. (#594)
(cherry picked from commit 5cfb88a225)
2019-03-20 19:09:25 -07:00
Hanisha Koneru 598c16c1fc
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
(cherry picked from commit 12402b7a74)
2019-03-20 17:53:06 -07:00
Ajay Yadav d2e115d8c8 HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601)
(cherry picked from commit f10d493325)
2019-03-18 23:11:36 -07:00
Xiaoyu Yao 6fd95b8595 HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#616)
(cherry picked from commit 66a104bc57)
2019-03-18 09:39:05 -07:00
Xiaoyu Yao 3ca1024eec HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh.
Closes #585 

(cherry picked from commit d1afa03804)
2019-03-15 10:42:09 -07:00
Vivek Ratnavel Subramanian 64726dd8fe
HDDS-761. Create S3 subcommand to run S3 related operations.
Closes #579

(cherry picked from commit 9001508485)
2019-03-14 21:19:48 -07:00
Ajay Yadav 15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api
Closes #561

(cherry picked from commit dcb0de848d)
2019-03-12 18:54:59 +01:00
Xiaoyu Yao e673bebcfe HDDS-1245. OM delegation expiration time should use Time.now instead … (#587)
Closes #587.

(cherry picked from commit c7307867f0)
2019-03-11 21:20:57 -07:00
Márton Elek 9cd3fe49cf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
Closes #490

(cherry picked from commit 45f976fdcf)
2019-03-07 14:44:34 +01:00
Xiaoyu Yao eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
This reverts commit 8e1225991d.
2019-03-04 16:58:59 +09:00
Ajay Yadav 9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544)
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
2019-03-01 16:19:43 -08:00
Xiaoyu Yao 78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao 6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar 4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Hanisha Koneru 8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00
Ajay Kumar cbf82fabf0 HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar. 2019-02-27 17:00:42 -08:00
Xiaoyu Yao 9e0f3d1c52 HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar. 2019-02-26 06:02:10 -08:00
Anu Engineer 8387bbdfb5 HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
Anu Engineer c1e5b19212 HDDS-1147. Fix failing unit tests in TestOzoneManager.
Contributed by Nandakumar.
2019-02-23 20:56:24 -08:00
Bharat Viswanadham d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.

* fix test failures in TestOzoneConfigurationFields
2019-02-21 13:29:10 -08:00
avijayanhwx e8d7e3b4e6 HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan. 2019-02-19 16:32:47 -08:00
Xiaoyu Yao cf1a66d0da HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer. 2019-02-19 10:42:56 -08:00
Anu Engineer 588b4c4d78 HDDS-1085. Create an OM API to serve snapshots to Recon server.
Contributed by Aravindan Vijayan.
2019-02-18 22:35:36 -08:00
Anu Engineer 7ea91494ce HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Contributed by Xiaoyu Yao.
2019-02-16 10:23:10 -08:00
Elek, Márton afe126d71f HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek. 2019-02-15 11:49:52 -08:00
Anu Engineer 217bdbd940 HDDS-1116.Add java profiler servlet to the Ozone web servers.
Contributed by Elek, Marton.
2019-02-15 11:32:06 -08:00
Anu Engineer 75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer 0395f22145 HDDS-1068. Improve the error propagation for ozone sh.
Contributed by Elek, Marton.
2019-02-14 22:51:46 -08:00
Márton Elek 7a57974f1f HDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is not defined. Contributed by Hanisha Koneru. 2019-02-14 14:02:16 +01:00
Bharat Viswanadham 917ac9f108 HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru. 2019-02-12 22:07:27 -08:00
Nanda kumar a536eb5c41 HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
Márton Elek e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Márton Elek 194f0b49fb HDDS-631. Ozone classpath shell command is not working. Contributed by Elek, Marton. 2019-02-05 16:20:30 +01:00
Márton Elek 033d97abac HDDS-956. MultipartUpload: List Parts for a Multipart upload key. Contributed by Bharat Viswanadham. 2019-01-31 14:51:31 +01:00
Yiqun Lin 8326450bca HDDS-974. Add getServiceAddress method to ServiceInfo and use it in TestOzoneShell. Contributed by Doroszlai, Attila. 2019-01-28 17:03:12 +08:00
Bharat Viswanadham fb69519e68 HDDS-1011. Fix NPE BucketManagerImpl.setBucketProperty. Contributed by Xiaoyu Yao. 2019-01-25 14:46:17 -08:00
Xiaoyu Yao 2ec296e659 HDDS-991. Fix failures in TestSecureOzoneCluster. Contributed by Ajay Kumar. 2019-01-25 10:50:23 -08:00
Xiaoyu Yao 9fc7df8afb HDDS-793. Support custom key/value annotations on volume/bucket/key. Contributed by Elek, Marton. 2019-01-24 23:24:09 -08:00
Nanda kumar 45c4cfe790 HDDS-906. Display the ozone version on SCM/OM web ui instead of Hadoop version.
Contributed by Doroszlai, Attila.
2019-01-25 12:16:29 +05:30
Xiaoyu Yao 06c83d3b8a HDDS-984. Fix TestOzoneManagerRatisServer.testIsReadOnlyCapturesAllCmdTypeEnums. Contributed by Xiaoyu Yao. 2019-01-17 14:03:46 -08:00
Bharat Viswanadham c0683ed253 HDDS-960. Add cli command option for getS3Secret. Contributed by Dinesh Chitlangia. 2019-01-17 10:30:45 -08:00
Anu Engineer 8978466fca HDDS-945. Fix generics warnings in delegation token.
Contributed by Ajay Kumar.
2019-01-16 16:23:26 -07:00
Anu Engineer 1d5734e341 HDDS-938. Add Client APIs for using S3 Auth interface.
Contributed by  Dinesh Chitlangia.
2019-01-16 16:18:39 -07:00
Bharat Viswanadham ddaef67181 HDDS-937. Create an S3 Auth Table. Contributed by Dinesh Chitlangia. 2019-01-16 13:43:30 -07:00
Ajay Kumar 50c4045fde HDDS-805. Block token: Client api changes for block token. Contributed by Ajay Kumar. 2019-01-16 13:38:27 -07:00
Xiaoyu Yao 2b115222cd HDDS-929. Remove ozone.max.key.len property. Contributed by Ajay Kumar. 2019-01-16 01:42:08 -07:00