85 Commits

Author SHA1 Message Date
Xiaoyu Yao
5f8ded542a
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao.
This closes #652.

(cherry picked from commit 8a59efee34107517bf6ad6dfb9b4342098e2f847)
2019-03-27 21:53:31 -07:00
Xiaoyu Yao
8d1c218428
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
This closes #627.

(cherry picked from commit 6a34c9bb29dc3e0370b63b63f26229e3dc90cc13)
2019-03-23 09:36:56 -07:00
Xiaoyu Yao
a55a295c7a HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao.
This closes #615

(cherry picked from commit 992489c11ca6710466266250a3933e0281ac4d35)
2019-03-19 09:57:50 -07:00
Ajay Yadav
d2e115d8c8 HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601)
(cherry picked from commit f10d49332522beca7cb7342e68b2acdbe4c974f8)
2019-03-18 23:11:36 -07:00
Vivek Ratnavel Subramanian
64726dd8fe
HDDS-761. Create S3 subcommand to run S3 related operations.
Closes #579

(cherry picked from commit 90015084850298803d8e165a0f6f9719ba724ea3)
2019-03-14 21:19:48 -07:00
Ajay Yadav
15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api
Closes #561

(cherry picked from commit dcb0de848d8388fcee425847e52f6361790225c6)
2019-03-12 18:54:59 +01:00
Ajay Yadav
6028aefb57 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
This closes (#581)

(cherry picked from commit 599e926d462134aa3235311feb27f3a8cdff6a51)
2019-03-11 15:02:43 -07:00
Bharat Viswanadham
e65717af25
HDDS-1242. In S3 when bucket already exists, it should just return location.
(cherry picked from commit 73e1801b2db928d165e4cf076e1ba50ec1e8b48a)
2019-03-09 21:48:46 -08:00
Elek, Márton
118986cde7
HDDS-1213. Support plain text S3 MPU initialization request.
(cherry picked from commit c072458e5d1ec88c8e4d76cd09623083b8ccfc03)
2019-03-08 10:15:30 -08:00
Vivek Ratnavel Subramanian
62ab3425dc
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
Closes #560

(cherry picked from commit 475011bbf8b58a10457fe0c68a8e18edc5bf1623)
2019-03-07 14:46:01 +01:00
Vivek Ratnavel Subramanian
67a26ac793
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
(cherry picked from commit a55fc362999f269efa1b6304438148aef3c03ed8)
2019-03-07 14:45:51 +01:00
Ajay Kumar
5502da4ae2
HDDS-1216. Change name of ozoneManager service in docker compose files to om.
Closes #553

(cherry picked from commit 9d87247af30757fbf521a4b432149846790364c5)
2019-03-07 14:41:28 +01:00
Elek, Márton
8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502)
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5e430e340c8fd731fd9e35e22f9ddbf)
2019-03-05 12:15:56 -08:00
Arpit Agarwal
c57e1ddd63
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek.
(cherry picked from commit 3ef1235215c68e9f0aff8e17643c52838fa363a3)
2019-03-05 10:27:15 -08:00
Anu Engineer
eae3db9649 HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs.
Contributed Elek, Marton.
2019-02-28 17:14:47 -08:00
Xiaoyu Yao
3a8118b480
HDDS-1190. Fix jdk 11 issue for ozonesecure base image and docker-compose . Contributed by Xiaoyu Yao. 2019-02-28 15:51:08 +01:00
Xiaoyu Yao
0e450202a6
HDDS-1019. Use apache/hadoop-runner image to test ozone secure cluster. Contributed by Xiaoyu Yao. 2019-02-27 12:44:04 +01:00
Xiaoyu Yao
9e0f3d1c52 HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar. 2019-02-26 06:02:10 -08:00
Márton Elek
642fe6a260
HDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh Chitlangia. 2019-02-20 12:08:24 +01:00
Anu Engineer
7ea91494ce HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
Contributed by Xiaoyu Yao.
2019-02-16 10:23:10 -08:00
Elek, Márton
afe126d71f HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek. 2019-02-15 11:49:52 -08:00
Anu Engineer
217bdbd940 HDDS-1116.Add java profiler servlet to the Ozone web servers.
Contributed by Elek, Marton.
2019-02-15 11:32:06 -08:00
Elek, Márton
d10444e79c
HDDS-1092. Use Java 11 JRE to run Ozone in containers. 2019-02-15 17:26:56 +01:00
Anu Engineer
75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer
506bd02c63 HDDS-905. Create informative landing page for Ozone S3 gateway.
Contributed by Elek, Marton.
2019-02-14 23:16:23 -08:00
Mukul Kumar Singh
73b67b2df5 HDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi. 2019-02-11 20:08:25 +05:30
Márton Elek
e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Xiaoyu Yao
e50dc7ee59 HDDS-1018. Update the base image of krb5 container for the secure ozone cluster. Contributed by Xiaoyu Yao. 2019-02-08 12:45:49 -08:00
Bharat Viswanadham
a140a890c6 HDDS-1069. Temporarily disable the security acceptance tests by default in Ozone. Contributed by Marton Elek. 2019-02-07 18:05:05 -08:00
Bharat Viswanadham
75e8441c61 HDDS-1071. Make Ozone s3 acceptance test suite centos compatible. Contributed by Elek Marton. 2019-02-07 08:53:11 -08:00
Márton Elek
a65aca2fef HDDS-922. Create isolated classloder to use ozonefs with any older hadoop versions. Contributed by Elek, Marton. 2019-02-07 17:02:03 +01:00
Mukul Kumar Singh
911790cc26 HDDS-1027. Add blockade Tests for datanode isolation and scm failures. Contributed by Nilotpal Nandi. 2019-02-06 11:32:38 +05:30
Márton Elek
9ace37b119 HDDS-987. MultipartUpload: S3API for list parts of a object. Contributed by Bharat Viswanadham. 2019-02-05 13:08:36 +01:00
Mukul Kumar Singh
13aa939224 HDDS-997. Add blockade Tests for scm isolation and mixed node isolation. Contributed by Nilotpal Nandi. 2019-02-01 13:10:17 +05:30
Bharat Viswanadham
945a61c164 HDDS-549. Add support for key rename in Ozone Shell. Contributed by Doroszlai Attila. 2019-01-30 16:00:18 -08:00
Márton Elek
0e95ae402c HDDS-1030. Move auditparser robot tests under ozone basic. Contributed by Dinesh Chitlangia. 2019-01-30 17:34:32 +01:00
Nanda kumar
8ff9578126 HDDS-1007. Add robot test for AuditParser.
Contributed by Dinesh Chitlangia.
2019-01-25 12:14:10 +05:30
Márton Elek
4e0aa2ceac HDDS-948. MultipartUpload: S3 API for Abort Multipart Upload. Contributed by Bharat Viswanadham. 2019-01-24 20:24:19 +01:00
Márton Elek
3c7d700b65 HDDS-1002. ozonesecure compose incompatible with smoke test. Contributed by Doroszlai, Attila. 2019-01-24 17:17:40 +01:00
Márton Elek
09a5859f58 HDDS-993. Update hadoop version to 3.2.0. Contributed by Supratim Deka. 2019-01-24 11:32:58 +01:00
Elek, Márton
0b91329ed6 HDDS-764. Run S3 smoke tests with replication STANDARD. (#462)
HDDS-764. Run S3 smoke tests with replication STANDARD. Contributed by Elek, Marton.
2019-01-23 11:37:49 -08:00
Shashikant Banerjee
e72e27edd8 HDDS-932. Add blockade Tests for Network partition. Contributed by Nilotpal Nandi. 2019-01-23 14:05:49 +05:30
Xiaoyu Yao
53120e2e6c HDDS-592. Fix ozone-secure.robot test. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
61e85d7cd1 HDDS-684. Fix HDDS-4 branch after HDDS-490 and HADOOP-15832. Contributed by Xiaoyu Yao. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
16e0bb874d HDDS-591. Adding ASF license header to kadm5.acl. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
0aab74026e HDDS-10. Add kdc docker image for secure ozone cluster. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Ajay Kumar
d4511889fd HDDS-566. Move OzoneSecure docker-compose after HDDS-447. Contributed by Xiaoyu Yao. 2019-01-15 23:01:03 -07:00
Márton Elek
999f31fd20 HDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bharat Viswanadham. 2019-01-08 15:48:48 +01:00
Márton Elek
d66925a315 HDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat Viswanadham. 2019-01-07 12:39:46 +01:00
Márton Elek
992dd9d189 HDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bharat Viswanadham. 2019-01-07 12:06:22 +01:00