Commit Graph

578 Commits

Author SHA1 Message Date
Elek, Márton 7ec6a31eb3 HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. (#653) 2019-04-04 14:00:54 -07:00
Yiqun Lin 0781a7174f HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee.
(cherry picked from commit d31c86892e)
2019-04-02 14:28:12 +05:30
nilotpalnandi f2dee89b4f
HDDS-1309 . change logging from warn to debug in XceiverClient. Contributed by Nilotpal Nandi. (#638)
(cherry picked from commit 4cceeb2682)
2019-03-28 12:24:12 -07:00
Shashikant Banerjee c53408c3e3 HDDS-1293. ExcludeList#getProtoBuf throws ArrayIndexOutOfBoundsException. Contributed by Shashikant Banerjee.
(cherry picked from commit ac4010bb22)
2019-03-29 00:47:38 +05:30
Xiaoyu Yao f8f85fcc31
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao.
This closes #641 

(cherry picked from commit ca5e4ce036)
2019-03-28 12:01:45 -07:00
Sandeep Nemuri f6acbc9caf HDDS-1310. In datanode once a container becomes unhealthy, datanode restart fails.
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 5c0a81ad3c)
2019-03-26 15:45:45 +05:30
Shashikant Banerjee eed623ad61 HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee. 2019-03-25 15:45:26 +05:30
Vivek Ratnavel Subramanian 6b3e0b3edc
HDDS-1302. Fix SCM CLI does not list container with id 1.
(cherry picked from commit 73f7b04e2b)
2019-03-22 15:17:12 -07:00
Arpit Agarwal 8f422d7b5e
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh.
(cherry picked from commit 90afc9ab03)
2019-03-21 14:27:07 -07:00
Hanisha Koneru 598c16c1fc
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
(cherry picked from commit 12402b7a74)
2019-03-20 17:53:06 -07:00
Ajay Yadav d2e115d8c8 HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601)
(cherry picked from commit f10d493325)
2019-03-18 23:11:36 -07:00
Arpit Agarwal 7cd82b4547
Revert "HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. (#608)"
This reverts commit 0d35cfc006.
2019-03-18 14:23:56 -07:00
Vivek Ratnavel Subramanian 328bfcc0b6
HDDS-1263. SCM CLI does not list container with id 1.
(cherry picked from commit af2dfc9f3d)
2019-03-15 20:56:09 -07:00
Elek, Márton 0d35cfc006 HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. (#608)
(cherry picked from commit 44b8451821)
2019-03-15 14:53:38 -07:00
Márton Elek 3fd9c0db17 HDDS-807. Period should be an invalid character in bucket names. Contributed by Siddharth Wagle.
(cherry picked from commit c449cdebe6)
2019-03-15 10:04:50 -07:00
Shashikant Banerjee 8bd13ffa10 HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee.
(cherry picked from commit 155ab6d5d8)
2019-03-15 15:47:56 +05:30
Vivek Ratnavel Subramanian 64726dd8fe
HDDS-761. Create S3 subcommand to run S3 related operations.
Closes #579

(cherry picked from commit 9001508485)
2019-03-14 21:19:48 -07:00
Shashikant Banerjee 8614da3723 HDDS-1257. Incorrect object because of mismatch in block lengths. Contributed by Shashikant Banerjee.
(cherry picked from commit d60673c470)
2019-03-14 19:34:54 +05:30
Mukul Kumar Singh f38a8a9630 HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh.
(cherry picked from commit ea9fb07fd2)
2019-03-14 15:25:22 +05:30
Ajay Yadav 0f4ae392d7 HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. (#598)
(cherry picked from commit 4fa009989b)
2019-03-13 12:02:17 -07:00
Xiaoyu Yao eeb7d63046 HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contributed by Xiaoyu Yao. (#596)
(cherry picked from commit 86d508c7c7)
2019-03-13 11:52:47 -07:00
Aravindan Vijayan 34f0ad064d HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline.
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 1f47fb7a2f)
2019-03-13 17:14:51 +05:30
Lokesh Jain b5b3f4d823 HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 0d62753da9)
2019-03-13 16:47:04 +05:30
Vivek Ratnavel Subramanian 32477ed1e6
HDDS-1226. Addendum. ozone-filesystem jar missing in hadoop classpath
Closes #560

(cherry picked from commit c1649bf1e1)
2019-03-13 12:09:41 +01:00
Ajay Yadav 15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api
Closes #561

(cherry picked from commit dcb0de848d)
2019-03-12 18:54:59 +01:00
Xiaoyu Yao 262260fadf HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#593)
Closes PR #593

(cherry picked from commit 2778259b88)
2019-03-12 09:36:37 -07:00
Mukul Kumar Singh 97fd3025a4 HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh.
(cherry picked from commit daf4660eeb)
2019-03-12 20:03:36 +05:30
Shashikant Banerjee 4373c12701 HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee.
(cherry picked from commit b4aa24d3c5)
2019-03-12 10:21:14 +05:30
Ajay Yadav 6028aefb57 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
This closes (#581)

(cherry picked from commit 599e926d46)
2019-03-11 15:02:43 -07:00
Mukul Kumar Singh 5d67a17877 HDDS-1238. Fix Ratis Snapshot creation error if the snapshot file already exists in ContainerStateMachine. Contributed by Shashikant Banerjee.
(cherry picked from commit 8458ced11e)
2019-03-11 14:57:45 +05:30
Mukul Kumar Singh aa9de9a0fa HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh.
(cherry picked from commit 2c3ec37738)
2019-03-11 14:57:45 +05:30
Xiaoyu Yao 49217971b5 HDDS-1235. BaseHttpServer NPE is HTTP policy is HTTPS_ONLY. Contributed by Xiaoyu Yao.
Closes #572

(cherry picked from commit 11db46956c)
2019-03-09 09:40:05 -08:00
Ajay Yadav 6465125a5a HDDS-594. SCM CA: DN sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. (#547)
(cherry picked from commit 064f38b3a5)
2019-03-09 09:40:00 -08:00
Lokesh Jain c334bc8baf HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain.
(cherry picked from commit 129fd5dd18)
2019-03-08 09:02:41 +05:30
Vivek Ratnavel Subramanian 62ab3425dc
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
Closes #560

(cherry picked from commit 475011bbf8)
2019-03-07 14:46:01 +01:00
Vivek Ratnavel Subramanian 67a26ac793
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
(cherry picked from commit a55fc36299)
2019-03-07 14:45:51 +01:00
Márton Elek ab5da9a984
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-07 14:35:51 +01:00
Shashikant Banerjee 8655abb353 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee.
(cherry picked from commit 62e89dc275)
2019-03-07 14:29:38 +05:30
Shashikant Banerjee b99ae7b4e2 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee.
(cherry picked from commit 5fcea54a50)
2019-03-07 14:26:38 +05:30
Elek, Márton 8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502)
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5)
2019-03-05 12:15:56 -08:00
Bharat Viswanadham 4cf50e3972 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534)
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.

(cherry picked from commit 313e8b9f13)
2019-03-05 11:48:52 -08:00
Elek, Márton f4918acdae HDDS-623. On SCM UI, Node Manager info is empty (#523)
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.

(cherry picked from commit 90c37ac40d)
2019-03-05 09:35:52 -08:00
Xiaoyu Yao eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
This reverts commit 8e1225991d.
2019-03-04 16:58:59 +09:00
Ajay Yadav 9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544)
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
2019-03-01 16:19:43 -08:00
Xiaoyu Yao 6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar 4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00
Xiaoyu Yao eea40cb88a
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConverter used by DefaultProfile. Contributed by Xiaoyu Yao. 2019-03-01 10:49:39 -08:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Hanisha Koneru 8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00