d7a2f9456b
HDDS-1350. Fix checkstyle issue in TestDatanodeStateMachine. Contributed by Xiaoyu Yao. ( #656 )
2019-03-28 14:50:34 -07:00
4cceeb2682
HDDS-1309 . change logging from warn to debug in XceiverClient. Contributed by Nilotpal Nandi. ( #638 )
2019-03-28 12:22:44 -07:00
ac4010bb22
HDDS-1293. ExcludeList#getProtoBuf throws ArrayIndexOutOfBoundsException. Contributed by Shashikant Banerjee.
2019-03-29 00:43:28 +05:30
ca5e4ce036
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao.
...
This closes #641
2019-03-28 12:00:58 -07:00
b4ed81c4e6
HDDS-1332. Add some logging for flaky test testStartStopDatanodeStateMachine. Contributed by Arpit Agarwal. ( #649 )
2019-03-27 20:53:30 +05:30
5c0a81ad3c
HDDS-1310. In datanode once a container becomes unhealthy, datanode restart fails.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-26 15:44:18 +05:30
8739693514
HDDS-1217. Refactor ChillMode rules and chillmode manager. ( #558 )
2019-03-26 01:41:03 +05:30
e5d72f504e
HDDS-1234. Iterate the OM DB snapshot and populate the recon container DB. Contributed by Aravindan Vijayan.
2019-03-25 22:52:02 +08:00
d4e4a7d456
HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee.
2019-03-25 15:41:20 +05:30
128dd91e10
HDDS-1331. In DatanodeStateMachine join check for not null.
2019-03-23 09:43:49 -07:00
43e421afef
HDDS-918. Expose SCMMXBean as a MetricsSource. Contributed by Siddharth Wagle.
2019-03-22 16:44:12 -07:00
771ea6b5e7
Revert "HDDS-1310. In datanode once a container becomes unhealthy, datanode restart fails. Contributed by Sandeep Nemuri."
...
This reverts commit efad5717ec
2019-03-22 16:20:44 -07:00
efad5717ec
HDDS-1310. In datanode once a container becomes unhealthy, datanode restart fails. Contributed by Sandeep Nemuri.
2019-03-22 15:53:12 -07:00
73f7b04e2b
HDDS-1302. Fix SCM CLI does not list container with id 1.
2019-03-22 15:15:01 -07:00
f854a89190
HDDS-1205. Refactor ReplicationManager to handle QUASI_CLOSED containers. Contributed by Nanda kumar. ( #620 )
2019-03-22 14:36:29 -07:00
90afc9ab03
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-21 14:24:02 -07:00
60cdd4cac1
HDDS-1233. Create an Ozone Manager Service provider for Recon. Contributed by Aravindan Vijayan.
2019-03-21 11:02:29 +08:00
072750c00a
HDDS-1306. TestContainerStateManagerIntegration fails in Ratis shutdown. Contributed by Lokesh Jain.
2019-03-20 17:14:19 +05:30
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. ( #601 )
2019-03-18 23:08:17 -07:00
ae3a2c3851
Revert "HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. ( #608 )"
...
This reverts commit 44b8451821
2019-03-18 14:21:57 -07:00
4d2a116d6e
HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen.
2019-03-17 17:08:29 +08:00
926d548caa
HDDS-1281. Fix the findbug issue caused by HDDS-1163. Contributed by Aravindan Vijayan.
2019-03-15 21:06:44 -07:00
af2dfc9f3d
HDDS-1263. SCM CLI does not list container with id 1.
2019-03-15 15:39:30 -07:00
44b8451821
HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. ( #608 )
2019-03-15 14:51:37 -07:00
155ab6d5d8
HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee.
2019-03-15 15:40:59 +05:30
9001508485
HDDS-761. Create S3 subcommand to run S3 related operations.
...
Closes #579
2019-03-14 21:16:59 -07:00
091a664977
HDDS-917. Expose NodeManagerMXBean as a MetricsSource. Contributed by Siddharth Wagle.
2019-03-14 12:41:52 -07:00
d60673c470
HDDS-1257. Incorrect object because of mismatch in block lengths. Contributed by Shashikant Banerjee.
2019-03-14 19:32:36 +05:30
3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
...
Closes #588
2019-03-14 12:01:25 +01:00
ea9fb07fd2
HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-14 15:18:06 +05:30
4fa009989b
HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. ( #598 )
2019-03-13 12:01:08 -07:00
86d508c7c7
HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contributed by Xiaoyu Yao. ( #596 )
2019-03-13 11:50:53 -07:00
1f47fb7a2f
HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 17:12:43 +05:30
c1649bf1e1
HDDS-1226. Addendum. ozone-filesystem jar missing in hadoop classpath
...
Closes #560
2019-03-13 12:08:45 +01:00
0d62753da9
HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 16:30:06 +05:30
d602d462a6
HDDS-1256. Fix failure in TestKeyValueContainerCheck. Contributed by Supratim Deka.
2019-03-13 16:22:19 +05:30
24793d2d97
HDDS-1163. Basic framework for Ozone Data Scrubber. Contributed by Supratim Deka.
2019-03-13 04:32:39 +09:00
c449cdebe6
HDDS-807. Period should be an invalid character in bucket names. Contributed by Siddharth Wagle.
2019-03-12 19:14:55 +01:00
dcb0de848d
HDDS-1043. Enable token based authentication for S3 api
...
Closes #561
2019-03-12 18:47:06 +01:00
2778259b88
HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #593 )
...
Closes PR #593
2019-03-12 09:34:18 -07:00
daf4660eeb
HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh.
2019-03-12 20:02:19 +05:30
d17e31e062
HDDS-1214. Enable tracing for the datanode read/write path. Contributed by Elek, Marton.
...
Closes #550 .
2019-03-12 11:34:56 +01:00
599e926d46
HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
...
This closes (#581 )
2019-03-11 15:01:04 -07:00
b4aa24d3c5
HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee.
2019-03-11 23:15:49 +05:30
68aa2ccd89
HDDS-1240. Fix check style issues caused by HDDS-1196.
2019-03-09 21:50:46 -08:00
11db46956c
HDDS-1235. BaseHttpServer NPE is HTTP policy is HTTPS_ONLY. Contributed by Xiaoyu Yao.
...
Closes #572
2019-03-09 09:38:01 -08:00
8458ced11e
HDDS-1238. Fix Ratis Snapshot creation error if the snapshot file already exists in ContainerStateMachine. Contributed by Shashikant Banerjee.
2019-03-09 22:46:20 +05:30
341c076f05
HDDS-1196. Add a ReplicationStartTimer class. ( #567 )
2019-03-08 20:55:33 +05:30
fb851c9481
HDDS-1232. Recon Container DB service definition. Contributed by Aravindan Vijayan.
2019-03-08 16:59:41 +08:00
064f38b3a5
HDDS-594. SCM CA: DN sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. ( #547 )
2019-03-07 14:41:52 -08:00
475011bbf8
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
...
Closes #560
2019-03-07 14:09:13 +01:00
bb12e81ec8
HDDS-1175. Serve read requests directly from RocksDB. ( #557 )
...
HDDS-1175. Serve read requests directly from RocksDB.
2019-03-06 19:44:55 -08:00
a55fc36299
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
2019-03-06 17:43:57 -08:00
2c3ec37738
HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh.
2019-03-06 21:38:21 +05:30
129fd5dd18
HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain.
2019-03-06 17:00:37 +05:30
62e89dc275
HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee.
2019-03-06 10:00:16 +05:30
1ad5bfc53f
HDDS-1188. Implement a skeleton patch for Recon server with initial set of interfaces. Contributed by Siddharth Wagle.
2019-03-05 15:54:29 -08:00
7f636b47b5
HDDS-919. Enable prometheus endpoints for Ozone datanodes ( #502 )
...
Pull request from Elek, Márton. (#502 )
2019-03-05 12:04:57 -08:00
313e8b9f13
HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. ( #534 )
...
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.
2019-03-05 11:46:36 -08:00
df99137310
Merge pull request #555 from elek/HDDS-1219
...
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure
2019-03-05 10:19:05 -08:00
12402b7a74
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-05 09:24:22 -08:00
5fcea54a50
HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee.
2019-03-05 22:09:46 +05:30
296259e9b3
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton.
2019-03-05 13:45:47 +01:00
90c37ac40d
HDDS-623. On SCM UI, Node Manager info is empty ( #523 )
...
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.
2019-03-04 14:35:00 -08:00
10b802b84b
HDDS-1136 : Add metric counters to capture the RocksDB checkpointing statistics.
...
Contributed by Aravindan Vijayan.
2019-03-04 12:00:16 -08:00
eed8b794d8
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. ( #545 )
2019-03-04 10:37:26 -08:00
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
...
This reverts commit 8e1225991d
2019-03-04 16:58:59 +09:00
9e53088493
Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" ( #544 )
...
* Revert "Fix checkstyle issue"
This reverts commit 78c8a3323e6fef6fc5ee
2019-03-01 16:19:43 -08:00
6fef6fc5ee
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao.
2019-03-01 16:15:20 -08:00
4a3cddea70
HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar.
2019-03-01 15:41:09 -08:00
eea40cb88a
HDDS-1204. Fix ClassNotFound issue with javax.xml.bind.DatatypeConverter used by DefaultProfile. Contributed by Xiaoyu Yao.
2019-03-01 10:49:39 -08:00
de1dae64f2
HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee.
2019-03-01 23:30:28 +05:30
8e1225991d
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-01 00:27:39 -08:00
77b23c816e
HDDS-1182. Pipeline Rule where at least one datanode is reported in the pipeline.
2019-02-28 21:41:36 -08:00
eae3db9649
HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs.
...
Contributed Elek, Marton.
2019-02-28 17:14:47 -08:00
eae8819fd2
HDDS-1187. Healthy pipeline Chill Mode rule to consider only pipelines with replication factor three.
2019-02-28 17:03:39 -08:00
cbf82fabf0
HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar.
2019-02-27 17:00:42 -08:00
fef2e2fc88
HDDS-1176. Allow persisting X509CertImpl to SCM certificate table. Contributed by Xiaoyu Yao.
2019-02-27 10:40:41 -08:00
6c8c422beb
HDDS-1178. Healthy pipeline Chill Mode Rule.
...
Closes #518
2019-02-27 14:26:40 +01:00
9e0f3d1c52
HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar.
2019-02-26 06:02:10 -08:00
9de34d2990
HDDS-1151. Propagate the tracing id in ScmBlockLocationProtocol.
...
Contributed by Elek, Marton.
2019-02-25 13:50:37 -08:00
92b1fdcece
HDDS-1070. Adding Node and Pipeline related metrics in SCM.
...
Contributed by Nandakumar.
2019-02-24 15:39:41 -08:00
3aa0a57ea0
HDDS-1152. Add trace information for the client side of the datanode writes
...
Contributed by Elek, Marton.
2019-02-24 15:20:34 -08:00
5c1f946071
HDDS-1145. Add optional web server to the Ozone freon test tool.
...
Contributed by Elek, Marton.
2019-02-24 15:04:25 -08:00
fc5c83b2ca
HDDS-1090. Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s.
...
Contributed by Elek, Marton.
2019-02-24 14:02:30 -08:00
d82014b70a
HDDS-1149. Change the default ozone.client.checksum.type.
...
Contributed by Bharat Viswanadham.
2019-02-24 13:22:36 -08:00
8387bbdfb5
HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
...
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
021f8deef0
HDDS-1168.Use random ports in TestBlockManager and TestDeletedBlockLog.
...
Contributed by Nandakumar.
2019-02-24 12:36:03 -08:00
106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read.
2019-02-23 21:37:55 -08:00
490206e4b4
HDDS-1155.Fix failing unit test methods of TestDeadNodeHandler.
...
Contributed by Nandakumar.
2019-02-23 21:13:47 -08:00
014e17af78
HDDS-1166. Fix checkstyle line length issues.
...
Contributed by Nandakumar.
2019-02-23 20:31:39 -08:00
1b87668a3b
HDDS-1165. Document generation in maven should be configured on execution level. Contributed by Anu Engineer.
2019-02-23 10:44:46 -08:00
70579805c9
HDDS-1148. After allocating container, we are not adding to container DB.
2019-02-23 01:50:49 +05:30
28d0bf9f67
HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton.
2019-02-21 13:57:05 -08:00
d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
...
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.
* fix test failures in TestOzoneConfigurationFields
2019-02-21 13:29:10 -08:00
2bc3cfe28f
HDDS-1126. Datanode is trying to qausi-close a container which is already closed.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-02-21 21:37:08 +05:30
7c802c42dc
HDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton.
2019-02-21 14:04:18 +01:00
676a9cb888
HDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan.
2019-02-20 12:57:49 -08:00
1374f8f548
HDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar.
2019-02-20 11:35:49 -08:00
e8d7e3b4e6
HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.
2019-02-19 16:32:47 -08:00
02d04bd107
HDDS-1121. Key read failure when data is written parallel in to Ozone.
...
Contributed by Bharat Viswanadham.
2019-02-19 11:07:17 -08:00
cf1a66d0da
HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer.
2019-02-19 10:42:56 -08:00
588b4c4d78
HDDS-1085. Create an OM API to serve snapshots to Recon server.
...
Contributed by Aravindan Vijayan.
2019-02-18 22:35:36 -08:00
f2fb6536dc
HDDS-1106. Introduce queryMap in PipelineManager. Contributed by Lokesh Jain.
2019-02-18 22:35:23 +08:00
217bdbd940
HDDS-1116.Add java profiler servlet to the Ozone web servers.
...
Contributed by Elek, Marton.
2019-02-15 11:32:06 -08:00
de934ba2dc
HDDS-1076. TestSCMNodeManager crashed the jvm. Contributed by Lokesh Jain.
2019-02-15 21:13:30 +05:30
9584b47e03
HDDS-1082. OutOfMemoryError because of memory leak in KeyInputStream. Contributed by Supratim Deka.
2019-02-15 20:09:15 +05:30
8a426dc848
HDDS-1028. Improve logging in SCMPipelineManager. Contributed by Lokesh Jain.
2019-02-15 14:38:38 +05:30
75e15cc0c4
HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
...
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
0395f22145
HDDS-1068. Improve the error propagation for ozone sh.
...
Contributed by Elek, Marton.
2019-02-14 22:51:46 -08:00
917ac9f108
HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.
2019-02-12 22:07:27 -08:00
4f7d32edf8
HDDS-1081. CLOSING state containers should not be added to pipeline on SCM start.
...
Contributed by Lokesh Jain.
2019-02-12 14:39:08 +05:30
a536eb5c41
HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
...
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
d48e61dd36
HDDS-1012. Add Default CertificateClient implementation. Contributed by Ajay Kumar
2019-02-11 18:59:47 -08:00
e7d1ae52d2
HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton.
2019-02-11 12:18:26 +01:00
965d26c9c7
HDDS-1026. Reads should fail over to alternate replica. Contributed by Shashikant Banerjee.
2019-02-10 10:53:16 +05:30
fb8c997a68
HDDS-1048. Remove SCMNodeStat from SCMNodeManager and use storage information from DatanodeInfo#StorageReportProto. Contributed by Nanda kumar.
2019-02-08 23:49:37 +08:00
0c1bc4dcee
HDDS-981. Block allocation should involve pipeline selection and then container selection.
...
Contributed by Lokesh Jain.
2019-02-08 15:44:41 +05:30
a65aca2fef
HDDS-922. Create isolated classloder to use ozonefs with any older hadoop versions. Contributed by Elek, Marton.
2019-02-07 17:02:03 +01:00
214112b2d7
HDDS-1010. ContainerSet#getContainerMap should be renamed. Contributed by Supratim Deka.
2019-02-07 18:06:23 +05:30
912d9f790d
HDDS-1044. Client doesn't propogate correct error code to client on out of disk space. Contributed by Yiqun Lin.
2019-02-06 20:02:17 -08:00
9f2da01591
HDDS-776. Make OM initialization resilient to dns failures. Contributed by Doroszlai, Attila.
2019-02-05 16:11:19 +01:00
3efa168e1f
HDDS-1029. Allow option for force in DeleteContainerCommand. Contributed by Bharat Viswanadham.
2019-02-05 10:51:52 +08:00
9a19d6d48b
HDDS-1039. OzoneManager fails to connect with secure SCM. Contributed by Ajay Kumar
2019-02-04 16:30:07 -08:00
b6f90d3957
HDDS-1021. Allow ozone datanode to participate in a 1 node as well as 3 node Ratis Pipeline. Contributed by Shashikant Banerjee.
2019-02-03 00:53:06 +05:30
16195eaee1
HDDS-1025. Handle replication of closed containers in DeadNodeHanlder. Contributed by Bharat Viswanadham.
2019-02-01 11:34:51 +08:00
033d97abac
HDDS-956. MultipartUpload: List Parts for a Multipart upload key. Contributed by Bharat Viswanadham.
2019-01-31 14:51:31 +01:00
945a61c164
HDDS-549. Add support for key rename in Ozone Shell. Contributed by Doroszlai Attila.
2019-01-30 16:00:18 -08:00
c35419579b
HDDS-1016. Allow marking containers as unhealthy. Contributed by Arpit Agarwal.
2019-01-30 11:40:50 -08:00
7456fc99ee
HDDS-1031. Update ratis version to fix a DN restart Bug. Contributed by Bharat Viswanadham.
2019-01-30 11:14:02 -08:00
14441ccbc6
HDDS-1032. Package builds are failing with missing org.mockito:mockito-core dependency version. Contributed by Doroszlai, Attila.
2019-01-30 13:40:45 +01:00
d583cc45c6
HDDS-1024. Handle DeleteContainerCommand in the SCMDatanodeProtocolServer. Contributed by Bharat Viswanadham.
2019-01-30 13:56:28 +08:00
1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.
2019-01-29 18:29:56 -08:00
5d578d0c4a
HDDS-1004. SCMContainerManager#updateContainerStateInternal fails for QUASI_CLOSE and FORCE_CLOSE events. Contributed by Lokesh Jain.
2019-01-29 14:11:56 +05:30
2d06112b74
HDDS-1022. Add cmd type in getCommandResponse in SCMDatanodeProtocolServer. Contributed by Bharat Viswanadham.
2019-01-29 11:26:41 +08:00
3b49d7aeae
HDDS-989. Check Hdds Volumes for errors. Contributed by Arpit Agarwal.
2019-01-27 11:18:30 -08:00
5dae1a0c66
HDDS-973. HDDS/Ozone fail to build on Windows.
...
Contributed by Xiaoyu Yao.
2019-01-25 12:19:11 +05:30
2181b18850
HDDS-990. Typos in Ozone doc.
...
Contributed by Doroszlai, Attila.
2019-01-25 12:17:36 +05:30
45c4cfe790
HDDS-906. Display the ozone version on SCM/OM web ui instead of Hadoop version.
...
Contributed by Doroszlai, Attila.
2019-01-25 12:16:29 +05:30
09a5859f58
HDDS-993. Update hadoop version to 3.2.0. Contributed by Supratim Deka.
2019-01-24 11:32:58 +01:00
e321b91cb5
HDDS-980. Adding getOMCertificate in SCMSecurityProtocol. Contributed by Ajay Kumar.
2019-01-23 19:32:03 -08:00
2d69a35614
HDDS-982. Fix TestContainerDataYaml#testIncorrectContainerFile. Contributed by Doroszlai, Attila.
2019-01-23 11:31:07 +01:00
0ef54f72a6
HDDS-992. ozone-default.xml has invalid text from a stale merge. Contributed by Dinesh Chitlangia.
2019-01-22 13:37:05 -08:00
9390a0beef
HDDS-913. Ozonefs defaultFs example is wrong in the documentation. Contributed by Supratim Deka.
2019-01-22 09:27:17 -08:00
751bc62df7
Merge branch 'HDDS-4' into trunk
2019-01-18 14:44:24 -08:00
2aaaf12f9e
HDDS-943. Add block token validation in HddsDispatcher/XceiverServer. Contributed by Ajay Kumar.
2019-01-18 12:11:34 -08:00
4ac0404fe0
HDDS-959. KeyOutputStream should handle retry failures. Contributed by Lokesh Jain.
2019-01-18 11:08:43 -08:00
c0683ed253
HDDS-960. Add cli command option for getS3Secret. Contributed by Dinesh Chitlangia.
2019-01-17 10:30:45 -08:00
01a7f9ed35
HDDS-597. Ratis: Support secure gRPC endpoint with mTLS for Ratis. Contributed by Ajay Kumar.
2019-01-17 10:30:44 -08:00
96ea464aaa
HDDS-971. ContainerDataConstructor throws exception on QUASI_CLOSED and UNHEALTHY container state. Contributed by Lokesh Jain.
2019-01-16 17:43:30 -08:00
140565f4db
HDDS-967. Fix failures in TestOzoneConfigurationFields. Contributed by Ajay Kumar.
2019-01-16 16:44:33 -07:00
0e16cf1973
HDDS-970. Fix classnotfound error for bouncy castle classes in OM,SCM init. Contributed by Ajay Kumar.
2019-01-16 16:40:05 -07:00
a5d0fcf704
HDDS-963. Fix failure in TestOzoneShell due to null check in SecurityConfig.
...
Contributed by Ajay Kumar.
2019-01-16 16:18:39 -07:00
1d5734e341
HDDS-938. Add Client APIs for using S3 Auth interface.
...
Contributed by Dinesh Chitlangia.
2019-01-16 16:18:39 -07:00
30bfc9cbd0
HDDS-955. SCM CA: Add CA to SCM.
...
Contributed by Anu Engineer.
2019-01-16 13:43:31 -07:00
924bea9730
HDDS-102. SCM CA: SCM CA server signs certificate for approved CSR. Contributed by Anu Engineer.
2019-01-16 13:43:30 -07:00
50c4045fde
HDDS-805. Block token: Client api changes for block token. Contributed by Ajay Kumar.
2019-01-16 13:38:27 -07:00
2b115222cd
HDDS-929. Remove ozone.max.key.len property. Contributed by Ajay Kumar.
2019-01-16 01:42:08 -07:00
f894d86b2f
HDDS-115. GRPC: Support secure gRPC endpoint with mTLS. Contributed by Xiaoyu Yao.
2019-01-16 01:42:08 -07:00
6d522dc05d
HDDS-804. Block token: Add secret token manager. Contributed by Ajay Kumar.
2019-01-16 01:22:43 -07:00
0c8829a9a1
HDDS-696. Bootstrap genesis SCM(CA) with self-signed certificate.
...
Contributed by Anu Engineer.
2019-01-16 01:16:25 -07:00
7e2770699c
HDDS-9. Add GRPC protocol interceptors for Ozone Block Token. Contributed by Xiaoyu Yao.
2019-01-16 01:10:08 -07:00
bb4a26ca32
HDDS-8. Add OzoneManager Delegation Token support. Contributed by Ajay Kumar.
2019-01-16 01:06:59 -07:00
6d6b1a00c2
HDDS-836. Add TokenIdentifier Ozone for delegation token and block token. Contributed by Ajay Kumar.
2019-01-15 23:01:04 -07:00
6ad794b1b6
HDDS-778. Add an interface for CA and Clients for Certificate operations
...
Contributed by Anu Engineer.
2019-01-15 23:01:03 -07:00
a28ad7ad81
HDDS-753. SCM security protocol server is not starting. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
8b8a3f5435
HDDS-760. Add asf license to TestCertificateSignRequest. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
33c274ea2e
HDDS-103. SCM CA: Add new security protocol for SCM to expose security related functions. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
c260c19d18
HDDS-101. SCM CA: generate CSR for SCM CA clients.
...
Contributed by Xiaoyu Yao.
2019-01-15 23:01:03 -07:00
e89c35a50b
HDDS-704. Fix the Dependency convergence issue on HDDS-4. Contributed by Xiaoyu Yao.
2019-01-15 23:01:03 -07:00
8d7c5f4ee7
HDDS-588. SelfSignedCertificate#generateCertificate should sign the certificate the configured security provider. Contributed by Xiaoyu Yao.
2019-01-15 23:01:03 -07:00
9920506b3d
HDDS-547. Fix secure docker and configs. Contributed by Xiaoyu Yao.
2019-01-15 23:01:02 -07:00
2d269440b0
HDDS-548. Create a Self-Signed Certificate. Contributed by Anu Engineer.
2019-01-15 22:54:51 -07:00
0b034b7005
HDDS-546. Resolve bouncy castle dependency for hadoop-hdds-common. Contributed by Ajay Kumar.
2019-01-15 22:54:51 -07:00
570b503e3e
Fix merge conflicts
2019-01-15 22:54:50 -07:00
faf53f8262
HDDS-100. SCM CA: generate public/private key pair for SCM/OM/DNs. Contributed by Ajay Kumar.
2019-01-15 22:53:56 -07:00
e47135d9d9
HDDS-70. Fix config names for secure ksm and scm. Contributed by Ajay Kumar.
2019-01-15 22:53:55 -07:00
bfa4929fdb
Revert "Bad merge with 996a627b289947af3894bf83e7b63ec702a665cd"
...
This reverts commit 996a627b289947af3894bf83e7b63ec702a665cd.
2019-01-15 22:40:08 -07:00
8e6743eb90
HDDS-6. Enable SCM kerberos auth. Contributed by Ajay Kumar.
2019-01-15 22:40:08 -07:00
d3920ecbb7
HDDS-5. Enable OzoneManager kerberos auth. Contributed by Ajay Kumar.
2019-01-15 22:40:08 -07:00
ff61931f91
HDDS-6. Enable SCM kerberos auth. Contributed by Ajay Kumar.
2019-01-15 22:16:58 -07:00
f280f52b20
HDDS-978. Fix typo in doc : Client > S3 section. Contributed by Dinesh Chitlangia.
2019-01-15 15:11:16 -08:00
2091d1a4af
HDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to BlockInputStream. Contributed by Shashikant Banerjee.
2019-01-09 20:02:36 -08:00
32cf0412ce
HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton.
2019-01-08 22:27:19 +01:00
0f26b5efaa
HDDS-931. Add documentation for ozone shell command providing ozone mapping for a S3Bucket.
...
Contributed by Bharat Viswanadham.
2019-01-07 13:06:45 -08:00
d14c56d150
HDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat Viswanadham.
2019-01-07 11:27:36 +01:00
999da98d67
HDDS-915. Submit client request to OM Ratis server.
...
Contributed by Hanisha Koneru.
2019-01-04 15:25:26 -08:00
ddc0a40507
HDDS-896. Handle over replicated containers in SCM.
...
Contributed by Nandakumar.
2019-01-04 09:04:10 -08:00
996ab4874a
HDDS-393. Audit Parser tool for processing ozone audit logs.
...
Contributed by Dinesh Chitlangia.
2019-01-02 11:52:12 -08:00
0cb3316cec
HDDS-482. NullPointer exception thrown on console when cli operation failed.
...
Contributed by Nandakumar.
2019-01-02 11:30:54 -08:00
4d50ad030c
HDDS-949. Update Ratis to 0.4.0-a8c4ca0-SNAPSHOT.
...
Contributed by Xiaoyu Yao.
2019-01-02 20:00:40 +05:30
dea2c1b485
HDDS-951. Replace the source url of Ozone logo. Contributed by Takanobu Asanuma.
2018-12-27 11:33:25 +09:00
26e4be7022
HDDS-921. Add JVM pause monitor to Ozone Daemons (OM, SCM and Datanodes). Contributed by Bharat Viswanadham.
2018-12-23 17:33:25 -08:00
cf571133b8
HDDS-893. pipeline status is ALLOCATED in scmcli listPipelines command. Contributed by Lokesh Jain.
2018-12-19 13:42:06 +05:30
12c139d7de
HDDS-933. Add documentation for genconf tool under Tools section. Contributed by Dinesh Chitlangia.
2018-12-18 11:40:32 -08:00
b51e9e4317
HDDS-912. Update ozone to latest ratis snapshot build (0.4.0-3b0be02-SNAPSHOT). Contributed by Lokesh Jain.
2018-12-18 18:21:17 +05:30
4ff1c46d95
HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and ChunkOutputStream to BlockOutputStream. Contributed by Shashikant Banerjee.
2018-12-18 18:03:46 +05:30
ee10ba26dd
HDDS-539. Ozone datanode command ignores the invalid options. Contributed by Vinicius Higa Murakami.
2018-12-18 16:10:27 +05:30
94b368f29f
HDDS-99. Adding SCM Audit log. Contributed by Dinesh Chitlangia.
2018-12-17 15:40:22 -08:00
17a8708039
HDDS-879. MultipartUpload: Add InitiateMultipartUpload in ozone. Contributed by Bharat Viswanadham.
2018-12-10 10:05:38 +01:00
1afba83f2c
HDDS-870. Avoid creating block sized buffer in ChunkGroupOutputStream. Contributed by Shashikant Banerjee.
2018-12-08 09:23:10 -08:00
5e773efd78
HDDS-909 : Default implementation for Ozone acls.
...
Contributed by Ajay Kumar.
2018-12-07 23:20:19 -08:00
019836b113
HDDS-858. Start a Standalone Ratis Server on OM
2018-12-06 13:33:52 -08:00
8d882c3786
HDDS-880. Create api for ACL handling in Ozone. (Contributed by Ajay Kumar)
2018-12-06 13:27:28 -08:00
343aaea2d1
HDDS-864. Use strongly typed codec implementations for the tables of the OmMetadataManager. Contributed by Elek Marton.
2018-12-06 11:39:59 -08:00
7274115d57
HDDS-890. Handle OverlappingFileLockException during writeStateMachineData in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-12-04 20:12:35 +05:30
ef3b03b75a
HDDS-885. Fix test failures due to ChecksumData. Contributed by Hanisha Koneru.
2018-12-03 10:52:49 -08:00
3044b78bd0
HDDS-848. Create SCM metrics related to container state. Contributed by Bharat Viswanadham.
2018-12-03 17:16:34 +08:00
8f3e12ff07
HDDS-882. Provide a config to optionally turn on/off the sync flag during chunk writes. Contributed by Shashikant Banerjee.
2018-12-02 08:06:24 +05:30
5a3c7714c4
HDDS-887. Add DispatcherContext info to Dispatcher from containerStateMachine. Contributed by Shashikant Banerjee.
2018-12-02 08:00:35 +05:30
d15dc43659
HDDS-748. Use strongly typed metadata Table implementation. Contributed by Elek Marton.
2018-12-01 16:52:23 -08:00
62f821115b
HDDS-886. Unnecessary buffer copy in HddsDispatcher#dispatch. Contributed by Lokesh Jain.
2018-11-30 22:57:29 +08:00
ae5fbdd9ed
HDDS-877. Ensure correct surefire version for Ozone test. Contributed by Xiaoyu Yao.
2018-11-29 11:37:36 -08:00
5e102f9aa5
HDDS-850. ReadStateMachineData hits OverlappingFileLockException in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-11-29 22:20:08 +05:30
184cced513
HDDS-808. Simplify OMAction and DNAction classes used for AuditLogging. Contributed by Dinesh Chitlangia.
2018-11-29 08:35:20 -08:00
b71cc7f33e
HDDS-642. Add chill mode exit condition for pipeline availability. Contributed by Yiqun Lin.
2018-11-28 17:47:57 -08:00
64a4b6b08b
HDDS-284. Checksum for ChunksData.
2018-11-28 10:53:12 -08:00
34a914be03
HDDS-846. Exports ozone metrics to prometheus.
...
Contributed by Elek, Marton.
2018-11-27 15:57:24 -08:00
099e723406
HDDS-868. Handle quasi closed container replicas in SCM.
...
Contributed by Nanda kumar.
2018-11-27 13:01:22 +05:30
95d526a270
HDDS-869. Fix log message in XceiverClientRatis#sendCommandAsync. Contributed by Lokesh Jain.
2018-11-22 18:39:14 +05:30
ff2484906c
HDDS-841. [JDK11] Fix Javadoc errors in hadoop-hdds-container-service module. Contributed by Dinesh Chitlangia.
2018-11-22 12:04:29 +01:00
ee44b069c6
HDDS-866. Handle RaftRetryFailureException in OzoneClient. Contributed by Shashikant Banerjee.
2018-11-22 15:02:07 +05:30
f207e30142
HDDS-814. dfs.ratis.leader.election.minimum.timeout.duration should not be read by client. Contributed by chencan.
2018-11-22 10:46:10 +05:30
8d2789c5eb
HDDS-795. RocksDb specific classes leak from DBStore/Table interfaces. Contributed by Márton Elek.
2018-11-21 12:25:41 -08:00
919a6e4310
HDDS-861. SCMNodeManager unit tests are broken. Contributed by Xiaoyu Yao.
2018-11-21 11:46:53 -08:00
ebb9245366
HDDS-853. Option to force close a container in Datanode.
...
Contributed by Nanda kumar.
2018-11-22 00:50:27 +05:30
c4d0ef6946
HDDS-816. Create OM metrics for bucket, volume, keys. Contributed by Bharat Viswanadham.
2018-11-21 10:35:39 -08:00
f42b2dfdf1
HDDS-865. GrpcXceiverService is added twice to GRPC netty server. Contributed by Xiaoyu Yao.
2018-11-21 23:43:01 +05:30
14e1a0a3d6
HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee.
2018-11-21 10:51:50 +05:30
1734ace35f
Revert "HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee."
...
This reverts commit c74783036d
2018-11-21 01:07:38 +05:30
c74783036d
HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee.
2018-11-20 23:01:02 +05:30
0123e5197b
HDDS-164. Add unit test for HddsDatanodeService. Contributed by Yiqun Lin.
2018-11-20 15:49:48 +01:00
d0cc679441
HDDS-817. Create SCM metrics for disk from node report. Contributed by Bharat Viswanadham.
2018-11-20 14:22:30 +08:00
b5d7b292c9
HDDS-718. Introduce new SCM Commands to list and close Pipelines. Contributed by Lokesh Jain.
2018-11-19 22:59:30 +05:30
e7438a1b38
HDDS-849. Fix NPE in TestKeyValueHandler because of audit log write.
...
Contributed by Dinesh Chitlangia.
2018-11-19 22:47:43 +05:30
5a7ca6ac3e
HDDS-837. Persist originNodeId as part of .container file in datanode.
...
Contributed by Nanda kumar.
2018-11-19 14:39:55 +05:30
10cf5773ba
HDDS-845. Create a new raftClient instance for every watch request for Ratis. Contributed by Shashikant Banerjee.
2018-11-19 14:38:51 +05:30
cfb915f3df
HDDS-844. Add logic for pipeline teardown after timeout. Contributed by Lokesh Jain.
2018-11-19 12:11:05 +05:30
29374999b6
HDDS-120. Adding HDDS datanode Audit Log. Contributed by Dinesh Chitlangia.
2018-11-16 14:59:59 -08:00
3420ddd0f8
HDDS-840. [JDK11] Fix Javadoc errors in hadoop-hdds-client module. Contributed by Dinesh Chitlangia.
2018-11-16 10:13:41 -08:00
c4d9640028
HDDS-801. Quasi close the container when close is not executed via Ratis.
...
Contributed by Nanda kumar.
2018-11-16 23:11:33 +05:30
a16aa2f60b
HDDS-825. Code cleanup based on messages from ErrorProne.
...
Contributed by Anu Engineer.
2018-11-15 17:36:09 -08:00
fcd94eeab8
HDDS-842. [JDK11] Fix Javadoc errors in hadoop-hdds-common module. Contributed by Dinesh Chitlangia.
2018-11-15 14:59:31 -08:00
d8ec017a8d
HDDS-843. [JDK11] Fix Javadoc errors in hadoop-hdds-server-scm module. Contributed by Dinesh Chitlangia.
2018-11-15 14:54:41 -08:00
0a8b1efbfb
HDDS-827. TestStorageContainerManagerHttpServer should use dynamic port. Contributed by Sandeep Nemuri.
2018-11-15 14:23:24 +01:00
2718f7534d
HDDS-828. Fix deprecation log generated by getting value of the setting ozone.scm.heartbeat.rpc-timeout. Contributed by Yiqun Lin.
2018-11-15 14:04:55 +01:00
fb1e8bb0cc
HDDS-528. add cli command to checkChill mode status and exit chill mode. Contributed by chencan.
2018-11-15 13:59:56 +01:00
b12e69475b
HDDS-658. Implement s3 bucket list backend call and use it from rest endpoint. Contributed by Bharat Viswanadham.
2018-11-15 12:22:16 +01:00
9b01f039eb
HDDS-832. Docs folder is missing from the Ozone distribution package. Contributed by Elek, Marton.
2018-11-15 11:08:48 +01:00
b57cc73f83
HDDS-774. Remove OpenContainerBlockMap from datanode. Contributed by Shashikant Banerjee.
2018-11-14 20:05:56 +05:30
a948281706
HDDS-834. Datanode goes OOM based because of segment size. Contributed by Mukul Kumar Singh.
2018-11-14 15:53:22 +05:30
671fd6524b
HDDS-675. Add blocking buffer and use watchApi for flush/close in OzoneClient. Contributed by Shashikant Banerjee.
2018-11-13 23:39:14 +05:30
f944f33832
HDDS-709. Modify Close Container handling sequence on datanodes. Contributed by Shashikant Banerjee.
2018-11-12 14:08:39 -08:00
18fe65d756
HDDS-576. Move ContainerWithPipeline creation to RPC endpoint.
...
Contributed by Nanda kumar.
2018-11-12 23:33:11 +05:30
298d2502b0
HDDS-826. Update Ratis to 0.3.0-6f3419a-SNAPSHOT.
2018-11-09 18:35:40 -08:00
9fe50b4991
HDDS-733. Create container if not exist, as part of chunk write.
...
Contributed by Lokesh Jain.
2018-11-10 00:08:17 +05:30
66bf62404a
HDDS-812. TestEndPoint#testCheckVersionResponse is failing. Contributed by Hanisha Koneru.
2018-11-08 17:52:09 -08:00
31614bcc7c
HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh.
2018-11-09 00:05:45 +05:30
9317a61f3c
HDDS-802. Container State Manager should get open pipelines for allocating container. Contributed by Lokesh Jain.
2018-11-08 23:41:43 +08:00
c80f753b0e
HDDS-737. Introduce Incremental Container Report.
...
Contributed by Nanda kumar.
2018-11-08 18:33:38 +05:30
addec29297
HDDS-809. Refactor SCMChillModeManager.
2018-11-07 13:54:08 +08:00
49412a1289
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
2018-11-06 21:26:43 +09:00
50f40e0536
HDDS-794. addendum patch to fix compilation failure. Contributed by Shashikant Banerjee.
2018-11-06 00:20:57 +05:30
5ddefdd507
HDDS-794. Add configs to set StateMachineData write timeout in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-11-05 10:41:28 -08:00
942693bddd
HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh.
2018-11-05 23:43:22 +05:30
c8ca1747c0
HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru.
2018-11-05 09:40:00 -08:00
15df2e7a75
HDDS-796. Fix failed test TestStorageContainerManagerHttpServer#testHttpPolicy.
2018-11-05 17:31:06 +08:00
d16d5f730e
HDDS-751. Replace usage of Guava Optional with Java Optional.
2018-11-02 10:50:32 +08:00
2e8ac14dcb
HDDS-786. Fix the findbugs for SCMClientProtocolServer#getContainerWithPipeline.
2018-11-01 14:10:17 +08:00
b13c56742a
HDDS-697. update and validate the BCSID for PutSmallFile/GetSmallFile command. Contributed by Shashikant Banerjee.
2018-11-01 10:21:39 +05:30
08bb0362e0
HDDS-759. Create config settings for SCM and OM DB directories. Contributed by Arpit Agarwal.
2018-10-31 11:23:15 -07:00
e4f22b08e0
HDDS-755. ContainerInfo and ContainerReplica protobuf changes.
...
Contributed by Nanda kumar.
2018-10-31 10:29:35 +05:30
773f0d1519
HDDS-754. VolumeInfo#getScmUsed throws NPE.
...
Contributed by Hanisha Koneru.
2018-10-30 19:17:57 -07:00
e33b61f335
HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
...
Contributed by Mukul Kumar Singh.
2018-10-30 19:16:52 -07:00
7757331dbc
HDDS-749. Restructure BlockId class in Ozone. Contributed by Shashikant Banerjee.
2018-10-30 14:15:27 +05:30
496f0ffe90
HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal.
2018-10-29 17:14:18 -07:00
a58048e8d5
HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi.
2018-10-29 09:35:18 -07:00
902345de66
HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
...
Contributed by Mukul Kumar Singh.
2018-10-29 19:53:52 +05:30
2fa01f823c
HDDS-744. Fix ASF license warning in PipelineNotFoundException class.
...
Contributed by Lokesh Jain.
2018-10-27 16:51:08 +05:30
dce4ebe814
HDDS-694. Plugin new Pipeline management code in SCM.
...
Contributed by Lokesh Jain.
2018-10-26 17:55:04 +05:30
38a65e3b7c
HDDS-682. Unified o3 address parsing for ozonen sh. Contributed by Elek, Marton.
2018-10-25 17:04:16 -07:00
a4b9b7c130
HDDS-702:Used fixed/external version from hadoop jars in hdds/ozone projects. Contributed by Elek Marton.
2018-10-25 16:26:48 -07:00
244afaba4a
HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
2018-10-24 16:17:05 -07:00
0891cdda79
HDDS-716. Update ozone to latest ratis snapshot build(0.3.0-aa38160-SNAPSHOT). Contributed by Mukul Kumar Singh.
2018-10-24 16:05:08 +05:30
b61846392e
HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee.
2018-10-23 16:52:17 +05:30
e3cca12048
HDDS-676. Enable Read from open Containers via Standalone Protocol.
...
Contributed by Shashikant Banerjee.
2018-10-22 15:57:01 -07:00
82919a1e7a
HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh.
2018-10-22 19:59:35 +05:30
c696419f3e
Revert "HDDS-705. OS3Exception resource name should be the actual resource name."
...
This reverts commit 977c6f6470
2018-10-22 15:37:40 +05:30
7db3bb3ac1
HDDS-544. Unconditional wait findbug warning from ReplicationSupervisor.
...
Contributed by Arpit Agarwal.
2018-10-21 23:18:38 -07:00
c9077a9f5a
HDDS-707. Allow registering MBeans without additional jmx properties.
...
Contributed by Arpit Agarwal.
2018-10-21 22:50:28 -07:00
977c6f6470
HDDS-705. OS3Exception resource name should be the actual resource name.
...
Contributed by Bharat Viswanadham.
2018-10-21 22:49:16 -07:00
dc27408043
HDDS-612. Even after setting hdds.scm.chillmode.enabled to false, SCM allocateblock fails with ChillModePrecheck exception. Contributed by Hanisha Koneru.
2018-10-19 11:36:28 -07:00
d93d515af5
HDDS-651. Rename o3 to o3fs for Filesystem.
2018-10-17 14:19:17 -07:00
d54f5598f4
HDDS-661. When a volume fails in datanode, VersionEndpointTask#call ends up in dead lock. Contributed by Hanisha Koneru.
2018-10-17 18:44:05 +05:30
50715c0699
HDDS-662. Introduce ContainerReplicaState in StorageContainerManager. Contributed by Nanda kumar.
2018-10-17 17:45:35 +05:30
a9a63ae4a8
HDDS-527. Show SCM chill mode status in SCM UI. Contributed by Yiqun Lin.
2018-10-17 12:54:01 +02:00
64a43c92c2
HDDS-656. Add logic for pipeline report and action processing in new pipeline code. Contributed by Lokesh Jain.
2018-10-17 13:57:38 +05:30
5f0b43fa93
HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton.
2018-10-16 10:40:00 -07:00
53e5173bd1
HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh.
2018-10-16 10:34:51 -07:00
2614078b21
HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
2018-10-15 16:45:08 -07:00
e13a38f4bc
HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee.
2018-10-15 11:52:38 -07:00
603649d3a9
HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee.
2018-10-13 19:15:01 -07:00
5209c7503b
HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee.
2018-10-13 12:15:42 -07:00
22f37af935
Revert "HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee."
...
This reverts commit 0473b68000
2018-10-13 12:14:39 -07:00
0473b68000
HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee.
2018-10-13 12:12:08 -07:00
9227f3d224
HDDS-653. TestMetadataStore#testIterator fails on Windows.
...
Contributed by Yiqun Lin.
2018-10-13 10:41:06 -07:00
5c8e023ba3
HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
2018-10-13 03:22:20 +05:30
3a684a2b23
HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham.
2018-10-12 14:44:51 -07:00
02e1ef5e07
HDDS-624.PutBlock fails with Unexpected Storage Container Exception.
...
Contributed by Arpit Agarwal.
2018-10-12 14:22:46 -07:00
e12edb3d8f
HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
2018-10-12 10:36:57 -07:00
74db993a61
HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru.
2018-10-11 21:03:01 -07:00
fb18cc5eaa
HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal
2018-10-12 10:37:37 +08:00
50552479c4
HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal.
2018-10-11 17:21:27 -07:00
0bc6d0484a
HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-10-11 17:12:47 -07:00
eb34b5f8af
HDDS-601. On restart, SCM throws 'No such datanode' exception.
2018-10-11 13:20:32 -07:00
2bd000c851
HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia.
2018-10-10 17:37:20 -07:00
90552b1ea8
HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh.
2018-10-10 20:50:49 +05:30
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2018-10-10 10:16:57 +09:00
6a39739316
HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari.
2018-10-09 15:21:19 -07:00
600438bcde
HDDS-602. Bump Ozone version to 0.4.0-SNAPSHOT after ozone-0.3 branch cut.
2018-10-09 19:04:25 +02:00
9e9915ddab
HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri.
2018-10-09 18:23:05 +05:30
7367ff333b
HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee.
2018-10-09 18:07:01 +05:30
cdf5d58364
HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar.
2018-10-05 14:07:16 -07:00
f362037527
HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh.
2018-10-05 16:47:01 +05:30
2a07617f85
HDDS-354. VolumeInfo.getScmUsed throws NPE. Contributed by Hanisha Koneru.
2018-10-04 21:46:17 -07:00
e6b77ad65f
HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1.
...
Contributed by Anu Engineer.
2018-10-04 21:40:13 -07:00
095c269620
HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar.
2018-10-03 16:00:39 +05:30
7b374482d2
HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar.
2018-10-03 15:15:43 +05:30
58fa96b697
Changed version in trunk to 3.3.0-SNAPSHOT.
2018-10-02 22:41:41 +05:30
a39296260f
HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain.
2018-10-02 19:47:44 +05:30
4eff629ab3
HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham
2018-10-01 13:16:08 -07:00
cc80ac2315
HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar.
2018-10-01 11:21:26 -07:00
f7ff8c051e
HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain.
2018-10-01 13:50:17 +05:30
0da03f8b14
HDDS-391. Simplify Audit Framework to make audit logging easier to use.
...
Contributed by Dinesh Chitlangia.
2018-09-28 14:00:24 -07:00
3c798c1e3c
HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge.
2018-09-28 10:33:17 -07:00
2a5d4315bf
HDDS-551. Fix the close container status check in CloseContainerCommandHandler. Contributed by Shashikant Banerjee.
2018-09-27 16:03:49 -07:00
184544eff8
HDDS-401. Update storage statistics on dead node. Contributed by LiXin Ge.
2018-09-27 09:56:30 -07:00
3f6195045e
HDDS-554. In XceiverClientSpi, implement sendCommand(..) using sendCommandAsync(..). Contributed by Tsz Wo Nicholas Sze.
2018-09-26 09:16:23 +05:30
3928af983e
HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar.
2018-09-25 13:08:44 -07:00
9c3fbbc4f6
HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton.
2018-09-24 22:10:16 -07:00
62f817d32e
HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton.
2018-09-24 10:10:11 -07:00
524f7cd354
HDDS-514. Clean Unregister JMX upon SCMConnectionManager#close.
...
Contributed by Xiaoyu Yao.
2018-09-20 12:21:34 -07:00
096a716080
HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis.
...
Contributed Dinesh Chitlangia.
2018-09-20 11:51:49 -07:00
f6bb1ca3c1
HDDS-513. Check if the EventQueue is not closed before executing handlers. Contributed by Nanda Kumar.
2018-09-19 14:35:29 -07:00
236d16e3a5
HDDS-507. EventQueue should be shutdown on SCM shutdown. Contributed by Xiaoyu Yao.
2018-09-20 01:22:18 +05:30
042bf74d5e
HDDS-460. Replication manager failed to import container data. Contributed by Elek, Marton.
2018-09-19 23:51:50 +05:30
61a4b07bda
HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee.
2018-09-19 21:43:44 +05:30
b3c5221f30
HDDS-458. numberofKeys is 0 for all containers even when keys are present. Contributed by LiXin Ge.
...
(cherry picked from commit 8600b049af
2018-09-19 17:11:05 +02:00
15ed74fa24
HDDS-502. Exception in OM startup when running unit tests. Contributed by Arpit Agarwal.
2018-09-19 19:46:25 +05:30
c0956ee2a8
HDDS-476. Add Pipeline reports to make pipeline active on SCM restart.
...
Contributed by Mukul Kumar Singh.
2018-09-19 18:52:08 +05:30
Xiaoyu Yao
nilotpalnandi
Shashikant Banerjee
Arpit Agarwal
Sandeep Nemuri
Bharat Viswanadham
Yiqun Lin
Ajay Kumar
Vivek Ratnavel Subramanian
Arpit Agarwal
Mukul Kumar Singh
Ajay Yadav
Sammi Chen
Elek, Márton
Márton Elek
Aravindan Vijayan
Lokesh Jain
Hanisha Koneru
Hanisha Koneru
Anu Engineer
Nanda kumar
avijayanhwx
Akira Ajisaka
Nanda kumar
Ajay Kumar
Jitendra Pandey
Giovanni Matteo Fumarola
Tsz Wo Nicholas Sze
Sunil G