Commit Graph

142 Commits

Author SHA1 Message Date
Xiaoyu Yao 3a9e25edf5 HDDS-199. Implement ReplicationManager to handle underreplication of closed containers. Contributed by Elek Marton. 2018-07-23 10:28:33 -07:00
Mukul Kumar Singh bbe2f6225e HDDS-181. CloseContainer should commit all pending open Keys on a datanode. Contributed by Shashikant Banerjee. 2018-07-23 09:13:03 +05:30
Nanda kumar 9fa9e301b0 HDDS-249. Fail if multiple SCM IDs on the DataNode and add SCM ID check after version request. Contributed by Bharat Viswanadham. 2018-07-21 18:46:31 +05:30
Xiaoyu Yao 347c955013 HDDS-260. Support in Datanode for sending ContainerActions to SCM. Contributed by Nanda kumar. 2018-07-20 14:37:13 -07:00
Xiaoyu Yao 9be25e3476 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 14:22:02 -07:00
Xiaoyu Yao d2acf8d560 Revert "HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh."
This reverts commit 6837121a43231f854b0b22ad20330012439313ce.(Mixed with HDDS-260)
2018-07-20 14:20:18 -07:00
Xiaoyu Yao 6837121a43 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 13:03:35 -07:00
Bharat Viswanadham ba25d27ddb HDDS-257. Hook up VolumeSet#shutdown from HddsDispatcher#shutdown. Contributed by Hanisha Koneru 2018-07-20 12:41:52 -07:00
Hanisha Koneru de894d34f6 HDDS-250. Cleanup ContainerData. 2018-07-20 11:36:42 -07:00
Xiaoyu Yao 89a0f80741 HDDS-256. Adding CommandStatusReport Handler. Contributed by Ajay Kumar. 2018-07-20 11:07:09 -07:00
Xiaoyu Yao 68b57ad32c HDDS-259. Implement ContainerReportPublisher and NodeReportPublisher. Contributed by Nanda kumar. 2018-07-20 09:12:48 -07:00
Nanda kumar e9c44ecfc6 HDDS-269. Refactor IdentifiableEventPayload to use a long ID. Contributed by Ajay Kumar. 2018-07-20 21:39:45 +05:30
Xiaoyu Yao d5d444732b HDDS-241. Handle Volume in inconsistent state. Contributed by Hanisha Koneru. 2018-07-18 09:38:43 -07:00
Bharat Viswanadham 0927bc4f76 HDDS-251. Integrate BlockDeletingService in KeyValueHandler. Contributed by Lokesh Jain 2018-07-15 10:34:00 -07:00
Nanda kumar d18507209e HDDS-232. Parallel unit test execution for HDDS/Ozone. Contributed by Arpit Agarwal. 2018-07-13 19:50:52 +05:30
Nanda kumar 1fe5b93843 HDDS-253. SCMBlockDeletingService should publish events for delete blocks to EventQueue. Contributed by Lokesh Jain. 2018-07-13 17:18:42 +05:30
Xiaoyu Yao 3f3f72221f HDDS-238. Add Node2Pipeline Map in SCM to track ratis/standalone pipelines. Contributed by Mukul Kumar Singh. 2018-07-12 22:14:03 -07:00
Anu Engineer f89e265905 HDDS-187. Command status publisher for datanode.
Contributed by Ajay Kumar.
2018-07-12 21:35:12 -07:00
Anu Engineer 556d9b36be HDDS-234. Add SCM node report handler.
Contributed by Ajay Kumar.
2018-07-12 12:09:31 -07:00
Anu Engineer 5ee90efed3 HDDS-228. Add the ReplicaMaps to ContainerStateManager.
Contributed by Ajay Kumar.
2018-07-12 10:43:24 -07:00
Anu Engineer 632aca5793 HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event
and corresponding event handlers in SCM.
Contributed by Nanda Kumar.

Recommitting after making sure that patch is clean.
2018-07-11 12:08:50 -07:00
Anu Engineer b56785873a Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event"
This reverts commit a47ec5dac4.
There was a spurious file in this commit. Revert to clean it.
2018-07-11 12:03:42 -07:00
Anu Engineer a47ec5dac4 HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event
and corresponding event handlers in SCM.
Contributed by Nanda Kumar.
2018-07-10 15:58:47 -07:00
Arpit Agarwal 9bd5bef297 Merge remote-tracking branch 'apache/trunk' into HDDS-48 2018-07-09 13:22:58 -07:00
Anu Engineer 2403231c8c HDDS-240. Implement metrics for EventQueue.
Contributed by Elek, Marton.
2018-07-09 13:04:44 -07:00
Anu Engineer 3c0a66abe6 Revert "HDDS-224. Create metrics for Event Watcher."
This reverts commit cb5e225868.
The JIRA number is wrong, reverting to fix it.
2018-07-09 13:03:57 -07:00
Anu Engineer cb5e225868 HDDS-224. Create metrics for Event Watcher.
Contributed b Elek, Marton.
2018-07-09 13:02:40 -07:00
Bharat Viswanadham c275a9a6a0 Merge trunk into HDDS-48 2018-07-09 12:13:03 -07:00
Anu Engineer e12d93bfc1 HDDS-224. Create metrics for Event Watcher.
Contributed by Elek, Marton.
2018-07-09 12:10:12 -07:00
Hanisha Koneru 44e19fc7f7 HDDS-213. Single lock to synchronize KeyValueContainer#update. 2018-07-09 09:33:09 -07:00
Anu Engineer 790c563511 HDDS-235. Fix TestOzoneAuditLogger#verifyDefaultLogLevel.
Contributed by Xiaoyu Yao.
2018-07-08 11:27:54 -07:00
Anu Engineer 2f51cd60ef HDDS-217. Move all SCMEvents to a package.
Contributed by Anu Engineer.
2018-07-08 11:11:21 -07:00
Bharat Viswanadham cb9574a337 HDDS-237. Add updateDeleteTransactionId. Contributed by Bharat Viswanadham and Lokesh Jain 2018-07-06 16:26:40 -07:00
Bharat Viswanadham e899c4cc01 HDDS-211. Add a create container Lock. Contributed by Bharat Viswanadham 2018-07-06 15:02:40 -07:00
Arpit Agarwal 061b168529 HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal. 2018-07-06 12:09:05 -07:00
Bharat Viswanadham 7dcf5878a4 HDDS-204. Modify Integration tests for new ContainerIO classes. Contributed by Bharat Viswanadham 2018-07-06 11:01:33 -07:00
Bharat Viswanadham 2c2351e87b HDDS-182:CleanUp Reimplemented classes. Contributed by Hansiha Koneru 2018-07-05 15:23:39 -07:00
Bharat Viswanadham a404164939 HDDS-229:Remove singleton for Handler. Contributed by Bharat Viswanadham 2018-07-05 11:26:00 -07:00
Nanda kumar 71df8c27c9 HDDS-212. Introduce NodeStateManager to manage the state of Datanodes in SCM. Contributed by Nanda kumar. 2018-07-05 02:11:10 +05:30
Anu Engineer 7ca4f0cefa HDDS-175. Refactor ContainerInfo to remove Pipeline object from it.
Contributed by Ajay Kumar.
2018-07-03 14:11:52 -07:00
Anu Engineer c0ef7e7680 HDDS-198. Create AuditLogger mechanism to be used by OM, SCM and Datanode.
Contributed by Dinesh Chitlangia.
2018-07-03 11:39:50 -07:00
Hanisha Koneru e1f4b3b560 HDDS-176. Add keyCount and container maximum size to ContainerData. Contributed by Bharat Viswanadham. 2018-07-03 09:53:41 -07:00
Hanisha Koneru 44b091a8d7 HDDS-205. Add metrics to HddsDispatcher. Contributed by Bharat Viswanadham. 2018-07-03 09:50:25 -07:00
Bharat Viswanadham 23ebe0f4f0 HDDS-169:Add Volume IO Stats. Contributed by Bharat Viswanadham 2018-06-28 17:10:10 -07:00
Nanda kumar e4d7227aad HDDS-178: DN should update transactionId on block delete. Contributed by Lokesh Jain. 2018-06-29 04:37:16 +05:30
Bharat Viswanadham c104525168 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-28 14:28:23 -07:00
Bharat Viswanadham 52d1d9603e HDDS-183:Integrate Volumeset, ContainerSet and HddsDispatcher. Contributed by Bharat Viswanadham 2018-06-28 14:07:52 -07:00
Hanisha Koneru 13579f9296 HDDS-173. Refactor Dispatcher and implement Handler for new ContainerIO design. 2018-06-28 10:13:30 -07:00
Anu Engineer 85627e2cba HDDS-195. Create generic CommandWatcher utility.
Contributed by Elek, Marton.
2018-06-27 23:39:33 -07:00
Anu Engineer 8752a48564 HDDS-193. Make Datanode heartbeat dispatcher in SCM event based.
Contributed by Elek, Marton.
2018-06-27 14:18:25 -07:00