Commit Graph

89 Commits

Author SHA1 Message Date
Anu Engineer 9c238ffc30 HDDS-432. Replication of closed containers is not working.
Contributed by Elek, Marton.
2018-09-11 17:00:04 -07:00
Anu Engineer 8ffbbf51c9 HDDS-431. LeaseManager of CommandWatcher is not started.
Contributed by Elek, Marton.
2018-09-11 10:44:47 -07:00
Anu Engineer 7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution.
Contributed by Elek, Marton.
2018-09-11 10:19:50 -07:00
Hanisha Koneru ab90248b30 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 11:20:25 -07:00
Anu Engineer ff64d35716 HDDS-351. Add chill mode state to SCM.
Contributed by Ajay Kumar.
2018-09-07 10:54:35 -07:00
Márton Elek 94ed5cffd7 HDDS-214. Bump ozone/hdds version after the release branch cut 2018-09-07 17:45:26 +02:00
Tsz Wo Nicholas Sze b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Xiaoyu Yao 8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Xiaoyu Yao 85c3fe341a HDDS-268. Add SCM close container watcher. Contributed by Ajay Kumar. 2018-09-04 22:56:57 -07:00
Hanisha Koneru 9964e33e8d HDDS-369. Remove the containers of a dead node from the container state map. Contributed by Elek, Marton 2018-09-04 14:57:54 -07:00
Nanda kumar 567b5558d5 HDDS-343. Containers are stuck in closing state in scm. Contributed by Elek, Marton. 2018-09-03 20:14:45 +05:30
Anu Engineer c5629d546d HDDS-382. Remove RatisTestHelper#RatisTestSuite constructor argument and fix checkstyle in ContainerTestHelper, GenericTestUtils
Contributed by Nandakumar.
2018-08-28 14:06:19 -07:00
Xiaoyu Yao c9b63956d9 HDSS-375. ContainerReportHandler should not send replication events for open containers. Contributed by Ajay Kumar. 2018-08-27 10:40:33 -07:00
Márton Elek a5eba25506 HDDS-364. Update open container replica information in SCM during DN register. Contributed by Ajay Kumar. 2018-08-24 22:42:51 +02:00
Márton Elek 138b0c1443 HDDS-363. Faster datanode registration during the first startup. Contributed by Elek, Marton. 2018-08-24 15:36:10 +02:00
Márton Elek 55b6931059 HDDS-317. Use new StorageSize API for reading ozone.scm.container.size.gb. Contributed by Junjie Chen. 2018-08-24 13:56:30 +02:00
Xiaoyu Yao 4c25f37c6c HDDS-350. ContainerMapping#flushContainerInfo doesn't set containerId. Contributed by Ajay Kumar. 2018-08-22 10:54:10 -07:00
Mukul Kumar Singh e3d73bbc24 HDDS-353. Multiple delete Blocks tests are failing consistently. Contributed by Lokesh Jain. 2018-08-20 13:37:58 +05:30
Xiaoyu Yao 75fc51588d HDDS-298. Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers. Contributed by Ajay Kumar. 2018-08-14 14:57:46 -07:00
Xiaoyu Yao b4031a8f1b HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh. 2018-08-13 12:47:49 -07:00
Mukul Kumar Singh a8dae0047c HDDS-308. SCM should identify a container with pending deletes using container reports. Contributed by Lokesh Jain. 2018-08-13 12:47:52 +05:30
Xiaoyu Yao f5dbbfe2e9 HDDS-245. Handle ContainerReports in the SCM. Contributed by Elek Marton. 2018-08-09 16:55:39 -07:00
Mukul Kumar Singh 7c368575a3 HDDS-304. Process ContainerAction from datanode heartbeat in SCM. Contributed by Nanda Kumar. 2018-08-02 17:34:17 +05:30
Mukul Kumar Singh b28bdc7e8b HDDS-279. DeleteBlocks command should not be sent for open containers. Contributed by Lokesh Jain. 2018-07-31 19:50:40 +05:30
Nanda kumar 3517a47897 HDDS-287. Add Close ContainerAction to Datanode#StateContext when the container gets full. Contributed by Nanda kumar. 2018-07-30 21:18:42 +05:30
Mukul Kumar Singh feb795b58d HDDS-273. DeleteLog entries should be purged only after corresponding DNs commit the transaction. Contributed by Lokesh Jain. 2018-07-29 01:02:24 +05:30
Xiaoyu Yao fd31cb6cfe HDDS-277. PipelineStateMachine should handle closure of pipelines in SCM. Contributed by Mukul Kumar Singh. 2018-07-26 13:15:55 -07:00
Nanda kumar a19229594e HDDS-201. Add name for LeaseManager. Contributed by Sandeep Nemuri. 2018-07-26 19:00:23 +05:30
Xiaoyu Yao 2ced3efe94 HDDS-258. Helper methods to generate NodeReport and ContainerReport for testing. Contributed by Nanda Kumar. 2018-07-23 22:04:20 -07:00
Xiaoyu Yao 3a9e25edf5 HDDS-199. Implement ReplicationManager to handle underreplication of closed containers. Contributed by Elek Marton. 2018-07-23 10:28:33 -07:00
Nanda kumar 9fa9e301b0 HDDS-249. Fail if multiple SCM IDs on the DataNode and add SCM ID check after version request. Contributed by Bharat Viswanadham. 2018-07-21 18:46:31 +05:30
Xiaoyu Yao 9be25e3476 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 14:22:02 -07:00
Xiaoyu Yao d2acf8d560 Revert "HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh."
This reverts commit 6837121a43231f854b0b22ad20330012439313ce.(Mixed with HDDS-260)
2018-07-20 14:20:18 -07:00
Xiaoyu Yao 6837121a43 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 13:03:35 -07:00
Xiaoyu Yao 89a0f80741 HDDS-256. Adding CommandStatusReport Handler. Contributed by Ajay Kumar. 2018-07-20 11:07:09 -07:00
Xiaoyu Yao 68b57ad32c HDDS-259. Implement ContainerReportPublisher and NodeReportPublisher. Contributed by Nanda kumar. 2018-07-20 09:12:48 -07:00
Nanda kumar 1fe5b93843 HDDS-253. SCMBlockDeletingService should publish events for delete blocks to EventQueue. Contributed by Lokesh Jain. 2018-07-13 17:18:42 +05:30
Xiaoyu Yao 3f3f72221f HDDS-238. Add Node2Pipeline Map in SCM to track ratis/standalone pipelines. Contributed by Mukul Kumar Singh. 2018-07-12 22:14:03 -07:00
Anu Engineer f89e265905 HDDS-187. Command status publisher for datanode.
Contributed by Ajay Kumar.
2018-07-12 21:35:12 -07:00
Anu Engineer 556d9b36be HDDS-234. Add SCM node report handler.
Contributed by Ajay Kumar.
2018-07-12 12:09:31 -07:00
Anu Engineer 5ee90efed3 HDDS-228. Add the ReplicaMaps to ContainerStateManager.
Contributed by Ajay Kumar.
2018-07-12 10:43:24 -07:00
Anu Engineer 632aca5793 HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event
and corresponding event handlers in SCM.
Contributed by Nanda Kumar.

Recommitting after making sure that patch is clean.
2018-07-11 12:08:50 -07:00
Anu Engineer b56785873a Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event"
This reverts commit a47ec5dac4.
There was a spurious file in this commit. Revert to clean it.
2018-07-11 12:03:42 -07:00
Anu Engineer a47ec5dac4 HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event
and corresponding event handlers in SCM.
Contributed by Nanda Kumar.
2018-07-10 15:58:47 -07:00
Bharat Viswanadham c275a9a6a0 Merge trunk into HDDS-48 2018-07-09 12:13:03 -07:00
Anu Engineer 2f51cd60ef HDDS-217. Move all SCMEvents to a package.
Contributed by Anu Engineer.
2018-07-08 11:11:21 -07:00
Arpit Agarwal 061b168529 HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal. 2018-07-06 12:09:05 -07:00
Nanda kumar 71df8c27c9 HDDS-212. Introduce NodeStateManager to manage the state of Datanodes in SCM. Contributed by Nanda kumar. 2018-07-05 02:11:10 +05:30
Anu Engineer 7ca4f0cefa HDDS-175. Refactor ContainerInfo to remove Pipeline object from it.
Contributed by Ajay Kumar.
2018-07-03 14:11:52 -07:00
Bharat Viswanadham c104525168 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-28 14:28:23 -07:00