Commit Graph

129 Commits

Author SHA1 Message Date
Arpit Agarwal da32f6537b HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal.
(cherry picked from commit 496f0ffe90)
2018-10-29 17:14:34 -07:00
Arpit Agarwal 2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
(cherry picked from commit 244afaba4a)
2018-10-24 16:17:14 -07:00
Nanda kumar 346afb0a5c HDDS-695. Introduce new SCM Commands to list and close Pipelines.
Contributed by Nanda kumar.
2018-10-23 18:41:30 +05:30
Anu Engineer 2928f952f0 HDDS-707. Allow registering MBeans without additional jmx properties.
Contributed by Arpit Agarwal.

(cherry picked from commit c9077a9f5a)
2018-10-21 23:00:09 -07:00
Nandakumar eeb1d432a8 HDDS-687. Exception while loading containers during SCM startup. Contributed by Lokesh Jain. 2018-10-18 18:03:33 +05:30
Márton Elek b2ab592e0a HDDS-527. Show SCM chill mode status in SCM UI. Contributed by Yiqun Lin.
(cherry picked from commit a9a63ae4a8)
2018-10-17 13:01:27 +02:00
Arpit Agarwal 15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
(cherry picked from commit 2614078b21)
2018-10-15 16:45:16 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
(cherry picked from commit 5c8e023ba3)
2018-10-13 03:23:53 +05:30
Bharat Viswanadham 67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru.
(cherry picked from commit 74db993a61)
2018-10-11 21:04:19 -07:00
Hanisha Koneru 43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception.
(cherry picked from commit eb34b5f8af)
2018-10-11 13:48:02 -07:00
Nanda kumar 79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh.
(cherry picked from commit 90552b1ea8)
2018-10-10 20:51:23 +05:30
Bharat Viswanadham 056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari.
(cherry picked from commit 6a39739316)
2018-10-09 15:21:50 -07:00
Ajay Kumar cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Nanda kumar f362037527 HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh. 2018-10-05 16:47:01 +05:30
Nanda kumar 095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar 7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Nanda kumar a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Ajay Kumar cc80ac2315 HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar. 2018-10-01 11:21:26 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Ajay Kumar 3c798c1e3c HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. 2018-09-28 10:33:17 -07:00
Ajay Kumar 184544eff8 HDDS-401. Update storage statistics on dead node. Contributed by LiXin Ge. 2018-09-27 09:56:30 -07:00
Ajay Kumar 3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Nanda kumar 236d16e3a5 HDDS-507. EventQueue should be shutdown on SCM shutdown. Contributed by Xiaoyu Yao. 2018-09-20 01:22:18 +05:30
Nanda kumar 61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Márton Elek b3c5221f30 HDDS-458. numberofKeys is 0 for all containers even when keys are present. Contributed by LiXin Ge.
(cherry picked from commit 8600b049af)
2018-09-19 17:11:05 +02:00
Nanda kumar 15ed74fa24 HDDS-502. Exception in OM startup when running unit tests. Contributed by Arpit Agarwal. 2018-09-19 19:46:25 +05:30
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart.
Contributed by Mukul Kumar Singh.
2018-09-19 18:52:08 +05:30
Xiaoyu Yao e435e12f1f HDDS-506. Fields in AllocateScmBlockResponseProto should be optional. Contributed by Arpit Agarwal. 2018-09-18 23:21:29 -07:00
Xiaoyu Yao 295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer 23a6137a40 HDDS-475. Block Allocation returns same BlockID on different keys creation.
Contributed by Nanda Kumar.
2018-09-17 14:41:17 -07:00
Nanda kumar 846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Xiaoyu Yao 95231f1749 HDDS-362. Modify functions impacted by SCM chill mode in ScmBlockLocationProtocol. Contributed by Ajay Kumar. 2018-09-16 17:55:46 -07:00
Nanda kumar c9fa081897 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar. 2018-09-15 23:11:39 +05:30
Márton Elek a65c3ea91c HDDS-449. Add a NULL check to protect DeadNodeHandler#onMessage. Contributed by LiXin Ge. 2018-09-15 13:35:21 +02:00
Nanda kumar b0a659c8c0 HDDS-466. Handle null in argv of StorageContainerManager#createSCM. Contributed by Nanda kumar 2018-09-15 02:34:33 +05:30
Jitendra Pandey 446cb8301e HDDS-452. 'ozone scm' with incorrect argument first logs all the STARTUP_MSG. Contributed by Namit Maheshwari. 2018-09-14 11:39:36 -07:00
Anu Engineer 0c8a43b9ec HDDS-429. StorageContainerManager lock optimization.
Contributed by Nanda Kumar.
2018-09-14 10:08:06 -07:00
Mukul Kumar Singh c6e19db197 HDDS-420. putKey failing with KEY_ALLOCATION_ERROR. Contributed by Shashikant Banerjee. 2018-09-13 11:29:40 +05:30
Anu Engineer 64c7a12b57 HDDS-436. Allow SCM chill mode to be disabled by configuration.
Contributed by Ajay Kumar.
2018-09-12 11:40:24 -07:00
Anu Engineer 9c238ffc30 HDDS-432. Replication of closed containers is not working.
Contributed by Elek, Marton.
2018-09-11 17:00:04 -07:00
Anu Engineer 8ffbbf51c9 HDDS-431. LeaseManager of CommandWatcher is not started.
Contributed by Elek, Marton.
2018-09-11 10:44:47 -07:00
Anu Engineer 7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution.
Contributed by Elek, Marton.
2018-09-11 10:19:50 -07:00
Hanisha Koneru ab90248b30 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 11:20:25 -07:00
Anu Engineer ff64d35716 HDDS-351. Add chill mode state to SCM.
Contributed by Ajay Kumar.
2018-09-07 10:54:35 -07:00
Márton Elek 94ed5cffd7 HDDS-214. Bump ozone/hdds version after the release branch cut 2018-09-07 17:45:26 +02:00
Tsz Wo Nicholas Sze b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Xiaoyu Yao 8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Xiaoyu Yao 85c3fe341a HDDS-268. Add SCM close container watcher. Contributed by Ajay Kumar. 2018-09-04 22:56:57 -07:00
Hanisha Koneru 9964e33e8d HDDS-369. Remove the containers of a dead node from the container state map. Contributed by Elek, Marton 2018-09-04 14:57:54 -07:00