Commit Graph

185 Commits

Author SHA1 Message Date
Shashikant Banerjee 39d088bc2c HDDS-771. ChunkGroupOutputStream stream entries need to be properly updated on closed container exception. Contributed by Lokesh Jain. 2018-11-01 15:50:15 +05:30
Anu Engineer 382b73a109 HDDS-754. VolumeInfo#getScmUsed throws NPE.
Contributed by Hanisha Koneru.

(cherry picked from commit 773f0d1519)
2018-10-30 19:26:35 -07:00
Anu Engineer 9cc2ce1645 HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
Contributed by Mukul Kumar Singh.
2018-10-30 19:25:13 -07:00
Nanda kumar 38f96c5f72 HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
Contributed by Mukul Kumar Singh.
2018-10-30 00:57:13 +05:30
Anu Engineer e0d0ef58db HDDS-568. ozone sh volume info, update, delete operations fail when volume name is not prefixed by /.
Contributed by Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Arpit Agarwal 2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
(cherry picked from commit 244afaba4a)
2018-10-24 16:17:14 -07:00
Shashikant Banerjee 27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee."
This reverts commit a619d120a6.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
2018-10-24 15:05:50 +05:30
Shashikant Banerjee 3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee 575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee."
This reverts commit a492edee4b.
The commit msg is wrong.
2018-10-23 19:14:18 +05:30
Shashikant Banerjee a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Shashikant Banerjee 0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee.
(cherry picked from commit b61846392e)
2018-10-23 17:01:24 +05:30
Bharat Viswanadham 3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 4c4364ddd0)
2018-10-17 16:47:11 -07:00
Arpit Agarwal 1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton.
(cherry picked from commit 5f0b43fa93)
2018-10-16 10:40:07 -07:00
Jitendra Pandey e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Arpit Agarwal f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia.
(cherry picked from commit 0bf8a110a5)
2018-10-15 19:30:58 -07:00
Arpit Agarwal 15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
(cherry picked from commit 2614078b21)
2018-10-15 16:45:16 -07:00
Jitendra Pandey b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey 0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
(cherry picked from commit 5c8e023ba3)
2018-10-13 03:23:53 +05:30
Bharat Viswanadham 252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 8ae8a5004f)
2018-10-12 14:00:25 -07:00
Xiaoyu Yao 2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh.
(cherry picked from commit 07d55292dc)
2018-10-12 13:26:29 -07:00
Xiaoyu Yao 4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
(cherry picked from commit e12edb3d8f)
2018-10-12 13:26:29 -07:00
Anu Engineer 7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2.
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48ced)
2018-10-12 11:18:10 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Arpit Agarwal d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari.
(cherry picked from commit 03d66b1f5d)
2018-10-09 11:05:23 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee.
(cherry picked from commit 7367ff333b)
2018-10-09 22:31:19 +05:30
Bharat Viswanadham 7fb91b8a53 HDDS-565. TestContainerPersistence fails regularly in Jenkins. Contributed by Dinesh Chitlangia. 2018-10-04 21:27:12 -07:00
Nanda kumar 095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar 7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Nanda kumar a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Bharat Viswanadham 4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Hanisha Koneru 72891fc9be HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. 2018-09-28 11:24:42 -07:00
Ajay Kumar 3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham 9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Anu Engineer 096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis.
Contributed Dinesh Chitlangia.
2018-09-20 11:51:49 -07:00
Anu Engineer 98c9bc4aa0 HDDS-509. TestStorageContainerManager is flaky.
Contributed by Xiaoyu Yao and Ajay Kumar.
2018-09-19 13:03:19 -07:00
Nanda kumar 61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart.
Contributed by Mukul Kumar Singh.
2018-09-19 18:52:08 +05:30
Xiaoyu Yao 3929653707 HDDS-488. Handle chill mode exception from SCM in OzoneManager. Contributed by Ajay Kumar. 2018-09-18 20:05:25 -07:00
Arpit Agarwal 17f5651a51 HDDS-503. Suppress ShellBasedUnixGroupsMapping exception in tests. Contributed by Arpit Agarwal. 2018-09-18 16:06:21 -07:00
Arpit Agarwal 7ff00f5587 HDDS-500. TestErrorCode.java has wrong package name. Contributed by Anu Engineer. 2018-09-18 15:52:00 -07:00
Xiaoyu Yao 295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer f938925bde HDDS-464. Fix TestCloseContainerHandlingByClient.
Contributed by Lokesh Jain.
2018-09-18 10:45:51 -07:00
Nanda kumar 846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Arpit Agarwal 82fbbd546c HDDS-469. Rename 'ozone oz' to 'ozone sh'. Contributed by Arpit Agarwal. 2018-09-15 22:12:47 -07:00
Márton Elek 985f3bf3fb HDDS-409. Ozone acceptance-test and integration-test packages have undefined hadoop component. Contributed by Dinesh Chitlangia. 2018-09-15 13:21:32 +02:00
Xiaoyu Yao 6f037468bc HDDS-419. ChunkInputStream bulk read api does not read from all the chunks. Contributed by Lokesh Jain and Mukul Kumar. 2018-09-14 13:45:38 -07:00