Commit Graph

234 Commits

Author SHA1 Message Date
Márton Elek d44b37d7ac HDDS-889. MultipartUpload: Support uploading a part file in ozone. Contributed by Bharat Viswanadham. 2018-12-12 14:16:21 +01:00
Márton Elek 17a8708039 HDDS-879. MultipartUpload: Add InitiateMultipartUpload in ozone. Contributed by Bharat Viswanadham. 2018-12-10 10:05:38 +01:00
Jitendra Pandey 1afba83f2c HDDS-870. Avoid creating block sized buffer in ChunkGroupOutputStream. Contributed by Shashikant Banerjee. 2018-12-08 09:23:10 -08:00
Anu Engineer 5e773efd78 HDDS-909 : Default implementation for Ozone acls.
Contributed by Ajay Kumar.
2018-12-07 23:20:19 -08:00
Hanisha Koneru 019836b113 HDDS-858. Start a Standalone Ratis Server on OM 2018-12-06 13:33:52 -08:00
Bharat Viswanadham 343aaea2d1 HDDS-864. Use strongly typed codec implementations for the tables of the OmMetadataManager. Contributed by Elek Marton. 2018-12-06 11:39:59 -08:00
Mukul Kumar Singh 7274115d57 HDDS-890. Handle OverlappingFileLockException during writeStateMachineData in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-12-04 20:12:35 +05:30
Bharat Viswanadham ef3b03b75a HDDS-885. Fix test failures due to ChecksumData. Contributed by Hanisha Koneru. 2018-12-03 10:52:49 -08:00
Yiqun Lin 3044b78bd0 HDDS-848. Create SCM metrics related to container state. Contributed by Bharat Viswanadham. 2018-12-03 17:16:34 +08:00
Shashikant Banerjee 8f3e12ff07 HDDS-882. Provide a config to optionally turn on/off the sync flag during chunk writes. Contributed by Shashikant Banerjee. 2018-12-02 08:06:24 +05:30
Shashikant Banerjee 5a3c7714c4 HDDS-887. Add DispatcherContext info to Dispatcher from containerStateMachine. Contributed by Shashikant Banerjee. 2018-12-02 08:00:35 +05:30
Bharat Viswanadham d15dc43659 HDDS-748. Use strongly typed metadata Table implementation. Contributed by Elek Marton. 2018-12-01 16:52:23 -08:00
Shashikant Banerjee 5e102f9aa5 HDDS-850. ReadStateMachineData hits OverlappingFileLockException in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-11-29 22:20:08 +05:30
Hanisha Koneru 64a4b6b08b HDDS-284. Checksum for ChunksData. 2018-11-28 10:53:12 -08:00
Shashikant Banerjee ee44b069c6 HDDS-866. Handle RaftRetryFailureException in OzoneClient. Contributed by Shashikant Banerjee. 2018-11-22 15:02:07 +05:30
Bharat Viswanadham c4d0ef6946 HDDS-816. Create OM metrics for bucket, volume, keys. Contributed by Bharat Viswanadham. 2018-11-21 10:35:39 -08:00
Shashikant Banerjee 14e1a0a3d6 HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee. 2018-11-21 10:51:50 +05:30
Shashikant Banerjee 1734ace35f Revert "HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee."
This reverts commit c74783036d.
2018-11-21 01:07:38 +05:30
Shashikant Banerjee c74783036d HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee. 2018-11-20 23:01:02 +05:30
Yiqun Lin d0cc679441 HDDS-817. Create SCM metrics for disk from node report. Contributed by Bharat Viswanadham. 2018-11-20 14:22:30 +08:00
Mukul Kumar Singh b5d7b292c9 HDDS-718. Introduce new SCM Commands to list and close Pipelines. Contributed by Lokesh Jain. 2018-11-19 22:59:30 +05:30
Nanda kumar 93666087bc HDDS-847. TestBlockDeletion is failing.
Contributed by Lokesh Jain.
2018-11-19 17:04:18 +05:30
Nanda kumar 5a7ca6ac3e HDDS-837. Persist originNodeId as part of .container file in datanode.
Contributed by Nanda kumar.
2018-11-19 14:39:55 +05:30
Mukul Kumar Singh cfb915f3df HDDS-844. Add logic for pipeline teardown after timeout. Contributed by Lokesh Jain. 2018-11-19 12:11:05 +05:30
Nanda kumar c4d9640028 HDDS-801. Quasi close the container when close is not executed via Ratis.
Contributed by Nanda kumar.
2018-11-16 23:11:33 +05:30
Anu Engineer a16aa2f60b HDDS-825. Code cleanup based on messages from ErrorProne.
Contributed by Anu Engineer.
2018-11-15 17:36:09 -08:00
Márton Elek b12e69475b HDDS-658. Implement s3 bucket list backend call and use it from rest endpoint. Contributed by Bharat Viswanadham. 2018-11-15 12:22:16 +01:00
Shashikant Banerjee b57cc73f83 HDDS-774. Remove OpenContainerBlockMap from datanode. Contributed by Shashikant Banerjee. 2018-11-14 20:05:56 +05:30
Shashikant Banerjee 671fd6524b HDDS-675. Add blocking buffer and use watchApi for flush/close in OzoneClient. Contributed by Shashikant Banerjee. 2018-11-13 23:39:14 +05:30
Yiqun Lin f8713f8ade HDDS-831. TestOzoneShell in integration-test is flaky. Contributed by Nanda kumar. 2018-11-13 10:38:27 +08:00
Jitendra Pandey f944f33832 HDDS-709. Modify Close Container handling sequence on datanodes. Contributed by Shashikant Banerjee. 2018-11-12 14:08:39 -08:00
Nanda kumar 18fe65d756 HDDS-576. Move ContainerWithPipeline creation to RPC endpoint.
Contributed by Nanda kumar.
2018-11-12 23:33:11 +05:30
Nanda kumar 9fe50b4991 HDDS-733. Create container if not exist, as part of chunk write.
Contributed by Lokesh Jain.
2018-11-10 00:08:17 +05:30
Yiqun Lin 9317a61f3c HDDS-802. Container State Manager should get open pipelines for allocating container. Contributed by Lokesh Jain. 2018-11-08 23:41:43 +08:00
Nanda kumar c80f753b0e HDDS-737. Introduce Incremental Container Report.
Contributed by Nanda kumar.
2018-11-08 18:33:38 +05:30
Yiqun Lin addec29297 HDDS-809. Refactor SCMChillModeManager. 2018-11-07 13:54:08 +08:00
Shashikant Banerjee 942693bddd HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh. 2018-11-05 23:43:22 +05:30
Arpit Agarwal c8ca1747c0 HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru. 2018-11-05 09:40:00 -08:00
Shashikant Banerjee e0ac3081e9 HDDS-771. ChunkGroupOutputStream stream entries need to be properly updated on closed container exception. Contributed by Lokesh Jain. 2018-11-01 15:43:48 +05:30
Shashikant Banerjee b13c56742a HDDS-697. update and validate the BCSID for PutSmallFile/GetSmallFile command. Contributed by Shashikant Banerjee. 2018-11-01 10:21:39 +05:30
Arpit Agarwal 08bb0362e0 HDDS-759. Create config settings for SCM and OM DB directories. Contributed by Arpit Agarwal. 2018-10-31 11:23:15 -07:00
Nanda kumar e4f22b08e0 HDDS-755. ContainerInfo and ContainerReplica protobuf changes.
Contributed by Nanda kumar.
2018-10-31 10:29:35 +05:30
Anu Engineer 773f0d1519 HDDS-754. VolumeInfo#getScmUsed throws NPE.
Contributed by Hanisha Koneru.
2018-10-30 19:17:57 -07:00
Anu Engineer e33b61f335 HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
Contributed by Mukul Kumar Singh.
2018-10-30 19:16:52 -07:00
Shashikant Banerjee 7757331dbc HDDS-749. Restructure BlockId class in Ozone. Contributed by Shashikant Banerjee. 2018-10-30 14:15:27 +05:30
Nanda kumar 902345de66 HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
Contributed by Mukul Kumar Singh.
2018-10-29 19:53:52 +05:30
Nanda kumar dce4ebe814 HDDS-694. Plugin new Pipeline management code in SCM.
Contributed by Lokesh Jain.
2018-10-26 17:55:04 +05:30
Hanisha Koneru 38a65e3b7c HDDS-682. Unified o3 address parsing for ozonen sh. Contributed by Elek, Marton. 2018-10-25 17:04:16 -07:00
Arpit Agarwal 244afaba4a HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal. 2018-10-24 16:17:05 -07:00
Shashikant Banerjee b61846392e HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 16:52:17 +05:30