Commit Graph

105 Commits

Author SHA1 Message Date
Shashikant Banerjee 2d4f6b6daa HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee. 2019-04-09 10:27:58 +05:30
Doroszlai, Attila 7dc0ecc446 [HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila.
This closes #659.
2019-03-29 09:01:56 -07:00
Márton Elek 3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
Closes #588
2019-03-14 12:01:25 +01:00
Lokesh Jain 0d62753da9 HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 16:30:06 +05:30
Bharat Viswanadham 341c076f05 HDDS-1196. Add a ReplicationStartTimer class. (#567) 2019-03-08 20:55:33 +05:30
Márton Elek 45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
Closes #490
2019-03-06 18:22:22 +01:00
Anu Engineer 7fd890116a HDDS-1171. Add benchmark for OM and OM client in Genesis.
Contributed by Lokesh Jain.
2019-03-05 11:31:09 -08:00
Márton Elek 02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-05 16:35:04 +01:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Anu Engineer a5a751b418 HDDS-1174. Freon tests are failing with null pointer exception.
Contributed by Shashikant Banerjee.
2019-02-26 14:33:54 -08:00
Márton Elek 585cebf26b
HDDS-1104. Use picocli with Ozone genesis tool. Contributed by Lokesh Jain. 2019-02-26 16:11:55 +01:00
Anu Engineer 3aa0a57ea0 HDDS-1152. Add trace information for the client side of the datanode writes
Contributed by Elek, Marton.
2019-02-24 15:20:34 -08:00
Anu Engineer 5c1f946071 HDDS-1145. Add optional web server to the Ozone freon test tool.
Contributed by Elek, Marton.
2019-02-24 15:04:25 -08:00
Elek, Márton 28d0bf9f67 HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton. 2019-02-21 13:57:05 -08:00
Yiqun Lin 1d30fd94c6 HDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain. 2019-02-20 10:45:51 +08:00
Anu Engineer 75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer 5cb67cf044 HDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
Contributed by Lokesh Jain.
2019-02-14 23:24:58 -08:00
Yiqun Lin 084b6a6751 HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham. 2019-02-15 14:23:34 +08:00
Yiqun Lin 492e49e7ca Revert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham."
This reverts commit 5656409327.
2019-02-15 14:21:29 +08:00
Yiqun Lin 5656409327 HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham. 2019-02-15 14:07:15 +08:00
Anu Engineer 6c8ffdb958 HDDS-1100. fix asf license errors in newly added files by HDDS-936.
Contributed by  Dinesh Chitlangia.
2019-02-14 17:42:59 -08:00
Jitendra Pandey fa067aa157 HDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla 2019-02-13 15:43:14 -08:00
Nanda kumar a536eb5c41 HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
Márton Elek e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Nanda kumar 0c1bc4dcee HDDS-981. Block allocation should involve pipeline selection and then container selection.
Contributed by Lokesh Jain.
2019-02-08 15:44:41 +05:30
Xiaoyu Yao 9fc7df8afb HDDS-793. Support custom key/value annotations on volume/bucket/key. Contributed by Elek, Marton. 2019-01-24 23:24:09 -08:00
Nanda kumar c6d901af77 HDDS-1006. AuditParser assumes incorrect log format.
Contributed by Dinesh Chitlangia.
2019-01-25 12:11:58 +05:30
Márton Elek 32cf0412ce HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton. 2019-01-08 22:27:19 +01:00
Anu Engineer 06279ecc55 HDDS-946. AuditParser - insert audit to database in batches.
contributed by Dinesh Chitlangia.
2019-01-07 11:19:42 -08:00
Anu Engineer 996ab4874a HDDS-393. Audit Parser tool for processing ozone audit logs.
Contributed by Dinesh Chitlangia.
2019-01-02 11:52:12 -08:00
Nanda kumar ea621fa087 HDDS-934. Freon run hung on non-functional pipeline.
Contributed by Nanda kumar.
2018-12-20 11:13:15 +05:30
Shashikant Banerjee 5a3c7714c4 HDDS-887. Add DispatcherContext info to Dispatcher from containerStateMachine. Contributed by Shashikant Banerjee. 2018-12-02 08:00:35 +05:30
Shashikant Banerjee c8b3dfa625 HDDS-860. Fix TestDataValidate unit tests. Contributed by Shashikant Banerjee. 2018-11-21 11:28:20 +05:30
Márton Elek 4ecdcc9620 HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath. 2018-11-20 15:24:20 +01:00
Márton Elek c946f1b121 Revert "HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath."
This reverts commit 2a7f485991.
2018-11-20 13:35:40 +01:00
Márton Elek 2a7f485991 HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath. 2018-11-20 12:57:27 +01:00
Mukul Kumar Singh cfb915f3df HDDS-844. Add logic for pipeline teardown after timeout. Contributed by Lokesh Jain. 2018-11-19 12:11:05 +05:30
Nanda kumar c4d9640028 HDDS-801. Quasi close the container when close is not executed via Ratis.
Contributed by Nanda kumar.
2018-11-16 23:11:33 +05:30
Anu Engineer a16aa2f60b HDDS-825. Code cleanup based on messages from ErrorProne.
Contributed by Anu Engineer.
2018-11-15 17:36:09 -08:00
Shashikant Banerjee 671fd6524b HDDS-675. Add blocking buffer and use watchApi for flush/close in OzoneClient. Contributed by Shashikant Banerjee. 2018-11-13 23:39:14 +05:30
Nanda kumar 18fe65d756 HDDS-576. Move ContainerWithPipeline creation to RPC endpoint.
Contributed by Nanda kumar.
2018-11-12 23:33:11 +05:30
Arpit Agarwal 08bb0362e0 HDDS-759. Create config settings for SCM and OM DB directories. Contributed by Arpit Agarwal. 2018-10-31 11:23:15 -07:00
Nanda kumar e4f22b08e0 HDDS-755. ContainerInfo and ContainerReplica protobuf changes.
Contributed by Nanda kumar.
2018-10-31 10:29:35 +05:30
Anu Engineer e33b61f335 HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
Contributed by Mukul Kumar Singh.
2018-10-30 19:16:52 -07:00
Nanda kumar 902345de66 HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
Contributed by Mukul Kumar Singh.
2018-10-29 19:53:52 +05:30
Nanda kumar dce4ebe814 HDDS-694. Plugin new Pipeline management code in SCM.
Contributed by Lokesh Jain.
2018-10-26 17:55:04 +05:30
Arpit Agarwal 244afaba4a HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal. 2018-10-24 16:17:05 -07:00
Mukul Kumar Singh 82919a1e7a HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh. 2018-10-22 19:59:35 +05:30
Arpit Agarwal c456d6b3a5 HDDS-621. ozone genconf improvements. Contributed by Dinesh Chitlangia. 2018-10-19 11:36:36 -07:00
Anu Engineer f8d61b9fc2 HDDS-690. Javadoc build fails in hadoop-ozone.
Contributed by Takanobu Asanuma.
2018-10-18 12:14:54 -07:00