Commit Graph

114 Commits

Author SHA1 Message Date
Hrishikesh Gadre f347c348d8 Add support for checksum verification in data scrubber
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-04 20:31:49 -07:00
supratimdeka 1407414a52 HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka (#1323) 2019-08-28 10:05:20 -07:00
Anu Engineer dc72782008 HDDS-738. Removing REST protocol support from OzoneClient.
Contributed by Elek, Marton.
2019-08-28 09:53:31 -07:00
Shashikant Banerjee 66cfa482c4 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee(#1226). 2019-08-27 23:38:43 +05:30
Shashikant Banerjee ce8eb1283a Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee."
This reverts commit 62445021d5 as it has unintended changes in DirectoryWithSnapshotFeature class..
2019-08-27 23:23:44 +05:30
Shashikant Banerjee 62445021d5 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee. 2019-08-20 14:37:01 +05:30
Bharat Viswanadham aa5f445fb9
HDDS-1863. Freon RandomKeyGenerator even if keySize is set to 0, it returns some random data to key. (#1167) 2019-08-08 15:40:19 -07:00
HUAN-PING SU 38e6968647 HDDS-1919. Fix Javadoc in TestAuditParser (#1240) 2019-08-06 18:00:34 -07:00
Márton Elek c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 16:27:50 -07:00
Doroszlai, Attila 256fcc160e
HDDS-1785. OOM error in Freon due to the concurrency handling
Closes #1085
2019-07-17 15:02:15 +02:00
Ajay Yadav cdb20adfcc HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973) 2019-07-10 11:03:58 -07:00
dineshchitlangia 1f75660350 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) 2019-07-01 08:58:47 -07:00
Xudong Cao 3d020e914f HDDS-1532. Improve the concurrent testing framework of Freon. (#957) 2019-06-17 11:09:05 -07:00
S O'Donnell 22b36dd311
HDDS-1660. Use Picocli for Ozone Manager
Closes #925
2019-06-17 14:13:50 +02:00
Xiaoyu Yao 76c0183ae3 HDDS-1652. HddsDispatcher should not shutdown volumeSet. Contributed by Xiaoyu Yao. (#916) 2019-06-06 23:47:59 +05:30
Xudong Cao 9ad7cad205 HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. Contributed by Xudong Cao. (#830) 2019-05-29 15:57:48 -07:00
Mukul Kumar Singh 72dd79015a HDDS-1534. freon should return non-zero exit code on failure. Contributed by Nilotpal Nandi. 2019-05-28 07:52:56 +05:30
Ajay Yadav ef1cc725b8
HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. (#828) 2019-05-21 15:53:40 -07:00
Kitti Nanasi 3f787cd506
HDDS-1192. Support -conf command line argument in GenericCli
Closes #713
2019-04-24 15:34:49 +02:00
Arpit Agarwal ebbda181e4
HDDS-1198. Rename chill mode to safe mode. Contributed by Siddharth Wagle. (#737) 2019-04-13 07:27:03 -07:00
Shashikant Banerjee 2d4f6b6daa HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee. 2019-04-09 10:27:58 +05:30
Lokesh Jain 0d62753da9 HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 16:30:06 +05:30
Bharat Viswanadham 341c076f05 HDDS-1196. Add a ReplicationStartTimer class. (#567) 2019-03-08 20:55:33 +05:30
Anu Engineer 7fd890116a HDDS-1171. Add benchmark for OM and OM client in Genesis.
Contributed by Lokesh Jain.
2019-03-05 11:31:09 -08:00
Márton Elek 02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-05 16:35:04 +01:00
Shashikant Banerjee de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Anu Engineer a5a751b418 HDDS-1174. Freon tests are failing with null pointer exception.
Contributed by Shashikant Banerjee.
2019-02-26 14:33:54 -08:00
Márton Elek 585cebf26b
HDDS-1104. Use picocli with Ozone genesis tool. Contributed by Lokesh Jain. 2019-02-26 16:11:55 +01:00
Anu Engineer 3aa0a57ea0 HDDS-1152. Add trace information for the client side of the datanode writes
Contributed by Elek, Marton.
2019-02-24 15:20:34 -08:00
Anu Engineer 5c1f946071 HDDS-1145. Add optional web server to the Ozone freon test tool.
Contributed by Elek, Marton.
2019-02-24 15:04:25 -08:00
Elek, Márton 28d0bf9f67 HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton. 2019-02-21 13:57:05 -08:00
Yiqun Lin 1d30fd94c6 HDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain. 2019-02-20 10:45:51 +08:00
Anu Engineer 75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer 5cb67cf044 HDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
Contributed by Lokesh Jain.
2019-02-14 23:24:58 -08:00
Yiqun Lin 084b6a6751 HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham. 2019-02-15 14:23:34 +08:00
Yiqun Lin 492e49e7ca Revert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham."
This reverts commit 5656409327.
2019-02-15 14:21:29 +08:00
Yiqun Lin 5656409327 HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham. 2019-02-15 14:07:15 +08:00
Anu Engineer 6c8ffdb958 HDDS-1100. fix asf license errors in newly added files by HDDS-936.
Contributed by  Dinesh Chitlangia.
2019-02-14 17:42:59 -08:00
Jitendra Pandey fa067aa157 HDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla 2019-02-13 15:43:14 -08:00
Nanda kumar a536eb5c41 HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
Márton Elek e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Nanda kumar 0c1bc4dcee HDDS-981. Block allocation should involve pipeline selection and then container selection.
Contributed by Lokesh Jain.
2019-02-08 15:44:41 +05:30
Xiaoyu Yao 9fc7df8afb HDDS-793. Support custom key/value annotations on volume/bucket/key. Contributed by Elek, Marton. 2019-01-24 23:24:09 -08:00
Nanda kumar c6d901af77 HDDS-1006. AuditParser assumes incorrect log format.
Contributed by Dinesh Chitlangia.
2019-01-25 12:11:58 +05:30
Márton Elek 32cf0412ce HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton. 2019-01-08 22:27:19 +01:00
Anu Engineer 06279ecc55 HDDS-946. AuditParser - insert audit to database in batches.
contributed by Dinesh Chitlangia.
2019-01-07 11:19:42 -08:00
Anu Engineer 996ab4874a HDDS-393. Audit Parser tool for processing ozone audit logs.
Contributed by Dinesh Chitlangia.
2019-01-02 11:52:12 -08:00
Nanda kumar ea621fa087 HDDS-934. Freon run hung on non-functional pipeline.
Contributed by Nanda kumar.
2018-12-20 11:13:15 +05:30
Shashikant Banerjee 5a3c7714c4 HDDS-887. Add DispatcherContext info to Dispatcher from containerStateMachine. Contributed by Shashikant Banerjee. 2018-12-02 08:00:35 +05:30
Shashikant Banerjee c8b3dfa625 HDDS-860. Fix TestDataValidate unit tests. Contributed by Shashikant Banerjee. 2018-11-21 11:28:20 +05:30