Commit Graph

808 Commits

Author SHA1 Message Date
Siddharth c183bd8e20 HDDS-1527. HDDS Datanode start fails due to datanode.id file read error. Contributed by Siddharth Wagle.
This closes #822.
2019-05-16 15:13:10 -07:00
Elek, Márton b7de735159 HDDS-1522. Provide intellij runConfiguration for Ozone components. Contributed by Elek, Marton. 2019-05-16 16:38:50 +02:00
supratimdeka 9569015802 HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka (#812) 2019-05-15 10:26:01 -07:00
Lokesh Jain 6bcc1dce52
HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server (#813) 2019-05-14 14:49:50 +05:30
Hanisha Koneru 02c9efcb81
HDDS-1491. Ozone KeyInputStream seek() should not read the chunk file. (#795) 2019-05-13 20:49:52 -07:00
Vivek Ratnavel Subramanian b832e174b0 HDDS-1474. "ozone.scm.datanode.id" config should take path for a dir and not a file (#809) 2019-05-09 17:11:09 -07:00
Hanisha Koneru 2d31ccc1b3
Revert "HDDS-1474. ozone.scm.datanode.id config should take path for a dir (#792)" (#808)
This reverts commit 18cca583ac.
2019-05-09 11:18:46 -07:00
Vivek Ratnavel Subramanian 18cca583ac HDDS-1474. ozone.scm.datanode.id config should take path for a dir (#792) 2019-05-09 10:23:44 -07:00
avijayanhwx 25951255ce HDDS-1500. Allocate block failures in client should print exception trace. Contributed by Aravindan Vijayan (#801). 2019-05-09 15:38:49 +05:30
Siddharth c4be3ea276 HDDS-1489. Unnecessary log messages on console with Ozone shell. (#797) 2019-05-07 14:48:39 -07:00
avijayanhwx eb9c8900bc HDDS-1475 : Fix OzoneContainer start method. (#788) 2019-05-07 14:09:41 -07:00
Shashikant Banerjee 7f0e2c67e0 HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749). Contributed by Shashikant Banerjee 2019-05-08 01:00:10 +05:30
Shashikant Banerjee 01451a57de Revert "HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749)"
This reverts commit d525633619.
2019-05-08 00:49:15 +05:30
bshashikant d525633619
HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749)
HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749).
2019-05-08 00:38:53 +05:30
Márton Elek 1a696cc761
HDDS-1424. Support multi-container robot test execution
Closes #726
2019-05-07 17:48:10 +02:00
Márton Elek fb7c1cad0e
Revert "HDDS-1384. TestBlockOutputStreamWithFailures is failing"
This reverts commit dead9b4049.
2019-05-06 20:17:00 +02:00
Siddharth 1d70c8ca0f HDDS-1464. Client should have different retry policies for different exceptions. (#785) 2019-05-05 09:21:15 -07:00
avijayanhwx f194540520 HDDS-1448 : RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation. (#786) 2019-05-04 00:19:00 +05:30
Siddharth 1df679985b HDDS-1473. DataNode ID file should be human readable. (#781) 2019-05-02 13:59:14 -07:00
Bharat Viswanadham 4605db369e
HDDS-1482. Use strongly typed codec implementations for the S3Table
Closes #789
2019-05-02 13:56:30 +02:00
Márton Elek e2f0f72677
HDDS-1469. Generate default configuration fragments based on annotations
Closes #773
2019-05-02 12:14:43 +02:00
Márton Elek f1673b0db1
HDDS-1478. Provide k8s resources files for prometheus and performance tests
Closes #783
2019-05-02 11:23:44 +02:00
Márton Elek 2ab318b603
HDDS-1412. Provide example k8s deployment files as part of the release package
Closes #719
2019-05-02 11:18:54 +02:00
dineshchitlangia f682a171f5 HDDS-1483. Fix getMultipartKey javadoc. (#790) 2019-05-01 21:51:11 -07:00
Márton Elek dead9b4049
HDDS-1384. TestBlockOutputStreamWithFailures is failing
Closes #750
2019-04-30 14:27:39 +02:00
Ajay Yadav 95790bb7e5
HDDS-1430. NPE if secure ozone if KMS uri is not defined. Contributed by Ajay Kumar. (#752) 2019-04-29 14:07:23 -07:00
Xiaoyu Yao a96d16a843
HDDS-1455. Inconsistent naming convention with Ozone Kerberos configuration. Contributed by Xiaoyu Yao. (#762) 2019-04-29 11:18:11 -07:00
Ajay Yadav dbce729b24 HDDS-1472. Add retry to kinit command in smoketests. Contributed by Ajay Kumar. (#778) 2019-04-29 07:46:01 -07:00
Ajay Yadav b434f558ca
HDDS-1471. Update ratis dependency to 0.3.0. Contributed by Ajay Kumar. (#777) 2019-04-28 20:57:59 -07:00
Bharat Viswanadham 43b2a4b77b
HDDS-1456. Stop the datanode, when any datanode statemachine state is… (#769) 2019-04-26 14:25:34 -07:00
Hanisha Koneru 37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container (#753) 2019-04-26 10:39:03 -07:00
Lokesh Jain 556eafd01a
HDDS-1460: Add the optmizations of HDDS-1300 to BasicOzoneFileSystem (#765) 2019-04-26 17:29:50 +05:30
Siddharth Wagle c35abcd831
HDDS-999. Make the DNS resolution in OzoneManager more resilient
Closes #758
2019-04-26 12:38:24 +02:00
Kitti Nanasi 3f787cd506
HDDS-1192. Support -conf command line argument in GenericCli
Closes #713
2019-04-24 15:34:49 +02:00
Siddharth 59ded7641f HDDS-1411. Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart. (#755) 2019-04-23 21:04:14 +05:30
Márton Elek b979fdde99
HDDS-1447. Fix CheckStyle warnings. Contributed by Wanqiang Ji. 2019-04-18 08:54:43 +02:00
Shashikant Banerjee d608be660f HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException.(#729) 2019-04-17 14:49:02 +05:30
Shashikant Banerjee 082f1e0437 Revert "HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729)"
This reverts commit df2ae27f3e.
2019-04-17 14:38:08 +05:30
Shashikant Banerjee df2ae27f3e HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729) 2019-04-17 14:25:35 +05:30
Shashikant Banerjee e5a918cda3 Revert "Merge pull request #729 from bshashikant/HDDS-1373"
This reverts commit 4ff4314e40, reversing
changes made to 04c0437d13.
2019-04-17 14:17:54 +05:30
bshashikant 4ff4314e40
Merge pull request #729 from bshashikant/HDDS-1373
HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee.
2019-04-17 14:12:52 +05:30
Elek, Márton 04c0437d13 HDDS-1402. Remove unused ScmBlockLocationProtocol from ObjectStoreHandler (#707) 2019-04-16 19:16:05 -07:00
Hanisha Koneru e543c3b31a
HDDS-1376. Datanode exits while executing client command when scmId is null (#724) 2019-04-16 13:51:39 -07:00
Arpit Agarwal f2ab2795db
HDDS-1432. Ozone client list command truncates response without any indication. Contributed by Siddharth Wagle. 2019-04-16 12:35:49 -07:00
Shashikant Banerjee bfcb6534cd HDDS-1380. Add functonality to write from multiple clients in MiniOzoneChaosCluster. Contributed by Shashikant Banerjee. 2019-04-16 18:52:07 +05:30
avijayanhwx 62e38ea911 HDDS-1396 : Recon start fails due to changes in Aggregate Schema definition. (#700) 2019-04-15 12:58:06 -07:00
Arpit Agarwal ebbda181e4
HDDS-1198. Rename chill mode to safe mode. Contributed by Siddharth Wagle. (#737) 2019-04-13 07:27:03 -07:00
Elek, Márton 5379d85d8e HDDS-1387. ConcurrentModificationException in TestMiniChaosOzoneCluster. Contributed by Marton Elek. (#732) 2019-04-12 15:19:50 -07:00
Elek, Márton 0c1fec34f4 HDDS-1425. Ozone compose files are not compatible with the latest docker-compose. (#727) 2019-04-12 09:45:36 -07:00
Bharat Viswanadham a458c5bd96
HDDS-1285. Implement actions need to be taken after chill mode exit wait time. (#612) 2019-04-12 09:40:27 -07:00
Arpit Agarwal abace709cc
HDDS-1420. Tracing exception in DataNode HddsDispatcher
Closes #723
2019-04-12 12:21:10 +02:00
Doroszlai, Attila 75ba719ddd
HDDS-1419. Fix shellcheck errors in start-chaos.sh
Closes #728
2019-04-12 11:59:55 +02:00
Arpit Agarwal fd676e190a
HDDS-1426. Minor logging improvements for MiniOzoneChaosCluster
Closes #730
2019-04-12 11:42:23 +02:00
Doroszlai, Attila 3b08ac4659 HDDS-1363. ozone.metadata.dirs doesn't pick multiple dirs (#691) 2019-04-12 15:00:08 +05:30
Nanda kumar 4003849fa4
HDDS-1416. MiniOzoneCluster should set custom value for hdds.datanode.replication.work.dir.
Contributed by chencan.
2019-04-12 14:45:57 +05:30
Arpit Agarwal fcc7f9b32f
HDDS-1410. TestSCMNodeMetrics is flaky. Contributed by Siddharth Wagle. 2019-04-11 15:14:28 -07:00
Shashikant Banerjee 22d0468b39 HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee 2019-04-11 22:13:41 +05:30
Shashikant Banerjee a0468c5756 HDDS-1348. Refactor BlockOutpuStream Class. Contributed by Shashikant Banerjee. 2019-04-11 19:31:26 +05:30
Arpit Agarwal feaab241e5
HDDS-1418. Move bang line to the start of the start-chaos.sh script. Contributed by Arpit Agarwal. (#720)
Change-Id: I4fcf39d61a7d4c4ca79cb56a6958db0f691fe971
2019-04-10 12:44:01 -07:00
Mukul Kumar Singh df01469141 HDDS-1401. Static ContainerCache in Datanodes can result in overwrite of container db. Contributed by Mukul Kumar Singh. (#708) 2019-04-10 18:00:10 +05:30
Bharat Viswanadham 25c421bcc0
HDDS-1393. Convert all OM Bucket related operations to HA model. (#704) 2019-04-09 14:57:32 -07:00
Mukul Kumar Singh 312d4d4cc5 HDDS-1388. Add a shell script to run MiniOzoneChaosCluster using mvn exec. Contributed by Mukul Kumar Singh. (#709) 2019-04-09 13:08:25 -07:00
Lokesh Jain a78bdd15fc
HDDS-1405. ITestOzoneContractCreate is failing. (#712) 2019-04-09 23:05:54 +05:30
Márton Elek 8ef3bc8113
HDDS-1383. Create project skeleton with CLI interface for In-place upgrade.
Closes #694
2019-04-09 17:35:14 +02:00
Shashikant Banerjee 2d4f6b6daa HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee. 2019-04-09 10:27:58 +05:30
Vivek Ratnavel Subramanian 69e3745b86 HDDS-1340. Add List Containers API for Recon (#648) 2019-04-08 09:36:06 -07:00
avijayanhwx 26dc940813 HDDS-1390. Fix OzoneS3 Gateway server due to exclusion of hk2-api. (#698) 2019-04-05 12:36:00 -07:00
Elek, Márton 89f9c8604b HDDS-1385. Make the ozonesecure-mr environment definition version independent. Contributed by Elek, Marton. (#695)
(cherry picked from commit d758c97873)
2019-04-05 09:30:40 -07:00
Ajay Kumar 0356b3699d HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. (#653)
(cherry picked from commit 7ec6a31eb3)
2019-04-05 09:29:21 -07:00
Bharat Viswanadham 77fe51e136
HDDS-1379. Convert all OM Volume related operations to HA model. (#689) 2019-04-04 21:09:50 -07:00
Bharat Viswanadham d2141ef886
HDDS-1189. Build failing due to rat check failure introduced by HDDS-1189. Contributed by Siddharth Wagle. 2019-04-04 17:38:02 -07:00
avijayanhwx 993f36ee33 HDDS-1353 : Metrics scm_pipeline_metrics_num_pipeline_creation_failed keeps increasing because of BackgroundPipelineCreator. (#681) 2019-04-04 19:18:32 +05:30
Yiqun Lin a92806d05a HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle. 2019-04-04 17:33:37 +08:00
Hanisha Koneru f09a78f73f
HDDS-1339. Implement ratis snapshots on OM (#651) 2019-04-03 22:50:28 -07:00
Hanisha Koneru 4e64f8d763 HDDS-1324. TestOzoneManagerHA tests are flaky (#676) 2019-04-03 16:02:19 -07:00
Bharat Viswanadham 358f7f9b99
HDDS-1211. Test SCMChillMode failing randomly in Jenkins run (#543) 2019-04-03 15:02:00 -07:00
avijayanhwx 8ff41d6243 HDDS-1358 : Recon Server REST API not working as expected. (#668) 2019-04-03 14:52:06 -07:00
avijayanhwx 59022b28b7 HDDS-1330 : Add a docker compose for Ozone deployment with Recon. (#669) 2019-04-03 13:20:51 -07:00
Xiaoyu Yao d6c233fce6 HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. (#683) 2019-04-03 11:53:51 -07:00
Shashikant Banerjee 7cd7045eea HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi. 2019-04-03 22:19:10 +05:30
Ajay Kumar bfc90bdc64
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar.
Closes #677
2019-04-02 15:43:01 +02:00
Kitti Nanasi aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable
Closes #673
2019-04-02 14:21:47 +02:00
Yiqun Lin d31c86892e HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee. 2019-04-02 16:32:30 +08:00
Vivek Ratnavel Subramanian 04f1db8936 HDDS-1260. Create Recon Server lifecyle integration with Ozone. (#643) 2019-04-01 09:59:32 -07:00
Ajay Kumar 5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode 2019-04-01 17:04:28 +02:00
Shashikant Banerjee 0df949202a HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi. 2019-04-01 19:02:56 +05:30
Shashikant Banerjee ef5de29243 HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee. 2019-04-01 16:09:58 +05:30
Shashikant Banerjee 509f31b109 HDDS-1295. Add MiniOzoneChaosCluster to mimic long running workload in a unit test environment. Contributed by Mukul Kumar Singh. 2019-04-01 15:50:03 +05:30
Bharat Viswanadham bf3b7fd732
HDDS-1288. SCM - Failing test on trunk that waits for HB report processing. Contributed by Siddharth Wagle. 2019-03-30 10:54:45 -07:00
Elek, Márton ec82e4cab2 HDDS-1357. ozone s3 shell command has confusing subcommands (#663) 2019-03-30 10:13:29 -07:00
Doroszlai, Attila 7dc0ecc446 [HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila.
This closes #659.
2019-03-29 09:01:56 -07:00
Lokesh Jain 6186ed94b9 HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain. 2019-03-29 19:27:29 +05:30
Xiaoyu Yao ca5e4ce036
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao.
This closes #641
2019-03-28 12:00:58 -07:00
Xiaoyu Yao 8a59efee34
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao.
This closes #652.
2019-03-27 21:52:36 -07:00
Vivek Ratnavel Subramanian b2269581f7 HDDS-1264. Remove Parametrized in TestOzoneShell. (#614) 2019-03-26 22:07:22 -07:00
Bharat Viswanadham eef8cae7cf
HDDS-1262. In OM HA OpenKey call Should happen only leader OM. (#626) 2019-03-26 21:48:01 -07:00
Shweta Yakkali f426b7ce8f
HDDS-139. Output of createVolume can be improved. Contributed by Shweta. 2019-03-26 19:01:49 -07:00
Ajay Yadav 82d477293c HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. (#634) 2019-03-26 08:59:59 -07:00
Yiqun Lin c99b107772 HDDS-1334. Fix asf license errors in newly added files by HDDS-1234. Contributed by Aravindan Vijayan. 2019-03-26 11:51:04 +08:00
Yiqun Lin e5d72f504e HDDS-1234. Iterate the OM DB snapshot and populate the recon container DB. Contributed by Aravindan Vijayan. 2019-03-25 22:52:02 +08:00