Commit Graph

889 Commits

Author SHA1 Message Date
Nanda kumar e78848fc3c
HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation
Closes #1435
2019-09-19 11:59:43 +02:00
dchitlangia 5c963a75d6
HDDS-2016. Add option to enforce GDPR in Bucket Create command
Closes #1458
2019-09-19 11:18:16 +02:00
bshashikant 2c52d00a27
HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. Contributed by Shashikant Banerjee (#1420). 2019-09-18 22:30:41 +05:30
Bharat Viswanadham 6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils
Closes #1465
2019-09-18 16:51:39 +02:00
Viraj Jasani 285ed0a849
HDDS-2137. HddsClientUtils and OzoneUtils have duplicate verifyResourceName()
Closes #1455
2019-09-18 16:43:24 +02:00
bshashikant 7f9073132d HDDS-2117. ContainerStateMachine#writeStateMachineData times out. (#1430) 2019-09-17 16:49:25 +05:30
Doroszlai, Attila e54977f888 HDDS-2132. TestKeyValueContainer is failing (#1457). 2019-09-17 14:31:33 +05:30
Vivek Ratnavel Subramanian 66bd1681f8 HDDS-2107. Datanodes should retry forever to connect to SCM in an unsecure environment (#1424) 2019-09-16 12:58:16 -07:00
Sammi Chen 4222b62f2b HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology (#1194) 2019-09-16 12:57:41 -07:00
Doroszlai, Attila 363373e0ef
HDDS-2124. Random next links
Closes #1443
2019-09-16 15:41:17 +02:00
Doroszlai, Attila e952ecf807
HDDS-2109. Refactor scm.container.client config
Closes #1426
2019-09-16 15:22:11 +02:00
Xiaoyu Yao b6334381df
HDDS-2096. Ozone ACL document missing AddAcl API
Closes #1427
2019-09-16 14:55:06 +02:00
avijayanhwx 8024818d33 HDDS-1786 : Datanodes takeSnapshot should delete previously created snapshots (#1163) 2019-09-13 23:20:31 +05:30
Doroszlai, Attila 4a9a6a21b8
HDDS-2122. Broken logo image on category sub-pages (#1437)
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-09-13 16:11:00 +05:30
Shashikant Banerjee fe8cdf0ab8 HDDS-2076. Read fails because the block cannot be located in the container (#1410)
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-09-12 21:18:14 +05:30
Márton Elek f537410563
HDDS-2106. Avoid usage of hadoop projects as parent of hdds/ozone
Closes #1423
2019-09-12 02:38:41 +02:00
Lokesh Jain c3beeb7761 HDDS-2048: State check during container state transition in datanode should be lock protected (#1375) 2019-09-10 14:14:52 +05:30
Mukul Kumar Singh d69b811ddd HDDS-2102. HddsVolumeChecker should use java optional in place of Guava optional. Contributed by Mukul Kumar Singh. (#1416) 2019-09-09 14:17:28 -07:00
Shashikant Banerjee 469165e6f2 HDDS-1843. Undetectable corruption after restart of a datanode. Contributed by Shashikant Banerjee(#1364). 2019-09-09 22:43:20 +05:30
Vivek Ratnavel Subramanian 3b9584d12b HDDS-2087. Remove the hard coded config key in ChunkManager (#1409) 2019-09-08 20:44:07 -07:00
Sammi Chen c46d43ab13 HDDS-1553. Add metrics in rack aware container placement policy. (#1361) 2019-09-06 17:11:54 -07:00
dchitlangia b15c116c1e HDDS-2015. Encrypt/decrypt key using symmetric key while writing/reading
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-06 11:35:00 -07:00
Lokesh Jain 6e4cdf89ef HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove (#1401) 2019-09-06 13:15:49 +05:30
Anu Engineer acbea8d976 HDDS-1708. Add container scrubber metrics.
Contributed by Hrishikesh Gadre.
2019-09-05 14:33:06 -07:00
Nanda kumar 2b16d5377c
HDDS-1898. GrpcReplicationService#download cannot replicate the container. (#1326) 2019-09-05 18:12:36 +05:30
Hrishikesh Gadre f347c348d8 Add support for checksum verification in data scrubber
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-04 20:31:49 -07:00
Bharat Viswanadham f25fe92743
HDDS-1909. Use new HA code for Non-HA in OM. (#1225) 2019-09-03 13:24:32 -07:00
Sammi Chen 0f549ec02a HDDS-2069. Default values of properties hdds.datanode.storage.utilization.{critical | warning}.threshold are not reasonable. (#1393) 2019-09-03 17:58:48 +05:30
Nanda kumar 0b9704f610
HDDS-1810. SCM command to Activate and Deactivate pipelines. (#1224) 2019-09-03 16:50:57 +05:30
avijayanhwx b53d19a343 HDDS-1783 : Latency metric for applyTransaction in ContainerStateMachine (#1363). 2019-09-03 15:18:50 +05:30
Márton Elek c187d2cb9f HDDS-2060. Create Ozone specific LICENSE file for the Ozone source package
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-31 15:01:46 -07:00
Doroszlai, Attila a2d083f2c5 HDDS-1413. Attempt to fix TestCloseContainerCommandHandler by adjusting timeouts
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-30 18:17:08 -07:00
dineshchitlangia 46696bd9b0 HDDS-2014. Create Symmetric Key for GDPR (#1362) 2019-08-30 09:55:36 -07:00
Xiaoyu Yao ec34cee5e3
HDDS-2047. Datanodes fail to come up after 10 retries in a secure env… (#1379) 2019-08-30 09:27:37 -07:00
Nanda kumar 22a58615a2
HDDS-2058. Remove hadoop dependencies in ozone build
Closes #1376
2019-08-30 10:21:04 +02:00
Elek, Márton 4f5f46eb4a HDDS-1935. Improve the visibility with Ozone Insight tool (#1255) 2019-08-29 17:07:55 -07:00
Márton Elek 371c9eb6a6
Revert "HDDS-1596. Create service endpoint to download configuration from SCM."
This reverts commit c0499bd704.
2019-08-29 09:25:03 +02:00
Doroszlai, Attila 872cdf48a6 HDDS-1941. Unused executor in SimpleContainerDownloader (#1367) 2019-08-28 14:59:49 -07:00
Doroszlai, Attila 3e6a0166f4 HDDS-2051. Rat check failure in decommissioning.md (#1372) 2019-08-28 13:28:07 -07:00
Elek, Márton c7d426daf0 HDDS-1881. Design doc: decommissioning in Ozone (#1196)
* Address comments from Anu
 * In-flight calculation is removed from the base model
 * Throttling is mentioned but will be discussed in a separated document
 * Model is improved to handle the over-replication in a specific way
 (to handle Nanda's use-case)
 * Stop conditions are defined independently from the model
 * Style of the table fragments are improved
* typo fix (thx to sodonnell)
* remove white spaces from the end of the lines
* example is restored
* minor whitespace improvement to support pdf conversion
2019-08-28 10:19:03 -07:00
supratimdeka 1407414a52 HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka (#1323) 2019-08-28 10:05:20 -07:00
Anu Engineer dc72782008 HDDS-738. Removing REST protocol support from OzoneClient.
Contributed by Elek, Marton.
2019-08-28 09:53:31 -07:00
Márton Elek c0499bd704 HDDS-1596. Create service endpoint to download configuration from SCM.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-28 09:13:46 -07:00
bshashikant 5d31a4eff7 HDDS-1753. Datanode unable to find chunk while replication data using ratis. (#1318) 2019-08-28 10:54:44 +05:30
Vivek Ratnavel Subramanian b1eee8b52e HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… (#1311) 2019-08-27 17:29:27 -07:00
Nanda kumar 2b9cc7eb95 HDDS-2037. Fix hadoop version in pom.ozone.xml.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 16:14:01 -07:00
Doroszlai, Attila 0883ce1021 HDDS-2026. Overlapping chunk region cannot be read concurrently
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 15:34:58 -07:00
Shashikant Banerjee 66cfa482c4 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee(#1226). 2019-08-27 23:38:43 +05:30
Shashikant Banerjee ce8eb1283a Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee."
This reverts commit 62445021d5 as it has unintended changes in DirectoryWithSnapshotFeature class..
2019-08-27 23:23:44 +05:30
Lokesh Jain 4379370fb1
HDDS-1981: Datanode should sync db when container is moved to CLOSED or QUASI_CLOSED state (#1319) 2019-08-27 10:22:03 +05:30