Commit Graph

526 Commits

Author SHA1 Message Date
Istvan Fajth 1d27930407 HDDS-2233 - Remove ByteStringHelper and refactor the code to the place where it used (#1596) 2019-10-09 11:28:47 +05:30
Anu Engineer 4fdf016358 HDDS-2245. Use dynamic ports for SCM in TestSecureOzoneCluster
Contributed by kevin su.
2019-10-07 15:41:42 -07:00
Doroszlai, Attila 1877312440 HDDS-2238. Container Data Scrubber spams log in empty cluster
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-10-07 13:59:49 -07:00
avijayanhwx f3eaa84f9d HDDS-2164 : om.db.checkpoints is getting filling up fast. (#1536) 2019-10-04 12:44:21 -07:00
Aravindan Vijayan 76605f17dd HDDS-1720 : Add ability to configure RocksDB logs for Ozone Manager.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-10-03 15:17:09 -07:00
Bharat Viswanadham 169cef758d
HDDS-2162. Make OM Generic related configuration support HA style config. (#1511) 2019-10-02 15:09:33 -07:00
bshashikant 41440ec890
HDDS-2210. ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception(#1552). 2019-10-02 10:11:01 +05:30
Bharat Viswanadham 14b4fbc019
HDDS-1146. Adding container related metrics in SCM. (#1541) 2019-09-27 15:24:30 -07:00
Bharat Viswanadham b6ef8cc120 HDD-2193. Adding container related metrics in SCM.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-26 21:42:20 -07:00
dchitlangia c55ac6a1c7 HDDS-2174. Delete GDPR Encryption Key from metadata when a Key is deleted
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-26 21:10:34 -07:00
avijayanhwx 8f1a135118 HDDS-2081. Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude. Contributed by Aravindan Vijayan. (#1506) 2019-09-24 12:59:51 +05:30
Siyao Meng d7d6ec8fae HDDS-2128. Make ozone sh command work with OM HA service ids (#1445) 2019-09-20 14:22:55 -07:00
Anu Engineer 5553887d95 HDDS-1949. Missing or error-prone test cleanup.
Contributed by Doroszlai, Attila.
2019-09-20 09:57:08 -07:00
Xiaoyu Yao d072d3304c HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:43:00 -07:00
Bharat Viswanadham 6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils
Closes #1465
2019-09-18 16:51:39 +02:00
Doroszlai, Attila e952ecf807
HDDS-2109. Refactor scm.container.client config
Closes #1426
2019-09-16 15:22:11 +02:00
Siyao Meng e22a324f87 HDDS-2007. Make ozone fs shell command work with OM HA service ids (#1360) 2019-09-13 11:22:00 -07:00
avijayanhwx 8024818d33 HDDS-1786 : Datanodes takeSnapshot should delete previously created snapshots (#1163) 2019-09-13 23:20:31 +05:30
Shashikant Banerjee fe8cdf0ab8 HDDS-2076. Read fails because the block cannot be located in the container (#1410)
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-09-12 21:18:14 +05:30
Doroszlai, Attila 5a381f73e9 HDDS-2103. TestContainerReplication fails due to unhealthy container (#1421) 2019-09-11 19:49:10 +05:30
Shashikant Banerjee 469165e6f2 HDDS-1843. Undetectable corruption after restart of a datanode. Contributed by Shashikant Banerjee(#1364). 2019-09-09 22:43:20 +05:30
Vivek Ratnavel Subramanian 3b9584d12b HDDS-2087. Remove the hard coded config key in ChunkManager (#1409) 2019-09-08 20:44:07 -07:00
Sammi Chen c46d43ab13 HDDS-1553. Add metrics in rack aware container placement policy. (#1361) 2019-09-06 17:11:54 -07:00
dchitlangia b15c116c1e HDDS-2015. Encrypt/decrypt key using symmetric key while writing/reading
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-06 11:35:00 -07:00
Lokesh Jain 6e4cdf89ef HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove (#1401) 2019-09-06 13:15:49 +05:30
Anu Engineer acbea8d976 HDDS-1708. Add container scrubber metrics.
Contributed by Hrishikesh Gadre.
2019-09-05 14:33:06 -07:00
Nanda kumar 2b16d5377c
HDDS-1898. GrpcReplicationService#download cannot replicate the container. (#1326) 2019-09-05 18:12:36 +05:30
Hrishikesh Gadre f347c348d8 Add support for checksum verification in data scrubber
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-04 20:31:49 -07:00
Xiaoyu Yao ae287474c0
HDDS-2079. Fix TestSecureOzoneManager. Contributed by Xiaoyu Yao. (#1400) 2019-09-04 14:03:38 -07:00
Bharat Viswanadham f25fe92743
HDDS-1909. Use new HA code for Non-HA in OM. (#1225) 2019-09-03 13:24:32 -07:00
Nanda kumar 0b9704f610
HDDS-1810. SCM command to Activate and Deactivate pipelines. (#1224) 2019-09-03 16:50:57 +05:30
avijayanhwx b53d19a343 HDDS-1783 : Latency metric for applyTransaction in ContainerStateMachine (#1363). 2019-09-03 15:18:50 +05:30
Doroszlai, Attila 70855126d1 HDDS-2061. Add hdds.container.chunk.persistdata as exception to TestOzoneConfigurationFields (#1382) 2019-08-30 12:31:52 -07:00
Doroszlai, Attila 472a26d2b8 HDDS-2063. Integration tests create untracked file audit.log (#1384) 2019-08-30 12:23:25 -07:00
Anu Engineer dc72782008 HDDS-738. Removing REST protocol support from OzoneClient.
Contributed by Elek, Marton.
2019-08-28 09:53:31 -07:00
bshashikant 5d31a4eff7 HDDS-1753. Datanode unable to find chunk while replication data using ratis. (#1318) 2019-08-28 10:54:44 +05:30
Vivek Ratnavel Subramanian b1eee8b52e HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… (#1311) 2019-08-27 17:29:27 -07:00
Shashikant Banerjee 66cfa482c4 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee(#1226). 2019-08-27 23:38:43 +05:30
Shashikant Banerjee ce8eb1283a Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee."
This reverts commit 62445021d5 as it has unintended changes in DirectoryWithSnapshotFeature class..
2019-08-27 23:23:44 +05:30
HUAN-PING SU 3329257d99 HDDS-1998. TestSecureContainerServer#testClientServerRatisGrpc is failing (#1328) 2019-08-27 11:58:23 +05:30
Bharat Viswanadham d1aa8596e0
HDDS-1975. Implement default acls for bucket/volume/key for OM HA code. (#1315) 2019-08-26 11:05:40 -07:00
Hanisha Koneru 3f887f3b92
HDDS-1827. Load Snapshot info when OM Ratis server starts. (#1130) 2019-08-23 13:19:13 -07:00
Vivek Ratnavel Subramanian e2a55482ee
HDDS-2023. Fix rat check failures in trunk
Closes #1342
2019-08-23 12:02:45 +02:00
Doroszlai, Attila f6af7d0fd7 HDDS-1808. TestRatisPipelineCreateAndDestory times out (#1338) 2019-08-22 17:55:42 -07:00
Bharat Viswanadham 4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. (#670) 2019-08-22 15:00:17 -07:00
avijayanhwx 28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
Xiaoyu Yao d58eba8672 HDDS-1927. Consolidate add/remove Acl into OzoneAclUtil class. Contributed by Xiaoyu Yao.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-21 16:16:18 -07:00
Shashikant Banerjee 62445021d5 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee. 2019-08-20 14:37:01 +05:30
Bharat Viswanadham a46ba03d15
HDDS-1913. Fix OzoneBucket and RpcClient APIS for acl. (#1257) 2019-08-16 16:39:49 -07:00
Bharat Viswanadham c8675ec42e
HDDS-1911. Support Prefix ACL operations for OM HA. (#1275) 2019-08-16 15:11:11 -07:00