3b9584d12b
HDDS-2087. Remove the hard coded config key in ChunkManager ( #1409 )
2019-09-08 20:44:07 -07:00
c46d43ab13
HDDS-1553. Add metrics in rack aware container placement policy. ( #1361 )
2019-09-06 17:11:54 -07:00
b15c116c1e
HDDS-2015. Encrypt/decrypt key using symmetric key while writing/reading
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-06 11:35:00 -07:00
6e4cdf89ef
HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove ( #1401 )
2019-09-06 13:15:49 +05:30
acbea8d976
HDDS-1708. Add container scrubber metrics.
...
Contributed by Hrishikesh Gadre.
2019-09-05 14:33:06 -07:00
2b16d5377c
HDDS-1898. GrpcReplicationService#download cannot replicate the container. ( #1326 )
2019-09-05 18:12:36 +05:30
f347c348d8
Add support for checksum verification in data scrubber
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-04 20:31:49 -07:00
f25fe92743
HDDS-1909. Use new HA code for Non-HA in OM. ( #1225 )
2019-09-03 13:24:32 -07:00
0f549ec02a
HDDS-2069. Default values of properties hdds.datanode.storage.utilization.{critical | warning}.threshold are not reasonable. ( #1393 )
2019-09-03 17:58:48 +05:30
0b9704f610
HDDS-1810. SCM command to Activate and Deactivate pipelines. ( #1224 )
2019-09-03 16:50:57 +05:30
b53d19a343
HDDS-1783 : Latency metric for applyTransaction in ContainerStateMachine ( #1363 ).
2019-09-03 15:18:50 +05:30
c187d2cb9f
HDDS-2060. Create Ozone specific LICENSE file for the Ozone source package
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-31 15:01:46 -07:00
a2d083f2c5
HDDS-1413. Attempt to fix TestCloseContainerCommandHandler by adjusting timeouts
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-30 18:17:08 -07:00
46696bd9b0
HDDS-2014. Create Symmetric Key for GDPR ( #1362 )
2019-08-30 09:55:36 -07:00
ec34cee5e3
HDDS-2047. Datanodes fail to come up after 10 retries in a secure env… ( #1379 )
2019-08-30 09:27:37 -07:00
22a58615a2
HDDS-2058. Remove hadoop dependencies in ozone build
...
Closes #1376
2019-08-30 10:21:04 +02:00
4f5f46eb4a
HDDS-1935. Improve the visibility with Ozone Insight tool ( #1255 )
2019-08-29 17:07:55 -07:00
371c9eb6a6
Revert "HDDS-1596. Create service endpoint to download configuration from SCM."
...
This reverts commit c0499bd704
2019-08-29 09:25:03 +02:00
872cdf48a6
HDDS-1941. Unused executor in SimpleContainerDownloader ( #1367 )
2019-08-28 14:59:49 -07:00
3e6a0166f4
HDDS-2051. Rat check failure in decommissioning.md ( #1372 )
2019-08-28 13:28:07 -07:00
c7d426daf0
HDDS-1881. Design doc: decommissioning in Ozone ( #1196 )
...
* Address comments from Anu
* In-flight calculation is removed from the base model
* Throttling is mentioned but will be discussed in a separated document
* Model is improved to handle the over-replication in a specific way
(to handle Nanda's use-case)
* Stop conditions are defined independently from the model
* Style of the table fragments are improved
* typo fix (thx to sodonnell)
* remove white spaces from the end of the lines
* example is restored
* minor whitespace improvement to support pdf conversion
2019-08-28 10:19:03 -07:00
1407414a52
HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka ( #1323 )
2019-08-28 10:05:20 -07:00
dc72782008
HDDS-738. Removing REST protocol support from OzoneClient.
...
Contributed by Elek, Marton.
2019-08-28 09:53:31 -07:00
c0499bd704
HDDS-1596. Create service endpoint to download configuration from SCM.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-28 09:13:46 -07:00
5d31a4eff7
HDDS-1753. Datanode unable to find chunk while replication data using ratis. ( #1318 )
2019-08-28 10:54:44 +05:30
b1eee8b52e
HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… ( #1311 )
2019-08-27 17:29:27 -07:00
2b9cc7eb95
HDDS-2037. Fix hadoop version in pom.ozone.xml.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 16:14:01 -07:00
0883ce1021
HDDS-2026. Overlapping chunk region cannot be read concurrently
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 15:34:58 -07:00
66cfa482c4
HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee( #1226 ).
2019-08-27 23:38:43 +05:30
ce8eb1283a
Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee."
...
This reverts commit 62445021d5
2019-08-27 23:23:44 +05:30
4379370fb1
HDDS-1981: Datanode should sync db when container is moved to CLOSED or QUASI_CLOSED state ( #1319 )
2019-08-27 10:22:03 +05:30
b661dcf563
HDDS-2002. Update documentation for 0.4.1 release.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-23 19:04:13 -07:00
d3fe993e60
HDDS-2023. Fix rat check failures in trunk (addendum)
2019-08-23 12:31:42 +02:00
e2a55482ee
HDDS-2023. Fix rat check failures in trunk
...
Closes #1342
2019-08-23 12:02:45 +02:00
b4a95a2b00
HDDS-2000. Don't depend on bootstrap/jquery versions from hadoop-trunk snapshot
...
Closes #1339
2019-08-23 10:56:00 +02:00
4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. ( #670 )
2019-08-22 15:00:17 -07:00
28fb4b527a
HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. ( #1333 )
2019-08-22 10:57:22 -07:00
2ae7f444bd
HDDS-1999. Basic acceptance test and SCM/OM web UI broken by Bootstrap upgrade ( #1327 )
2019-08-21 12:16:14 -07:00
62445021d5
HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee.
2019-08-20 14:37:01 +05:30
d69a1a0aa4
HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager ( #1259 )
2019-08-19 10:47:49 -07:00
12c7084be3
HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified ( #1306 )
2019-08-18 18:29:52 -07:00
e32f52c75f
HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … ( #1303 )
2019-08-18 10:08:38 -07:00
e61825682a
HDDS-1979. Fix checkstyle errors ( #1312 )
2019-08-17 21:53:12 -07:00
02015e3ed8
HDDS-1959. Decrement purge interval for Ratis logs in datanode ( #1301 )
2019-08-17 16:54:33 +05:30
bf3751521b
HDDS-1894. Add filter to scmcli listPipelines. ( #1286 )
2019-08-16 14:33:04 +08:00
77d102ceba
HDDS-1910. Cannot build hadoop-hdds-config from scratch in IDEA
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-15 11:03:41 -07:00
c801f7a26c
HDDS-1768. Audit xxxAcl methods in OzoneManager ( #1204 )
2019-08-15 08:43:47 -07:00
fc229b6490
HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging)
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 22:04:31 -07:00
bf457797f6
HDDS-1920. Place ozone.om.address config key default value in ozone-site.xml
...
Change-Id: Ic5970b383357147b74a01680aedf40bed4d3e176
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 20:27:37 -07:00
50a22b66c0
HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject ( #950 )
...
* HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject
* Remove Site improvements to display proposals
* adding license header
* clarify the support of the existing method
2019-08-13 17:10:36 -07:00
69b74e9016
HDDS-1488. Scm cli command to start/stop replication manager.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:57:05 -07:00
689a80d3ce
HDDS-1886. Use ArrayList#clear to address audit failure scenario
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:37:32 -07:00
14a4ce3cee
HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng.
2019-08-08 13:38:10 -07:00
397a5633af
HDDS-1888. Add containers to node2container map in SCM as part of ICR processing.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-08-08 15:22:03 +05:30
70b4617cfe
HDDS-1900. Remove UpdateBucket handler which supports add/remove Acl. ( #1219 )
2019-08-07 17:07:40 -07:00
8f9245bc2d
HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic ( #1184 )
2019-08-07 16:59:13 -07:00
0520f5cede
HDDS-1924. ozone sh bucket path command does not exist
...
Closes #1245
2019-08-07 18:21:37 +02:00
a63023f261
HDDS-1901. Fix Ozone HTTP WebConsole Authentication. Contributed by Xiaoyu Yao. ( #1228 )
2019-08-06 12:07:53 -07:00
2662e20580
HDDS-1905. PipelineActionHandler is not closing the pipeline when close action is received. ( #1227 )
2019-08-06 14:36:04 +05:30
f8ea6e1ce1
HDDS-1798. Propagate failure in writeStateMachineData to Ratis. Contributed by Supratim Deka ( #1113 )
2019-08-05 13:43:41 +05:30
065cbc6b54
HDDS-1896. Suppress WARN log from NetworkTopology#getDistanceCost. Contributed by Xiaoyu Yao. ( #1214 )
2019-08-03 22:33:01 -07:00
f4df97fd89
HDDS-1870. ConcurrentModification at PrometheusMetricsSink ( #1179 )
2019-08-03 22:26:25 -07:00
ec1d453846
HDDS-1788. Fix kerberos principal error in Ozone Recon. ( #1201 )
2019-08-03 10:49:07 -07:00
6e8c8413ee
HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. ( #1200 )
2019-08-02 22:31:00 +05:30
946e301731
HDDS-1878. checkstyle error in ContainerStateMachine ( #1195 )
2019-08-02 22:27:54 +05:30
e111789aeb
HDDS-1882. TestReplicationManager failed with NPE. ( #1197 )
2019-08-02 01:03:57 +05:30
8bda91d20a
HADOOP-16398. Exports Hadoop metrics to Prometheus ( #1170 )
2019-07-31 10:11:36 -07:00
d4ab9aea6f
HDDS-1816: ContainerStateMachine should limit number of pending apply transactions. Adds a config, uses snapshot threshold default value. ( #1150 )
2019-07-31 13:26:24 +05:30
68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. ( #1183 )
2019-07-29 16:44:48 -07:00
4d07134b13
HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated ( #1164 )
2019-07-29 16:42:00 -07:00
60325c9611
HDDS-1391 : Add ability in OM to serve delta updates through an API. ( #1033 )
2019-07-29 09:39:40 -07:00
d023663e3e
HDDS-1833. Moved RefCountedDB stacktrace to log level trace.
...
Contributed by Siddharth Wagle
2019-07-29 12:05:24 -04:00
b039f7591f
HDDS-1682. TestEventWatcher.testMetrics is flaky
...
Closes #962 .
2019-07-29 11:04:45 +02:00
902ff4a2f6
HDDS-1867. Invalid Prometheus metric name from JvmMetrics
...
Closes #1172
2019-07-29 10:27:55 +02:00
c7c7a889a8
HDDS-1839: Change topology sorting related logs in Pipeline from INFO to DEBUG. Contributed by Junjie Chen.
...
This closes #1158 .
2019-07-26 08:14:24 -07:00
3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. ( #1165 )
2019-07-25 22:30:06 -07:00
2b1d8aedbb
HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-25 14:25:39 -07:00
b41ef61ebc
HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle.
2019-07-25 09:52:02 -07:00
ba43233451
HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. ( #1124 )
2019-07-25 20:24:46 +05:30
2546e6ece2
HDDS-1817. GetKey fails with IllegalArgumentException.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-24 15:59:30 -07:00
fbe2fc6580
HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 10:42:16 -07:00
278390f5bf
HDDS-1710. Fix checkstyle errors
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 07:56:30 -07:00
c533b79c32
HDDS-1710. Publish JVM metrics via Hadoop metrics
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 16:27:50 -07:00
c958eddcf4
HDDS-1811. Prometheus metrics are broken.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 14:12:06 -07:00
cdc36fe286
HDDS-1649. On installSnapshot notification from OM leader, download checkpoint and reload OM state ( #948 )
2019-07-22 12:06:55 -07:00
69a46a95bb
HDDS-1713. ReplicationManager fail to find proper node topology based… ( #1112 )
2019-07-19 15:45:26 -07:00
4e66cb9333
HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao. ( #1067 )
...
* HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao.
* use ip/hostname instead of network name for -o output and add smoke test
2019-07-19 11:00:49 +08:00
d5ef38b093
HDDS-1822. NPE in SCMCommonPolicy.chooseDatanodes ( #1120 )
2019-07-18 13:28:03 -07:00
20cf50c6d0
HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens. Cotributed by Shashikant Banerjee. ( #923 )
2019-07-18 17:09:05 +05:30
ccceedb432
HDDS-1780. TestFailureHandlingByClient tests are flaky. Contributed by Shashikant Banerjee. ( #1073 )
2019-07-18 16:01:58 +05:30
23e9bebe13
HDDS-1767: ContainerStateMachine should have its own executors for executing applyTransaction calls ( #1087 )
2019-07-18 14:48:13 +05:30
3dc256ef81
HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. ( #1088 )
2019-07-17 21:46:27 -07:00
73e6ffce69
HDDS-1802. Add Eviction policy for table cache. ( #1100 )
2019-07-17 18:19:06 -07:00
303a7f8a39
HDDS-1721 : Client Metrics are not being pushed to the configured sink while running a hadoop command to write to Ozone. ( #1034 )
2019-07-17 12:05:43 -07:00
eb0849b547
HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-17 10:32:59 -07:00
493b0b5760
HDDS-1787. NPE thrown while trying to find DN closest to client. Contributed by Sammi Chen. ( #1094 )
2019-07-16 12:52:29 -07:00
d21eccf8ba
HDDS-1492. Generated chunk size name too long. Contributed by Shashikannt Banerjee. ( #1084 )
2019-07-16 18:01:13 +05:30
1502e6a22f
HDDS-1756. DeleteContainerCommandHandler fails with NPE. Contributed by Nanda kumar( #1095 ).
2019-07-16 15:06:41 +05:30
47345e598e
Merge pull request #1058 from elek/HDDS-1763
...
HDDS-1763. Use vendor neutral s3 logo in ozone doc
2019-07-15 13:17:21 -07:00
0976f6fc30
HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. ( #1072 )
2019-07-14 10:53:51 +05:30
Vivek Ratnavel Subramanian
Sammi Chen
dchitlangia
Lokesh Jain
Anu Engineer
Nanda kumar
Hrishikesh Gadre
Bharat Viswanadham
avijayanhwx
Márton Elek
Doroszlai, Attila
Xiaoyu Yao
Elek, Márton
Doroszlai, Attila
supratimdeka
bshashikant
Shashikant Banerjee
Siyao Meng
HUAN-PING SU
Li Cheng
Aravindan Vijayan
Siyao Meng
Akira Ajisaka
Eric Yang
Chen, Junjie
Hanisha Koneru
Mukul Kumar Singh