Commit Graph

850 Commits

Author SHA1 Message Date
Elek, Márton c7d426daf0 HDDS-1881. Design doc: decommissioning in Ozone (#1196)
* Address comments from Anu
 * In-flight calculation is removed from the base model
 * Throttling is mentioned but will be discussed in a separated document
 * Model is improved to handle the over-replication in a specific way
 (to handle Nanda's use-case)
 * Stop conditions are defined independently from the model
 * Style of the table fragments are improved
* typo fix (thx to sodonnell)
* remove white spaces from the end of the lines
* example is restored
* minor whitespace improvement to support pdf conversion
2019-08-28 10:19:03 -07:00
supratimdeka 1407414a52 HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka (#1323) 2019-08-28 10:05:20 -07:00
Anu Engineer dc72782008 HDDS-738. Removing REST protocol support from OzoneClient.
Contributed by Elek, Marton.
2019-08-28 09:53:31 -07:00
Márton Elek c0499bd704 HDDS-1596. Create service endpoint to download configuration from SCM.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-28 09:13:46 -07:00
bshashikant 5d31a4eff7 HDDS-1753. Datanode unable to find chunk while replication data using ratis. (#1318) 2019-08-28 10:54:44 +05:30
Vivek Ratnavel Subramanian b1eee8b52e HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… (#1311) 2019-08-27 17:29:27 -07:00
Nanda kumar 2b9cc7eb95 HDDS-2037. Fix hadoop version in pom.ozone.xml.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 16:14:01 -07:00
Doroszlai, Attila 0883ce1021 HDDS-2026. Overlapping chunk region cannot be read concurrently
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-27 15:34:58 -07:00
Shashikant Banerjee 66cfa482c4 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee(#1226). 2019-08-27 23:38:43 +05:30
Shashikant Banerjee ce8eb1283a Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee."
This reverts commit 62445021d5 as it has unintended changes in DirectoryWithSnapshotFeature class..
2019-08-27 23:23:44 +05:30
Lokesh Jain 4379370fb1
HDDS-1981: Datanode should sync db when container is moved to CLOSED or QUASI_CLOSED state (#1319) 2019-08-27 10:22:03 +05:30
Nanda kumar b661dcf563 HDDS-2002. Update documentation for 0.4.1 release.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-23 19:04:13 -07:00
Vivek Ratnavel Subramanian d3fe993e60
HDDS-2023. Fix rat check failures in trunk (addendum) 2019-08-23 12:31:42 +02:00
Vivek Ratnavel Subramanian e2a55482ee
HDDS-2023. Fix rat check failures in trunk
Closes #1342
2019-08-23 12:02:45 +02:00
Vivek Ratnavel Subramanian b4a95a2b00
HDDS-2000. Don't depend on bootstrap/jquery versions from hadoop-trunk snapshot
Closes #1339
2019-08-23 10:56:00 +02:00
Bharat Viswanadham 4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. (#670) 2019-08-22 15:00:17 -07:00
avijayanhwx 28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
Doroszlai, Attila 2ae7f444bd HDDS-1999. Basic acceptance test and SCM/OM web UI broken by Bootstrap upgrade (#1327) 2019-08-21 12:16:14 -07:00
Shashikant Banerjee 62445021d5 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee. 2019-08-20 14:37:01 +05:30
avijayanhwx d69a1a0aa4 HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259) 2019-08-19 10:47:49 -07:00
Siyao Meng 12c7084be3 HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306) 2019-08-18 18:29:52 -07:00
avijayanhwx e32f52c75f HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … (#1303) 2019-08-18 10:08:38 -07:00
Vivek Ratnavel Subramanian e61825682a HDDS-1979. Fix checkstyle errors (#1312) 2019-08-17 21:53:12 -07:00
HUAN-PING SU 02015e3ed8 HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301) 2019-08-17 16:54:33 +05:30
Li Cheng bf3751521b HDDS-1894. Add filter to scmcli listPipelines. (#1286) 2019-08-16 14:33:04 +08:00
Doroszlai, Attila 77d102ceba HDDS-1910. Cannot build hadoop-hdds-config from scratch in IDEA
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-15 11:03:41 -07:00
dineshchitlangia c801f7a26c HDDS-1768. Audit xxxAcl methods in OzoneManager (#1204) 2019-08-15 08:43:47 -07:00
Aravindan Vijayan fc229b6490 HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging)
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 22:04:31 -07:00
Siyao Meng bf457797f6 HDDS-1920. Place ozone.om.address config key default value in ozone-site.xml
Change-Id: Ic5970b383357147b74a01680aedf40bed4d3e176
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 20:27:37 -07:00
Elek, Márton 50a22b66c0 HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject (#950)
* HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject
     * Remove Site improvements to display proposals
     * adding license header
     * clarify the support of the existing method
2019-08-13 17:10:36 -07:00
Nanda kumar 69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:57:05 -07:00
dchitlangia 689a80d3ce HDDS-1886. Use ArrayList#clear to address audit failure scenario
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:37:32 -07:00
Siyao Meng 14a4ce3cee HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng. 2019-08-08 13:38:10 -07:00
Nanda kumar 397a5633af
HDDS-1888. Add containers to node2container map in SCM as part of ICR processing.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-08-08 15:22:03 +05:30
Bharat Viswanadham 70b4617cfe
HDDS-1900. Remove UpdateBucket handler which supports add/remove Acl. (#1219) 2019-08-07 17:07:40 -07:00
Sammi Chen 8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Doroszlai, Attila 0520f5cede
HDDS-1924. ozone sh bucket path command does not exist
Closes #1245
2019-08-07 18:21:37 +02:00
Xiaoyu Yao a63023f261
HDDS-1901. Fix Ozone HTTP WebConsole Authentication. Contributed by Xiaoyu Yao. (#1228) 2019-08-06 12:07:53 -07:00
Nanda kumar 2662e20580
HDDS-1905. PipelineActionHandler is not closing the pipeline when close action is received. (#1227) 2019-08-06 14:36:04 +05:30
supratimdeka f8ea6e1ce1 HDDS-1798. Propagate failure in writeStateMachineData to Ratis. Contributed by Supratim Deka (#1113) 2019-08-05 13:43:41 +05:30
Xiaoyu Yao 065cbc6b54 HDDS-1896. Suppress WARN log from NetworkTopology#getDistanceCost. Contributed by Xiaoyu Yao. (#1214) 2019-08-03 22:33:01 -07:00
Doroszlai, Attila f4df97fd89 HDDS-1870. ConcurrentModification at PrometheusMetricsSink (#1179) 2019-08-03 22:26:25 -07:00
Vivek Ratnavel Subramanian ec1d453846 HDDS-1788. Fix kerberos principal error in Ozone Recon. (#1201) 2019-08-03 10:49:07 -07:00
avijayanhwx 6e8c8413ee HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (#1200) 2019-08-02 22:31:00 +05:30
Doroszlai, Attila 946e301731 HDDS-1878. checkstyle error in ContainerStateMachine (#1195) 2019-08-02 22:27:54 +05:30
Sammi Chen e111789aeb HDDS-1882. TestReplicationManager failed with NPE. (#1197) 2019-08-02 01:03:57 +05:30
Akira Ajisaka 8bda91d20a
HADOOP-16398. Exports Hadoop metrics to Prometheus (#1170) 2019-07-31 10:11:36 -07:00
Lokesh Jain d4ab9aea6f HDDS-1816: ContainerStateMachine should limit number of pending apply transactions. Adds a config, uses snapshot threshold default value. (#1150) 2019-07-31 13:26:24 +05:30
Bharat Viswanadham 68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. (#1183) 2019-07-29 16:44:48 -07:00
Siyao Meng 4d07134b13 HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated (#1164) 2019-07-29 16:42:00 -07:00