Commit Graph

433 Commits

Author SHA1 Message Date
Bharat Viswanadham 4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. (#670) 2019-08-22 15:00:17 -07:00
avijayanhwx 28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
avijayanhwx d69a1a0aa4 HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259) 2019-08-19 10:47:49 -07:00
HUAN-PING SU 02015e3ed8 HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301) 2019-08-17 16:54:33 +05:30
Doroszlai, Attila 77d102ceba HDDS-1910. Cannot build hadoop-hdds-config from scratch in IDEA
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-15 11:03:41 -07:00
dineshchitlangia c801f7a26c HDDS-1768. Audit xxxAcl methods in OzoneManager (#1204) 2019-08-15 08:43:47 -07:00
Siyao Meng bf457797f6 HDDS-1920. Place ozone.om.address config key default value in ozone-site.xml
Change-Id: Ic5970b383357147b74a01680aedf40bed4d3e176
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 20:27:37 -07:00
Nanda kumar 69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:57:05 -07:00
dchitlangia 689a80d3ce HDDS-1886. Use ArrayList#clear to address audit failure scenario
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-08-13 14:37:32 -07:00
Siyao Meng 14a4ce3cee HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng. 2019-08-08 13:38:10 -07:00
Sammi Chen 8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Xiaoyu Yao a63023f261
HDDS-1901. Fix Ozone HTTP WebConsole Authentication. Contributed by Xiaoyu Yao. (#1228) 2019-08-06 12:07:53 -07:00
Xiaoyu Yao 065cbc6b54 HDDS-1896. Suppress WARN log from NetworkTopology#getDistanceCost. Contributed by Xiaoyu Yao. (#1214) 2019-08-03 22:33:01 -07:00
Vivek Ratnavel Subramanian ec1d453846 HDDS-1788. Fix kerberos principal error in Ozone Recon. (#1201) 2019-08-03 10:49:07 -07:00
Doroszlai, Attila 946e301731 HDDS-1878. checkstyle error in ContainerStateMachine (#1195) 2019-08-02 22:27:54 +05:30
Lokesh Jain d4ab9aea6f HDDS-1816: ContainerStateMachine should limit number of pending apply transactions. Adds a config, uses snapshot threshold default value. (#1150) 2019-07-31 13:26:24 +05:30
Bharat Viswanadham 68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. (#1183) 2019-07-29 16:44:48 -07:00
Siyao Meng 4d07134b13 HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated (#1164) 2019-07-29 16:42:00 -07:00
avijayanhwx 60325c9611 HDDS-1391 : Add ability in OM to serve delta updates through an API. (#1033) 2019-07-29 09:39:40 -07:00
Chen, Junjie c7c7a889a8 HDDS-1839: Change topology sorting related logs in Pipeline from INFO to DEBUG. Contributed by Junjie Chen.
This closes #1158.
2019-07-26 08:14:24 -07:00
Bharat Viswanadham 3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. (#1165) 2019-07-25 22:30:06 -07:00
Xiaoyu Yao b41ef61ebc HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle. 2019-07-25 09:52:02 -07:00
Nanda kumar 2546e6ece2 HDDS-1817. GetKey fails with IllegalArgumentException.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-24 15:59:30 -07:00
Bharat Viswanadham fbe2fc6580 HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 10:42:16 -07:00
Doroszlai, Attila 278390f5bf HDDS-1710. Fix checkstyle errors
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 07:56:30 -07:00
Márton Elek c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 16:27:50 -07:00
Hanisha Koneru cdc36fe286 HDDS-1649. On installSnapshot notification from OM leader, download checkpoint and reload OM state (#948) 2019-07-22 12:06:55 -07:00
Sammi Chen 69a46a95bb HDDS-1713. ReplicationManager fail to find proper node topology based… (#1112) 2019-07-19 15:45:26 -07:00
Bharat Viswanadham 3dc256ef81
HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. (#1088) 2019-07-17 21:46:27 -07:00
Bharat Viswanadham 73e6ffce69
HDDS-1802. Add Eviction policy for table cache. (#1100) 2019-07-17 18:19:06 -07:00
Xiaoyu Yao eb0849b547 HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-17 10:32:59 -07:00
supratimdeka 738fab3bff HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka (#1081) 2019-07-12 10:31:48 +05:30
Ajay Yadav cdb20adfcc HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973) 2019-07-10 11:03:58 -07:00
Xiaoyu Yao 030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen. 2019-07-09 14:43:55 -07:00
Mukul Kumar Singh 96d0555913 HDDS-1718. Increase Ratis Leader election timeout default. Contributed by Aravindan Vijayan & Siddharth Wagle. (#1062) 2019-07-09 23:17:50 +05:30
Vivek Ratnavel Subramanian 82d88a8d30 HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian. 2019-07-08 21:06:50 -07:00
S O'Donnell f8d62a9c4c
HDDS-1258. Fix error propagation for SCM protocol
Closes #1001
2019-07-01 20:04:32 +02:00
dineshchitlangia 1f75660350 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) 2019-07-01 08:58:47 -07:00
Mukul Kumar Singh 9df6275954 HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. (#846) 2019-07-01 20:52:32 +05:30
Bharat Viswanadham 4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. (#956) 2019-06-26 18:04:12 -07:00
avijayanhwx 0a37ccf379 HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist (#1013) 2019-06-26 11:44:49 -07:00
Bharat Viswanadham a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. (#1014) 2019-06-25 17:12:45 -07:00
Bharat Viswanadham 049bb42760 HDDS-1723. Create new OzoneManagerLock class. (#1006)
* HDDS-1723. Create new OzoneManagerLock class.

* add logs

* fix exception message

* add license

* fix findbug

* throw exception when acquiring 2nd lock failed.

* fix review comments

* fix missed review comment

* fix checkstyle

* fix review comments
2019-06-25 08:48:03 -07:00
Elek, Márton 004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969)
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
2019-06-24 11:56:04 -07:00
avijayanhwx 81d2f1b724 HDDS-1719 : Increase ratis log segment size to 1MB. (#1005)
* HDDS-1719 : Increase ratis log segment size to 1MB.

* HDDS-1719 : Increase ratis log segment size to 1MB.
2019-06-24 08:57:08 -07:00
S O'Donnell b95a58e231
HDDS-1674. Make ScmBlockLocationProtocol message type based.
Closes #984
2019-06-21 11:35:43 +02:00
avijayanhwx 71edfce187 HDDS-1699. Update RocksDB version to 6.0.1 (#980) 2019-06-18 11:13:13 -07:00
Bharat Viswanadham ba681bb80e
HDDS-1692. RDBTable#iterator should disabled caching of the keys during iterator. (#975) 2019-06-16 22:00:39 -07:00
Bharat Viswanadham 88c53d516c
HDDS-1620. Implement Volume Write Requests to use Cache and DoubleBuffer. (#884) 2019-06-12 17:45:42 -07:00
Sammi Chen 1732312f45 HDDS-1663. Add datanode to network topology cluster during node regis… (#937) 2019-06-12 12:16:42 -07:00