Commit Graph

871 Commits

Author SHA1 Message Date
Márton Elek 317f2c896f
fix rat problem 2019-07-12 11:30:56 +02:00
Márton Elek 987bf3f696
fix print0 consequences 2019-07-12 11:30:56 +02:00
Márton Elek 6f25420f57
fixing ALL the checkstule issues under hadoop-ozone/dev-support/checks 2019-07-12 11:30:56 +02:00
Márton Elek 0bae9e8ec8
HDDS-1735. Create separate unit and integration test executor dev-support script 2019-07-12 11:30:55 +02:00
Márton Elek 9119ed07ff
HDDS-1384. TestBlockOutputStreamWithFailures is failing
Closes #1029
2019-07-12 11:00:03 +02:00
Hrishikesh Gadre acef5e0cec HDDS-1201. Reporting corrupted containers info to SCM (#1032) 2019-07-11 14:49:58 +05:30
Anu Engineer 6872efcabf HDDS-1611.[Addendum] Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973)
Fixes a build break in ozone.
2019-07-10 11:28:18 -07:00
Ajay Yadav cdb20adfcc HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973) 2019-07-10 11:03:58 -07:00
Nanda kumar efb916457f HDDS-1778. Fix existing blockade tests. (#1068) 2019-07-10 09:43:58 -07:00
Márton Elek bbf5844968
HDDS-1525. Mapreduce failure when using Hadoop 2.7.5
Closes #1065
2019-07-10 15:31:28 +02:00
Márton Elek 93824886e9
HDDS-1764. Fix hidden errors in acceptance tests
Closes #1059
2019-07-10 13:22:51 +02:00
supratimdeka ac7a8accdf HDDS-1603. Handle Ratis Append Failure in Container State Machine. Contributed by Supratim Deka (#1019) 2019-07-10 07:49:36 +05:30
Xiaoyu Yao 030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen. 2019-07-09 14:43:55 -07:00
pifta 1dc58c5b04
HDDS-1742. Merge ozone-perf and ozonetrace example clusters
Closes #1057
2019-07-09 17:21:16 +02:00
Hanisha Koneru 8861573e8c
HDDS-1717. MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2
Closes #1056
2019-07-09 13:22:00 +02:00
Vivek Ratnavel Subramanian 82d88a8d30 HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian. 2019-07-08 21:06:50 -07:00
Mukul Kumar Singh e5ffb88257 HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. (#1050)
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
2019-07-08 20:24:12 -07:00
Lokesh Jain b5d30e4914 HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. (#1047) 2019-07-09 08:42:55 +05:30
Mukul Kumar Singh ce91d35b29
HDDS-1728. Add metrics for leader's latency in ContainerStateMachine. Contributed by Mukul Kumar Singh. (#1022) 2019-07-08 12:19:16 +05:30
Mukul Kumar Singh c9c3429a16
HDDS-1758. Add replication and key deletion tests to MiniOzoneChaosCluster. Contributed by Mukul Kumar Singh. (#1049) 2019-07-05 17:04:40 +05:30
pifta acd2d524e8
HDDS-1741. Fix prometheus configuration in ozoneperf example cluster
Closes #1045
2019-07-03 22:48:40 +02:00
Bharat Viswanadham 8965ddcf59
HDDS-1731. Implement File CreateFile Request to use Cache and DoubleBuffer. (#1044) 2019-07-03 13:15:04 -07:00
Bharat Viswanadham 91cc197227 HDDS-1757. Use ExecutorService in OzoneManagerStateMachine. (#1048) 2019-07-02 16:02:27 -07:00
Márton Elek 75b1e458b1
HDDS-1716. Smoketest results are generated with an internal user
Closes #1002
2019-07-02 22:52:06 +02:00
Elek, Márton 564758ae8d HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile (#979)
* HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile

* docker image is moved to the parent in HDDS-1667
2019-07-02 09:54:43 -07:00
Márton Elek 2f4b37b53c
HDDS-1667. Docker compose file may referring to incorrect docker image name. Contributed by Eric Yang. 2019-07-02 02:19:57 +02:00
Vivek Ratnavel Subramanian db674a0b14 HDDS-1685. Recon: Add support for "start" query param to containers and containers/{id} endpoints. 2019-07-01 12:44:14 -07:00
dineshchitlangia 1f75660350 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) 2019-07-01 08:58:47 -07:00
Mukul Kumar Singh 9df6275954 HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. (#846) 2019-07-01 20:52:32 +05:30
Bharat Viswanadham 1e727cf2a1
HDDS-1730. Implement File CreateDirectory Request to use Cache and Do… (#1026) 2019-06-30 22:38:53 -07:00
Bharat Viswanadham 49c5e8ac24
HDDS-1672. Improve locking in OzoneManager. (#1016) 2019-06-28 14:05:19 -07:00
Bharat Viswanadham 4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. (#956) 2019-06-26 18:04:12 -07:00
avijayanhwx 0a37ccf379 HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist (#1013) 2019-06-26 11:44:49 -07:00
Bharat Viswanadham a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. (#1014) 2019-06-25 17:12:45 -07:00
Anu Engineer 4b50981cfa HDDS-1709. TestScmSafeNode is flaky.
Contributed by Elek, Marton.
2019-06-25 13:57:01 -07:00
Bharat Viswanadham 049bb42760 HDDS-1723. Create new OzoneManagerLock class. (#1006)
* HDDS-1723. Create new OzoneManagerLock class.

* add logs

* fix exception message

* add license

* fix findbug

* throw exception when acquiring 2nd lock failed.

* fix review comments

* fix missed review comment

* fix checkstyle

* fix review comments
2019-06-25 08:48:03 -07:00
Elek, Márton d023f1f864 HDDS-1646. Support real persistence in the k8s example files (#945)
* HDDS-1646. Support real persistence in the k8s example files

* ephemeral clusters can be scaled up
2019-06-24 12:02:35 -07:00
Elek, Márton 004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969)
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
2019-06-24 11:56:04 -07:00
S O'Donnell cba13c7f83
HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name
Closes #1000
2019-06-21 16:25:10 +02:00
Márton Elek 256bdd6982
HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop
Closes #959
2019-06-21 14:14:06 +02:00
Bharat Viswanadham d9a9e9913e
HDDS-1579. Create OMDoubleBuffer metrics. (#871) 2019-06-20 09:42:45 -07:00
Márton Elek 9c4b15d2f4
HDDS-1508. Provide example k8s deployment files for the new CSI server
Closes #905
2019-06-20 16:36:42 +02:00
Hanisha Koneru 2dfa932818
HDDS-1684. OM should create Ratis related dirs only if ratis is enabled (#965) 2019-06-18 16:08:48 -07:00
Vivek Ratnavel Subramanian 37bd5bb342 HDDS-1702. Optimize Ozone Recon build time (#982) 2019-06-18 14:44:23 -07:00
Vivek Ratnavel Subramanian fb1ce0d50a HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints (#954) 2019-06-18 08:51:16 -07:00
Xudong Cao 3d020e914f HDDS-1532. Improve the concurrent testing framework of Freon. (#957) 2019-06-17 11:09:05 -07:00
S O'Donnell 22b36dd311
HDDS-1660. Use Picocli for Ozone Manager
Closes #925
2019-06-17 14:13:50 +02:00
Bharat Viswanadham e70aeb4d7e
HDDS-1601. Implement updating lastAppliedIndex after buffer flush to OM DB. (#972) 2019-06-15 13:47:07 -07:00
Elek, Márton 89acbbc0b9 HDDS-1677. Auditparser robot test shold use a world writable working directory (#958) 2019-06-13 16:04:14 -07:00
Chen, Junjie 940bcf01cd HDDS-1587. Support dynamically adding delegated classes from to isolated class loader. Contributed by Junjie Chen. (#942) 2019-06-12 20:08:15 -07:00