Shashikant Banerjee
ccceedb432
HDDS-1780. TestFailureHandlingByClient tests are flaky. Contributed by Shashikant Banerjee. ( #1073 )
2019-07-18 16:01:58 +05:30
Lokesh Jain
23e9bebe13
HDDS-1767: ContainerStateMachine should have its own executors for executing applyTransaction calls ( #1087 )
2019-07-18 14:48:13 +05:30
Bharat Viswanadham
3dc256ef81
HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. ( #1088 )
2019-07-17 21:46:27 -07:00
Bharat Viswanadham
73e6ffce69
HDDS-1802. Add Eviction policy for table cache. ( #1100 )
2019-07-17 18:19:06 -07:00
avijayanhwx
303a7f8a39
HDDS-1721 : Client Metrics are not being pushed to the configured sink while running a hadoop command to write to Ozone. ( #1034 )
2019-07-17 12:05:43 -07:00
Xiaoyu Yao
eb0849b547
HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-17 10:32:59 -07:00
Sammi Chen
493b0b5760
HDDS-1787. NPE thrown while trying to find DN closest to client. Contributed by Sammi Chen. ( #1094 )
2019-07-16 12:52:29 -07:00
Shashikant Banerjee
d21eccf8ba
HDDS-1492. Generated chunk size name too long. Contributed by Shashikannt Banerjee. ( #1084 )
2019-07-16 18:01:13 +05:30
Nanda kumar
1502e6a22f
HDDS-1756. DeleteContainerCommandHandler fails with NPE. Contributed by Nanda kumar( #1095 ).
2019-07-16 15:06:41 +05:30
Anu Engineer
47345e598e
Merge pull request #1058 from elek/HDDS-1763
...
HDDS-1763. Use vendor neutral s3 logo in ozone doc
2019-07-15 13:17:21 -07:00
Mukul Kumar Singh
0976f6fc30
HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. ( #1072 )
2019-07-14 10:53:51 +05:30
Márton Elek
9119ed07ff
HDDS-1384. TestBlockOutputStreamWithFailures is failing
...
Closes #1029
2019-07-12 11:00:03 +02:00
Hrishikesh Gadre
14c43f85de
HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. ( #1080 )
2019-07-12 14:15:48 +05:30
supratimdeka
738fab3bff
HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka ( #1081 )
2019-07-12 10:31:48 +05:30
Nanda kumar
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command.
2019-07-11 19:01:06 +05:30
Hrishikesh Gadre
acef5e0cec
HDDS-1201. Reporting corrupted containers info to SCM ( #1032 )
2019-07-11 14:49:58 +05:30
Ajay Yadav
cdb20adfcc
HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
2019-07-10 11:03:58 -07:00
supratimdeka
e0fa1040af
HDDS-1748. Error message for 3 way commit failure is not verbose. Contributed by Supratim Deka ( #1051 )
2019-07-10 16:45:55 +05:30
supratimdeka
ac7a8accdf
HDDS-1603. Handle Ratis Append Failure in Container State Machine. Contributed by Supratim Deka ( #1019 )
2019-07-10 07:49:36 +05:30
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen.
2019-07-09 14:43:55 -07:00
Mukul Kumar Singh
96d0555913
HDDS-1718. Increase Ratis Leader election timeout default. Contributed by Aravindan Vijayan & Siddharth Wagle. ( #1062 )
2019-07-09 23:17:50 +05:30
Vivek Ratnavel Subramanian
82d88a8d30
HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian.
2019-07-08 21:06:50 -07:00
Mukul Kumar Singh
e5ffb88257
HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. ( #1050 )
...
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
2019-07-08 20:24:12 -07:00
Lokesh Jain
b5d30e4914
HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. ( #1047 )
2019-07-09 08:42:55 +05:30
Mukul Kumar Singh
ce91d35b29
HDDS-1728. Add metrics for leader's latency in ContainerStateMachine. Contributed by Mukul Kumar Singh. ( #1022 )
2019-07-08 12:19:16 +05:30
Márton Elek
68f53f95ad
HDDS-1763. Use vendor neutral s3 logo in ozone doc. Contributed by Elek, Marton.
2019-07-04 17:14:19 +02:00
Mukul Kumar Singh
8b0d1adf31
HDDS-1616. ManagedChannel references are being leaked in while removing RaftGroup. Contributed by Mukul Kumar Singh. ( #1039 )
2019-07-02 14:34:49 -07:00
S O'Donnell
f8d62a9c4c
HDDS-1258. Fix error propagation for SCM protocol
...
Closes #1001
2019-07-01 20:04:32 +02:00
dineshchitlangia
1f75660350
HDDS-373. Genconf tool must generate ozone-site.xml with sample values ( #1025 )
2019-07-01 08:58:47 -07:00
Mukul Kumar Singh
9df6275954
HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. ( #846 )
2019-07-01 20:52:32 +05:30
dineshchitlangia
da568996af
HDDS-1733. Fix Ozone documentation ( #1031 )
2019-06-28 15:59:33 -07:00
Márton Elek
9fd3c702fc
HDDS-1639. Restructure documentation pages for better understanding
...
Closes #901
2019-06-28 19:51:30 +02:00
Bharat Viswanadham
4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. ( #956 )
2019-06-26 18:04:12 -07:00
avijayanhwx
0a37ccf379
HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist ( #1013 )
2019-06-26 11:44:49 -07:00
Bharat Viswanadham
a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. ( #1014 )
2019-06-25 17:12:45 -07:00
Bharat Viswanadham
049bb42760
HDDS-1723. Create new OzoneManagerLock class. ( #1006 )
...
* HDDS-1723. Create new OzoneManagerLock class.
* add logs
* fix exception message
* add license
* fix findbug
* throw exception when acquiring 2nd lock failed.
* fix review comments
* fix missed review comment
* fix checkstyle
* fix review comments
2019-06-25 08:48:03 -07:00
Elek, Márton
004207996c
HDDS-1597. Remove hdds-server-scm dependency from ozone-common ( #969 )
...
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.
* checkstyle fixes
* revert the import reorder of HddsUtil
* add javadoc
* switch back to the commons-lang2
* fix typo
* fix metrics core classpath problem (+rebase fix)
2019-06-24 11:56:04 -07:00
avijayanhwx
81d2f1b724
HDDS-1719 : Increase ratis log segment size to 1MB. ( #1005 )
...
* HDDS-1719 : Increase ratis log segment size to 1MB.
* HDDS-1719 : Increase ratis log segment size to 1MB.
2019-06-24 08:57:08 -07:00
Nanda kumar
b28ddb22a5
HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi.
2019-06-22 16:15:45 +05:30
Hrishikesh Gadre
8194a1196e
HDDS-1690. ContainerController should provide a way to retrieve containers per volume ( #986 )
2019-06-21 10:23:11 -07:00
S O'Donnell
b95a58e231
HDDS-1674. Make ScmBlockLocationProtocol message type based.
...
Closes #984
2019-06-21 11:35:43 +02:00
supratimdeka
9d6842501c
HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka ( #852 )
2019-06-19 20:11:16 +05:30
Hanisha Koneru
2dfa932818
HDDS-1684. OM should create Ratis related dirs only if ratis is enabled ( #965 )
2019-06-18 16:08:48 -07:00
avijayanhwx
71edfce187
HDDS-1699. Update RocksDB version to 6.0.1 ( #980 )
2019-06-18 11:13:13 -07:00
Márton Elek
e188bb12b0
HDDS-1694. TestNodeReportHandler is failing with NPE
...
Closes #978
2019-06-18 08:55:38 +02:00
Bharat Viswanadham
ba681bb80e
HDDS-1692. RDBTable#iterator should disabled caching of the keys during iterator. ( #975 )
2019-06-16 22:00:39 -07:00
Elek, Márton
e094b3b4cd
HDDS-1680. Create missing parent directories during the creation of HddsVolume dirs ( #961 )
2019-06-13 16:18:15 -07:00
Bharat Viswanadham
88c53d516c
HDDS-1620. Implement Volume Write Requests to use Cache and DoubleBuffer. ( #884 )
2019-06-12 17:45:42 -07:00
Sammi Chen
1732312f45
HDDS-1663. Add datanode to network topology cluster during node regis… ( #937 )
2019-06-12 12:16:42 -07:00
Márton Elek
23c037906f
Revert "HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject ( #922 )"
...
This reverts commit e997f2a34a
.
2019-06-12 08:52:16 +02:00
Elek, Márton
e997f2a34a
HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject ( #922 )
...
* HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject
* Remove Site improvements to display proposals
2019-06-11 11:20:21 -07:00
Márton Elek
f918e3fe62
HDDS-1669. SCM startup is failing if network-topology-default.xml is part of a jar
...
Closes #946
2019-06-11 19:30:22 +02:00
Shweta Yakkali
fcfe7a3cc0
HDDS-1655. Redundant toString() call for metaDataPath in KeyValueContainerCheck ( #932 )
2019-06-08 22:12:29 -07:00
Elek, Márton
46b23c11b0
HDDS-1636. Tracing id is not propagated via async datanode grpc call ( #895 )
2019-06-07 20:40:32 -07:00
S O'Donnell
85479577da
HDDS-1622. Use picocli for StorageContainerManager
...
Closes #918
2019-06-07 17:50:57 +02:00
Hanisha Koneru
a91d24fea4
HDDS-1496. Support partial chunk reads and checksum verification ( #804 )
2019-06-06 19:44:40 -07:00
Hanisha Koneru
0b115b60b0
HDDS-1371. OMSnapshotProvider to download DB checkpoint from leader OM. ( #703 )
2019-06-06 19:42:34 -07:00
Sammi Chen
8ca58efeec
HDDS-1490. Support configurable container placement policy through 'o… ( #903 )
2019-06-06 12:14:47 -07:00
Xiaoyu Yao
c7e6f076df
HDDS-1650. Fix Ozone tests leaking volume checker thread. Contributed by Xiaoyu Yao. ( #915 )
2019-06-06 23:50:04 +05:30
Xiaoyu Yao
76c0183ae3
HDDS-1652. HddsDispatcher should not shutdown volumeSet. Contributed by Xiaoyu Yao. ( #916 )
2019-06-06 23:47:59 +05:30
avijayanhwx
fe069570d8
HDDS-1647 : Recon config tag does not show up on Ozone UI. ( #914 )
2019-06-06 23:43:29 +05:30
Shweta Yakkali
c8276f3e76
HDDS-1201. Reporting Corruptions in Containers to SCM ( #912 )
2019-06-06 23:36:48 +05:30
Bharat Viswanadham
0b8a2608e0
HDDS-1605. Implement AuditLogging for OM HA Bucket write requests. ( #867 )
2019-06-06 10:13:36 -07:00
S O'Donnell
36757ad6a9
HDDS-1645. Change the version of Pico CLI to the latest 3.x release - 3.9.6
...
Closes #909
2019-06-06 16:00:00 +02:00
supratimdeka
9fded678ff
HDDS-1621. writeData in ChunkUtils should not use AsynchronousFileChannel. Contributed by Supratim Deka ( #917 )
2019-06-06 18:53:37 +05:30
Sammi Chen
73954c1dd9
HDDS-1612. Add 'scmcli printTopology' shell command to print datanode topology. Contributed by Sammi Chen.( #910 )
2019-06-05 20:13:39 -07:00
ChenSammi
0b1e288deb
HDDS-1637. Fix random test failure TestSCMContainerPlacementRackAware. Contributed by Sammi Chen. ( #904 )
2019-06-05 09:09:36 -07:00
avijayanhwx
1a78794227
HDDS-1624 : Refactor operations inside the bucket lock in OM key write. ( #882 )
2019-06-04 15:41:37 -07:00
Elek, Márton
97607f3dce
HDDS-1510. Classpath files are deployed to the maven repository as pom/jar files. Contributed by Elek, Marton. ( #900 )
2019-06-04 10:38:37 -07:00
bshashikant
e4b4fec66f
HDDS-1224. Restructure code to validate the response from server in the Read path ( #806 )
2019-06-04 10:37:02 -07:00
Mukul Kumar Singh
277e9a835b
Opening of rocksDB in datanode fails with "No locks available"
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 02:12:44 +05:30
avijayanhwx
21de9af903
HDDS-1625 : ConcurrentModificationException when SCM has containers of different owners. ( #883 )
2019-06-04 01:15:04 +05:30
Shashikant Banerjee
f3271126fc
HDDS-1558. IllegalArgumentException while processing container Reports.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 00:59:02 +05:30
Márton Elek
2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )"
...
This reverts commit baee71551d
.
2019-06-03 08:34:19 +02:00
Márton Elek
1ae062c818
HDDS-1382. Create customized CSI server for Ozone
...
Closes #693
2019-05-31 13:35:58 +02:00
Bharat Viswanadham
c965f7f499
HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. ( #850 )
2019-05-30 15:28:15 -07:00
Elek, Márton
baee71551d
HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )
2019-05-30 09:20:16 -07:00
avijayanhwx
33419a980a
HDDS-1568 : Add RocksDB metrics to OM. Contributed by Aravindan Vijayan
2019-05-30 08:48:14 -07:00
dineshchitlangia
0b907bc0e8
HDDS-1581. Atleast one of the metadata dir config property must be tagged as REQUIRED.
2019-05-30 08:39:19 -07:00
Shashikant Banerjee
18c1eebc08
HDDS-1502. Add metrics for Ozone Ratis performance.Contributed by Shashikant Banerjee( #833 ).
2019-05-30 16:17:45 +05:30
Bharat Viswanadham
751f0df710
HDDS-1231. Add ChillMode metrics. Contributed by Bharat Viswanadham.
2019-05-29 20:55:44 +02:00
Akira Ajisaka
afd844059c
HADOOP-16331. Fix ASF License check in pom.xml
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
supratimdeka
346c2b7980
HDDS-1559. Include committedBytes to determine Out of Space in VolumeChoosingPolicy. Contributed by Supratim Deka ( #841 )
2019-05-28 20:48:14 -07:00
Xiaoyu Yao
7f2e87a419
HDDS-1604. ContainerReader#initializeUsedBytes leaks DB reference. Co… ( #866 )
2019-05-28 18:39:23 -07:00
Elek, Márton
79d14d0d42
HDDS-1341. TestContainerReplication#testContainerReplication fails intermittently. Contributed by Elek, Marton. ( #862 )
2019-05-28 14:40:45 -07:00
Bharat Viswanadham
d8b18e82f0
HDDS-1602. Fix TestContainerPersistence#testDeleteBlockTwice. ( #858 )
2019-05-28 11:27:16 -07:00
Shweta Yakkali
d1ec1c52e5
HDDS-1580. Obtain Handler reference in ContainerScrubber ( #842 )
2019-05-28 11:14:24 -07:00
Mukul Kumar Singh
9f0d3412f8
HDDS-1533. JVM exit on TestHddsDatanodeService
...
Closes #859
2019-05-28 14:18:25 +02:00
Bharat Viswanadham
b70d1be685
HDDS-1559. Fix TestReplicationManager. Contributed by Bharat Viswanadham. ( #856 )
2019-05-27 17:52:09 -07:00
Elek, Márton
ec92ca6575
HDDS-1598. Fix Ozone checkstyle issues on trunk. Contributed by Elek, Marton. ( #854 )
2019-05-27 14:40:51 -07:00
Akira Ajisaka
9f933e6446
HADOOP-16323. https everywhere in Maven settings.
2019-05-27 15:24:59 +09:00
avijayanhwx
4b099b8b89
HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. ( #819 )
2019-05-23 15:34:55 -07:00
Arpit Agarwal
b4b9120e28
HDDS-1535. Space tracking for Open Containers : Handle Node Startup. Contributed by Supratim Deka ( #832 )
...
* HDDS-1535. Space tracking for Open Containers : Handle Node Startup. Contributed by Supratim Deka
* Fixed checkstyle issues.
* verifyContainerData also does fixup, renamed. Added a Javadoc comment, both as per review discussion
* fixed merge error. adapted to new signature of BlockUtils getDB
* fixed checkstyle issue post merge
2019-05-23 10:42:08 -07:00
Xiaoyu Yao
20a4ec351c
HDDS-700. Support rack awared node placement policy based on network topology. Contributed by Sammi Chen.
2019-05-23 10:40:15 -07:00
sdeka
ca93760504
fixed checkstyle issue post merge
2019-05-23 20:49:52 +05:30
sdeka
72bef0f6cb
fixed merge error. adapted to new signature of BlockUtils getDB
2019-05-23 11:36:40 +05:30
supratimdeka
9da62f33be
Merge branch 'trunk' into HDDS-1535
2019-05-23 09:51:33 +05:30
Ajay Yadav
9c61494c02
HDDS-1065. OM and DN should persist SCM certificate as the trust root. Contributed by Ajay Kumar. ( #834 )
2019-05-22 11:47:32 -07:00
Shashikant Banerjee
a315913c48
HDDS-1517. AllocateBlock call fails with ContainerNotFoundException ( #826 ). Contributed by Shashikant Banerjee.
2019-05-22 17:24:27 +05:30
Mukul Kumar Singh
2fc6f8599a
HDDS-1449. JVM Exit in datanode while committing a key. Contributed by Mukul Kumar Singh. ( #825 )
2019-05-22 17:18:40 +05:30