20331 Commits

Author SHA1 Message Date
Shashikant Banerjee
3923a4a279 HDDS-834. Datanode goes OOM based because of segment size. Contributed by Mukul Kumar Singh. 2018-11-14 15:50:46 +05:30
Anu Engineer
a2fa8324d4 HDDS-832.Docs folder is missing from the Ozone distribution package.
Contributed by Elek, Marton.
2018-11-12 15:21:31 -08:00
Tsz Wo Nicholas Sze
612236b574 HDDS-826. Update Ratis to 0.3.0-6f3419a-SNAPSHOT. 2018-11-09 18:39:03 -08:00
Mukul Kumar Singh
feb43ecbb4 HDDS-824. WriteStateMachineData timesout leading to Datanode crash. Contributed by Mukul Kumar Singh. 2018-11-09 18:15:24 +05:30
Bharat Viswanadham
a5b72cb1b8 HDDS-823. OzoneRestClient is failing with NPE on getKeyDetails call. Contributed by Bharat Viswanadham.
(cherry picked from commit 47194fefdd7a225399342af1960cbd219a9b4763)
2018-11-08 21:28:59 -08:00
Bharat Viswanadham
6bb401616c HDDS-812. TestEndPoint#testCheckVersionResponse is failing. Contributed by Hanisha Koneru.
(cherry picked from commit 66bf62404a038193fe5849c84edaa062d8e05f44)
2018-11-08 17:53:14 -08:00
Shashikant Banerjee
788cf061cd HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh. 2018-11-09 00:59:48 +05:30
Márton Elek
aed5046f8d HDDS-798. Storage-class is showing incorrectly. Contributed by Bharat Viswanadham. 2018-11-06 18:30:09 +01:00
Akira Ajisaka
f2f3d47ab5
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
(cherry picked from commit 49412a12898eda60cb460ebf4bb9126f3c8c1f53)
2018-11-06 21:27:23 +09:00
Shashikant Banerjee
4b00044883 HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh. 2018-11-06 00:00:23 +05:30
Arpit Agarwal
53d4aefae8 HDDS-794. Add configs to set StateMachineData write timeout in ContainerStateMachine. Contributed by Shashikant Banerjee.
(cherry picked from commit 408f59caa9321be8a55afe44b1811c5dacf23206)
2018-11-05 10:10:17 -08:00
Arpit Agarwal
db90350c97 HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru.
(cherry picked from commit c8ca1747c08d905cdefaa5566dd58d770a6b71bd)
2018-11-05 10:07:43 -08:00
Bharat Viswanadham
732df81a6e HDDS-788. Change title page of bucket browser in S3gateway. Contributed by Bharat Viswanadham.
(cherry picked from commit 6d9c18cfa9a458423b832a59166a15d098281ccd)
2018-11-02 08:02:26 -07:00
Nanda kumar
73fbde31c6 HDDS-775. Batch updates to container db to minimize number of updates.
Contributed by Mukul Kumar Singh.
2018-11-01 17:56:34 +05:30
Shashikant Banerjee
39d088bc2c HDDS-771. ChunkGroupOutputStream stream entries need to be properly updated on closed container exception. Contributed by Lokesh Jain. 2018-11-01 15:50:15 +05:30
Yiqun Lin
73e9e43483 HDDS-786. Fix the findbugs for SCMClientProtocolServer#getContainerWithPipeline.
(cherry picked from commit 2e8ac14dcb57a0fe07b2119c26535c3541665b70)
2018-11-01 14:12:30 +08:00
Bharat Viswanadham
8411c2bf56 HDDS-777. Fix missing jenkins issue in s3gateway module. Contributed by Bharat Viswanadham.
(cherry picked from commit c5eb237e3e951e27565d40a47b6f55e7eb399f5c)
2018-10-31 19:11:47 -07:00
Bharat Viswanadham
c0a43ac917 HDDS-677. Create documentation for s3 gateway to the docs. Contributed by Elek Marton.
(cherry picked from commit 6668c19dafde530c43ccacb23de11455ae1813b5)
2018-10-31 11:49:12 -07:00
Bharat Viswanadham
81d3e1b1ae HDDS-773. Loading ozone s3 bucket browser could be failed. Contributed by Elek Marton.
(cherry picked from commit 478b2cba0de5aadf655ac0b5a607760d46cc2a1e)
2018-10-31 07:55:10 -07:00
Márton Elek
7495fad190 HDDS-659. Implement pagination in GET bucket (object list) endpoint. Contributed by Bharat Viswanadham. 2018-10-31 12:21:38 +01:00
Márton Elek
11291d9c7a HDDS-712. Use x-amz-storage-class to specify replication type and replication factor. Contributed by Bharat Viswanadham. 2018-10-31 11:08:43 +01:00
Anu Engineer
382b73a109 HDDS-754. VolumeInfo#getScmUsed throws NPE.
Contributed by Hanisha Koneru.

(cherry picked from commit 773f0d1519715e3ddf77c139998cc12d7447da66)
2018-10-30 19:26:35 -07:00
Anu Engineer
9cc2ce1645 HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
Contributed by Mukul Kumar Singh.
2018-10-30 19:25:13 -07:00
Mukul Kumar Singh
5e48a70474 HDDS-721. NullPointerException thrown while trying to read a file when datanode restarted. Contributed by Shashikant Banerjee. 2018-10-30 19:45:32 +05:30
Arpit Agarwal
da32f6537b HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal.
(cherry picked from commit 496f0ffe9017b11d0d7c071bad259d132687c656)
2018-10-29 17:14:34 -07:00
Bharat Viswanadham
ad61bc8d99 HDDS-743. S3 multi delete request should return XML header in quiet mode. Contributed by Elek Marton.
(cherry picked from commit 3655e573e28eea79e46936d348a852158b2fc48a)
2018-10-29 15:00:51 -07:00
Nanda kumar
38f96c5f72 HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
Contributed by Mukul Kumar Singh.
2018-10-30 00:57:13 +05:30
Arpit Agarwal
9854eed1a4 HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi.
(cherry picked from commit a58048e8d545534e5b7f32e747df5a5f598889e2)
2018-10-29 09:35:24 -07:00
Mukul Kumar Singh
031cdf5d5f HDDS-714. Bump protobuf version to 3.5.1. Contributed by Mukul Kumar Singh.
(cherry picked from commit ace06a93baa09293c254d18c709162771738b092)
2018-10-29 15:07:36 +01:00
Anu Engineer
4c71caa30b HDDS-443. Create reusable ProgressBar utility for freon tests.
Contributed by Zsolt Horvath.
2018-10-29 15:07:36 +01:00
Anu Engineer
5bec17ebcf HDDS-604. Correct Ozone getOzoneConf description.
Contributed by Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
e0d0ef58db HDDS-568. ozone sh volume info, update, delete operations fail when volume name is not prefixed by /.
Contributed by Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
911b570d67 HDDS-559. fs.default.name is deprecated.
Contributed by  Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
78ec30cf4e HDDS-478. Log files related to each daemon doesn't have proper startup and shutdown logs.
Contributed by Dinesh Chitlangia.

(cherry picked from commit c1fe657a106aaae3bdf81fa4add70962aaee165b)
2018-10-29 15:07:36 +01:00
Márton Elek
095e8f61b7 HDDS-573. Make VirtualHostStyleFilter port agnostic. Contributed by Danilo Perez. 2018-10-29 14:51:06 +01:00
Bharat Viswanadham
63814f6d7a HDDS-739. Support MultiDeleteRequest without XML namespace. Contributed by Elek Marton.
(cherry picked from commit 199703f9853b8dfd9df114030208ed45fc830c2b)
2018-10-27 09:34:07 -07:00
Márton Elek
90871f0714 HDDS-703. Ozone docs does not render correctly on a Mobile Device. Contributed by Elek, Marton.
(cherry picked from commit c7f349bc3f9640c6beddc3ea25f35d1297190587)
2018-10-25 15:01:47 +02:00
Márton Elek
c65054afa5 HDDS-643. Parse Authorization header in a separate filter. Contributed by Bharat Viswanadham. 2018-10-25 13:07:31 +02:00
Arpit Agarwal
2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
(cherry picked from commit 244afaba4a2dd7db830a0479941e11efb114cca0)
2018-10-24 16:17:14 -07:00
Bharat Viswanadham
767fc0ba8a HDDS-516. Implement CopyObject REST endpoint. Contributed by Bharat Viswanadham.
(cherry picked from commit 021caaa55e3f4315f927adb130fe95abcfe66744)
2018-10-24 15:57:31 -07:00
Bharat Viswanadham
2777d5b051 HDDS-693. Support multi-chunk signatures in s3g PUT object endpoint. Contributed by Elek Marton.
(cherry picked from commit ebf8e1731d8f7fdba199b8285930c8fda1a7584c)
2018-10-24 12:52:15 -07:00
Shashikant Banerjee
d37705c0f1 HDDS-716. Update ozone to latest ratis snapshot build(0.3.0-aa38160-SNAPSHOT). Contributed by Mukul Kumar Singh.
(cherry picked from commit 0891cdda7961f7d0d7debdb8e89b7816f39f7c7b)
2018-10-24 08:34:34 -07:00
Shashikant Banerjee
27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee."
This reverts commit a619d120a6c44bde2a846d61505a94f896e58e46.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
2018-10-24 15:05:50 +05:30
Shashikant Banerjee
3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee
575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee."
This reverts commit a492edee4b84e38552f185a4227b49abf60f762d.
The commit msg is wrong.
2018-10-23 19:14:18 +05:30
Shashikant Banerjee
a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Nanda kumar
346afb0a5c HDDS-695. Introduce new SCM Commands to list and close Pipelines.
Contributed by Nanda kumar.
2018-10-23 18:41:30 +05:30
Shashikant Banerjee
0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee.
(cherry picked from commit b61846392ee589a0217e95defbfa824f29088057)
2018-10-23 17:01:24 +05:30
Bharat Viswanadham
51d2273e1a HDDS-705. addendum patch to fix find bug issue. Contributed by Bharat Viswanadham.
(cherry picked from commit f6498af0d7618c580ecfbc77aff9946362efe4f3)
2018-10-22 10:18:41 -07:00
Mukul Kumar Singh
e26f26c4c2 HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh.
(cherry picked from commit 82919a1e7af2ec22993f273e9ee64512a688c99b)
2018-10-22 21:56:09 +05:30