340 Commits

Author SHA1 Message Date
Akira Ajisaka
f2f3d47ab5
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
(cherry picked from commit 49412a12898eda60cb460ebf4bb9126f3c8c1f53)
2018-11-06 21:27:23 +09:00
Shashikant Banerjee
4b00044883 HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh. 2018-11-06 00:00:23 +05:30
Arpit Agarwal
db90350c97 HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru.
(cherry picked from commit c8ca1747c08d905cdefaa5566dd58d770a6b71bd)
2018-11-05 10:07:43 -08:00
Bharat Viswanadham
732df81a6e HDDS-788. Change title page of bucket browser in S3gateway. Contributed by Bharat Viswanadham.
(cherry picked from commit 6d9c18cfa9a458423b832a59166a15d098281ccd)
2018-11-02 08:02:26 -07:00
Shashikant Banerjee
39d088bc2c HDDS-771. ChunkGroupOutputStream stream entries need to be properly updated on closed container exception. Contributed by Lokesh Jain. 2018-11-01 15:50:15 +05:30
Bharat Viswanadham
8411c2bf56 HDDS-777. Fix missing jenkins issue in s3gateway module. Contributed by Bharat Viswanadham.
(cherry picked from commit c5eb237e3e951e27565d40a47b6f55e7eb399f5c)
2018-10-31 19:11:47 -07:00
Bharat Viswanadham
c0a43ac917 HDDS-677. Create documentation for s3 gateway to the docs. Contributed by Elek Marton.
(cherry picked from commit 6668c19dafde530c43ccacb23de11455ae1813b5)
2018-10-31 11:49:12 -07:00
Bharat Viswanadham
81d3e1b1ae HDDS-773. Loading ozone s3 bucket browser could be failed. Contributed by Elek Marton.
(cherry picked from commit 478b2cba0de5aadf655ac0b5a607760d46cc2a1e)
2018-10-31 07:55:10 -07:00
Márton Elek
7495fad190 HDDS-659. Implement pagination in GET bucket (object list) endpoint. Contributed by Bharat Viswanadham. 2018-10-31 12:21:38 +01:00
Márton Elek
11291d9c7a HDDS-712. Use x-amz-storage-class to specify replication type and replication factor. Contributed by Bharat Viswanadham. 2018-10-31 11:08:43 +01:00
Anu Engineer
382b73a109 HDDS-754. VolumeInfo#getScmUsed throws NPE.
Contributed by Hanisha Koneru.

(cherry picked from commit 773f0d1519715e3ddf77c139998cc12d7447da66)
2018-10-30 19:26:35 -07:00
Anu Engineer
9cc2ce1645 HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
Contributed by Mukul Kumar Singh.
2018-10-30 19:25:13 -07:00
Mukul Kumar Singh
5e48a70474 HDDS-721. NullPointerException thrown while trying to read a file when datanode restarted. Contributed by Shashikant Banerjee. 2018-10-30 19:45:32 +05:30
Arpit Agarwal
da32f6537b HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal.
(cherry picked from commit 496f0ffe9017b11d0d7c071bad259d132687c656)
2018-10-29 17:14:34 -07:00
Bharat Viswanadham
ad61bc8d99 HDDS-743. S3 multi delete request should return XML header in quiet mode. Contributed by Elek Marton.
(cherry picked from commit 3655e573e28eea79e46936d348a852158b2fc48a)
2018-10-29 15:00:51 -07:00
Nanda kumar
38f96c5f72 HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
Contributed by Mukul Kumar Singh.
2018-10-30 00:57:13 +05:30
Arpit Agarwal
9854eed1a4 HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi.
(cherry picked from commit a58048e8d545534e5b7f32e747df5a5f598889e2)
2018-10-29 09:35:24 -07:00
Anu Engineer
4c71caa30b HDDS-443. Create reusable ProgressBar utility for freon tests.
Contributed by Zsolt Horvath.
2018-10-29 15:07:36 +01:00
Anu Engineer
5bec17ebcf HDDS-604. Correct Ozone getOzoneConf description.
Contributed by Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
e0d0ef58db HDDS-568. ozone sh volume info, update, delete operations fail when volume name is not prefixed by /.
Contributed by Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
911b570d67 HDDS-559. fs.default.name is deprecated.
Contributed by  Dinesh Chitlangia.
2018-10-29 15:07:36 +01:00
Anu Engineer
78ec30cf4e HDDS-478. Log files related to each daemon doesn't have proper startup and shutdown logs.
Contributed by Dinesh Chitlangia.

(cherry picked from commit c1fe657a106aaae3bdf81fa4add70962aaee165b)
2018-10-29 15:07:36 +01:00
Márton Elek
095e8f61b7 HDDS-573. Make VirtualHostStyleFilter port agnostic. Contributed by Danilo Perez. 2018-10-29 14:51:06 +01:00
Bharat Viswanadham
63814f6d7a HDDS-739. Support MultiDeleteRequest without XML namespace. Contributed by Elek Marton.
(cherry picked from commit 199703f9853b8dfd9df114030208ed45fc830c2b)
2018-10-27 09:34:07 -07:00
Márton Elek
90871f0714 HDDS-703. Ozone docs does not render correctly on a Mobile Device. Contributed by Elek, Marton.
(cherry picked from commit c7f349bc3f9640c6beddc3ea25f35d1297190587)
2018-10-25 15:01:47 +02:00
Márton Elek
c65054afa5 HDDS-643. Parse Authorization header in a separate filter. Contributed by Bharat Viswanadham. 2018-10-25 13:07:31 +02:00
Arpit Agarwal
2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
(cherry picked from commit 244afaba4a2dd7db830a0479941e11efb114cca0)
2018-10-24 16:17:14 -07:00
Bharat Viswanadham
767fc0ba8a HDDS-516. Implement CopyObject REST endpoint. Contributed by Bharat Viswanadham.
(cherry picked from commit 021caaa55e3f4315f927adb130fe95abcfe66744)
2018-10-24 15:57:31 -07:00
Bharat Viswanadham
2777d5b051 HDDS-693. Support multi-chunk signatures in s3g PUT object endpoint. Contributed by Elek Marton.
(cherry picked from commit ebf8e1731d8f7fdba199b8285930c8fda1a7584c)
2018-10-24 12:52:15 -07:00
Shashikant Banerjee
27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee."
This reverts commit a619d120a6c44bde2a846d61505a94f896e58e46.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
2018-10-24 15:05:50 +05:30
Shashikant Banerjee
3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee
575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee."
This reverts commit a492edee4b84e38552f185a4227b49abf60f762d.
The commit msg is wrong.
2018-10-23 19:14:18 +05:30
Shashikant Banerjee
a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Shashikant Banerjee
0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee.
(cherry picked from commit b61846392ee589a0217e95defbfa824f29088057)
2018-10-23 17:01:24 +05:30
Bharat Viswanadham
51d2273e1a HDDS-705. addendum patch to fix find bug issue. Contributed by Bharat Viswanadham.
(cherry picked from commit f6498af0d7618c580ecfbc77aff9946362efe4f3)
2018-10-22 10:18:41 -07:00
Mukul Kumar Singh
e26f26c4c2 HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh.
(cherry picked from commit 82919a1e7af2ec22993f273e9ee64512a688c99b)
2018-10-22 21:56:09 +05:30
Nanda kumar
ce6919734d HDDS-705. OS3Exception resource name should be the actual resource name.
Contributed by Bharat Viswanadham.

Recommitting after making sure that patch is clean.

(cherry picked from commit 97a41b3dbeb42653c82559cd07ec4b7d7d709377)
2018-10-22 08:56:54 -07:00
Anu Engineer
2928f952f0 HDDS-707. Allow registering MBeans without additional jmx properties.
Contributed by Arpit Agarwal.

(cherry picked from commit c9077a9f5a693df63c2ff797415605233e38a9a8)
2018-10-21 23:00:09 -07:00
Anu Engineer
6417a51192 HDDS-679. Add query parameter to the constructed query in VirtualHostStyleFilter.
Contributed by Bharat Viswanadham.

(cherry picked from commit d7b012e5600fa19b330d61a2572499f14fe9bb61)
2018-10-19 12:02:24 -07:00
Arpit Agarwal
69cf9e66e2 HDDS-621. ozone genconf improvements. Contributed by Dinesh Chitlangia.
(cherry picked from commit c456d6b3a5061b99141869f07dc1820ec96b7a67)
2018-10-19 11:36:41 -07:00
Anu Engineer
4aa4936576 HDDS-701. Support key multi-delete.
Contributed by Elek, Marton.

(cherry picked from commit 9aebafd2da44fd048d201b6ea5a043d7dda3dad9)
2018-10-19 10:22:05 -07:00
Anu Engineer
dec5f08810 HDDS-672. Spark shell throws OzoneFileSystem not found.
Contributed by Anu Engineer.

(cherry picked from commit cd057918d6b7f222bf2008966dc2c2de5a01d286)
2018-10-19 09:45:38 -07:00
Anu Engineer
63375af8c1 HDDS-680. Provide web based bucket browser.
Contributed by Elek, Marton.

(cherry picked from commit b22651e94939132c0ec9b241691e82935035a760)
2018-10-19 08:55:56 -07:00
Anu Engineer
fac987b9a1 HDDS-690. Javadoc build fails in hadoop-ozone.
Contributed by Takanobu Asanuma.

(cherry picked from commit f8d61b9fc2259e7bfd503924a0c2e41a0955aaed)
2018-10-18 12:16:30 -07:00
Arpit Agarwal
ca1136fb4b HDDS-673. Suppress "Key not found" exception log with stack trace in OM. Contributed by Arpit Agarwal.
(cherry picked from commit c64018026e66b437533d1fdea4b0d92a209e9054)
2018-10-18 11:51:24 -07:00
Bharat Viswanadham
ba7d46d21c HDDS-678. Format of Last-Modified header is invalid in HEAD Object call. Contributed by Elek Marton.
(cherry picked from commit 3ed71633029e1d2d85b97e77b54e95d474066b4f)
2018-10-17 20:45:43 -07:00
Hanisha Koneru
6d08833626 HDDS-670. Fix OzoneFS directory rename.
(cherry picked from commit 9146d33e1843524885938f60c77b47d4f52e80fb)
2018-10-17 17:54:32 -07:00
Bharat Viswanadham
3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 4c4364ddd06927fa990d3e66d4eadbd4a7eb9474)
2018-10-17 16:47:11 -07:00
Jitendra Pandey
106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Márton Elek
c09f808853 HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham. 2018-10-17 12:48:33 +02:00