Commit Graph

20276 Commits

Author SHA1 Message Date
Anu Engineer 4aa4936576 HDDS-701. Support key multi-delete.
Contributed by Elek, Marton.

(cherry picked from commit 9aebafd2da)
2018-10-19 10:22:05 -07:00
Anu Engineer dec5f08810 HDDS-672. Spark shell throws OzoneFileSystem not found.
Contributed by Anu Engineer.

(cherry picked from commit cd057918d6)
2018-10-19 09:45:38 -07:00
Anu Engineer 63375af8c1 HDDS-680. Provide web based bucket browser.
Contributed by Elek, Marton.

(cherry picked from commit b22651e949)
2018-10-19 08:55:56 -07:00
Anu Engineer fac987b9a1 HDDS-690. Javadoc build fails in hadoop-ozone.
Contributed by Takanobu Asanuma.

(cherry picked from commit f8d61b9fc2)
2018-10-18 12:16:30 -07:00
Arpit Agarwal ca1136fb4b HDDS-673. Suppress "Key not found" exception log with stack trace in OM. Contributed by Arpit Agarwal.
(cherry picked from commit c64018026e)
2018-10-18 11:51:24 -07:00
Nandakumar eeb1d432a8 HDDS-687. Exception while loading containers during SCM startup. Contributed by Lokesh Jain. 2018-10-18 18:03:33 +05:30
Bharat Viswanadham ba7d46d21c HDDS-678. Format of Last-Modified header is invalid in HEAD Object call. Contributed by Elek Marton.
(cherry picked from commit 3ed7163302)
2018-10-17 20:45:43 -07:00
Hanisha Koneru 6d08833626 HDDS-670. Fix OzoneFS directory rename.
(cherry picked from commit 9146d33e18)
2018-10-17 17:54:32 -07:00
Bharat Viswanadham 3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 4c4364ddd0)
2018-10-17 16:47:11 -07:00
Jitendra Pandey 106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Nandakumar 51a79cc71d HDDS-661. When a volume fails in datanode, VersionEndpointTask#call ends up in dead lock. Contributed by Hanisha Koneru.
(cherry picked from commit d54f5598f4)
2018-10-17 19:00:19 +05:30
Márton Elek b2ab592e0a HDDS-527. Show SCM chill mode status in SCM UI. Contributed by Yiqun Lin.
(cherry picked from commit a9a63ae4a8)
2018-10-17 13:01:27 +02:00
Márton Elek c09f808853 HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham. 2018-10-17 12:48:33 +02:00
Bharat Viswanadham f66e3c59cb HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham.
(cherry picked from commit 657032f5dd)
2018-10-16 15:31:07 -07:00
Arpit Agarwal 1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton.
(cherry picked from commit 5f0b43fa93)
2018-10-16 10:40:07 -07:00
Jitendra Pandey e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Márton Elek 0cc5bc1108 HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton. 2018-10-16 17:30:15 +02:00
Arpit Agarwal f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia.
(cherry picked from commit 0bf8a110a5)
2018-10-15 19:30:58 -07:00
Arpit Agarwal 15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
(cherry picked from commit 2614078b21)
2018-10-15 16:45:16 -07:00
Jitendra Pandey b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey 0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Márton Elek abfff4cccb HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge. 2018-10-14 12:10:31 +02:00
Anu Engineer 39ffed2a11 HDDS-653. TestMetadataStore#testIterator fails on Windows.
Contributed by Yiqun Lin.

(cherry picked from commit 9227f3d224)
2018-10-13 10:46:58 -07:00
Arpit Agarwal 690da72cd4 HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey.
(cherry picked from commit addb84600f)
2018-10-13 09:19:54 -07:00
Márton Elek 37f1f6dd17 HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan.
(cherry picked from commit ae268b4894)
2018-10-13 15:57:17 +02:00
Márton Elek 820d1ec5d2 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:58:32 +02:00
Bharat Viswanadham cc21ce955d HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham.
(cherry picked from commit 28ca5c9d16)
2018-10-12 17:00:09 -07:00
Anu Engineer 9e219e3707 HDDS-445. Create a logger to print out all of the incoming requests.
Contributed by Bharat Viswanadham.

(cherry picked from commit 3c1fe073d2)
2018-10-12 16:29:42 -07:00
Arpit Agarwal 1a9bb57b09 HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar.
(cherry picked from commit ddc9649328)
2018-10-12 15:06:53 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
(cherry picked from commit 5c8e023ba3)
2018-10-13 03:23:53 +05:30
Anu Engineer 9aa6c7b2ad HDDS-645. Enable OzoneFS contract tests by default.
Contributed by Arpit Agarwal.

(cherry picked from commit c07b95bdfc)
2018-10-12 14:46:40 -07:00
Arpit Agarwal 86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham.
(cherry picked from commit 3a684a2b23)
2018-10-12 14:44:56 -07:00
Anu Engineer 7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception.
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e07)
2018-10-12 14:29:59 -07:00
Bharat Viswanadham 252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 8ae8a5004f)
2018-10-12 14:00:25 -07:00
Arpit Agarwal ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh.
(cherry picked from commit 56b18b9df1)
2018-10-12 13:33:45 -07:00
Xiaoyu Yao 2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh.
(cherry picked from commit 07d55292dc)
2018-10-12 13:26:29 -07:00
Xiaoyu Yao 4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
(cherry picked from commit e12edb3d8f)
2018-10-12 13:26:29 -07:00
Arpit Agarwal 2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh.
(cherry picked from commit 85ccab7d3f)
2018-10-12 11:31:06 -07:00
Anu Engineer 7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2.
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48ced)
2018-10-12 11:18:10 -07:00
Bharat Viswanadham 645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham.
(cherry picked from commit 38fe447d93)
2018-10-12 10:03:31 -07:00
Yiqun Lin 54a229c332 HDDS-628. Fix outdated names used in HDDS documentations.
(cherry picked from commit 5da042227c)
2018-10-12 14:01:47 +08:00
Bharat Viswanadham 67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru.
(cherry picked from commit 74db993a61)
2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Anu Engineer 587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir.
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a)
2018-10-11 17:26:02 -07:00
Arpit Agarwal ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal.
(cherry picked from commit 50552479c4)
2018-10-11 17:21:46 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao 72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh.
(cherry picked from commit c05b260069)
2018-10-11 15:12:06 -07:00
Hanisha Koneru 43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception.
(cherry picked from commit eb34b5f8af)
2018-10-11 13:48:02 -07:00
Arpit Agarwal e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma.
(cherry picked from commit 47eeb3eb7b)
2018-10-11 09:20:20 -07:00