Commit Graph

20268 Commits

Author SHA1 Message Date
Bharat Viswanadham 3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 4c4364ddd0)
2018-10-17 16:47:11 -07:00
Jitendra Pandey 106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Nandakumar 51a79cc71d HDDS-661. When a volume fails in datanode, VersionEndpointTask#call ends up in dead lock. Contributed by Hanisha Koneru.
(cherry picked from commit d54f5598f4)
2018-10-17 19:00:19 +05:30
Márton Elek b2ab592e0a HDDS-527. Show SCM chill mode status in SCM UI. Contributed by Yiqun Lin.
(cherry picked from commit a9a63ae4a8)
2018-10-17 13:01:27 +02:00
Márton Elek c09f808853 HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham. 2018-10-17 12:48:33 +02:00
Bharat Viswanadham f66e3c59cb HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham.
(cherry picked from commit 657032f5dd)
2018-10-16 15:31:07 -07:00
Arpit Agarwal 1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton.
(cherry picked from commit 5f0b43fa93)
2018-10-16 10:40:07 -07:00
Jitendra Pandey e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Márton Elek 0cc5bc1108 HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton. 2018-10-16 17:30:15 +02:00
Arpit Agarwal f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia.
(cherry picked from commit 0bf8a110a5)
2018-10-15 19:30:58 -07:00
Arpit Agarwal 15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
(cherry picked from commit 2614078b21)
2018-10-15 16:45:16 -07:00
Jitendra Pandey b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey 0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Márton Elek abfff4cccb HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge. 2018-10-14 12:10:31 +02:00
Anu Engineer 39ffed2a11 HDDS-653. TestMetadataStore#testIterator fails on Windows.
Contributed by Yiqun Lin.

(cherry picked from commit 9227f3d224)
2018-10-13 10:46:58 -07:00
Arpit Agarwal 690da72cd4 HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey.
(cherry picked from commit addb84600f)
2018-10-13 09:19:54 -07:00
Márton Elek 37f1f6dd17 HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan.
(cherry picked from commit ae268b4894)
2018-10-13 15:57:17 +02:00
Márton Elek 820d1ec5d2 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:58:32 +02:00
Bharat Viswanadham cc21ce955d HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham.
(cherry picked from commit 28ca5c9d16)
2018-10-12 17:00:09 -07:00
Anu Engineer 9e219e3707 HDDS-445. Create a logger to print out all of the incoming requests.
Contributed by Bharat Viswanadham.

(cherry picked from commit 3c1fe073d2)
2018-10-12 16:29:42 -07:00
Arpit Agarwal 1a9bb57b09 HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar.
(cherry picked from commit ddc9649328)
2018-10-12 15:06:53 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
(cherry picked from commit 5c8e023ba3)
2018-10-13 03:23:53 +05:30
Anu Engineer 9aa6c7b2ad HDDS-645. Enable OzoneFS contract tests by default.
Contributed by Arpit Agarwal.

(cherry picked from commit c07b95bdfc)
2018-10-12 14:46:40 -07:00
Arpit Agarwal 86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham.
(cherry picked from commit 3a684a2b23)
2018-10-12 14:44:56 -07:00
Anu Engineer 7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception.
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e07)
2018-10-12 14:29:59 -07:00
Bharat Viswanadham 252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 8ae8a5004f)
2018-10-12 14:00:25 -07:00
Arpit Agarwal ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh.
(cherry picked from commit 56b18b9df1)
2018-10-12 13:33:45 -07:00
Xiaoyu Yao 2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh.
(cherry picked from commit 07d55292dc)
2018-10-12 13:26:29 -07:00
Xiaoyu Yao 4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
(cherry picked from commit e12edb3d8f)
2018-10-12 13:26:29 -07:00
Arpit Agarwal 2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh.
(cherry picked from commit 85ccab7d3f)
2018-10-12 11:31:06 -07:00
Anu Engineer 7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2.
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48ced)
2018-10-12 11:18:10 -07:00
Bharat Viswanadham 645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham.
(cherry picked from commit 38fe447d93)
2018-10-12 10:03:31 -07:00
Yiqun Lin 54a229c332 HDDS-628. Fix outdated names used in HDDS documentations.
(cherry picked from commit 5da042227c)
2018-10-12 14:01:47 +08:00
Bharat Viswanadham 67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru.
(cherry picked from commit 74db993a61)
2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Anu Engineer 587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir.
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a)
2018-10-11 17:26:02 -07:00
Arpit Agarwal ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal.
(cherry picked from commit 50552479c4)
2018-10-11 17:21:46 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao 72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh.
(cherry picked from commit c05b260069)
2018-10-11 15:12:06 -07:00
Hanisha Koneru 43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception.
(cherry picked from commit eb34b5f8af)
2018-10-11 13:48:02 -07:00
Arpit Agarwal e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma.
(cherry picked from commit 47eeb3eb7b)
2018-10-11 09:20:20 -07:00
Arpit Agarwal d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia.
(cherry picked from commit 2bd000c851)
2018-10-10 17:37:29 -07:00
Nanda kumar 79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh.
(cherry picked from commit 90552b1ea8)
2018-10-10 20:51:23 +05:30
Márton Elek b64fcc71f1 HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge.
(cherry picked from commit cd280514b8)
2018-10-10 15:38:53 +02:00
Bharat Viswanadham 056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari.
(cherry picked from commit 6a39739316)
2018-10-09 15:21:50 -07:00
Bharat Viswanadham 308c614d4a HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton.
(cherry picked from commit d5dd6f31fc)
2018-10-09 12:44:24 -07:00
Arpit Agarwal d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari.
(cherry picked from commit 03d66b1f5d)
2018-10-09 11:05:23 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee.
(cherry picked from commit 7367ff333b)
2018-10-09 22:31:19 +05:30
Nanda kumar 4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri.
(cherry picked from commit 9e9915ddab)
2018-10-09 22:30:31 +05:30