Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,289 Commits 326 Branches 371 Tags
Commit Graph

20289 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Shashikant Banerjee
27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee." 
This reverts commit a619d120a6c44bde2a846d61505a94f896e58e46.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
 2018-10-24 15:05:50 +05:30
Shashikant Banerjee
3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee
575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee." 
This reverts commit a492edee4b84e38552f185a4227b49abf60f762d.
The commit msg is wrong.
 2018-10-23 19:14:18 +05:30
Shashikant Banerjee
a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Nanda kumar
346afb0a5c HDDS-695. Introduce new SCM Commands to list and close Pipelines. 
Contributed by Nanda kumar.
 2018-10-23 18:41:30 +05:30
Shashikant Banerjee
0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 
(cherry picked from commit b61846392ee589a0217e95defbfa824f29088057)
 2018-10-23 17:01:24 +05:30
Bharat Viswanadham
51d2273e1a HDDS-705. addendum patch to fix find bug issue. Contributed by Bharat Viswanadham. 
(cherry picked from commit f6498af0d7618c580ecfbc77aff9946362efe4f3)
 2018-10-22 10:18:41 -07:00
Mukul Kumar Singh
e26f26c4c2 HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 82919a1e7af2ec22993f273e9ee64512a688c99b)
 2018-10-22 21:56:09 +05:30
Nanda kumar
ce6919734d HDDS-705. OS3Exception resource name should be the actual resource name. 
Contributed by Bharat Viswanadham.

Recommitting after making sure that patch is clean.

(cherry picked from commit 97a41b3dbeb42653c82559cd07ec4b7d7d709377)
 2018-10-22 08:56:54 -07:00
Anu Engineer
34650b18e4 HDDS-544. Unconditional wait findbug warning from ReplicationSupervisor. 
Contributed by Arpit Agarwal.

(cherry picked from commit 7db3bb3ac185929fbe8f5b9b59cdd157eec2ac64)
 2018-10-21 23:20:32 -07:00
Anu Engineer
2928f952f0 HDDS-707. Allow registering MBeans without additional jmx properties. 
Contributed by Arpit Agarwal.

(cherry picked from commit c9077a9f5a693df63c2ff797415605233e38a9a8)
 2018-10-21 23:00:09 -07:00
Anu Engineer
6417a51192 HDDS-679. Add query parameter to the constructed query in VirtualHostStyleFilter. 
Contributed by Bharat Viswanadham.

(cherry picked from commit d7b012e5600fa19b330d61a2572499f14fe9bb61)
 2018-10-19 12:02:24 -07:00
Arpit Agarwal
69cf9e66e2 HDDS-621. ozone genconf improvements. Contributed by Dinesh Chitlangia. 
(cherry picked from commit c456d6b3a5061b99141869f07dc1820ec96b7a67)
 2018-10-19 11:36:41 -07:00
Anu Engineer
4aa4936576 HDDS-701. Support key multi-delete. 
Contributed by Elek, Marton.

(cherry picked from commit 9aebafd2da44fd048d201b6ea5a043d7dda3dad9)
 2018-10-19 10:22:05 -07:00
Anu Engineer
dec5f08810 HDDS-672. Spark shell throws OzoneFileSystem not found. 
Contributed by Anu Engineer.

(cherry picked from commit cd057918d6b7f222bf2008966dc2c2de5a01d286)
 2018-10-19 09:45:38 -07:00
Anu Engineer
63375af8c1 HDDS-680. Provide web based bucket browser. 
Contributed by Elek, Marton.

(cherry picked from commit b22651e94939132c0ec9b241691e82935035a760)
 2018-10-19 08:55:56 -07:00
Anu Engineer
fac987b9a1 HDDS-690. Javadoc build fails in hadoop-ozone. 
Contributed by Takanobu Asanuma.

(cherry picked from commit f8d61b9fc2259e7bfd503924a0c2e41a0955aaed)
 2018-10-18 12:16:30 -07:00
Arpit Agarwal
ca1136fb4b HDDS-673. Suppress "Key not found" exception log with stack trace in OM. Contributed by Arpit Agarwal. 
(cherry picked from commit c64018026e66b437533d1fdea4b0d92a209e9054)
 2018-10-18 11:51:24 -07:00
Nandakumar
eeb1d432a8 HDDS-687. Exception while loading containers during SCM startup. Contributed by Lokesh Jain. 2018-10-18 18:03:33 +05:30
Bharat Viswanadham
ba7d46d21c HDDS-678. Format of Last-Modified header is invalid in HEAD Object call. Contributed by Elek Marton. 
(cherry picked from commit 3ed71633029e1d2d85b97e77b54e95d474066b4f)
 2018-10-17 20:45:43 -07:00
Hanisha Koneru
6d08833626 HDDS-670. Fix OzoneFS directory rename. 
(cherry picked from commit 9146d33e1843524885938f60c77b47d4f52e80fb)
 2018-10-17 17:54:32 -07:00
Bharat Viswanadham
3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4c4364ddd06927fa990d3e66d4eadbd4a7eb9474)
 2018-10-17 16:47:11 -07:00
Jitendra Pandey
106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Nandakumar
51a79cc71d HDDS-661. When a volume fails in datanode, VersionEndpointTask#call ends up in dead lock. Contributed by Hanisha Koneru. 
(cherry picked from commit d54f5598f4ccd1031e8295a215a3183f3647031a)
 2018-10-17 19:00:19 +05:30
Márton Elek
b2ab592e0a HDDS-527. Show SCM chill mode status in SCM UI. Contributed by Yiqun Lin. 
(cherry picked from commit a9a63ae4a8367e66d5ec86b0097326b8491e4b1e)
 2018-10-17 13:01:27 +02:00
Márton Elek
c09f808853 HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham. 2018-10-17 12:48:33 +02:00
Bharat Viswanadham
f66e3c59cb HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham. 
(cherry picked from commit 657032f5ddd2cdf111fc89c96672fe08b483cbfc)
 2018-10-16 15:31:07 -07:00
Arpit Agarwal
1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton. 
(cherry picked from commit 5f0b43fa93d02c90956d48eb5c6c0b60deeac91c)
 2018-10-16 10:40:07 -07:00
Jitendra Pandey
e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Márton Elek
0cc5bc1108 HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton. 2018-10-16 17:30:15 +02:00
Arpit Agarwal
f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 0bf8a110a56539ee85de0fc24575dd9a4c66d01b)
 2018-10-15 19:30:58 -07:00
Arpit Agarwal
15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari. 
(cherry picked from commit 2614078b213e03085635b4455ed391438eef8db2)
 2018-10-15 16:45:16 -07:00
Jitendra Pandey
b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey
a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey
0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Márton Elek
abfff4cccb HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge. 2018-10-14 12:10:31 +02:00
Anu Engineer
39ffed2a11 HDDS-653. TestMetadataStore#testIterator fails on Windows. 
Contributed by Yiqun Lin.

(cherry picked from commit 9227f3d22412f94d22f4cae6a4fb3a52ead9b011)
 2018-10-13 10:46:58 -07:00
Arpit Agarwal
690da72cd4 HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey. 
(cherry picked from commit addb84600fa2f9e010768c642db3fdc2ec497d52)
 2018-10-13 09:19:54 -07:00
Márton Elek
37f1f6dd17 HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan. 
(cherry picked from commit ae268b48943dcce1adacd4bf01231fcb21d76f3a)
 2018-10-13 15:57:17 +02:00
Márton Elek
820d1ec5d2 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:58:32 +02:00
Bharat Viswanadham
cc21ce955d HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham. 
(cherry picked from commit 28ca5c9d1647837a1b2480d8935deffc6f68d807)
 2018-10-12 17:00:09 -07:00
Anu Engineer
9e219e3707 HDDS-445. Create a logger to print out all of the incoming requests. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 3c1fe073d2fef76676660144e7dce2050761ae64)
 2018-10-12 16:29:42 -07:00
Arpit Agarwal
1a9bb57b09 HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar. 
(cherry picked from commit ddc964932817b4c4e4f4dc848dae764d5285e875)
 2018-10-12 15:06:53 -07:00
Nandakumar
c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 
(cherry picked from commit 5c8e023ba32da3e65193f6ced354efe830dba75d)
 2018-10-13 03:23:53 +05:30
Anu Engineer
9aa6c7b2ad HDDS-645. Enable OzoneFS contract tests by default. 
Contributed by Arpit Agarwal.

(cherry picked from commit c07b95bdfcd410aa82acdb1fed28e84981ff06f9)
 2018-10-12 14:46:40 -07:00
Arpit Agarwal
86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham. 
(cherry picked from commit 3a684a2b23517df996a8c30731d9b5cb3282cc2a)
 2018-10-12 14:44:56 -07:00
Anu Engineer
7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception. 
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e0779369f1363df2bb0437945fe9a271c)
 2018-10-12 14:29:59 -07:00
Bharat Viswanadham
252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 8ae8a5004f8fbe2638a3e27ab8efbe0e2e27cb8c)
 2018-10-12 14:00:25 -07:00
Arpit Agarwal
ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 56b18b9df14b91c02cf3b7f548ab58755475b374)
 2018-10-12 13:33:45 -07:00
Xiaoyu Yao
2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh. 
(cherry picked from commit 07d55292dc1536d3b34a89d4a45edf688d62a9e5)
 2018-10-12 13:26:29 -07:00