Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,299 Commits 326 Branches 371 Tags
Commit Graph

180 Commits

Author SHA1 Message Date
Arpit Agarwal
2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal. 
(cherry picked from commit 244afaba4a2dd7db830a0479941e11efb114cca0)
 2018-10-24 16:17:14 -07:00
Shashikant Banerjee
27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee." 
This reverts commit a619d120a6c44bde2a846d61505a94f896e58e46.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
 2018-10-24 15:05:50 +05:30
Shashikant Banerjee
3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee
575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee." 
This reverts commit a492edee4b84e38552f185a4227b49abf60f762d.
The commit msg is wrong.
 2018-10-23 19:14:18 +05:30
Shashikant Banerjee
a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Shashikant Banerjee
0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 
(cherry picked from commit b61846392ee589a0217e95defbfa824f29088057)
 2018-10-23 17:01:24 +05:30
Bharat Viswanadham
3c11dec714 HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4c4364ddd06927fa990d3e66d4eadbd4a7eb9474)
 2018-10-17 16:47:11 -07:00
Arpit Agarwal
1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton. 
(cherry picked from commit 5f0b43fa93d02c90956d48eb5c6c0b60deeac91c)
 2018-10-16 10:40:07 -07:00
Jitendra Pandey
e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Arpit Agarwal
f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 0bf8a110a56539ee85de0fc24575dd9a4c66d01b)
 2018-10-15 19:30:58 -07:00
Arpit Agarwal
15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari. 
(cherry picked from commit 2614078b213e03085635b4455ed391438eef8db2)
 2018-10-15 16:45:16 -07:00
Jitendra Pandey
b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey
a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey
0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Nandakumar
c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 
(cherry picked from commit 5c8e023ba32da3e65193f6ced354efe830dba75d)
 2018-10-13 03:23:53 +05:30
Bharat Viswanadham
252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 8ae8a5004f8fbe2638a3e27ab8efbe0e2e27cb8c)
 2018-10-12 14:00:25 -07:00
Xiaoyu Yao
2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh. 
(cherry picked from commit 07d55292dc1536d3b34a89d4a45edf688d62a9e5)
 2018-10-12 13:26:29 -07:00
Xiaoyu Yao
4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh. 
(cherry picked from commit e12edb3d8f05ff6206c6de1b81ecfa1a03abb193)
 2018-10-12 13:26:29 -07:00
Anu Engineer
7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48cedb0d70ca154771fec48e5c4129cf29a)
 2018-10-12 11:18:10 -07:00
Jitendra Pandey
077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Arpit Agarwal
d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari. 
(cherry picked from commit 03d66b1f5d8936e8006b87511af7a647ed1c3fcd)
 2018-10-09 11:05:23 -07:00
Nanda kumar
abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333bf332b300e0acd6e7501ce8139a1998)
 2018-10-09 22:31:19 +05:30
Bharat Viswanadham
7fb91b8a53 HDDS-565. TestContainerPersistence fails regularly in Jenkins. Contributed by Dinesh Chitlangia. 2018-10-04 21:27:12 -07:00
Nanda kumar
095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar
7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Nanda kumar
a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Bharat Viswanadham
4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Nanda kumar
f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Hanisha Koneru
72891fc9be HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. 2018-09-28 11:24:42 -07:00
Ajay Kumar
3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham
9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham
62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Anu Engineer
096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis. 
Contributed Dinesh Chitlangia.
 2018-09-20 11:51:49 -07:00
Anu Engineer
98c9bc4aa0 HDDS-509. TestStorageContainerManager is flaky. 
Contributed by Xiaoyu Yao and Ajay Kumar.
 2018-09-19 13:03:19 -07:00
Nanda kumar
61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Nanda kumar
c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Xiaoyu Yao
3929653707 HDDS-488. Handle chill mode exception from SCM in OzoneManager. Contributed by Ajay Kumar. 2018-09-18 20:05:25 -07:00
Arpit Agarwal
17f5651a51 HDDS-503. Suppress ShellBasedUnixGroupsMapping exception in tests. Contributed by Arpit Agarwal. 2018-09-18 16:06:21 -07:00
Arpit Agarwal
7ff00f5587 HDDS-500. TestErrorCode.java has wrong package name. Contributed by Anu Engineer. 2018-09-18 15:52:00 -07:00
Xiaoyu Yao
295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer
f938925bde HDDS-464. Fix TestCloseContainerHandlingByClient. 
Contributed by Lokesh Jain.
 2018-09-18 10:45:51 -07:00
Nanda kumar
846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Arpit Agarwal
82fbbd546c HDDS-469. Rename 'ozone oz' to 'ozone sh'. Contributed by Arpit Agarwal. 2018-09-15 22:12:47 -07:00
Márton Elek
985f3bf3fb HDDS-409. Ozone acceptance-test and integration-test packages have undefined hadoop component. Contributed by Dinesh Chitlangia. 2018-09-15 13:21:32 +02:00
Xiaoyu Yao
6f037468bc HDDS-419. ChunkInputStream bulk read api does not read from all the chunks. Contributed by Lokesh Jain and Mukul Kumar. 2018-09-14 13:45:38 -07:00
Nanda kumar
c1df3084ff HDDS-389. Remove XceiverServer and XceiverClient and related classes. Contributed by chencan. 2018-09-15 00:20:19 +05:30
Arpit Agarwal
a12f12f1af HDDS-438. 'ozone oz' should print usage when command or sub-command is missing. Contributed by Dinesh Chitlangia. 2018-09-14 07:02:28 -07:00
Mukul Kumar Singh
c9e0b69ab3 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 2018-09-13 19:01:07 +05:30
Márton Elek
9011567169 HDDS-425. Move unit test of the genconf tool to hadoop-ozone/tools module. Contributed by Dinesh Chitlangia. 2018-09-12 11:11:12 +02:00
Anu Engineer
a406f6f60e HDDS-424. Consolidate ozone oz parameters to use GNU convention. 
Contributed by Elek, Marton.
 2018-09-11 16:47:33 -07:00