Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,332 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

165 Commits

Author SHA1 Message Date
Márton Elek ebbf459e6a HDDS-602. Version changes for 0.3.0-alpha release 2018-11-14 17:21:56 +01:00
Shashikant Banerjee 3923a4a279 HDDS-834. Datanode goes OOM based because of segment size. Contributed by Mukul Kumar Singh. 2018-11-14 15:50:46 +05:30
Shashikant Banerjee 788cf061cd HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh. 2018-11-09 00:59:48 +05:30
Akira Ajisaka f2f3d47ab5
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain. 
(cherry picked from commit 49412a1289)
 2018-11-06 21:27:23 +09:00
Arpit Agarwal 53d4aefae8 HDDS-794. Add configs to set StateMachineData write timeout in ContainerStateMachine. Contributed by Shashikant Banerjee. 
(cherry picked from commit 408f59caa9321be8a55afe44b1811c5dacf23206)
 2018-11-05 10:10:17 -08:00
Arpit Agarwal da32f6537b HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal. 
(cherry picked from commit 496f0ffe90)
 2018-10-29 17:14:34 -07:00
Arpit Agarwal 9854eed1a4 HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi. 
(cherry picked from commit a58048e8d5)
 2018-10-29 09:35:24 -07:00
Arpit Agarwal 2d8bb2ac02 HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal. 
(cherry picked from commit 244afaba4a)
 2018-10-24 16:17:14 -07:00
Shashikant Banerjee 27bbbd0f9d Revert "HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee." 
This reverts commit a619d120a6.
This change introduces a new state for container replica called UNHEALTHY, which is not handled in SCM currently.
 2018-10-24 15:05:50 +05:30
Shashikant Banerjee 3191afa121 HDDS-676. Enable Read from open Containers via Standalone Protocol. Contributed by Shashikant Banerjee. 2018-10-23 19:19:58 +05:30
Shashikant Banerjee 575613ef7a Revert "HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee." 
This reverts commit a492edee4b.
The commit msg is wrong.
 2018-10-23 19:14:18 +05:30
Shashikant Banerjee a492edee4b HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 19:02:12 +05:30
Nanda kumar 346afb0a5c HDDS-695. Introduce new SCM Commands to list and close Pipelines. 
Contributed by Nanda kumar.
 2018-10-23 18:41:30 +05:30
Shashikant Banerjee 0674f11fc0 HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 
(cherry picked from commit b61846392e)
 2018-10-23 17:01:24 +05:30
Mukul Kumar Singh e26f26c4c2 HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 82919a1e7a)
 2018-10-22 21:56:09 +05:30
Anu Engineer 2928f952f0 HDDS-707. Allow registering MBeans without additional jmx properties. 
Contributed by Arpit Agarwal.

(cherry picked from commit c9077a9f5a)
 2018-10-21 23:00:09 -07:00
Jitendra Pandey 106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Arpit Agarwal 1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton. 
(cherry picked from commit 5f0b43fa93)
 2018-10-16 10:40:07 -07:00
Jitendra Pandey a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey 0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Anu Engineer 39ffed2a11 HDDS-653. TestMetadataStore#testIterator fails on Windows. 
Contributed by Yiqun Lin.

(cherry picked from commit 9227f3d224)
 2018-10-13 10:46:58 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 
(cherry picked from commit 5c8e023ba3)
 2018-10-13 03:23:53 +05:30
Arpit Agarwal 86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham. 
(cherry picked from commit 3a684a2b23)
 2018-10-12 14:44:56 -07:00
Anu Engineer 7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception. 
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e07)
 2018-10-12 14:29:59 -07:00
Arpit Agarwal ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal. 
(cherry picked from commit 50552479c4)
 2018-10-11 17:21:46 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Arpit Agarwal d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 2bd000c851)
 2018-10-10 17:37:29 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333b)
 2018-10-09 22:31:19 +05:30
Nanda kumar 4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri. 
(cherry picked from commit 9e9915ddab)
 2018-10-09 22:30:31 +05:30
Ajay Kumar cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Bharat Viswanadham 2a07617f85 HDDS-354. VolumeInfo.getScmUsed throws NPE. Contributed by Hanisha Koneru. 2018-10-04 21:46:17 -07:00
Anu Engineer e6b77ad65f HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1. 
Contributed by Anu Engineer.
 2018-10-04 21:40:13 -07:00
Bharat Viswanadham 4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Anu Engineer 0da03f8b14 HDDS-391. Simplify Audit Framework to make audit logging easier to use. 
Contributed by Dinesh Chitlangia.
 2018-09-28 14:00:24 -07:00
Nanda kumar 3f6195045e HDDS-554. In XceiverClientSpi, implement sendCommand(..) using sendCommandAsync(..). Contributed by Tsz Wo Nicholas Sze. 2018-09-26 09:16:23 +05:30
Ajay Kumar 3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham 9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Anu Engineer 096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis. 
Contributed Dinesh Chitlangia.
 2018-09-20 11:51:49 -07:00
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Xiaoyu Yao e435e12f1f HDDS-506. Fields in AllocateScmBlockResponseProto should be optional. Contributed by Arpit Agarwal. 2018-09-18 23:21:29 -07:00
Xiaoyu Yao 295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer f938925bde HDDS-464. Fix TestCloseContainerHandlingByClient. 
Contributed by Lokesh Jain.
 2018-09-18 10:45:51 -07:00
Nanda kumar 846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Xiaoyu Yao 95231f1749 HDDS-362. Modify functions impacted by SCM chill mode in ScmBlockLocationProtocol. Contributed by Ajay Kumar. 2018-09-16 17:55:46 -07:00
Nanda kumar 87e2c0f425 HDDS-465. Suppress group mapping lookup warnings for ozone. Contributed by Xiaoyu Yao. 2018-09-15 23:14:57 +05:30
Nanda kumar c9fa081897 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar. 2018-09-15 23:11:39 +05:30
Arpit Agarwal a12f12f1af HDDS-438. 'ozone oz' should print usage when command or sub-command is missing. Contributed by Dinesh Chitlangia. 2018-09-14 07:02:28 -07:00
Hanisha Koneru 291dcf2247 HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton. 2018-09-13 16:37:44 -07:00