Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,236 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

289 Commits

Author SHA1 Message Date
Bharat Viswanadham 67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru. 
(cherry picked from commit 74db993a61)
 2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Arpit Agarwal ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal. 
(cherry picked from commit 50552479c4)
 2018-10-11 17:21:46 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Hanisha Koneru 43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception. 
(cherry picked from commit eb34b5f8af)
 2018-10-11 13:48:02 -07:00
Arpit Agarwal d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 2bd000c851)
 2018-10-10 17:37:29 -07:00
Nanda kumar 79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 90552b1ea8)
 2018-10-10 20:51:23 +05:30
Bharat Viswanadham 056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari. 
(cherry picked from commit 6a39739316)
 2018-10-09 15:21:50 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333b)
 2018-10-09 22:31:19 +05:30
Nanda kumar 4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri. 
(cherry picked from commit 9e9915ddab)
 2018-10-09 22:30:31 +05:30
Ajay Kumar cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Nanda kumar f362037527 HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh. 2018-10-05 16:47:01 +05:30
Bharat Viswanadham 2a07617f85 HDDS-354. VolumeInfo.getScmUsed throws NPE. Contributed by Hanisha Koneru. 2018-10-04 21:46:17 -07:00
Anu Engineer e6b77ad65f HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1. 
Contributed by Anu Engineer.
 2018-10-04 21:40:13 -07:00
Nanda kumar 095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar 7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Nanda kumar a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Bharat Viswanadham 4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Ajay Kumar cc80ac2315 HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar. 2018-10-01 11:21:26 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Anu Engineer 0da03f8b14 HDDS-391. Simplify Audit Framework to make audit logging easier to use. 
Contributed by Dinesh Chitlangia.
 2018-09-28 14:00:24 -07:00
Ajay Kumar 3c798c1e3c HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. 2018-09-28 10:33:17 -07:00
Hanisha Koneru 2a5d4315bf HDDS-551. Fix the close container status check in CloseContainerCommandHandler. Contributed by Shashikant Banerjee. 2018-09-27 16:03:49 -07:00
Ajay Kumar 184544eff8 HDDS-401. Update storage statistics on dead node. Contributed by LiXin Ge. 2018-09-27 09:56:30 -07:00
Nanda kumar 3f6195045e HDDS-554. In XceiverClientSpi, implement sendCommand(..) using sendCommandAsync(..). Contributed by Tsz Wo Nicholas Sze. 2018-09-26 09:16:23 +05:30
Ajay Kumar 3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham 9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Anu Engineer 524f7cd354 HDDS-514. Clean Unregister JMX upon SCMConnectionManager#close. 
Contributed by Xiaoyu Yao.
 2018-09-20 12:21:34 -07:00
Anu Engineer 096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis. 
Contributed Dinesh Chitlangia.
 2018-09-20 11:51:49 -07:00
Bharat Viswanadham f6bb1ca3c1 HDDS-513. Check if the EventQueue is not closed before executing handlers. Contributed by Nanda Kumar. 2018-09-19 14:35:29 -07:00
Nanda kumar 236d16e3a5 HDDS-507. EventQueue should be shutdown on SCM shutdown. Contributed by Xiaoyu Yao. 2018-09-20 01:22:18 +05:30
Nanda kumar 042bf74d5e HDDS-460. Replication manager failed to import container data. Contributed by Elek, Marton. 2018-09-19 23:51:50 +05:30
Nanda kumar 61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Márton Elek b3c5221f30 HDDS-458. numberofKeys is 0 for all containers even when keys are present. Contributed by LiXin Ge. 
(cherry picked from commit 8600b049af)
 2018-09-19 17:11:05 +02:00
Nanda kumar 15ed74fa24 HDDS-502. Exception in OM startup when running unit tests. Contributed by Arpit Agarwal. 2018-09-19 19:46:25 +05:30
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Xiaoyu Yao e435e12f1f HDDS-506. Fields in AllocateScmBlockResponseProto should be optional. Contributed by Arpit Agarwal. 2018-09-18 23:21:29 -07:00
Arpit Agarwal fb85351dc6 HDDS-497. Suppress license warnings for error log files. Contributed by Arpit Agarwal. 2018-09-18 21:18:15 -07:00
Anu Engineer a968ea4897 HDDS-440. Datanode loops forever if it cannot create directories. 
Contributed by Bharat Viswanadham.
 2018-09-18 14:31:50 -07:00
Xiaoyu Yao 295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer f938925bde HDDS-464. Fix TestCloseContainerHandlingByClient. 
Contributed by Lokesh Jain.
 2018-09-18 10:45:51 -07:00
Anu Engineer 23a6137a40 HDDS-475. Block Allocation returns same BlockID on different keys creation. 
Contributed by Nanda Kumar.
 2018-09-17 14:41:17 -07:00
Nanda kumar 846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Xiaoyu Yao 95231f1749 HDDS-362. Modify functions impacted by SCM chill mode in ScmBlockLocationProtocol. Contributed by Ajay Kumar. 2018-09-16 17:55:46 -07:00
Nanda kumar 87e2c0f425 HDDS-465. Suppress group mapping lookup warnings for ozone. Contributed by Xiaoyu Yao. 2018-09-15 23:14:57 +05:30
Nanda kumar c9fa081897 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar. 2018-09-15 23:11:39 +05:30
Márton Elek a65c3ea91c HDDS-449. Add a NULL check to protect DeadNodeHandler#onMessage. Contributed by LiXin Ge. 2018-09-15 13:35:21 +02:00
Nanda kumar b0a659c8c0 HDDS-466. Handle null in argv of StorageContainerManager#createSCM. Contributed by Nanda kumar 2018-09-15 02:34:33 +05:30