Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,929 Commits 326 Branches 371 Tags
Commit Graph

234 Commits

Author SHA1 Message Date
Arpit Agarwal
2ba438a709 HDDS-438. 'ozone oz' should print usage when command or sub-command is missing. Contributed by Dinesh Chitlangia. 2018-09-14 07:02:44 -07:00
Hanisha Koneru
f42d1eba23 HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton. 
(cherry picked from commit 291dcf2247f8f5f92a3290734a2ed081a99ccbc3)
 2018-09-13 16:39:22 -07:00
Mukul Kumar Singh
422c2cfb15 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 
(cherry picked from commit c9e0b69ab3b8e70b804e325ebe8901c2be98edca)
 2018-09-13 23:20:17 +02:00
Mukul Kumar Singh
d671e66500 HDDS-420. putKey failing with KEY_ALLOCATION_ERROR. Contributed by Shashikant Banerjee. 
(cherry picked from commit c6e19db197253b660c8b16854360fe95b1d7c43f)
 2018-09-13 23:07:41 +02:00
Mukul Kumar Singh
7f5382483e HDDS-433. ContainerStateMachine#readStateMachineData should properly build LogEntryProto. Contributed by Lokesh Jain. 
(cherry picked from commit 47299ce23fa0f327b8c532ca96191a571c92d244)
 2018-09-13 23:07:41 +02:00
Anu Engineer
62b02e03c8 HDDS-395. TestOzoneRestWithMiniCluster fails with "Unable to read ROCKDB config". 
Contributed by Dinesh Chitlangia.

(cherry picked from commit c18eb9780163f8995c21b7d1b7b2b04140e4bc0a)
 2018-09-12 14:20:01 -07:00
Anu Engineer
aa199a83c7 HDDS-436. Allow SCM chill mode to be disabled by configuration. 
Contributed by Ajay Kumar.

(cherry picked from commit 64c7a12b5775a330a04087adda25f85bd08b8366)
 2018-09-12 11:52:05 -07:00
Anu Engineer
f8165803fa HDDS-428. OzoneManager lock optimization. 
Contributed by Nanda Kumar.

(cherry picked from commit 6e2129cf4edcd34651631a409e065df47aac2b38)
 2018-09-12 10:53:52 -07:00
Anu Engineer
e6ece1506d HDDS-432. Replication of closed containers is not working. 
Contributed by Elek, Marton.

(cherry picked from commit 9c238ffc301c9aa1ae0f811c065e7426b1e23540)
 2018-09-11 17:06:17 -07:00
Anu Engineer
c074647c9e HDDS-424. Consolidate ozone oz parameters to use GNU convention. 
Contributed by Elek, Marton.

(cherry picked from commit a406f6f60ee0caf8229d13bda595d621a9779aa8)
 2018-09-11 16:52:23 -07:00
Anu Engineer
54ec2366e2 HDDS-431. LeaseManager of CommandWatcher is not started. 
Contributed by Elek, Marton.

(cherry picked from commit 8ffbbf51c9a0f9bbcd9ee7452d95e588a2cb87ac)
 2018-09-11 10:51:06 -07:00
Anu Engineer
0d3406e25c HDDS-222. Remove hdfs command line from ozone distribution. 
Contributed by Elek, Marton.

(cherry picked from commit 7b5886bf784579cc97656266901e6f934522b0e8)
 2018-09-11 10:25:43 -07:00
Xiaoyu Yao
4b9f1d7639 HDDS-403. Fix createdOn and modifiedOn timestamp for volume, bucket, key. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 8fe4062bfc20ee181106eb68635d3404c50c9238)
 2018-09-10 11:53:06 -07:00
Márton Elek
dfd7ece2df HDDS-421. Resilient DNS resolution in datanode-service. Contributed by Elek, Marton. 2018-09-10 20:52:00 +02:00
Mukul Kumar Singh
237d1c3ee9 HDDS-410. ozone scmcli list is not working properly. Contributed by Hanisha Koneru. 
(cherry picked from commit d924ca2e1a826187de3f430ba30b966f5b5c2d55)
 2018-09-10 15:49:47 +02:00
Hanisha Koneru
25ec339af5 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 13:12:43 -07:00
Anu Engineer
fd792ce54d HDDS-190. Improve shell error message for unrecognized option. 
Contributed by Elek, Marton.

(cherry picked from commit 73fcbdd296fb0f6e7cde17ef0bd6f3b981878077)
 2018-09-07 13:02:49 -07:00
Anu Engineer
48bcebc080 HDDS-351. Add chill mode state to SCM. 
Contributed by Ajay Kumar.

(cherry picked from commit ff64d3571660ace3fb266ee47bea181cebfee8d9)
 2018-09-07 11:00:31 -07:00
Tsz Wo Nicholas Sze
b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Xiaoyu Yao
8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Xiaoyu Yao
85c3fe341a HDDS-268. Add SCM close container watcher. Contributed by Ajay Kumar. 2018-09-04 22:56:57 -07:00
Anu Engineer
6e4c731471 HDDS-396. Remove openContainers.db from SCM. 
Contributed by Dinesh Chitlangia.
 2018-09-04 16:27:31 -07:00
Hanisha Koneru
9964e33e8d HDDS-369. Remove the containers of a dead node from the container state map. Contributed by Elek, Marton 2018-09-04 14:57:54 -07:00
Nanda kumar
6bbd249011 HDDS-98. Adding Ozone Manager Audit Log. Contributed by Dinesh Chitlangia. 2018-09-05 00:11:07 +05:30
Nanda kumar
b9932162e9 HDDS-75. Support for CopyContainer. Contributed by Elek, Marton. 2018-09-04 23:41:50 +05:30
Nanda kumar
567b5558d5 HDDS-343. Containers are stuck in closing state in scm. Contributed by Elek, Marton. 2018-09-03 20:14:45 +05:30
Mukul Kumar Singh
873ef8ae81 HDDS-263. Add retries in Ozone Client to handle BlockNotCommitted Exception. Contributed by Shashikant Banerjee. 2018-09-03 12:26:34 +05:30
Anu Engineer
ff036e49ff HDDS-357. Use DBStore and TableStore for OzoneManager non-background service. 
Contributed by Nandakumar.
 2018-09-02 11:47:32 -07:00
Nanda kumar
6edf3d2ea3 Revert "HDDS-98. Adding Ozone Manager Audit Log." 
This reverts commit 630b64ec7e963968a5bdcd1d625fc78746950137.
 2018-09-02 00:18:13 +05:30
Anu Engineer
19abaacdad HDDS-392. Incomplete description about auditMap#key in AuditLogging Framework. 
Contributed by  Dinesh Chitlangia.
 2018-08-31 22:24:30 -07:00
Anu Engineer
76bae4ccb1 HDDS-379. Simplify and improve the cli arg parsing of ozone scmcli. 
Contributed by Elek, Marton.
 2018-08-31 18:11:01 -07:00
Anu Engineer
50d2e3ec41 HDDS-388. Fix the name of the db profile configuration key. 
Contributed by Elek, Marton.
 2018-08-31 14:30:29 -07:00
Anu Engineer
630b64ec7e HDDS-98. Adding Ozone Manager Audit Log. 
Contributed by Dinesh Chitlangia.
 2018-08-31 14:20:56 -07:00
Nanda kumar
0bd4217194 HDDS-380. Remove synchronization from ChunkGroupOutputStream and ChunkOutputStream. Contributed by Shashikant Banerjee. 2018-08-29 13:31:19 +05:30
Mukul Kumar Singh
2651e2c43d HDDS-365. Implement flushStateMachineData for containerStateMachine. Contributed by Shashikant Banerjee. 2018-08-29 07:58:30 +05:30
Anu Engineer
c5629d546d HDDS-382. Remove RatisTestHelper#RatisTestSuite constructor argument and fix checkstyle in ContainerTestHelper, GenericTestUtils 
Contributed by Nandakumar.
 2018-08-28 14:06:19 -07:00
Anu Engineer
ac515d22d8 HDDS-376. Create custom message structure for use in AuditLogging 
Contributed by Dinesh Chitlangia.
 2018-08-28 12:59:08 -07:00
Márton Elek
c61824a189 HDDS-359. RocksDB Profiles support. Contributed by Anu Engineer. 2018-08-28 19:33:13 +02:00
Anu Engineer
df21e1b1dd HDDS-332. Remove the ability to configure ozone.handler.type 
Contributed by Nandakumar and Anu Engineer.
 2018-08-28 09:56:02 -07:00
Nanda kumar
2172399c55 HDDS-381. Fix TestKeys#testPutAndGetKeyWithDnRestart. Contributed by Mukul Kumar Singh. 2018-08-28 22:19:52 +05:30
Mukul Kumar Singh
3974427f67 HDDS-247. Handle CLOSED_CONTAINER_IO exception in ozoneClient. Contributed by Shashikant Banerjee. 2018-08-28 07:12:07 +05:30
Xiaoyu Yao
c9b63956d9 HDSS-375. ContainerReportHandler should not send replication events for open containers. Contributed by Ajay Kumar. 2018-08-27 10:40:33 -07:00
Xiaoyu Yao
6eecd251d8 HDDS-377. Make the ScmClient closable and stop the started threads. Contributed by Elek Marton. 2018-08-27 08:19:38 -07:00
Márton Elek
a813fd0215 HDDS-227. Use Grpc as the default transport protocol for Standalone pipeline. Contributed by chencan. 2018-08-27 16:07:55 +02:00
Márton Elek
744ce200d2 HDDS-313. Add metrics to containerState Machine. Contributed by chencan. 2018-08-27 15:51:34 +02:00
Nanda kumar
12b2f362cc HDDS-374. Support to configure container size in units lesser than GB. Contributed by Nanda kumar. 2018-08-27 18:29:32 +05:30
Márton Elek
a5eba25506 HDDS-364. Update open container replica information in SCM during DN register. Contributed by Ajay Kumar. 2018-08-24 22:42:51 +02:00
Márton Elek
138b0c1443 HDDS-363. Faster datanode registration during the first startup. Contributed by Elek, Marton. 2018-08-24 15:36:10 +02:00
Márton Elek
55b6931059 HDDS-317. Use new StorageSize API for reading ozone.scm.container.size.gb. Contributed by Junjie Chen. 2018-08-24 13:56:30 +02:00
Xiaoyu Yao
ca29fb754e HDDS-328. Support export and import of the KeyValueContainer. Contributed by Elek Marton. 2018-08-23 11:30:28 -07:00