19940 Commits

Author SHA1 Message Date
Nanda kumar
f0b87e3d29 HDDS-465. Suppress group mapping lookup warnings for ozone. Contributed by Xiaoyu Yao.
(cherry picked from commit 87e2c0f4258f2e46183f796d7d904c0b27030df0)
2018-09-15 23:15:38 +05:30
Nanda kumar
be7841e059 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar.
(cherry picked from commit c9fa081897df34dba1c2989f597e67a1f384a4e3)
2018-09-15 23:12:57 +05:30
Márton Elek
bcab70f927 HDDS-449. Add a NULL check to protect DeadNodeHandler#onMessage. Contributed by LiXin Ge. 2018-09-15 14:25:18 +02:00
Márton Elek
419ba3aeb2 HDDS-409. Ozone acceptance-test and integration-test packages have undefined hadoop component. Contributed by Dinesh Chitlangia. 2018-09-15 13:16:59 +02:00
Bharat Viswanadham
53a426d8d3 HDDS-446. Provide shaded artifact to start ozone service as a datanode plugin. Contributed by Elek Marton
(cherry picked from commit b95aa560628b527b1534a7f148bd61605deb90b3)
2018-09-14 14:17:50 -07:00
Nanda kumar
4d2db42595 HDDS-466. Handle null in argv of StorageContainerManager#createSCM. Contributed by Nanda kumar
(cherry picked from commit b0a659c8c0500c47f974518ec98ae44c283db9f4)
2018-09-15 02:35:25 +05:30
Xiaoyu Yao
435c3eacff HDDS-419. ChunkInputStream bulk read api does not read from all the chunks. Contributed by Lokesh Jain and Mukul Kumar.
(cherry picked from commit 6f037468bce7bbda6b9fc01166f2c61ae40b690b)
2018-09-14 13:46:16 -07:00
Nanda kumar
1b3f1b89a5 HDDS-454. TestChunkStreams#testErrorReadGroupInputStream & TestChunkStreams#testReadGroupInputStream are failing. Contributed by chencan.
(cherry picked from commit 5470de420b2660e3042a5fec566ecc6b0d8ff93a)
2018-09-15 01:40:12 +05:30
Jitendra Pandey
5d47072b43 HDDS-452. 'ozone scm' with incorrect argument first logs all the STARTUP_MSG. Contributed by Namit Maheshwari. 2018-09-14 11:58:38 -07:00
Nanda kumar
3ade889e56 HDDS-389. Remove XceiverServer and XceiverClient and related classes. Contributed by chencan.
(cherry picked from commit c1df3084ffd062a41f05601b928430a0b1a0db47)
2018-09-15 00:23:24 +05:30
Anu Engineer
ca80b7c26b HDDS-429. StorageContainerManager lock optimization.
Contributed by Nanda Kumar.

(cherry picked from commit 0c8a43b9ec77b3ba7b2bb4c8aa863b1deba3bc7b)
2018-09-14 11:37:25 -07:00
Arpit Agarwal
2ba438a709 HDDS-438. 'ozone oz' should print usage when command or sub-command is missing. Contributed by Dinesh Chitlangia. 2018-09-14 07:02:44 -07:00
Hanisha Koneru
f42d1eba23 HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton.
(cherry picked from commit 291dcf2247f8f5f92a3290734a2ed081a99ccbc3)
2018-09-13 16:39:22 -07:00
Mukul Kumar Singh
422c2cfb15 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee.
(cherry picked from commit c9e0b69ab3b8e70b804e325ebe8901c2be98edca)
2018-09-13 23:20:17 +02:00
Mukul Kumar Singh
d671e66500 HDDS-420. putKey failing with KEY_ALLOCATION_ERROR. Contributed by Shashikant Banerjee.
(cherry picked from commit c6e19db197253b660c8b16854360fe95b1d7c43f)
2018-09-13 23:07:41 +02:00
Mukul Kumar Singh
7f5382483e HDDS-433. ContainerStateMachine#readStateMachineData should properly build LogEntryProto. Contributed by Lokesh Jain.
(cherry picked from commit 47299ce23fa0f327b8c532ca96191a571c92d244)
2018-09-13 23:07:41 +02:00
Hanisha Koneru
22c318eeee HDDS-414. Fix sbin/stop-ozone.sh to stop Ozone daemons. Contributed by Elek, Marton.
(cherry picked from commit 4441fe9201223d02b8aecccd36333bdccc9c0d0b)
2018-09-13 13:43:04 -07:00
Arpit Agarwal
9ba7ce9574 HDDS-456. TestOzoneShell#init is breaking due to Null Pointer Exception. Contributed by Dinesh Chitlangia. 2018-09-13 13:01:07 -07:00
Márton Elek
530029809e HDDS-415. 'ozone om' with incorrect argument first logs all the STARTUP_MSG. Contributed by Namit Maheshwari. 2018-09-13 13:47:59 +02:00
Anu Engineer
62b02e03c8 HDDS-395. TestOzoneRestWithMiniCluster fails with "Unable to read ROCKDB config".
Contributed by Dinesh Chitlangia.

(cherry picked from commit c18eb9780163f8995c21b7d1b7b2b04140e4bc0a)
2018-09-12 14:20:01 -07:00
Anu Engineer
aa199a83c7 HDDS-436. Allow SCM chill mode to be disabled by configuration.
Contributed by Ajay Kumar.

(cherry picked from commit 64c7a12b5775a330a04087adda25f85bd08b8366)
2018-09-12 11:52:05 -07:00
Anu Engineer
f8165803fa HDDS-428. OzoneManager lock optimization.
Contributed by Nanda Kumar.

(cherry picked from commit 6e2129cf4edcd34651631a409e065df47aac2b38)
2018-09-12 10:53:52 -07:00
Márton Elek
159a49f8aa HDDS-425. Move unit test of the genconf tool to hadoop-ozone/tools module. Contributed by Dinesh Chitlangia.
(cherry picked from commit 3fbb88f29291542283672eb7b3a93d4edbd05f05)
2018-09-12 11:29:49 +02:00
Anu Engineer
e6ece1506d HDDS-432. Replication of closed containers is not working.
Contributed by Elek, Marton.

(cherry picked from commit 9c238ffc301c9aa1ae0f811c065e7426b1e23540)
2018-09-11 17:06:17 -07:00
Anu Engineer
c074647c9e HDDS-424. Consolidate ozone oz parameters to use GNU convention.
Contributed by Elek, Marton.

(cherry picked from commit a406f6f60ee0caf8229d13bda595d621a9779aa8)
2018-09-11 16:52:23 -07:00
Xiaoyu Yao
f1165d2166 HDDS-416. Remove currentPosition from ChunkInputStreamEntry. Contributed by Lokesh Jain.
(cherry picked from commit 1d567c25d0c97603f35ab5c789217df8ec6893d7)
2018-09-11 15:30:53 -07:00
Anu Engineer
54ec2366e2 HDDS-431. LeaseManager of CommandWatcher is not started.
Contributed by Elek, Marton.

(cherry picked from commit 8ffbbf51c9a0f9bbcd9ee7452d95e588a2cb87ac)
2018-09-11 10:51:06 -07:00
Anu Engineer
0d3406e25c HDDS-222. Remove hdfs command line from ozone distribution.
Contributed by Elek, Marton.

(cherry picked from commit 7b5886bf784579cc97656266901e6f934522b0e8)
2018-09-11 10:25:43 -07:00
Xiaoyu Yao
4b9f1d7639 HDDS-403. Fix createdOn and modifiedOn timestamp for volume, bucket, key. Contributed by Dinesh Chitlangia.
(cherry picked from commit 8fe4062bfc20ee181106eb68635d3404c50c9238)
2018-09-10 11:53:06 -07:00
Márton Elek
dfd7ece2df HDDS-421. Resilient DNS resolution in datanode-service. Contributed by Elek, Marton. 2018-09-10 20:52:00 +02:00
Mukul Kumar Singh
237d1c3ee9 HDDS-410. ozone scmcli list is not working properly. Contributed by Hanisha Koneru.
(cherry picked from commit d924ca2e1a826187de3f430ba30b966f5b5c2d55)
2018-09-10 15:49:47 +02:00
Márton Elek
9f77e17540 HDDS-417. Ambiguous error message when using genconf tool. Contributed by Dinesh Chitlangia. 2018-09-10 15:42:31 +02:00
Anu Engineer
5284b50436 HDDS-398. Support multiple tests in freon.
Contributed by Elek, Marton.

(cherry picked from commit ca3adf588ceef53de340f03cbfbd45db8d25a408)
2018-09-07 13:29:55 -07:00
Hanisha Koneru
25ec339af5 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 13:12:43 -07:00
Anu Engineer
fd792ce54d HDDS-190. Improve shell error message for unrecognized option.
Contributed by Elek, Marton.

(cherry picked from commit 73fcbdd296fb0f6e7cde17ef0bd6f3b981878077)
2018-09-07 13:02:49 -07:00
Anu Engineer
48bcebc080 HDDS-351. Add chill mode state to SCM.
Contributed by Ajay Kumar.

(cherry picked from commit ff64d3571660ace3fb266ee47bea181cebfee8d9)
2018-09-07 11:00:31 -07:00
Anu Engineer
be1ec005f1 HDDS-408. Read (getKey) operation is very slow.
Contributed by Nandakumar.
2018-09-07 07:36:24 -07:00
Xiaoyu Yao
396ce7b884 HDDS-397. Handle deletion for keys with no blocks. Contributed by Lokesh Jain. 2018-09-06 16:58:15 -07:00
Inigo Goiri
527288ef89 HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng. 2018-09-06 16:47:54 -07:00
Anu Engineer
c5bf43a8e8 HDDS-406. Enable acceptace test of the putKey for rpc protocol.
Contributed by Elek, Marton.
2018-09-06 15:09:21 -07:00
Giovanni Matteo Fumarola
eca1a4bfe9 HDFS-13695. Move logging to slf4j in HDFS package. Contributed by Ian Pickering. 2018-09-06 14:48:00 -07:00
Tsz Wo Nicholas Sze
b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Anu Engineer
fa2945e7a9 HDDS-405. User/volume mapping is not cleaned up during the deletion of the last volume.
Contributed by Elek, Marton.
2018-09-06 12:44:08 -07:00
Jason Lowe
eb0b5a844f MAPREDUCE-7131. Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate. Contributed by Anthony Hsu 2018-09-06 14:13:29 -05:00
Márton Elek
b6c543fe45 HDDS-404. Implement toString() in OmKeyLocationInfo. Contributed by Dinesh Chitlangia. 2018-09-06 13:16:54 +02:00
Vrushali C
962089ab59 HADOOP-15657 Registering MutableQuantiles via Metric annotation. Contributed by Sushil Ks 2018-09-05 20:53:21 -07:00
Xiaoyu Yao
8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Giovanni Matteo Fumarola
9af96d4ed4 HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak. 2018-09-05 10:50:25 -07:00
Wei-Chiu Chuang
e780556ae9 HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 2018-09-05 09:52:35 -07:00
Yiqun Lin
9315db5f5d HDFS-13815. RBF: Add check to order command. Contributed by Ranith Sardar. 2018-09-05 23:33:27 +08:00