Commit Graph

21390 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian c00e704496
HDDS-1265. ozone sh s3 getsecret throws Null Pointer Exception for unsecured clusters.
Closes #611

(cherry picked from commit 2627dad333)
2019-03-14 17:22:21 -07:00
Shashikant Banerjee 8614da3723 HDDS-1257. Incorrect object because of mismatch in block lengths. Contributed by Shashikant Banerjee.
(cherry picked from commit d60673c470)
2019-03-14 19:34:54 +05:30
Mukul Kumar Singh 8e66b6220b HDDS-1237. Fix test TestSecureContainerServer.testClientServerRatisGrpc. Contributed by Mukul Kumar Singh.
(cherry picked from commit 983b78afdc)
2019-03-14 17:03:07 +05:30
Mukul Kumar Singh f38a8a9630 HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh.
(cherry picked from commit ea9fb07fd2)
2019-03-14 15:25:22 +05:30
Ajay Yadav 0f4ae392d7 HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. (#598)
(cherry picked from commit 4fa009989b)
2019-03-13 12:02:17 -07:00
Xiaoyu Yao eeb7d63046 HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contributed by Xiaoyu Yao. (#596)
(cherry picked from commit 86d508c7c7)
2019-03-13 11:52:47 -07:00
Aravindan Vijayan 34f0ad064d HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline.
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 1f47fb7a2f)
2019-03-13 17:14:51 +05:30
Lokesh Jain b5b3f4d823 HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 0d62753da9)
2019-03-13 16:47:04 +05:30
Vivek Ratnavel Subramanian 32477ed1e6
HDDS-1226. Addendum. ozone-filesystem jar missing in hadoop classpath
Closes #560

(cherry picked from commit c1649bf1e1)
2019-03-13 12:09:41 +01:00
Ajay Yadav 15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api
Closes #561

(cherry picked from commit dcb0de848d)
2019-03-12 18:54:59 +01:00
Xiaoyu Yao 262260fadf HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#593)
Closes PR #593

(cherry picked from commit 2778259b88)
2019-03-12 09:36:37 -07:00
Mukul Kumar Singh 97fd3025a4 HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh.
(cherry picked from commit daf4660eeb)
2019-03-12 20:03:36 +05:30
Shashikant Banerjee 4373c12701 HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee.
(cherry picked from commit b4aa24d3c5)
2019-03-12 10:21:14 +05:30
Xiaoyu Yao e673bebcfe HDDS-1245. OM delegation expiration time should use Time.now instead … (#587)
Closes #587.

(cherry picked from commit c7307867f0)
2019-03-11 21:20:57 -07:00
Ajay Yadav 6028aefb57 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
This closes (#581)

(cherry picked from commit 599e926d46)
2019-03-11 15:02:43 -07:00
Xiaoyu Yao 1050bf42fa HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573)
(cherry picked from commit 4fc493e511)
2019-03-11 11:51:38 -07:00
Xiaoyu Yao fe41e67ba4 Revert "HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573)"
This reverts commit 89fb60ffd0.
2019-03-11 11:50:34 -07:00
Xiaoyu Yao 89fb60ffd0 HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573)
(cherry picked from commit 4fc493e511)
2019-03-11 09:22:29 -07:00
Mukul Kumar Singh 5d67a17877 HDDS-1238. Fix Ratis Snapshot creation error if the snapshot file already exists in ContainerStateMachine. Contributed by Shashikant Banerjee.
(cherry picked from commit 8458ced11e)
2019-03-11 14:57:45 +05:30
Mukul Kumar Singh aa9de9a0fa HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh.
(cherry picked from commit 2c3ec37738)
2019-03-11 14:57:45 +05:30
Lokesh Jain 60b5e178e3 HDDS-1220. KeyManager#openKey should release the bucket lock before doing an allocateBlock. Contributed by Lokesh Jain.
(cherry picked from commit ebb5fa115b)
2019-03-11 14:56:51 +05:30
Bharat Viswanadham e65717af25
HDDS-1242. In S3 when bucket already exists, it should just return location.
(cherry picked from commit 73e1801b2d)
2019-03-09 21:48:46 -08:00
Xiaoyu Yao 49217971b5 HDDS-1235. BaseHttpServer NPE is HTTP policy is HTTPS_ONLY. Contributed by Xiaoyu Yao.
Closes #572

(cherry picked from commit 11db46956c)
2019-03-09 09:40:05 -08:00
Ajay Yadav 6465125a5a HDDS-594. SCM CA: DN sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. (#547)
(cherry picked from commit 064f38b3a5)
2019-03-09 09:40:00 -08:00
Elek, Márton 118986cde7
HDDS-1213. Support plain text S3 MPU initialization request.
(cherry picked from commit c072458e5d)
2019-03-08 10:15:30 -08:00
Lokesh Jain c334bc8baf HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain.
(cherry picked from commit 129fd5dd18)
2019-03-08 09:02:41 +05:30
Vivek Ratnavel Subramanian 62ab3425dc
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
Closes #560

(cherry picked from commit 475011bbf8)
2019-03-07 14:46:01 +01:00
Vivek Ratnavel Subramanian 67a26ac793
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
(cherry picked from commit a55fc36299)
2019-03-07 14:45:51 +01:00
Márton Elek 9cd3fe49cf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
Closes #490

(cherry picked from commit 45f976fdcf)
2019-03-07 14:44:34 +01:00
Ajay Kumar 5502da4ae2
HDDS-1216. Change name of ozoneManager service in docker compose files to om.
Closes #553

(cherry picked from commit 9d87247af3)
2019-03-07 14:41:28 +01:00
Márton Elek a50ffd8d05
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-07 14:35:59 +01:00
Márton Elek ab5da9a984
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-07 14:35:51 +01:00
Shashikant Banerjee 8655abb353 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee.
(cherry picked from commit 62e89dc275)
2019-03-07 14:29:38 +05:30
Shashikant Banerjee b99ae7b4e2 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee.
(cherry picked from commit 5fcea54a50)
2019-03-07 14:26:38 +05:30
Elek, Márton 8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502)
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5)
2019-03-05 12:15:56 -08:00
Anu Engineer 6eb79815fa HDDS-1171. Add benchmark for OM and OM client in Genesis.
Contributed by Lokesh Jain.

(cherry picked from commit 7fd890116a)
2019-03-05 11:55:26 -08:00
Bharat Viswanadham 4cf50e3972 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534)
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.

(cherry picked from commit 313e8b9f13)
2019-03-05 11:48:52 -08:00
Arpit Agarwal c57e1ddd63
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek.
(cherry picked from commit 3ef1235215)
2019-03-05 10:27:15 -08:00
Elek, Márton f4918acdae HDDS-623. On SCM UI, Node Manager info is empty (#523)
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.

(cherry picked from commit 90c37ac40d)
2019-03-05 09:35:52 -08:00
Ajay Yadav c3986dc53b
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar.
(cherry picked from commit 353b90d59e)
2019-03-05 08:39:45 -08:00
Wei-Chiu Chuang 387dbe587a HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star. 2019-03-04 10:43:44 -08:00
Xiaoyu Yao eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
bibinchundatt 15098df744 Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph."
This reverts commit a63c358b78.
2019-03-04 16:57:31 +05:30
Yiqun Lin 18ea0c1493 HDFS-14182. Datanode usage histogram is clicked to show ip list. Contributed by fengchuang. 2019-03-04 17:34:24 +08:00
Akira Ajisaka bd8d299ded
YARN-7477. Moving logging APIs over to slf4j in hadoop-yarn-common. Contributed by Prabhu Joseph. 2019-03-04 16:59:20 +09:00
Wei-Chiu Chuang 6c4d566955
Revert "HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng."
This reverts commit 5c10630ad8.
2019-03-04 16:59:20 +09:00
Weiwei Yang e20b5ef52c
YARN-9332. RackResolver tool should accept multiple hosts. Contributed by Lantao Jin. 2019-03-04 16:59:20 +09:00
Hanisha Koneru b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
This reverts commit 8e1225991d.
2019-03-04 16:58:59 +09:00
Erik Krogen fc17ba172b
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen. 2019-03-04 16:52:04 +09:00
Ajay Yadav 9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544)
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
2019-03-01 16:19:43 -08:00