Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
21,381 Commits 326 Branches 371 Tags
Commit Graph

619 Commits

Author SHA1 Message Date
Ajay Yadav
15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api 
Closes #561

(cherry picked from commit dcb0de848d8388fcee425847e52f6361790225c6)
 2019-03-12 18:54:59 +01:00
Mukul Kumar Singh
97fd3025a4 HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit daf4660eebfa9267e7082f7c9a14c3dd5d6d5d46)
 2019-03-12 20:03:36 +05:30
Shashikant Banerjee
4373c12701 HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee. 
(cherry picked from commit b4aa24d3c5ad1b9309a58795e4b48e567695c4e4)
 2019-03-12 10:21:14 +05:30
Xiaoyu Yao
e673bebcfe HDDS-1245. OM delegation expiration time should use Time.now instead … (#587) 
Closes #587.

(cherry picked from commit c7307867f0d28dbb11e2194ff885da8269e4fb42)
 2019-03-11 21:20:57 -07:00
Ajay Yadav
6028aefb57 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar. 
This closes (#581)

(cherry picked from commit 599e926d462134aa3235311feb27f3a8cdff6a51)
 2019-03-11 15:02:43 -07:00
Xiaoyu Yao
1050bf42fa HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573) 
(cherry picked from commit 4fc493e511dacc41628925bdcb3506cd944346e6)
 2019-03-11 11:51:38 -07:00
Xiaoyu Yao
fe41e67ba4 Revert "HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573)" 
This reverts commit 89fb60ffd07e0ea21c6fb431eacc9a575360fb93.
 2019-03-11 11:50:34 -07:00
Xiaoyu Yao
89fb60ffd0 HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. (#573) 
(cherry picked from commit 4fc493e511dacc41628925bdcb3506cd944346e6)
 2019-03-11 09:22:29 -07:00
Mukul Kumar Singh
aa9de9a0fa HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 2c3ec37738544107238f75d0ca781fd23bdc309b)
 2019-03-11 14:57:45 +05:30
Lokesh Jain
60b5e178e3 HDDS-1220. KeyManager#openKey should release the bucket lock before doing an allocateBlock. Contributed by Lokesh Jain. 
(cherry picked from commit ebb5fa115b842a3bcb747e881ca2a8fe4c716d07)
 2019-03-11 14:56:51 +05:30
Bharat Viswanadham
e65717af25
HDDS-1242. In S3 when bucket already exists, it should just return location. 
(cherry picked from commit 73e1801b2db928d165e4cf076e1ba50ec1e8b48a)
 2019-03-09 21:48:46 -08:00
Elek, Márton
118986cde7
HDDS-1213. Support plain text S3 MPU initialization request. 
(cherry picked from commit c072458e5d1ec88c8e4d76cd09623083b8ccfc03)
 2019-03-08 10:15:30 -08:00
Vivek Ratnavel Subramanian
62ab3425dc
HDDS-1226. ozone-filesystem jar missing in hadoop classpath 
Closes #560

(cherry picked from commit 475011bbf8b58a10457fe0c68a8e18edc5bf1623)
 2019-03-07 14:46:01 +01:00
Vivek Ratnavel Subramanian
67a26ac793
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values. 
(cherry picked from commit a55fc362999f269efa1b6304438148aef3c03ed8)
 2019-03-07 14:45:51 +01:00
Márton Elek
9cd3fe49cf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton. 
Closes #490

(cherry picked from commit 45f976fdcf1d8cbcdcbcc4783c9f13fddae1c429)
 2019-03-07 14:44:34 +01:00
Ajay Kumar
5502da4ae2
HDDS-1216. Change name of ozoneManager service in docker compose files to om. 
Closes #553

(cherry picked from commit 9d87247af30757fbf521a4b432149846790364c5)
 2019-03-07 14:41:28 +01:00
Márton Elek
a50ffd8d05
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-07 14:35:59 +01:00
Shashikant Banerjee
b99ae7b4e2 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee. 
(cherry picked from commit 5fcea54a50753a37b61f0e3c6be5a0236f95861a)
 2019-03-07 14:26:38 +05:30
Elek, Márton
8d906d7217 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502) 
Pull request from Elek, Márton. (#502)

(cherry picked from commit 7f636b47b5e430e340c8fd731fd9e35e22f9ddbf)
 2019-03-05 12:15:56 -08:00
Anu Engineer
6eb79815fa HDDS-1171. Add benchmark for OM and OM client in Genesis. 
Contributed by Lokesh Jain.

(cherry picked from commit 7fd890116ab941d51b28cf84b01330b6e33c9b18)
 2019-03-05 11:55:26 -08:00
Arpit Agarwal
c57e1ddd63
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 
(cherry picked from commit 3ef1235215c68e9f0aff8e17643c52838fa363a3)
 2019-03-05 10:27:15 -08:00
Ajay Yadav
c3986dc53b
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar. 
(cherry picked from commit 353b90d59e3583a73a76db550d47aa86b3f36d5d)
 2019-03-05 08:39:45 -08:00
Xiaoyu Yao
eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
Hanisha Koneru
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client." 
This reverts commit 8e1225991d8da7d6801fc3753319139873f23bc9.
 2019-03-04 16:58:59 +09:00
Ajay Yadav
9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544) 
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323ea31afe7512d41a1bde0d0103c64622.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee5d9b72ba659d6a4289f571e1eabf1c.
 2019-03-01 16:19:43 -08:00
Xiaoyu Yao
78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao
6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar
4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00
Shashikant Banerjee
de1dae64f2 HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee. 2019-03-01 23:30:28 +05:30
Hanisha Koneru
8e1225991d HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-01 00:27:39 -08:00
Anu Engineer
eae3db9649 HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs. 
Contributed Elek, Marton.
 2019-02-28 17:14:47 -08:00
Xiaoyu Yao
3a8118b480
HDDS-1190. Fix jdk 11 issue for ozonesecure base image and docker-compose . Contributed by Xiaoyu Yao. 2019-02-28 15:51:08 +01:00
Ajay Kumar
cbf82fabf0 HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar. 2019-02-27 17:00:42 -08:00
Bharat Viswanadham
6c8c422beb
HDDS-1178. Healthy pipeline Chill Mode Rule. 
Closes #518
 2019-02-27 14:26:40 +01:00
Xiaoyu Yao
0e450202a6
HDDS-1019. Use apache/hadoop-runner image to test ozone secure cluster. Contributed by Xiaoyu Yao. 2019-02-27 12:44:04 +01:00
Ajay Kumar
625e93713b HDDS-1177. Add validation to AuthorizationHeaderV4. Contributed by Ajay Kumar 2019-02-26 18:57:43 -08:00
Anu Engineer
a5a751b418 HDDS-1174. Freon tests are failing with null pointer exception. 
Contributed by Shashikant Banerjee.
 2019-02-26 14:33:54 -08:00
Márton Elek
585cebf26b
HDDS-1104. Use picocli with Ozone genesis tool. Contributed by Lokesh Jain. 2019-02-26 16:11:55 +01:00
Xiaoyu Yao
9e0f3d1c52 HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar. 2019-02-26 06:02:10 -08:00
Anu Engineer
9de34d2990 HDDS-1151. Propagate the tracing id in ScmBlockLocationProtocol. 
Contributed by Elek, Marton.
 2019-02-25 13:50:37 -08:00
Márton Elek
a5eb7ce651
HDDS-1170. Fix the FindBugs issue in OzoneClientAdapterFactory. Contributed by Anu Engineer. 2019-02-25 10:41:43 +01:00
Anu Engineer
92b1fdcece HDDS-1070. Adding Node and Pipeline related metrics in SCM. 
Contributed by Nandakumar.
 2019-02-24 15:39:41 -08:00
Anu Engineer
3aa0a57ea0 HDDS-1152. Add trace information for the client side of the datanode writes 
Contributed by Elek, Marton.
 2019-02-24 15:20:34 -08:00
Anu Engineer
5c1f946071 HDDS-1145. Add optional web server to the Ozone freon test tool. 
Contributed by Elek, Marton.
 2019-02-24 15:04:25 -08:00
Anu Engineer
236b105e41 HDDS-1089. Disable OzoneFSStorageStatistics for hadoop versions older than 2.8. 
Contributed by Elek, Marton.
 2019-02-24 13:53:38 -08:00
Anu Engineer
8387bbdfb5 HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol. 
Contributed by Elek, Marton.
 2019-02-24 13:13:37 -08:00
Bharat Viswanadham
106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read. 2019-02-23 21:37:55 -08:00
Anu Engineer
c1e5b19212 HDDS-1147. Fix failing unit tests in TestOzoneManager. 
Contributed by Nandakumar.
 2019-02-23 20:56:24 -08:00
Anu Engineer
fb546d1807 HDDS-1167. Error in hadoop-ozone/dev-support/checks/checkstyle.sh. 
Contributed by Nandakumar.
 2019-02-23 20:45:01 -08:00
Hanisha Koneru
d0e21ac16b HDDS-1158. TestOzoneManagerHA.testTwoOMNodesDown is failing with ratis error. 2019-02-23 10:20:28 -08:00