avijayanhwx
993f36ee33
HDDS-1353 : Metrics scm_pipeline_metrics_num_pipeline_creation_failed keeps increasing because of BackgroundPipelineCreator. ( #681 )
2019-04-04 19:18:32 +05:30
Yiqun Lin
a92806d05a
HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle.
2019-04-04 17:33:37 +08:00
Hanisha Koneru
f09a78f73f
HDDS-1339. Implement ratis snapshots on OM ( #651 )
2019-04-03 22:50:28 -07:00
Hanisha Koneru
4e64f8d763
HDDS-1324. TestOzoneManagerHA tests are flaky ( #676 )
2019-04-03 16:02:19 -07:00
Bharat Viswanadham
358f7f9b99
HDDS-1211. Test SCMChillMode failing randomly in Jenkins run ( #543 )
2019-04-03 15:02:00 -07:00
avijayanhwx
8ff41d6243
HDDS-1358 : Recon Server REST API not working as expected. ( #668 )
2019-04-03 14:52:06 -07:00
avijayanhwx
59022b28b7
HDDS-1330 : Add a docker compose for Ozone deployment with Recon. ( #669 )
2019-04-03 13:20:51 -07:00
Xiaoyu Yao
d6c233fce6
HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. ( #683 )
2019-04-03 11:53:51 -07:00
Shashikant Banerjee
7cd7045eea
HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi.
2019-04-03 22:19:10 +05:30
Ajay Kumar
bfc90bdc64
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar.
...
Closes #677
2019-04-02 15:43:01 +02:00
Kitti Nanasi
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable
...
Closes #673
2019-04-02 14:21:47 +02:00
Yiqun Lin
d31c86892e
HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee.
2019-04-02 16:32:30 +08:00
Vivek Ratnavel Subramanian
04f1db8936
HDDS-1260. Create Recon Server lifecyle integration with Ozone. ( #643 )
2019-04-01 09:59:32 -07:00
Ajay Kumar
5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode
2019-04-01 17:04:28 +02:00
Shashikant Banerjee
0df949202a
HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi.
2019-04-01 19:02:56 +05:30
Shashikant Banerjee
ef5de29243
HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee.
2019-04-01 16:09:58 +05:30
Shashikant Banerjee
509f31b109
HDDS-1295. Add MiniOzoneChaosCluster to mimic long running workload in a unit test environment. Contributed by Mukul Kumar Singh.
2019-04-01 15:50:03 +05:30
Bharat Viswanadham
bf3b7fd732
HDDS-1288. SCM - Failing test on trunk that waits for HB report processing. Contributed by Siddharth Wagle.
2019-03-30 10:54:45 -07:00
Elek, Márton
ec82e4cab2
HDDS-1357. ozone s3 shell command has confusing subcommands ( #663 )
2019-03-30 10:13:29 -07:00
Doroszlai, Attila
7dc0ecc446
[HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila.
...
This closes #659 .
2019-03-29 09:01:56 -07:00
Lokesh Jain
6186ed94b9
HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain.
2019-03-29 19:27:29 +05:30
Xiaoyu Yao
ca5e4ce036
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao.
...
This closes #641
2019-03-28 12:00:58 -07:00
Xiaoyu Yao
8a59efee34
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao.
...
This closes #652 .
2019-03-27 21:52:36 -07:00
Vivek Ratnavel Subramanian
b2269581f7
HDDS-1264. Remove Parametrized in TestOzoneShell. ( #614 )
2019-03-26 22:07:22 -07:00
Bharat Viswanadham
eef8cae7cf
HDDS-1262. In OM HA OpenKey call Should happen only leader OM. ( #626 )
2019-03-26 21:48:01 -07:00
Shweta Yakkali
f426b7ce8f
HDDS-139. Output of createVolume can be improved. Contributed by Shweta.
2019-03-26 19:01:49 -07:00
Ajay Yadav
82d477293c
HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. ( #634 )
2019-03-26 08:59:59 -07:00
Yiqun Lin
c99b107772
HDDS-1334. Fix asf license errors in newly added files by HDDS-1234. Contributed by Aravindan Vijayan.
2019-03-26 11:51:04 +08:00
Yiqun Lin
e5d72f504e
HDDS-1234. Iterate the OM DB snapshot and populate the recon container DB. Contributed by Aravindan Vijayan.
2019-03-25 22:52:02 +08:00
Mukul Kumar Singh
67dd45fc25
HDDS-1185. Optimize GetFileStatus in OzoneFileSystem by reducing the number of rpc call to OM. Contributed by Mukul Kumar Singh.
2019-03-25 17:03:30 +05:30
Shashikant Banerjee
d4e4a7d456
HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee.
2019-03-25 15:41:20 +05:30
Xiaoyu Yao
6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
...
This closes #627 .
2019-03-23 09:22:34 -07:00
Xiaoyu Yao
dea6f2a065
HDDS-1291. Set OmKeyArgs#refreshPipeline flag properly to avoid reading from stale pipeline. Contributed by Xiaoyu Yao. ( #639 )
2019-03-22 15:08:28 -07:00
Arpit Agarwal
1d389ecb24
HDDS-1323. Ignore unit test TestFailureHandlingByClient. Contributed by Supratim Deka.
2019-03-22 11:29:56 -07:00
Arpit Agarwal
90afc9ab03
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-21 14:24:02 -07:00
Arpit Agarwal
2828f8c339
HDDS-1321. TestOzoneManagerHttpServer depends on hard-coded port numbers. Contributed by Arpit Agarwal. ( #633 )
...
Change-Id: I9656af4a7f41812da9d125c10ae0e8daf3dcf7f5
2019-03-21 14:18:58 -07:00
Yiqun Lin
60cdd4cac1
HDDS-1233. Create an Ozone Manager Service provider for Recon. Contributed by Aravindan Vijayan.
2019-03-21 11:02:29 +08:00
Bharat Viswanadham
310ebf5dc8
HDDS-1308. Fix asf license errors. ( #623 )
2019-03-19 14:06:39 -07:00
Bharat Viswanadham
1639071b05
HDDS-1307. Test ScmChillMode testChillModeOperations failed. ( #622 )
...
HDDS-1307. Test ScmChillMode testChillModeOperations failed. Contributed by Bharat Viswanadham. (#622 )
2019-03-19 13:57:02 -07:00
Xiaoyu Yao
992489c11c
HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao.
...
This closes #615
2019-03-19 09:55:52 -07:00
Ajay Yadav
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. ( #601 )
2019-03-18 23:08:17 -07:00
Bharat Viswanadham
93db5da4d9
HDDS-1250. In OM HA AllocateBlock call where connecting to SCM from OM should not happen on Ratis.
2019-03-18 13:51:44 -07:00
Xiaoyu Yao
66a104bc57
HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #616 )
2019-03-18 08:38:55 -07:00
Sammi Chen
4d2a116d6e
HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen.
2019-03-17 17:08:29 +08:00
Xiaoyu Yao
5cfb88a225
HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. ( #594 )
2019-03-15 16:08:30 -07:00
Elek, Márton
16b78622cc
HDDS-1283. Fix the dynamic documentation of basic s3 client usage. Contributed by Elek, Marton. ( #605 )
2019-03-15 14:12:10 -07:00
Xiaoyu Yao
d1afa03804
HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh.
...
Closes #585
2019-03-15 10:41:06 -07:00
Elek, Márton
dc21655f2a
HDDS-1259. OzoneFS classpath separation is broken by the token validation. Contributed by Elek Marton.
...
Closes #604
2019-03-15 09:43:01 -07:00
Shashikant Banerjee
a7f5e742a6
HDDS-1088. Add blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi.
2019-03-15 20:54:41 +05:30
Shashikant Banerjee
155ab6d5d8
HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee.
2019-03-15 15:40:59 +05:30
Vivek Ratnavel Subramanian
9001508485
HDDS-761. Create S3 subcommand to run S3 related operations.
...
Closes #579
2019-03-14 21:16:59 -07:00
Vivek Ratnavel Subramanian
2627dad333
HDDS-1265. ozone sh s3 getsecret throws Null Pointer Exception for unsecured clusters.
...
Closes #611
2019-03-14 17:21:06 -07:00
Bharat Viswanadham
091a664977
HDDS-917. Expose NodeManagerMXBean as a MetricsSource. Contributed by Siddharth Wagle.
2019-03-14 12:41:52 -07:00
Mukul Kumar Singh
983b78afdc
HDDS-1237. Fix test TestSecureContainerServer.testClientServerRatisGrpc. Contributed by Mukul Kumar Singh.
2019-03-14 16:49:43 +05:30
Márton Elek
3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
...
Closes #588
2019-03-14 12:01:25 +01:00
Mukul Kumar Singh
ea9fb07fd2
HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh.
2019-03-14 15:18:06 +05:30
Ajay Yadav
4fa009989b
HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. ( #598 )
2019-03-13 12:01:08 -07:00
Aravindan Vijayan
1f47fb7a2f
HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 17:12:43 +05:30
Lokesh Jain
0d62753da9
HDDS-1128. Create stateful manager class for the pipeline creation scheduling.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-13 16:30:06 +05:30
Márton Elek
c449cdebe6
HDDS-807. Period should be an invalid character in bucket names. Contributed by Siddharth Wagle.
2019-03-12 19:14:55 +01:00
Ajay Yadav
dcb0de848d
HDDS-1043. Enable token based authentication for S3 api
...
Closes #561
2019-03-12 18:47:06 +01:00
Xiaoyu Yao
2778259b88
HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #593 )
...
Closes PR #593
2019-03-12 09:34:18 -07:00
Mukul Kumar Singh
daf4660eeb
HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh.
2019-03-12 20:02:19 +05:30
Xiaoyu Yao
c7307867f0
HDDS-1245. OM delegation expiration time should use Time.now instead … ( #587 )
...
Closes #587 .
2019-03-11 21:15:40 -07:00
Ajay Yadav
599e926d46
HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar.
...
This closes (#581 )
2019-03-11 15:01:04 -07:00
Shashikant Banerjee
b4aa24d3c5
HDDS-1173. Fix a data corruption bug in BlockOutputStream. Contributed by Shashikant Banerjee.
2019-03-11 23:15:49 +05:30
Xiaoyu Yao
4fc493e511
HDDS-1236. Fix incorrect Ozone ClientProtocol KerberosInfo annotation. Contributed by Xiaoyu Yao. ( #573 )
2019-03-11 09:19:19 -07:00
Lokesh Jain
ebb5fa115b
HDDS-1220. KeyManager#openKey should release the bucket lock before doing an allocateBlock. Contributed by Lokesh Jain.
2019-03-11 14:54:44 +05:30
Bharat Viswanadham
68aa2ccd89
HDDS-1240. Fix check style issues caused by HDDS-1196.
2019-03-09 21:50:46 -08:00
Bharat Viswanadham
73e1801b2d
HDDS-1242. In S3 when bucket already exists, it should just return location.
2019-03-09 21:42:17 -08:00
Elek, Márton
c072458e5d
HDDS-1213. Support plain text S3 MPU initialization request.
2019-03-08 09:55:31 -08:00
Bharat Viswanadham
341c076f05
HDDS-1196. Add a ReplicationStartTimer class. ( #567 )
2019-03-08 20:55:33 +05:30
Yiqun Lin
fb851c9481
HDDS-1232. Recon Container DB service definition. Contributed by Aravindan Vijayan.
2019-03-08 16:59:41 +08:00
Vivek Ratnavel Subramanian
475011bbf8
HDDS-1226. ozone-filesystem jar missing in hadoop classpath
...
Closes #560
2019-03-07 14:09:13 +01:00
Hanisha Koneru
0eba4079bc
HDDS-1225. Provide docker-compose for OM HA.
...
Closes #562
2019-03-07 11:10:04 +01:00
Hanisha Koneru
bb12e81ec8
HDDS-1175. Serve read requests directly from RocksDB. ( #557 )
...
HDDS-1175. Serve read requests directly from RocksDB.
2019-03-06 19:44:55 -08:00
Vivek Ratnavel Subramanian
a55fc36299
HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.
2019-03-06 17:43:57 -08:00
Márton Elek
45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
...
Closes #490
2019-03-06 18:22:22 +01:00
Mukul Kumar Singh
2c3ec37738
HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh.
2019-03-06 21:38:21 +05:30
Ajay Kumar
9d87247af3
HDDS-1216. Change name of ozoneManager service in docker compose files to om.
...
Closes #553
2019-03-06 15:18:39 +01:00
Arpit Agarwal
1ad5bfc53f
HDDS-1188. Implement a skeleton patch for Recon server with initial set of interfaces. Contributed by Siddharth Wagle.
2019-03-05 15:54:29 -08:00
Elek, Márton
7f636b47b5
HDDS-919. Enable prometheus endpoints for Ozone datanodes ( #502 )
...
Pull request from Elek, Márton. (#502 )
2019-03-05 12:04:57 -08:00
Anu Engineer
7fd890116a
HDDS-1171. Add benchmark for OM and OM client in Genesis.
...
Contributed by Lokesh Jain.
2019-03-05 11:31:09 -08:00
Arpit Agarwal
3ef1235215
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek.
2019-03-05 10:25:31 -08:00
Arpit Agarwal
549d54f9a3
Merge pull request #556 from elek/HDDS-1222
...
HDDS-1222. Remove TestContainerSQLCli unit test stub
2019-03-05 10:15:55 -08:00
Hanisha Koneru
12402b7a74
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-05 09:24:22 -08:00
Shashikant Banerjee
5fcea54a50
HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee.
2019-03-05 22:09:46 +05:30
Ajay Yadav
353b90d59e
HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar.
2019-03-05 08:37:10 -08:00
Márton Elek
02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton.
2019-03-05 16:35:04 +01:00
Anu Engineer
10b802b84b
HDDS-1136 : Add metric counters to capture the RocksDB checkpointing statistics.
...
Contributed by Aravindan Vijayan.
2019-03-04 12:00:16 -08:00
Xiaoyu Yao
eed8b794d8
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. ( #545 )
2019-03-04 10:37:26 -08:00
Hanisha Koneru
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
...
This reverts commit 8e1225991d
.
2019-03-04 16:58:59 +09:00
Ajay Yadav
9e53088493
Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" ( #544 )
...
* Revert "Fix checkstyle issue"
This reverts commit 78c8a3323e
.
* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."
This reverts commit 6fef6fc5ee
.
2019-03-01 16:19:43 -08:00
Xiaoyu Yao
78c8a3323e
Fix checkstyle issue
2019-03-01 16:15:20 -08:00
Xiaoyu Yao
6fef6fc5ee
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao.
2019-03-01 16:15:20 -08:00
Ajay Kumar
4a3cddea70
HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar.
2019-03-01 15:41:09 -08:00
Shashikant Banerjee
de1dae64f2
HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee.
2019-03-01 23:30:28 +05:30
Hanisha Koneru
8e1225991d
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-01 00:27:39 -08:00
Anu Engineer
eae3db9649
HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs.
...
Contributed Elek, Marton.
2019-02-28 17:14:47 -08:00
Xiaoyu Yao
3a8118b480
HDDS-1190. Fix jdk 11 issue for ozonesecure base image and docker-compose . Contributed by Xiaoyu Yao.
2019-02-28 15:51:08 +01:00
Ajay Kumar
cbf82fabf0
HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar.
2019-02-27 17:00:42 -08:00
Bharat Viswanadham
6c8c422beb
HDDS-1178. Healthy pipeline Chill Mode Rule.
...
Closes #518
2019-02-27 14:26:40 +01:00
Xiaoyu Yao
0e450202a6
HDDS-1019. Use apache/hadoop-runner image to test ozone secure cluster. Contributed by Xiaoyu Yao.
2019-02-27 12:44:04 +01:00
Ajay Kumar
625e93713b
HDDS-1177. Add validation to AuthorizationHeaderV4. Contributed by Ajay Kumar
2019-02-26 18:57:43 -08:00
Anu Engineer
a5a751b418
HDDS-1174. Freon tests are failing with null pointer exception.
...
Contributed by Shashikant Banerjee.
2019-02-26 14:33:54 -08:00
Márton Elek
585cebf26b
HDDS-1104. Use picocli with Ozone genesis tool. Contributed by Lokesh Jain.
2019-02-26 16:11:55 +01:00
Xiaoyu Yao
9e0f3d1c52
HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar.
2019-02-26 06:02:10 -08:00
Anu Engineer
9de34d2990
HDDS-1151. Propagate the tracing id in ScmBlockLocationProtocol.
...
Contributed by Elek, Marton.
2019-02-25 13:50:37 -08:00
Márton Elek
a5eb7ce651
HDDS-1170. Fix the FindBugs issue in OzoneClientAdapterFactory. Contributed by Anu Engineer.
2019-02-25 10:41:43 +01:00
Anu Engineer
92b1fdcece
HDDS-1070. Adding Node and Pipeline related metrics in SCM.
...
Contributed by Nandakumar.
2019-02-24 15:39:41 -08:00
Anu Engineer
3aa0a57ea0
HDDS-1152. Add trace information for the client side of the datanode writes
...
Contributed by Elek, Marton.
2019-02-24 15:20:34 -08:00
Anu Engineer
5c1f946071
HDDS-1145. Add optional web server to the Ozone freon test tool.
...
Contributed by Elek, Marton.
2019-02-24 15:04:25 -08:00
Anu Engineer
236b105e41
HDDS-1089. Disable OzoneFSStorageStatistics for hadoop versions older than 2.8.
...
Contributed by Elek, Marton.
2019-02-24 13:53:38 -08:00
Anu Engineer
8387bbdfb5
HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
...
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
Bharat Viswanadham
106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read.
2019-02-23 21:37:55 -08:00
Anu Engineer
c1e5b19212
HDDS-1147. Fix failing unit tests in TestOzoneManager.
...
Contributed by Nandakumar.
2019-02-23 20:56:24 -08:00
Anu Engineer
fb546d1807
HDDS-1167. Error in hadoop-ozone/dev-support/checks/checkstyle.sh.
...
Contributed by Nandakumar.
2019-02-23 20:45:01 -08:00
Hanisha Koneru
d0e21ac16b
HDDS-1158. TestOzoneManagerHA.testTwoOMNodesDown is failing with ratis error.
2019-02-23 10:20:28 -08:00
Elek, Márton
28d0bf9f67
HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton.
2019-02-21 13:57:05 -08:00
Bharat Viswanadham
d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
...
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.
* fix test failures in TestOzoneConfigurationFields
2019-02-21 13:29:10 -08:00
Márton Elek
7c802c42dc
HDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton.
2019-02-21 14:04:18 +01:00
Hanisha Koneru
b1397ff9e4
HDDS-1109. Setup Failover Proxy Provider for OM client.
2019-02-20 14:49:59 -08:00
Arpit Agarwal
676a9cb888
HDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan.
2019-02-20 12:57:49 -08:00
Xiaoyu Yao
1374f8f548
HDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar.
2019-02-20 11:35:49 -08:00
Márton Elek
642fe6a260
HDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh Chitlangia.
2019-02-20 12:08:24 +01:00
Yiqun Lin
1d30fd94c6
HDDS-1130. Make BenchMarkBlockManager multi-threaded. Contributed by Lokesh Jain.
2019-02-20 10:45:51 +08:00
avijayanhwx
e8d7e3b4e6
HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.
2019-02-19 16:32:47 -08:00
Anu Engineer
02d04bd107
HDDS-1121. Key read failure when data is written parallel in to Ozone.
...
Contributed by Bharat Viswanadham.
2019-02-19 11:07:17 -08:00
Xiaoyu Yao
cf1a66d0da
HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer.
2019-02-19 10:42:56 -08:00
Anu Engineer
588b4c4d78
HDDS-1085. Create an OM API to serve snapshots to Recon server.
...
Contributed by Aravindan Vijayan.
2019-02-18 22:35:36 -08:00
Yiqun Lin
67af509097
HDDS-1122. Fix TestOzoneManagerRatisServer#testSubmitRatisRequest unit test failure. Contributed by Yiqun Lin.
2019-02-19 11:29:52 +08:00
Yiqun Lin
f2fb6536dc
HDDS-1106. Introduce queryMap in PipelineManager. Contributed by Lokesh Jain.
2019-02-18 22:35:23 +08:00
Anu Engineer
7ea91494ce
HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
...
Contributed by Xiaoyu Yao.
2019-02-16 10:23:10 -08:00
Elek, Márton
afe126d71f
HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek.
2019-02-15 11:49:52 -08:00
Anu Engineer
217bdbd940
HDDS-1116.Add java profiler servlet to the Ozone web servers.
...
Contributed by Elek, Marton.
2019-02-15 11:32:06 -08:00
Elek, Márton
d10444e79c
HDDS-1092. Use Java 11 JRE to run Ozone in containers.
2019-02-15 17:26:56 +01:00
Shashikant Banerjee
de934ba2dc
HDDS-1076. TestSCMNodeManager crashed the jvm. Contributed by Lokesh Jain.
2019-02-15 21:13:30 +05:30
Márton Elek
e0fe3d1eca
HDDS-1110. OzoneManager need to login during init when security is enabled. Contributed by Xiaoyu Yao.
2019-02-15 16:12:24 +01:00
Anu Engineer
75e15cc0c4
HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
...
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer
5cb67cf044
HDDS-1097. Add genesis benchmark for BlockManager#allocateBlock.
...
Contributed by Lokesh Jain.
2019-02-14 23:24:58 -08:00
Anu Engineer
506bd02c63
HDDS-905. Create informative landing page for Ozone S3 gateway.
...
Contributed by Elek, Marton.
2019-02-14 23:16:23 -08:00
Anu Engineer
0395f22145
HDDS-1068. Improve the error propagation for ozone sh.
...
Contributed by Elek, Marton.
2019-02-14 22:51:46 -08:00
Yiqun Lin
084b6a6751
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.
2019-02-15 14:23:34 +08:00
Yiqun Lin
492e49e7ca
Revert "HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham."
...
This reverts commit 5656409327
.
2019-02-15 14:21:29 +08:00
Yiqun Lin
5656409327
HDDS-1099. Genesis benchmark for ozone key creation in OM. Contributed by Bharat Viswanadham.
2019-02-15 14:07:15 +08:00
Anu Engineer
2d83b24994
HDDS-1108. Check s3bucket exists or not before MPU operations.
...
Contributed by Bharat Viswanadham.
2019-02-14 18:10:18 -08:00
Anu Engineer
6c8ffdb958
HDDS-1100. fix asf license errors in newly added files by HDDS-936.
...
Contributed by Dinesh Chitlangia.
2019-02-14 17:42:59 -08:00
Márton Elek
7a57974f1f
HDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is not defined. Contributed by Hanisha Koneru.
2019-02-14 14:02:16 +01:00
Jitendra Pandey
fa067aa157
HDDS-936. Need a tool to map containers to ozone objects. Contributed by Sarun Singla
2019-02-13 15:43:14 -08:00
Bharat Viswanadham
cf4aeccfa0
HDDS-1034. TestOzoneRpcClient and TestOzoneRpcClientWithRatis failure. Contributed by Mukul Kumar Singh.
2019-02-12 22:23:48 -08:00
Bharat Viswanadham
917ac9f108
HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.
2019-02-12 22:07:27 -08:00
Yiqun Lin
06d7890bdd
HDDS-1047. Fix TestRatisPipelineProvider#testCreatePipelineWithFactor. Contributed by Nilotpal Nandi.
2019-02-13 10:50:57 +08:00
Mukul Kumar Singh
20b92cdefe
HDDS-1050. TestSCMRestart#testPipelineWithScmRestart is failing. Contributed by Supratim Deka.
2019-02-12 16:33:58 +05:30
Nanda kumar
63a9b0d8aa
HDDS-1080. Ozonefs Isolated class loader should support FsStorageStatistics.
...
Contributed by Elek, Marton.
2019-02-12 14:49:51 +05:30
Nanda kumar
a536eb5c41
HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
...
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
Yiqun Lin
26e60135f5
HDDS-1074. Remove dead variable from KeyOutputStream#addKeyLocationInfo. Contributed by Siddharth Wagle.
2019-02-12 16:28:50 +08:00
Ajay Kumar
d48e61dd36
HDDS-1012. Add Default CertificateClient implementation. Contributed by Ajay Kumar
2019-02-11 18:59:47 -08:00
Mukul Kumar Singh
73b67b2df5
HDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi.
2019-02-11 20:08:25 +05:30
Márton Elek
e7d1ae52d2
HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton.
2019-02-11 12:18:26 +01:00
Bharat Viswanadham
a1414582a8
HDDS-1077. TestSecureOzoneCluster does not config OM HTTP keytab. Contributed by Xiaoyu Yao.
2019-02-10 19:34:53 -08:00
Bharat Viswanadham
ed99da850e
HDDS-1078. TestRatisPipelineProvider failing because of node count mismatch. Contributed by Mukul Kumar Singh.
2019-02-10 19:17:08 -08:00
Shashikant Banerjee
965d26c9c7
HDDS-1026. Reads should fail over to alternate replica. Contributed by Shashikant Banerjee.
2019-02-10 10:53:16 +05:30
Xiaoyu Yao
e50dc7ee59
HDDS-1018. Update the base image of krb5 container for the secure ozone cluster. Contributed by Xiaoyu Yao.
2019-02-08 12:45:49 -08:00
Nanda kumar
394a9f7d5c
HDDS-1033. Add FSStatistics for OzoneFileSystem.
...
Contributed by Mukul Kumar Singh.
2019-02-08 17:33:37 +05:30
Márton Elek
df7b7dadf9
HDDS-1073. Fix FindBugs issues on OzoneBucketStub#createMultipartKey. Contributed by Aravindan Vijayan.
2019-02-08 11:35:55 +01:00
Nanda kumar
0c1bc4dcee
HDDS-981. Block allocation should involve pipeline selection and then container selection.
...
Contributed by Lokesh Jain.
2019-02-08 15:44:41 +05:30
Bharat Viswanadham
a140a890c6
HDDS-1069. Temporarily disable the security acceptance tests by default in Ozone. Contributed by Marton Elek.
2019-02-07 18:05:05 -08:00
Bharat Viswanadham
75e8441c61
HDDS-1071. Make Ozone s3 acceptance test suite centos compatible. Contributed by Elek Marton.
2019-02-07 08:53:11 -08:00
Márton Elek
a65aca2fef
HDDS-922. Create isolated classloder to use ozonefs with any older hadoop versions. Contributed by Elek, Marton.
2019-02-07 17:02:03 +01:00
Mukul Kumar Singh
214112b2d7
HDDS-1010. ContainerSet#getContainerMap should be renamed. Contributed by Supratim Deka.
2019-02-07 18:06:23 +05:30
Mukul Kumar Singh
911790cc26
HDDS-1027. Add blockade Tests for datanode isolation and scm failures. Contributed by Nilotpal Nandi.
2019-02-06 11:32:38 +05:30
Márton Elek
194f0b49fb
HDDS-631. Ozone classpath shell command is not working. Contributed by Elek, Marton.
2019-02-05 16:20:30 +01:00
Márton Elek
9f2da01591
HDDS-776. Make OM initialization resilient to dns failures. Contributed by Doroszlai, Attila.
2019-02-05 16:11:19 +01:00
Márton Elek
9ace37b119
HDDS-987. MultipartUpload: S3API for list parts of a object. Contributed by Bharat Viswanadham.
2019-02-05 13:08:36 +01:00
Yiqun Lin
3efa168e1f
HDDS-1029. Allow option for force in DeleteContainerCommand. Contributed by Bharat Viswanadham.
2019-02-05 10:51:52 +08:00
Mukul Kumar Singh
b6f90d3957
HDDS-1021. Allow ozone datanode to participate in a 1 node as well as 3 node Ratis Pipeline. Contributed by Shashikant Banerjee.
2019-02-03 00:53:06 +05:30
Shashikant Banerjee
4123353151
HDDS-1037. Fix the block discard logic in Ozone client. Contributed by Shashikant Banerjee.
2019-02-01 20:44:48 +05:30
Mukul Kumar Singh
13aa939224
HDDS-997. Add blockade Tests for scm isolation and mixed node isolation. Contributed by Nilotpal Nandi.
2019-02-01 13:10:17 +05:30
Márton Elek
033d97abac
HDDS-956. MultipartUpload: List Parts for a Multipart upload key. Contributed by Bharat Viswanadham.
2019-01-31 14:51:31 +01:00
Bharat Viswanadham
53729279c7
HDDS-1035. Intermittent TestRootList failure. Contributed by Doroszlai Attila.
2019-01-30 16:21:42 -08:00
Bharat Viswanadham
945a61c164
HDDS-549. Add support for key rename in Ozone Shell. Contributed by Doroszlai Attila.
2019-01-30 16:00:18 -08:00
Bharat Viswanadham
7456fc99ee
HDDS-1031. Update ratis version to fix a DN restart Bug. Contributed by Bharat Viswanadham.
2019-01-30 11:14:02 -08:00
Márton Elek
0e95ae402c
HDDS-1030. Move auditparser robot tests under ozone basic. Contributed by Dinesh Chitlangia.
2019-01-30 17:34:32 +01:00
Yiqun Lin
d583cc45c6
HDDS-1024. Handle DeleteContainerCommand in the SCMDatanodeProtocolServer. Contributed by Bharat Viswanadham.
2019-01-30 13:56:28 +08:00
Yiqun Lin
8326450bca
HDDS-974. Add getServiceAddress method to ServiceInfo and use it in TestOzoneShell. Contributed by Doroszlai, Attila.
2019-01-28 17:03:12 +08:00
Hanisha Koneru
91649c34aa
HDDS-1013. NPE while listing directories.
2019-01-25 21:39:03 -08:00
Bharat Viswanadham
fb69519e68
HDDS-1011. Fix NPE BucketManagerImpl.setBucketProperty. Contributed by Xiaoyu Yao.
2019-01-25 14:46:17 -08:00
Xiaoyu Yao
2ec296e659
HDDS-991. Fix failures in TestSecureOzoneCluster. Contributed by Ajay Kumar.
2019-01-25 10:50:23 -08:00
Xiaoyu Yao
9fc7df8afb
HDDS-793. Support custom key/value annotations on volume/bucket/key. Contributed by Elek, Marton.
2019-01-24 23:24:09 -08:00
Nanda kumar
a448b05287
HDDS-1009. TestAbortMultipartUpload is missing the apache license text.
...
Contributed by Dinesh Chitlangia.
2019-01-25 12:20:12 +05:30
Nanda kumar
45c4cfe790
HDDS-906. Display the ozone version on SCM/OM web ui instead of Hadoop version.
...
Contributed by Doroszlai, Attila.
2019-01-25 12:16:29 +05:30
Nanda kumar
8ff9578126
HDDS-1007. Add robot test for AuditParser.
...
Contributed by Dinesh Chitlangia.
2019-01-25 12:14:10 +05:30
Nanda kumar
c6d901af77
HDDS-1006. AuditParser assumes incorrect log format.
...
Contributed by Dinesh Chitlangia.
2019-01-25 12:11:58 +05:30
Márton Elek
4e0aa2ceac
HDDS-948. MultipartUpload: S3 API for Abort Multipart Upload. Contributed by Bharat Viswanadham.
2019-01-24 20:24:19 +01:00
Márton Elek
3c7d700b65
HDDS-1002. ozonesecure compose incompatible with smoke test. Contributed by Doroszlai, Attila.
2019-01-24 17:17:40 +01:00
Shashikant Banerjee
f3d8265582
HDDS-996. Incorrect data length gets updated in OM by client in case it hits exception in multiple successive block writes. Contributed by Shashikant Banerjee.
2019-01-24 16:37:05 +05:30
Márton Elek
09a5859f58
HDDS-993. Update hadoop version to 3.2.0. Contributed by Supratim Deka.
2019-01-24 11:32:58 +01:00
Ajay Kumar
dcbc8b86ed
HDDS-975. Manage ozone security tokens with ozone shell cli. Contributed by Ajay Kumar.
2019-01-23 15:34:20 -08:00
Elek, Márton
0b91329ed6
HDDS-764. Run S3 smoke tests with replication STANDARD. ( #462 )
...
HDDS-764. Run S3 smoke tests with replication STANDARD. Contributed by Elek, Marton.
2019-01-23 11:37:49 -08:00
Shashikant Banerjee
e72e27edd8
HDDS-932. Add blockade Tests for Network partition. Contributed by Nilotpal Nandi.
2019-01-23 14:05:49 +05:30
Xiaoyu Yao
751bc62df7
Merge branch 'HDDS-4' into trunk
2019-01-18 14:44:24 -08:00
Bharat Viswanadham
c26d354e7d
HDDS-983. Rename S3Utils to avoid conflict with HDFS classes. Contributed by Bharat Viswanadham.
2019-01-18 13:16:38 -08:00
Xiaoyu Yao
2aaaf12f9e
HDDS-943. Add block token validation in HddsDispatcher/XceiverServer. Contributed by Ajay Kumar.
2019-01-18 12:11:34 -08:00
Mukul Kumar Singh
4ac0404fe0
HDDS-959. KeyOutputStream should handle retry failures. Contributed by Lokesh Jain.
2019-01-18 11:08:43 -08:00
Xiaoyu Yao
06c83d3b8a
HDDS-984. Fix TestOzoneManagerRatisServer.testIsReadOnlyCapturesAllCmdTypeEnums. Contributed by Xiaoyu Yao.
2019-01-17 14:03:46 -08:00
Bharat Viswanadham
c0683ed253
HDDS-960. Add cli command option for getS3Secret. Contributed by Dinesh Chitlangia.
2019-01-17 10:30:45 -08:00
Ajay Kumar
01a7f9ed35
HDDS-597. Ratis: Support secure gRPC endpoint with mTLS for Ratis. Contributed by Ajay Kumar.
2019-01-17 10:30:44 -08:00
Bharat Viswanadham
54b11de2c0
HDDS-898. Continue token should contain the previous dir in Ozone s3g object list. Contributed by Elek Marton.
2019-01-16 17:33:10 -08:00
Xiaoyu Yao
140565f4db
HDDS-967. Fix failures in TestOzoneConfigurationFields. Contributed by Ajay Kumar.
2019-01-16 16:44:33 -07:00
Ajay Kumar
0e16cf1973
HDDS-970. Fix classnotfound error for bouncy castle classes in OM,SCM init. Contributed by Ajay Kumar.
2019-01-16 16:40:05 -07:00
Ajay Kumar
0faa5701d9
HDDS-964. Fix test failure in TestOmMetrics. Contributed by Ajay Kumar.
2019-01-16 16:40:04 -07:00
Anu Engineer
8978466fca
HDDS-945. Fix generics warnings in delegation token.
...
Contributed by Ajay Kumar.
2019-01-16 16:23:26 -07:00
Anu Engineer
1d5734e341
HDDS-938. Add Client APIs for using S3 Auth interface.
...
Contributed by Dinesh Chitlangia.
2019-01-16 16:18:39 -07:00
Anu Engineer
30bfc9cbd0
HDDS-955. SCM CA: Add CA to SCM.
...
Contributed by Anu Engineer.
2019-01-16 13:43:31 -07:00
Bharat Viswanadham
ddaef67181
HDDS-937. Create an S3 Auth Table. Contributed by Dinesh Chitlangia.
2019-01-16 13:43:30 -07:00
Ajay Kumar
50c4045fde
HDDS-805. Block token: Client api changes for block token. Contributed by Ajay Kumar.
2019-01-16 13:38:27 -07:00
Xiaoyu Yao
2b115222cd
HDDS-929. Remove ozone.max.key.len property. Contributed by Ajay Kumar.
2019-01-16 01:42:08 -07:00
Ajay Kumar
f894d86b2f
HDDS-115. GRPC: Support secure gRPC endpoint with mTLS. Contributed by Xiaoyu Yao.
2019-01-16 01:42:08 -07:00
Xiaoyu Yao
417951ab58
HDDS-884. Fix merge issue that causes NPE OzoneManager#httpServer. Contributed by Xiaoyu Yao.
2019-01-16 01:22:44 -07:00
Ajay Kumar
6d522dc05d
HDDS-804. Block token: Add secret token manager. Contributed by Ajay Kumar.
2019-01-16 01:22:43 -07:00
Anu Engineer
0c8829a9a1
HDDS-696. Bootstrap genesis SCM(CA) with self-signed certificate.
...
Contributed by Anu Engineer.
2019-01-16 01:16:25 -07:00
Ajay Kumar
825310608b
HDDS-873. Fix TestSecureOzoneContainer NPE after HDDS-837. Contributed by Xiaoyu Yao.
2019-01-16 01:16:25 -07:00
Xiaoyu Yao
7e2770699c
HDDS-9. Add GRPC protocol interceptors for Ozone Block Token. Contributed by Xiaoyu Yao.
2019-01-16 01:10:08 -07:00
Ajay Kumar
bb4a26ca32
HDDS-8. Add OzoneManager Delegation Token support. Contributed by Ajay Kumar.
2019-01-16 01:06:59 -07:00
Xiaoyu Yao
6d6b1a00c2
HDDS-836. Add TokenIdentifier Ozone for delegation token and block token. Contributed by Ajay Kumar.
2019-01-15 23:01:04 -07:00
Xiaoyu Yao
53120e2e6c
HDDS-592. Fix ozone-secure.robot test. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
Ajay Kumar
a28ad7ad81
HDDS-753. SCM security protocol server is not starting. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
Xiaoyu Yao
61e85d7cd1
HDDS-684. Fix HDDS-4 branch after HDDS-490 and HADOOP-15832. Contributed by Xiaoyu Yao.
2019-01-15 23:01:03 -07:00
Xiaoyu Yao
16e0bb874d
HDDS-591. Adding ASF license header to kadm5.acl. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
Xiaoyu Yao
0aab74026e
HDDS-10. Add kdc docker image for secure ozone cluster. Contributed by Ajay Kumar.
2019-01-15 23:01:03 -07:00
Ajay Kumar
d4511889fd
HDDS-566. Move OzoneSecure docker-compose after HDDS-447. Contributed by Xiaoyu Yao.
2019-01-15 23:01:03 -07:00
Ajay Kumar
9920506b3d
HDDS-547. Fix secure docker and configs. Contributed by Xiaoyu Yao.
2019-01-15 23:01:02 -07:00
Xiaoyu Yao
570b503e3e
Fix merge conflicts
2019-01-15 22:54:50 -07:00
Xiaoyu Yao
faf53f8262
HDDS-100. SCM CA: generate public/private key pair for SCM/OM/DNs. Contributed by Ajay Kumar.
2019-01-15 22:53:56 -07:00
Xiaoyu Yao
e47135d9d9
HDDS-70. Fix config names for secure ksm and scm. Contributed by Ajay Kumar.
2019-01-15 22:53:55 -07:00
Xiaoyu Yao
914e93beeb
HDDS-7. Enable kerberos auth for Ozone client in hadoop rpc. Contributed by Ajay Kumar.
2019-01-15 22:44:45 -07:00
Xiaoyu Yao
d3920ecbb7
HDDS-5. Enable OzoneManager kerberos auth. Contributed by Ajay Kumar.
2019-01-15 22:40:08 -07:00
Xiaoyu Yao
ff61931f91
HDDS-6. Enable SCM kerberos auth. Contributed by Ajay Kumar.
2019-01-15 22:16:58 -07:00
Márton Elek
05c84ab01c
HDDS-977. Exclude dependency-reduced-pom.xml from ozone rat check. Contributed by Elek, Marton.
2019-01-14 16:30:21 -08:00
Hanisha Koneru
a4eefe5765
HDDS-947. Implement OzoneManager State Machine.
2019-01-11 10:06:05 -08:00
Bharat Viswanadham
2091d1a4af
HDDS-941. Rename ChunkGroupInputStream to keyInputStream and ChunkInputStream to BlockInputStream. Contributed by Shashikant Banerjee.
2019-01-09 20:02:36 -08:00
Hanisha Koneru
f4617c6239
Revert "HDDS-947. Implement OzoneManager State Machine."
...
This reverts commit 8dd11a1577
.
2019-01-09 11:20:57 -08:00
Hanisha Koneru
8dd11a1577
HDDS-947. Implement OzoneManager State Machine.
2019-01-09 10:57:24 -08:00
Márton Elek
32cf0412ce
HDDS-965. Ozone: checkstyle improvements and code quality scripts. Contributed by Elek, Marton.
2019-01-08 22:27:19 +01:00
Márton Elek
999f31fd20
HDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bharat Viswanadham.
2019-01-08 15:48:48 +01:00
Márton Elek
695e93c2bb
HDDS-969. Fix TestOzoneManagerRatisServer test failure. Contributed by Bharat Viswanadham.
2019-01-08 15:12:08 +01:00
Márton Elek
396ffba1aa
HDDS-968. Fix TestObjectPut failures. Contributed by Bharat Viswanadham.
2019-01-08 14:54:38 +01:00
Bharat Viswanadham
4297e20c8b
HDDS-926. Use Timeout rule for the the test methods in TestOzoneManager. Contributed by Dinesh Chitlangia.
2019-01-07 22:04:06 -08:00
Anu Engineer
06279ecc55
HDDS-946. AuditParser - insert audit to database in batches.
...
contributed by Dinesh Chitlangia.
2019-01-07 11:19:42 -08:00
Bharat Viswanadham
cdfbec47ce
HDDS-930. Multipart Upload: Abort multiupload request. Contributed by Bharat Viswanadham.
2019-01-07 11:09:14 -08:00
Márton Elek
d66925a315
HDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat Viswanadham.
2019-01-07 12:39:46 +01:00
Márton Elek
992dd9d189
HDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bharat Viswanadham.
2019-01-07 12:06:22 +01:00
Márton Elek
d14c56d150
HDDS-916. MultipartUpload: Complete Multipart upload request. Contributed by Bharat Viswanadham.
2019-01-07 11:27:36 +01:00
Anu Engineer
999da98d67
HDDS-915. Submit client request to OM Ratis server.
...
Contributed by Hanisha Koneru.
2019-01-04 15:25:26 -08:00
Anu Engineer
ddc0a40507
HDDS-896. Handle over replicated containers in SCM.
...
Contributed by Nandakumar.
2019-01-04 09:04:10 -08:00
Anu Engineer
14d232c0fe
HDDS-957. Replace incorrect use of system property user.name.
...
Contributed by Dinesh Chitlangia.
2019-01-03 09:43:26 -08:00
Anu Engineer
996ab4874a
HDDS-393. Audit Parser tool for processing ozone audit logs.
...
Contributed by Dinesh Chitlangia.
2019-01-02 11:52:12 -08:00
Nanda kumar
4d50ad030c
HDDS-949. Update Ratis to 0.4.0-a8c4ca0-SNAPSHOT.
...
Contributed by Xiaoyu Yao.
2019-01-02 20:00:40 +05:30
Bharat Viswanadham
26e4be7022
HDDS-921. Add JVM pause monitor to Ozone Daemons (OM, SCM and Datanodes). Contributed by Bharat Viswanadham.
2018-12-23 17:33:25 -08:00
Bharat Viswanadham
13d3f99b37
HDDS-881.009. Encapsulate all client to OM requests into one request message. Contributed by Hanisha Koneru.
2018-12-20 09:12:42 -08:00
Nanda kumar
ea621fa087
HDDS-934. Freon run hung on non-functional pipeline.
...
Contributed by Nanda kumar.
2018-12-20 11:13:15 +05:30
Arpit Agarwal
b1ce9aa3b3
HDDS-940. Remove dead store to local variable in OmMetadataManagerImpl. Contributed by Dinesh Chitlangia.
2018-12-19 12:30:40 +05:30
Bharat Viswanadham
2f6bc25044
HDDS-911. Make TestOzoneManager unit tests independent. Contributed by Elek Marton.
2018-12-18 10:52:29 -08:00
Bharat Viswanadham
99b5061265
HDDS-914. Add Grafana support to ozoneperf docker container. Contributed by Dinesh Chitlangia.
2018-12-18 09:59:13 -08:00
Shashikant Banerjee
b51e9e4317
HDDS-912. Update ozone to latest ratis snapshot build (0.4.0-3b0be02-SNAPSHOT). Contributed by Lokesh Jain.
2018-12-18 18:21:17 +05:30
Shashikant Banerjee
4ff1c46d95
HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and ChunkOutputStream to BlockOutputStream. Contributed by Shashikant Banerjee.
2018-12-18 18:03:46 +05:30
Shashikant Banerjee
ee10ba26dd
HDDS-539. Ozone datanode command ignores the invalid options. Contributed by Vinicius Higa Murakami.
2018-12-18 16:10:27 +05:30
Xiaoyu Yao
94b368f29f
HDDS-99. Adding SCM Audit log. Contributed by Dinesh Chitlangia.
2018-12-17 15:40:22 -08:00
Anu Engineer
5426653819
HDDS-908: NPE in TestOzoneRpcClient.
...
Contributed by Ajay Kumar.
2018-12-17 12:18:47 -08:00
Mukul Kumar Singh
92d44b2ad0
HDDS-876. Add blockade tests for flaky network. Contributed by Nilotpal Nandi.
2018-12-13 13:35:40 +05:30
Márton Elek
d44b37d7ac
HDDS-889. MultipartUpload: Support uploading a part file in ozone. Contributed by Bharat Viswanadham.
2018-12-12 14:16:21 +01:00
Márton Elek
21c9080121
HDDS-872. Add Dockerfile and skaffold config to deploy ozone dev build to k8s. Contributed by Elek, Marton.
2018-12-11 16:31:33 +01:00
Márton Elek
17a8708039
HDDS-879. MultipartUpload: Add InitiateMultipartUpload in ozone. Contributed by Bharat Viswanadham.
2018-12-10 10:05:38 +01:00
Jitendra Pandey
1afba83f2c
HDDS-870. Avoid creating block sized buffer in ChunkGroupOutputStream. Contributed by Shashikant Banerjee.
2018-12-08 09:23:10 -08:00
Anu Engineer
5e773efd78
HDDS-909 : Default implementation for Ozone acls.
...
Contributed by Ajay Kumar.
2018-12-07 23:20:19 -08:00
Bharat Viswanadham
6c852f2a37
HDDS-892. Parse aws v2 headers without spaces in Ozone s3 gateway. Contributed by Elek Marton.
2018-12-06 15:37:34 -08:00
Hanisha Koneru
019836b113
HDDS-858. Start a Standalone Ratis Server on OM
2018-12-06 13:33:52 -08:00
Ajay Kumar
8d882c3786
HDDS-880. Create api for ACL handling in Ozone. (Contributed by Ajay Kumar)
2018-12-06 13:27:28 -08:00
Bharat Viswanadham
343aaea2d1
HDDS-864. Use strongly typed codec implementations for the tables of the OmMetadataManager. Contributed by Elek Marton.
2018-12-06 11:39:59 -08:00
Mukul Kumar Singh
7274115d57
HDDS-890. Handle OverlappingFileLockException during writeStateMachineData in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-12-04 20:12:35 +05:30
Bharat Viswanadham
de4255509a
HDDS-894. Content-length should be set for ozone s3 ranged download. Contributed by Elek Marton.
2018-12-03 15:17:44 -08:00
Bharat Viswanadham
ef3b03b75a
HDDS-885. Fix test failures due to ChecksumData. Contributed by Hanisha Koneru.
2018-12-03 10:52:49 -08:00
Yiqun Lin
3044b78bd0
HDDS-848. Create SCM metrics related to container state. Contributed by Bharat Viswanadham.
2018-12-03 17:16:34 +08:00
Shashikant Banerjee
8f3e12ff07
HDDS-882. Provide a config to optionally turn on/off the sync flag during chunk writes. Contributed by Shashikant Banerjee.
2018-12-02 08:06:24 +05:30
Shashikant Banerjee
5a3c7714c4
HDDS-887. Add DispatcherContext info to Dispatcher from containerStateMachine. Contributed by Shashikant Banerjee.
2018-12-02 08:00:35 +05:30
Bharat Viswanadham
d15dc43659
HDDS-748. Use strongly typed metadata Table implementation. Contributed by Elek Marton.
2018-12-01 16:52:23 -08:00
Xiaoyu Yao
ae5fbdd9ed
HDDS-877. Ensure correct surefire version for Ozone test. Contributed by Xiaoyu Yao.
2018-11-29 11:37:36 -08:00
Shashikant Banerjee
5e102f9aa5
HDDS-850. ReadStateMachineData hits OverlappingFileLockException in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-11-29 22:20:08 +05:30
Ajay Kumar
184cced513
HDDS-808. Simplify OMAction and DNAction classes used for AuditLogging. Contributed by Dinesh Chitlangia.
2018-11-29 08:35:20 -08:00
Hanisha Koneru
64a4b6b08b
HDDS-284. Checksum for ChunksData.
2018-11-28 10:53:12 -08:00
Anu Engineer
34a914be03
HDDS-846. Exports ozone metrics to prometheus.
...
Contributed by Elek, Marton.
2018-11-27 15:57:24 -08:00
Márton Elek
96c104d365
HDDS-766. Ozone shell create volume fails if volume name does not have a leading slash. Contributed by chencan.
2018-11-27 12:32:54 +01:00
Márton Elek
753f421350
HDDS-820. Use more strict data format for the Last-Modified headers of s3 gateway. Contributed by Elek, Marton.
2018-11-23 10:05:12 +01:00
Shashikant Banerjee
ee44b069c6
HDDS-866. Handle RaftRetryFailureException in OzoneClient. Contributed by Shashikant Banerjee.
2018-11-22 15:02:07 +05:30
Ajay Kumar
8d2789c5eb
HDDS-795. RocksDb specific classes leak from DBStore/Table interfaces. Contributed by Márton Elek.
2018-11-21 12:25:41 -08:00
Bharat Viswanadham
c4d0ef6946
HDDS-816. Create OM metrics for bucket, volume, keys. Contributed by Bharat Viswanadham.
2018-11-21 10:35:39 -08:00
Márton Elek
34b6fa7d6b
HDDS-732. Add read method which takes offset and length in SignedChunkInputStream. Contributed by chencan.
2018-11-21 17:59:36 +01:00
Márton Elek
22867deffa
HDDS-791. Support Range header for ozone s3 object download. Contributed by Bharat Viswanadham.
2018-11-21 17:04:53 +01:00
Shashikant Banerjee
c8b3dfa625
HDDS-860. Fix TestDataValidate unit tests. Contributed by Shashikant Banerjee.
2018-11-21 11:28:20 +05:30
Shashikant Banerjee
14e1a0a3d6
HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee.
2018-11-21 10:51:50 +05:30
Xiaoyu Yao
f994b526a0
HDDS-855. Move OMMetadataManager from hadoop-ozone/ozone-manager to hadoop-ozone/common. Contributed by Ajay Kumar.
2018-11-20 20:31:07 -08:00
Shashikant Banerjee
1734ace35f
Revert "HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee."
...
This reverts commit c74783036d
.
2018-11-21 01:07:38 +05:30
Shashikant Banerjee
c74783036d
HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee.
2018-11-20 23:01:02 +05:30
Márton Elek
4ecdcc9620
HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath.
2018-11-20 15:24:20 +01:00
Márton Elek
c946f1b121
Revert "HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath."
...
This reverts commit 2a7f485991
.
2018-11-20 13:35:40 +01:00
Márton Elek
2a7f485991
HDDS-692. Use the ProgressBar class in the RandomKeyGenerator freon test. Contributed by Zsolt Horvath.
2018-11-20 12:57:27 +01:00
Yiqun Lin
d0cc679441
HDDS-817. Create SCM metrics for disk from node report. Contributed by Bharat Viswanadham.
2018-11-20 14:22:30 +08:00
Mukul Kumar Singh
b5d7b292c9
HDDS-718. Introduce new SCM Commands to list and close Pipelines. Contributed by Lokesh Jain.
2018-11-19 22:59:30 +05:30
Nanda kumar
93666087bc
HDDS-847. TestBlockDeletion is failing.
...
Contributed by Lokesh Jain.
2018-11-19 17:04:18 +05:30
Nanda kumar
5a7ca6ac3e
HDDS-837. Persist originNodeId as part of .container file in datanode.
...
Contributed by Nanda kumar.
2018-11-19 14:39:55 +05:30
Mukul Kumar Singh
cfb915f3df
HDDS-844. Add logic for pipeline teardown after timeout. Contributed by Lokesh Jain.
2018-11-19 12:11:05 +05:30
Xiaoyu Yao
29374999b6
HDDS-120. Adding HDDS datanode Audit Log. Contributed by Dinesh Chitlangia.
2018-11-16 14:59:59 -08:00
Nanda kumar
c4d9640028
HDDS-801. Quasi close the container when close is not executed via Ratis.
...
Contributed by Nanda kumar.
2018-11-16 23:11:33 +05:30
Anu Engineer
a16aa2f60b
HDDS-825. Code cleanup based on messages from ErrorProne.
...
Contributed by Anu Engineer.
2018-11-15 17:36:09 -08:00
Bharat Viswanadham
57866b366f
HDDS-821. Handle empty x-amz-storage-class header in Ozone S3 gateway. Contributed by Elek Marton.
2018-11-15 14:21:42 -08:00
Márton Elek
d40912b1bd
HDDS-223. Create acceptance test for using datanode plugin. Contributed by Sandeep Nemuri.
2018-11-15 15:18:07 +01:00
Márton Elek
b12e69475b
HDDS-658. Implement s3 bucket list backend call and use it from rest endpoint. Contributed by Bharat Viswanadham.
2018-11-15 12:22:16 +01:00
Anu Engineer
9b01f039eb
HDDS-832. Docs folder is missing from the Ozone distribution package. Contributed by Elek, Marton.
2018-11-15 11:08:48 +01:00
Arpit Agarwal
bac8807c8b
HDDS-819. Match OzoneFileSystem behavior with S3AFileSystem. Contributed by Hanisha Koneru.
2018-11-14 16:12:06 -08:00
Shashikant Banerjee
b57cc73f83
HDDS-774. Remove OpenContainerBlockMap from datanode. Contributed by Shashikant Banerjee.
2018-11-14 20:05:56 +05:30
Shashikant Banerjee
671fd6524b
HDDS-675. Add blocking buffer and use watchApi for flush/close in OzoneClient. Contributed by Shashikant Banerjee.
2018-11-13 23:39:14 +05:30
Yiqun Lin
f8713f8ade
HDDS-831. TestOzoneShell in integration-test is flaky. Contributed by Nanda kumar.
2018-11-13 10:38:27 +08:00
Jitendra Pandey
f944f33832
HDDS-709. Modify Close Container handling sequence on datanodes. Contributed by Shashikant Banerjee.
2018-11-12 14:08:39 -08:00
Nanda kumar
18fe65d756
HDDS-576. Move ContainerWithPipeline creation to RPC endpoint.
...
Contributed by Nanda kumar.
2018-11-12 23:33:11 +05:30
Márton Elek
9c32b50d61
HDDS-767. OM should not search for STDOUT root logger for audit logging. Contributed by Dinesh Chitlangia.
2018-11-12 10:54:41 +01:00
Tsz Wo Nicholas Sze
298d2502b0
HDDS-826. Update Ratis to 0.3.0-6f3419a-SNAPSHOT.
2018-11-09 18:35:40 -08:00
Nanda kumar
9fe50b4991
HDDS-733. Create container if not exist, as part of chunk write.
...
Contributed by Lokesh Jain.
2018-11-10 00:08:17 +05:30
Bharat Viswanadham
47194fefdd
HDDS-823. OzoneRestClient is failing with NPE on getKeyDetails call. Contributed by Bharat Viswanadham.
2018-11-08 21:28:04 -08:00
Shashikant Banerjee
31614bcc7c
HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh.
2018-11-09 00:05:45 +05:30
Yiqun Lin
9317a61f3c
HDDS-802. Container State Manager should get open pipelines for allocating container. Contributed by Lokesh Jain.
2018-11-08 23:41:43 +08:00
Nanda kumar
c80f753b0e
HDDS-737. Introduce Incremental Container Report.
...
Contributed by Nanda kumar.
2018-11-08 18:33:38 +05:30
Yiqun Lin
addec29297
HDDS-809. Refactor SCMChillModeManager.
2018-11-07 13:54:08 +08:00
Anu Engineer
00a67f770e
HDDS-810. Move the "\r\n" at the chunk end in TestSignedChunksInputStream#singlechunkwithoutend.
...
Contributed by Chencan.
2018-11-06 10:42:19 -08:00
Márton Elek
3d5cc1138a
HDDS-798. Storage-class is showing incorrectly. Contributed by Bharat Viswanadham.
2018-11-06 18:28:54 +01:00
Akira Ajisaka
49412a1289
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain.
2018-11-06 21:26:43 +09:00
Shashikant Banerjee
942693bddd
HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh.
2018-11-05 23:43:22 +05:30
Arpit Agarwal
c8ca1747c0
HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru.
2018-11-05 09:40:00 -08:00
Bharat Viswanadham
6d9c18cfa9
HDDS-788. Change title page of bucket browser in S3gateway. Contributed by Bharat Viswanadham.
2018-11-02 08:00:18 -07:00
Yiqun Lin
d16d5f730e
HDDS-751. Replace usage of Guava Optional with Java Optional.
2018-11-02 10:50:32 +08:00
Shashikant Banerjee
e0ac3081e9
HDDS-771. ChunkGroupOutputStream stream entries need to be properly updated on closed container exception. Contributed by Lokesh Jain.
2018-11-01 15:43:48 +05:30
Shashikant Banerjee
b13c56742a
HDDS-697. update and validate the BCSID for PutSmallFile/GetSmallFile command. Contributed by Shashikant Banerjee.
2018-11-01 10:21:39 +05:30
Bharat Viswanadham
c5eb237e3e
HDDS-777. Fix missing jenkins issue in s3gateway module. Contributed by Bharat Viswanadham.
2018-10-31 19:11:12 -07:00
Bharat Viswanadham
6668c19daf
HDDS-677. Create documentation for s3 gateway to the docs. Contributed by Elek Marton.
2018-10-31 11:48:23 -07:00
Arpit Agarwal
08bb0362e0
HDDS-759. Create config settings for SCM and OM DB directories. Contributed by Arpit Agarwal.
2018-10-31 11:23:15 -07:00
Bharat Viswanadham
478b2cba0d
HDDS-773. Loading ozone s3 bucket browser could be failed. Contributed by Elek Marton.
2018-10-31 07:54:23 -07:00
Márton Elek
b519f3f2a0
HDDS-659. Implement pagination in GET bucket (object list) endpoint. Contributed by Bharat Viswanadham.
2018-10-31 13:29:01 +01:00
Márton Elek
ecac351aac
HDDS-712. Use x-amz-storage-class to specify replication type and replication factor. Contributed by Bharat Viswanadham.
2018-10-31 13:28:59 +01:00
Nanda kumar
e4f22b08e0
HDDS-755. ContainerInfo and ContainerReplica protobuf changes.
...
Contributed by Nanda kumar.
2018-10-31 10:29:35 +05:30
Anu Engineer
773f0d1519
HDDS-754. VolumeInfo#getScmUsed throws NPE.
...
Contributed by Hanisha Koneru.
2018-10-30 19:17:57 -07:00
Anu Engineer
e33b61f335
HDDS-762. Fix unit test failure for TestContainerSQLCli & TestSCMMetrics.
...
Contributed by Mukul Kumar Singh.
2018-10-30 19:16:52 -07:00
Shashikant Banerjee
7757331dbc
HDDS-749. Restructure BlockId class in Ozone. Contributed by Shashikant Banerjee.
2018-10-30 14:15:27 +05:30
Arpit Agarwal
496f0ffe90
HDDS-620. ozone.scm.client.address should be an optional setting. Contributed by chencan and Arpit Agarwal.
2018-10-29 17:14:18 -07:00
Bharat Viswanadham
3655e573e2
HDDS-743. S3 multi delete request should return XML header in quiet mode. Contributed by Elek Marton.
2018-10-29 12:59:41 -07:00
Arpit Agarwal
a58048e8d5
HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi.
2018-10-29 09:35:18 -07:00
Nanda kumar
902345de66
HDDS-728. Datanodes should use different ContainerStateMachine for each pipeline.
...
Contributed by Mukul Kumar Singh.
2018-10-29 19:53:52 +05:30
Márton Elek
bfb720ebc8
HDDS-573. Make VirtualHostStyleFilter port agnostic. Contributed by Danilo Perez.
2018-10-29 14:45:01 +01:00
Bharat Viswanadham
199703f985
HDDS-739. Support MultiDeleteRequest without XML namespace. Contributed by Elek Marton.
2018-10-27 09:32:28 -07:00
Nanda kumar
dce4ebe814
HDDS-694. Plugin new Pipeline management code in SCM.
...
Contributed by Lokesh Jain.
2018-10-26 17:55:04 +05:30
Hanisha Koneru
38a65e3b7c
HDDS-682. Unified o3 address parsing for ozonen sh. Contributed by Elek, Marton.
2018-10-25 17:04:16 -07:00
Bharat Viswanadham
a4b9b7c130
HDDS-702:Used fixed/external version from hadoop jars in hdds/ozone projects. Contributed by Elek Marton.
2018-10-25 16:26:48 -07:00
Márton Elek
c7f349bc3f
HDDS-703. Ozone docs does not render correctly on a Mobile Device. Contributed by Elek, Marton.
2018-10-25 15:00:39 +02:00
Márton Elek
23887129cd
HDDS-643. Parse Authorization header in a separate filter. Contributed by Bharat Viswanadham.
2018-10-25 12:45:53 +02:00
Arpit Agarwal
244afaba4a
HDDS-719. Remove Ozone dependencies on Apache Hadoop 3.2.0. Contributed by Arpit Agarwal.
2018-10-24 16:17:05 -07:00
Bharat Viswanadham
021caaa55e
HDDS-516. Implement CopyObject REST endpoint. Contributed by Bharat Viswanadham.
2018-10-24 15:53:31 -07:00
Bharat Viswanadham
ebf8e1731d
HDDS-693. Support multi-chunk signatures in s3g PUT object endpoint. Contributed by Elek Marton.
2018-10-24 12:51:38 -07:00
Shashikant Banerjee
b61846392e
HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee.
2018-10-23 16:52:17 +05:30
Anu Engineer
e3cca12048
HDDS-676. Enable Read from open Containers via Standalone Protocol.
...
Contributed by Shashikant Banerjee.
2018-10-22 15:57:01 -07:00
Bharat Viswanadham
f6498af0d7
HDDS-705. addendum patch to fix find bug issue. Contributed by Bharat Viswanadham.
2018-10-22 10:17:12 -07:00
Mukul Kumar Singh
82919a1e7a
HDDS-638. Enable ratis snapshots for HDDS datanodes. Contributed by Mukul Kumar Singh.
2018-10-22 19:59:35 +05:30
Nanda kumar
97a41b3dbe
HDDS-705. OS3Exception resource name should be the actual resource name.
...
Contributed by Bharat Viswanadham.
Recommitting after making sure that patch is clean.
2018-10-22 15:48:36 +05:30
Nanda kumar
c696419f3e
Revert "HDDS-705. OS3Exception resource name should be the actual resource name."
...
This reverts commit 977c6f6470
.
There was spurious edit in this commit.
2018-10-22 15:37:40 +05:30
Anu Engineer
c9077a9f5a
HDDS-707. Allow registering MBeans without additional jmx properties.
...
Contributed by Arpit Agarwal.
2018-10-21 22:50:28 -07:00
Anu Engineer
977c6f6470
HDDS-705. OS3Exception resource name should be the actual resource name.
...
Contributed by Bharat Viswanadham.
2018-10-21 22:49:16 -07:00
Anu Engineer
d7b012e560
HDDS-679. Add query parameter to the constructed query in VirtualHostStyleFilter.
...
Contributed by Bharat Viswanadham.
2018-10-19 11:40:11 -07:00
Arpit Agarwal
c456d6b3a5
HDDS-621. ozone genconf improvements. Contributed by Dinesh Chitlangia.
2018-10-19 11:36:36 -07:00
Arpit Agarwal
dc27408043
HDDS-612. Even after setting hdds.scm.chillmode.enabled to false, SCM allocateblock fails with ChillModePrecheck exception. Contributed by Hanisha Koneru.
2018-10-19 11:36:28 -07:00
Anu Engineer
9aebafd2da
HDDS-701. Support key multi-delete.
...
Contributed by Elek, Marton.
2018-10-19 10:13:08 -07:00
Anu Engineer
cd057918d6
HDDS-672. Spark shell throws OzoneFileSystem not found.
...
Contributed by Anu Engineer.
2018-10-19 09:22:46 -07:00
Anu Engineer
b22651e949
HDDS-680. Provide web based bucket browser.
...
Contributed by Elek, Marton.
2018-10-19 08:48:11 -07:00
Anu Engineer
f8d61b9fc2
HDDS-690. Javadoc build fails in hadoop-ozone.
...
Contributed by Takanobu Asanuma.
2018-10-18 12:14:54 -07:00
Arpit Agarwal
c64018026e
HDDS-673. Suppress "Key not found" exception log with stack trace in OM. Contributed by Arpit Agarwal.
2018-10-18 11:51:16 -07:00
Bharat Viswanadham
3ed7163302
HDDS-678. Format of Last-Modified header is invalid in HEAD Object call. Contributed by Elek Marton.
2018-10-17 20:44:52 -07:00
Hanisha Koneru
9146d33e18
HDDS-670. Fix OzoneFS directory rename.
2018-10-17 17:51:29 -07:00
Bharat Viswanadham
4c4364ddd0
HDDS-683. Add a shell command to provide ozone mapping for a S3Bucket. Contributed by Bharat Viswanadham.
2018-10-17 16:46:13 -07:00
Jitendra Pandey
d93d515af5
HDDS-651. Rename o3 to o3fs for Filesystem.
2018-10-17 14:19:17 -07:00
Nandakumar
50715c0699
HDDS-662. Introduce ContainerReplicaState in StorageContainerManager. Contributed by Nanda kumar.
2018-10-17 17:45:35 +05:30
Márton Elek
9df1c84be0
HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham.
2018-10-17 12:43:44 +02:00
Nandakumar
64a43c92c2
HDDS-656. Add logic for pipeline report and action processing in new pipeline code. Contributed by Lokesh Jain.
2018-10-17 13:57:38 +05:30
Bharat Viswanadham
657032f5dd
HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham.
2018-10-16 15:29:53 -07:00
Arpit Agarwal
5f0b43fa93
HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton.
2018-10-16 10:40:00 -07:00
Jitendra Pandey
53e5173bd1
HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh.
2018-10-16 10:34:51 -07:00
Márton Elek
0c2914e582
HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton.
2018-10-16 17:30:53 +02:00
Arpit Agarwal
0bf8a110a5
HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia.
2018-10-15 19:30:40 -07:00
Arpit Agarwal
2614078b21
HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari.
2018-10-15 16:45:08 -07:00
Jitendra Pandey
e13a38f4bc
HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee.
2018-10-15 11:52:38 -07:00
Márton Elek
5033deb13b
HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge.
2018-10-14 11:30:18 +02:00
Jitendra Pandey
603649d3a9
HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee.
2018-10-13 19:15:01 -07:00
Jitendra Pandey
5209c7503b
HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee.
2018-10-13 12:15:42 -07:00
Jitendra Pandey
22f37af935
Revert "HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee."
...
This reverts commit 0473b68000
.
2018-10-13 12:14:39 -07:00
Jitendra Pandey
0473b68000
HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee.
2018-10-13 12:12:08 -07:00
Arpit Agarwal
addb84600f
HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey.
2018-10-13 09:19:45 -07:00
Márton Elek
ae268b4894
HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan.
2018-10-13 15:55:57 +02:00
Márton Elek
cdad91c039
HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton.
2018-10-13 08:40:49 +02:00
Bharat Viswanadham
28ca5c9d16
HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham.
2018-10-12 16:59:11 -07:00
Anu Engineer
3c1fe073d2
HDDS-445. Create a logger to print out all of the incoming requests.
...
Contributed by Bharat Viswanadham.
2018-10-12 16:27:54 -07:00
Arpit Agarwal
ddc9649328
HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar.
2018-10-12 15:06:42 -07:00
Nandakumar
5c8e023ba3
HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain.
2018-10-13 03:22:20 +05:30
Anu Engineer
c07b95bdfc
HDDS-645. Enable OzoneFS contract tests by default.
...
Contributed by Arpit Agarwal.
2018-10-12 14:46:04 -07:00
Bharat Viswanadham
8ae8a5004f
HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham.
2018-10-12 13:58:53 -07:00
Arpit Agarwal
56b18b9df1
HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh.
2018-10-12 13:33:38 -07:00
Arpit Agarwal
85ccab7d3f
HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh.
2018-10-12 11:30:57 -07:00
Xiaoyu Yao
07d55292dc
HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh.
2018-10-12 10:51:50 -07:00
Xiaoyu Yao
e12edb3d8f
HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
2018-10-12 10:36:57 -07:00
Bharat Viswanadham
38fe447d93
HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham.
2018-10-12 09:58:16 -07:00
Yiqun Lin
5da042227c
HDDS-628. Fix outdated names used in HDDS documentations.
2018-10-12 14:00:13 +08:00
Anu Engineer
604c27c33a
HDDS-634. OzoneFS: support basic user group and permission for file/dir.
...
Contributed by Xiaoyu Yao.
2018-10-11 17:25:25 -07:00
Jitendra Pandey
0bc6d0484a
HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee.
2018-10-11 17:12:47 -07:00
Xiaoyu Yao
c05b260069
HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh.
2018-10-11 15:08:22 -07:00
Arpit Agarwal
47eeb3eb7b
HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma.
2018-10-11 09:20:11 -07:00
Márton Elek
cd280514b8
HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge.
2018-10-10 15:28:41 +02:00
Anu Engineer
f068296f8a
HDDS-443. Create reusable ProgressBar utility for freon tests.
...
Contributed by Zsolt Horvath.
2018-10-09 18:19:00 -07:00
Akira Ajisaka
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2018-10-10 10:16:57 +09:00
Anu Engineer
794c0451cf
HDDS-604. Correct Ozone getOzoneConf description.
...
Contributed by Dinesh Chitlangia.
2018-10-09 17:52:06 -07:00
Anu Engineer
4de2dc2699
HDDS-568. ozone sh volume info, update, delete operations fail when volume name is not prefixed by /.
...
Contributed by Dinesh Chitlangia.
2018-10-09 17:32:04 -07:00
Anu Engineer
6a06bc309d
HDDS-559. fs.default.name is deprecated.
...
Contributed by Dinesh Chitlangia.
2018-10-09 16:57:39 -07:00
Anu Engineer
c1fe657a10
HDDS-478. Log files related to each daemon doesn't have proper startup and shutdown logs.
...
Contributed by Dinesh Chitlangia.
2018-10-09 16:44:32 -07:00
Anu Engineer
5b7ba48ced
HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2.
...
Contributed by Bharat Viswanadham.
2018-10-09 13:37:42 -07:00
Bharat Viswanadham
d5dd6f31fc
HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton.
2018-10-09 12:43:04 -07:00
Arpit Agarwal
03d66b1f5d
HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari.
2018-10-09 11:04:43 -07:00
Márton Elek
600438bcde
HDDS-602. Bump Ozone version to 0.4.0-SNAPSHOT after ozone-0.3 branch cut.
2018-10-09 19:04:25 +02:00
Nanda kumar
7367ff333b
HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee.
2018-10-09 18:07:01 +05:30
Márton Elek
d7c7f68c26
HDDS-521. Implement DeleteBucket REST endpoint. Contributed by Bharat Viswanadham.
2018-10-08 16:17:42 +02:00
Márton Elek
25b1e8a48e
HDDS-512. Addendum: update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia.
2018-10-05 13:32:47 +02:00
Márton Elek
0e28ef35be
HDDS-512. update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia.
2018-10-05 13:20:27 +02:00
Márton Elek
9bc8b1cfd3
HDDS-578. om-audit-log4j2.properties must be packaged in ozone-dist . Contributed by Dinesh Chitlangia.
2018-10-05 04:33:19 -04:00
Anu Engineer
153941b236
HDDS-479. Add more ozone fs tests in the robot integration framework.
...
Contributed by Nilotpal Nandi.
2018-10-04 22:53:51 -07:00
Anu Engineer
e6b77ad65f
HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1.
...
Contributed by Anu Engineer.
2018-10-04 21:40:13 -07:00
Bharat Viswanadham
7fb91b8a53
HDDS-565. TestContainerPersistence fails regularly in Jenkins. Contributed by Dinesh Chitlangia.
2018-10-04 21:27:12 -07:00
Nanda kumar
095c269620
HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar.
2018-10-03 16:00:39 +05:30
Nanda kumar
7b374482d2
HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar.
2018-10-03 15:15:43 +05:30
Bharat Viswanadham
ec075791da
HDDS-520. Implement HeadBucket REST endpoint. Contributed by Bharat Viswanadham.
2018-10-02 20:13:59 -07:00
Sunil G
58fa96b697
Changed version in trunk to 3.3.0-SNAPSHOT.
2018-10-02 22:41:41 +05:30
Nanda kumar
a39296260f
HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain.
2018-10-02 19:47:44 +05:30
Márton Elek
81072d5e3d
HDDS-560. Create Generic exception class to be used by S3 rest services. Contributed by Bharat Viswanadham.
2018-10-02 10:00:10 -04:00
Bharat Viswanadham
7d082193d2
HDDS-562. Create acceptance test to test aws cli with the s3 gateway. Contributed by Elek Marton.
2018-10-01 15:04:20 -07:00
Bharat Viswanadham
4eff629ab3
HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham
2018-10-01 13:16:08 -07:00
Nanda kumar
f7ff8c051e
HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain.
2018-10-01 13:50:17 +05:30
Anu Engineer
0da03f8b14
HDDS-391. Simplify Audit Framework to make audit logging easier to use.
...
Contributed by Dinesh Chitlangia.
2018-09-28 14:00:24 -07:00
Hanisha Koneru
35c7351f4b
HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia.
2018-09-28 13:06:50 -07:00
Hanisha Koneru
72891fc9be
HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan.
2018-09-28 11:24:42 -07:00