Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
21,428 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

21428 Commits

Author SHA1 Message Date
Elek, Márton 7ec6a31eb3 HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. (#653) 2019-04-04 14:00:54 -07:00
Xiaoyu Yao 3e8669cbe2
HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. (#683) 
(cherry picked from commit d6c233fce6)
 2019-04-03 15:04:01 -07:00
Ajay Kumar 7030e6ef92
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar. 
Closes #677

(cherry picked from commit bfc90bdc64)
 2019-04-02 15:44:24 +02:00
Yiqun Lin 0781a7174f HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee. 
(cherry picked from commit d31c86892e)
 2019-04-02 14:28:12 +05:30
Ajay Kumar fb7844db4e
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode 
Closes #632
 2019-04-01 17:16:18 +02:00
Shashikant Banerjee 0b84c2d5d6 HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi. 
(cherry picked from commit 0df949202a)
 2019-04-01 19:04:40 +05:30
Shashikant Banerjee bb20c80955 HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee. 
(cherry picked from commit ef5de29243)
 2019-04-01 16:18:21 +05:30
Elek, Márton f0640e2eba
HDDS-1357. ozone s3 shell command has confusing subcommands (#663) 
(cherry picked from commit ec82e4cab2)
 2019-03-30 10:29:05 -07:00
Doroszlai, Attila 4345e6e10f
[HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila. 
This closes #659.

(cherry picked from commit 7dc0ecc446)
 2019-03-29 09:03:38 -07:00
nilotpalnandi f2dee89b4f
HDDS-1309 . change logging from warn to debug in XceiverClient. Contributed by Nilotpal Nandi. (#638) 
(cherry picked from commit 4cceeb2682)
 2019-03-28 12:24:12 -07:00
Shashikant Banerjee c53408c3e3 HDDS-1293. ExcludeList#getProtoBuf throws ArrayIndexOutOfBoundsException. Contributed by Shashikant Banerjee. 
(cherry picked from commit ac4010bb22)
 2019-03-29 00:47:38 +05:30
Xiaoyu Yao f8f85fcc31
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao. 
This closes #641 

(cherry picked from commit ca5e4ce036)
 2019-03-28 12:01:45 -07:00
Xiaoyu Yao 5f8ded542a
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao. 
This closes #652.

(cherry picked from commit 8a59efee34)
 2019-03-27 21:53:31 -07:00
Shweta Yakkali 299177eaa7
HDDS-139. Output of createVolume can be improved. Contributed by Shweta. 
(cherry picked from commit f426b7ce8f)
 2019-03-26 19:03:09 -07:00
Ajay Yadav 447d53476a
HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. (#634) 
(cherry picked from commit 82d477293c)
 2019-03-26 09:02:15 -07:00
Sandeep Nemuri f6acbc9caf HDDS-1310. In datanode once a container becomes unhealthy, datanode restart fails. 
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 5c0a81ad3c)
 2019-03-26 15:45:45 +05:30
Shashikant Banerjee eed623ad61 HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee. 2019-03-25 15:45:26 +05:30
Xiaoyu Yao 8d1c218428
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao. 
This closes #627.

(cherry picked from commit 6a34c9bb29)
 2019-03-23 09:36:56 -07:00
Vivek Ratnavel Subramanian 6b3e0b3edc
HDDS-1302. Fix SCM CLI does not list container with id 1. 
(cherry picked from commit 73f7b04e2b)
 2019-03-22 15:17:12 -07:00
Xiaoyu Yao 9b989c49c9 HDDS-1291. Set OmKeyArgs#refreshPipeline flag properly to avoid reading from stale pipeline. Contributed by Xiaoyu Yao. (#639) 
(cherry picked from commit dea6f2a065)
 2019-03-22 15:09:22 -07:00
Arpit Agarwal 6d73e7bdf4
HDDS-1323. Ignore unit test TestFailureHandlingByClient. Contributed by Supratim Deka. 
(cherry picked from commit 1d389ecb24)
 2019-03-22 11:30:50 -07:00
Arpit Agarwal 8f422d7b5e
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh. 
(cherry picked from commit 90afc9ab03)
 2019-03-21 14:27:07 -07:00
Arpit Agarwal 6c009a3d04
HDDS-1321. TestOzoneManagerHttpServer depends on hard-coded port numbers. Contributed by Arpit Agarwal. (#633) 
Change-Id: I9656af4a7f41812da9d125c10ae0e8daf3dcf7f5
(cherry picked from commit 2828f8c339)
 2019-03-21 14:21:05 -07:00
Xiaoyu Yao b2c63c3ce1
HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. (#594) 
(cherry picked from commit 5cfb88a225)
 2019-03-20 19:09:25 -07:00
Hanisha Koneru 598c16c1fc
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 
(cherry picked from commit 12402b7a74)
 2019-03-20 17:53:06 -07:00
Bharat Viswanadham 3edb697a37
HDDS-1307. Test ScmChillMode testChillModeOperations failed. (#622) 
HDDS-1307. Test ScmChillMode testChillModeOperations failed. Contributed by Bharat Viswanadham. (#622)

(cherry picked from commit 1639071b05)
 2019-03-19 13:58:00 -07:00
Xiaoyu Yao a55a295c7a HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao. 
This closes #615

(cherry picked from commit 992489c11c)
 2019-03-19 09:57:50 -07:00
Ajay Yadav d2e115d8c8 HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601) 
(cherry picked from commit f10d493325)
 2019-03-18 23:11:36 -07:00
Arpit Agarwal 7cd82b4547
Revert "HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. (#608)" 
This reverts commit 0d35cfc006.
 2019-03-18 14:23:56 -07:00
Xiaoyu Yao 6fd95b8595 HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#616) 
(cherry picked from commit 66a104bc57)
 2019-03-18 09:39:05 -07:00
Vivek Ratnavel Subramanian 328bfcc0b6
HDDS-1263. SCM CLI does not list container with id 1. 
(cherry picked from commit af2dfc9f3d)
 2019-03-15 20:56:09 -07:00
Elek, Márton 0d35cfc006 HDDS-1284. Adjust default values of pipline recovery for more resilient service restart. Contributed by Elek, Marton. (#608) 
(cherry picked from commit 44b8451821)
 2019-03-15 14:53:38 -07:00
Elek, Márton a009255723 HDDS-1283. Fix the dynamic documentation of basic s3 client usage. Contributed by Elek, Marton. (#605) 
(cherry picked from commit 16b78622cc)
 2019-03-15 14:13:08 -07:00
Xiaoyu Yao 3ca1024eec HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh. 
Closes #585 

(cherry picked from commit d1afa03804)
 2019-03-15 10:42:09 -07:00
Elek, Márton 522976e405 HDDS-1259. OzoneFS classpath separation is broken by the token validation. Contributed by Elek Marton. 
Closes #604 

(cherry picked from commit dc21655f2a)
 2019-03-15 10:05:11 -07:00
Márton Elek 3fd9c0db17 HDDS-807. Period should be an invalid character in bucket names. Contributed by Siddharth Wagle. 
(cherry picked from commit c449cdebe6)
 2019-03-15 10:04:50 -07:00
Shashikant Banerjee 8bd13ffa10 HDDS-1098. Introduce Retry Policy in Ozone Client. Contributed by Shashikant Banerjee. 
(cherry picked from commit 155ab6d5d8)
 2019-03-15 15:47:56 +05:30
Vivek Ratnavel Subramanian 64726dd8fe
HDDS-761. Create S3 subcommand to run S3 related operations. 
Closes #579

(cherry picked from commit 9001508485)
 2019-03-14 21:19:48 -07:00
Vivek Ratnavel Subramanian c00e704496
HDDS-1265. ozone sh s3 getsecret throws Null Pointer Exception for unsecured clusters. 
Closes #611

(cherry picked from commit 2627dad333)
 2019-03-14 17:22:21 -07:00
Shashikant Banerjee 8614da3723 HDDS-1257. Incorrect object because of mismatch in block lengths. Contributed by Shashikant Banerjee. 
(cherry picked from commit d60673c470)
 2019-03-14 19:34:54 +05:30
Mukul Kumar Singh 8e66b6220b HDDS-1237. Fix test TestSecureContainerServer.testClientServerRatisGrpc. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 983b78afdc)
 2019-03-14 17:03:07 +05:30
Mukul Kumar Singh f38a8a9630 HDDS-1241. Update ozone to latest ratis snapshot build (0.4.0-5680cf5-SNAPSHOT). Contributed by Mukul Kumar Singh. 
(cherry picked from commit ea9fb07fd2)
 2019-03-14 15:25:22 +05:30
Ajay Yadav 0f4ae392d7 HDDS-1254. Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer. Contributed by Ajay Kumar. (#598) 
(cherry picked from commit 4fa009989b)
 2019-03-13 12:02:17 -07:00
Xiaoyu Yao eeb7d63046 HDDS-1087. Fix TestDefaultCertificateClient#testSignDataStream. Contributed by Xiaoyu Yao. (#596) 
(cherry picked from commit 86d508c7c7)
 2019-03-13 11:52:47 -07:00
Aravindan Vijayan 34f0ad064d HDDS-1209. Fix the block allocation logic in SCM when client wants to exclude all available open containers in a chosen pipeline. 
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 1f47fb7a2f)
 2019-03-13 17:14:51 +05:30
Lokesh Jain b5b3f4d823 HDDS-1128. Create stateful manager class for the pipeline creation scheduling. 
Signed-off-by: Nanda kumar <nanda@apache.org>
(cherry picked from commit 0d62753da9)
 2019-03-13 16:47:04 +05:30
Vivek Ratnavel Subramanian 32477ed1e6
HDDS-1226. Addendum. ozone-filesystem jar missing in hadoop classpath 
Closes #560

(cherry picked from commit c1649bf1e1)
 2019-03-13 12:09:41 +01:00
Ajay Yadav 15b6e38ddf
HDDS-1043. Enable token based authentication for S3 api 
Closes #561

(cherry picked from commit dcb0de848d)
 2019-03-12 18:54:59 +01:00
Xiaoyu Yao 262260fadf HDDS-1253. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#593) 
Closes PR #593

(cherry picked from commit 2778259b88)
 2019-03-12 09:36:37 -07:00
Mukul Kumar Singh 97fd3025a4 HDDS-1095. OzoneManager#openKey should do multiple block allocations in a single SCM rpc call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit daf4660eeb)
 2019-03-12 20:03:36 +05:30