Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,329 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

342 Commits

Author SHA1 Message Date
Jitendra Pandey 106be1416d HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:32:22 -07:00
Márton Elek c09f808853 HDDS-563. Support hybrid VirtualHost style URL. Contributed by Bharat Viswanadham. 2018-10-17 12:48:33 +02:00
Bharat Viswanadham f66e3c59cb HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham. 
(cherry picked from commit 657032f5dd)
 2018-10-16 15:31:07 -07:00
Arpit Agarwal 1f55beb527 HDDS-378. Remove dependencies between hdds/ozone and hdfs proto files. Contributed by Elek, Marton. 
(cherry picked from commit 5f0b43fa93)
 2018-10-16 10:40:07 -07:00
Jitendra Pandey e4dfdcee9f HDDS-667. Fix TestOzoneFileInterfaces. Contributed by Mukul Kumar Singh. 2018-10-16 10:36:37 -07:00
Márton Elek 0cc5bc1108 HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton. 2018-10-16 17:30:15 +02:00
Arpit Agarwal f30994caf0 HDDS-439. 'ozone oz volume create' should default to current logged in user. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 0bf8a110a5)
 2018-10-15 19:30:58 -07:00
Arpit Agarwal 15d4e0110c HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari. 
(cherry picked from commit 2614078b21)
 2018-10-15 16:45:16 -07:00
Jitendra Pandey b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey 0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Márton Elek abfff4cccb HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge. 2018-10-14 12:10:31 +02:00
Arpit Agarwal 690da72cd4 HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey. 
(cherry picked from commit addb84600f)
 2018-10-13 09:19:54 -07:00
Márton Elek 37f1f6dd17 HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan. 
(cherry picked from commit ae268b4894)
 2018-10-13 15:57:17 +02:00
Márton Elek 820d1ec5d2 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:58:32 +02:00
Bharat Viswanadham cc21ce955d HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham. 
(cherry picked from commit 28ca5c9d16)
 2018-10-12 17:00:09 -07:00
Anu Engineer 9e219e3707 HDDS-445. Create a logger to print out all of the incoming requests. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 3c1fe073d2)
 2018-10-12 16:29:42 -07:00
Arpit Agarwal 1a9bb57b09 HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar. 
(cherry picked from commit ddc9649328)
 2018-10-12 15:06:53 -07:00
Nandakumar c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 
(cherry picked from commit 5c8e023ba3)
 2018-10-13 03:23:53 +05:30
Anu Engineer 9aa6c7b2ad HDDS-645. Enable OzoneFS contract tests by default. 
Contributed by Arpit Agarwal.

(cherry picked from commit c07b95bdfc)
 2018-10-12 14:46:40 -07:00
Bharat Viswanadham 252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 8ae8a5004f)
 2018-10-12 14:00:25 -07:00
Arpit Agarwal ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 56b18b9df1)
 2018-10-12 13:33:45 -07:00
Xiaoyu Yao 2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh. 
(cherry picked from commit 07d55292dc)
 2018-10-12 13:26:29 -07:00
Xiaoyu Yao 4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh. 
(cherry picked from commit e12edb3d8f)
 2018-10-12 13:26:29 -07:00
Arpit Agarwal 2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 85ccab7d3f)
 2018-10-12 11:31:06 -07:00
Anu Engineer 7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48ced)
 2018-10-12 11:18:10 -07:00
Bharat Viswanadham 645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham. 
(cherry picked from commit 38fe447d93)
 2018-10-12 10:03:31 -07:00
Yiqun Lin 54a229c332 HDDS-628. Fix outdated names used in HDDS documentations. 
(cherry picked from commit 5da042227c)
 2018-10-12 14:01:47 +08:00
Anu Engineer 587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir. 
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a)
 2018-10-11 17:26:02 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao 72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh. 
(cherry picked from commit c05b260069)
 2018-10-11 15:12:06 -07:00
Arpit Agarwal e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma. 
(cherry picked from commit 47eeb3eb7b)
 2018-10-11 09:20:20 -07:00
Márton Elek b64fcc71f1 HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge. 
(cherry picked from commit cd280514b8)
 2018-10-10 15:38:53 +02:00
Bharat Viswanadham 308c614d4a HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton. 
(cherry picked from commit d5dd6f31fc)
 2018-10-09 12:44:24 -07:00
Arpit Agarwal d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari. 
(cherry picked from commit 03d66b1f5d)
 2018-10-09 11:05:23 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333b)
 2018-10-09 22:31:19 +05:30
Márton Elek d7c7f68c26 HDDS-521. Implement DeleteBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-08 16:17:42 +02:00
Márton Elek 25b1e8a48e HDDS-512. Addendum: update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:32:47 +02:00
Márton Elek 0e28ef35be HDDS-512. update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:20:27 +02:00
Márton Elek 9bc8b1cfd3 HDDS-578. om-audit-log4j2.properties must be packaged in ozone-dist . Contributed by Dinesh Chitlangia. 2018-10-05 04:33:19 -04:00
Anu Engineer 153941b236 HDDS-479. Add more ozone fs tests in the robot integration framework. 
Contributed by  Nilotpal Nandi.
 2018-10-04 22:53:51 -07:00
Anu Engineer e6b77ad65f HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1. 
Contributed by Anu Engineer.
 2018-10-04 21:40:13 -07:00
Bharat Viswanadham 7fb91b8a53 HDDS-565. TestContainerPersistence fails regularly in Jenkins. Contributed by Dinesh Chitlangia. 2018-10-04 21:27:12 -07:00
Nanda kumar 095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar 7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Bharat Viswanadham ec075791da HDDS-520. Implement HeadBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-02 20:13:59 -07:00
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Nanda kumar a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Márton Elek 81072d5e3d HDDS-560. Create Generic exception class to be used by S3 rest services. Contributed by Bharat Viswanadham. 2018-10-02 10:00:10 -04:00
Bharat Viswanadham 7d082193d2 HDDS-562. Create acceptance test to test aws cli with the s3 gateway. Contributed by Elek Marton. 2018-10-01 15:04:20 -07:00
Bharat Viswanadham 4eff629ab3 HDDS-525. Support virtual-hosted style URLs. Contributed by Bharat Viswanadham 2018-10-01 13:16:08 -07:00
Nanda kumar f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Anu Engineer 0da03f8b14 HDDS-391. Simplify Audit Framework to make audit logging easier to use. 
Contributed by Dinesh Chitlangia.
 2018-09-28 14:00:24 -07:00
Hanisha Koneru 35c7351f4b HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia. 2018-09-28 13:06:50 -07:00
Hanisha Koneru 72891fc9be HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. 2018-09-28 11:24:42 -07:00
Ajay Kumar 3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham 9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham 67173b4847 HDDS-441. Create new s3gateway daemon. Contributed by Elek Marton. 2018-09-24 13:42:55 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Anu Engineer 096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis. 
Contributed Dinesh Chitlangia.
 2018-09-20 11:51:49 -07:00
Anu Engineer 98c9bc4aa0 HDDS-509. TestStorageContainerManager is flaky. 
Contributed by Xiaoyu Yao and Ajay Kumar.
 2018-09-19 13:03:19 -07:00
Nanda kumar 61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Nanda kumar 15ed74fa24 HDDS-502. Exception in OM startup when running unit tests. Contributed by Arpit Agarwal. 2018-09-19 19:46:25 +05:30
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Arpit Agarwal fb85351dc6 HDDS-497. Suppress license warnings for error log files. Contributed by Arpit Agarwal. 2018-09-18 21:18:15 -07:00
Xiaoyu Yao 3929653707 HDDS-488. Handle chill mode exception from SCM in OzoneManager. Contributed by Ajay Kumar. 2018-09-18 20:05:25 -07:00
Arpit Agarwal 17f5651a51 HDDS-503. Suppress ShellBasedUnixGroupsMapping exception in tests. Contributed by Arpit Agarwal. 2018-09-18 16:06:21 -07:00
Arpit Agarwal 7ff00f5587 HDDS-500. TestErrorCode.java has wrong package name. Contributed by Anu Engineer. 2018-09-18 15:52:00 -07:00
Arpit Agarwal f176e8a3ae HDDS-501. AllocateBlockResponse.keyLocation must be an optional field. Contributed by Arpit Agarwal. 2018-09-18 15:41:28 -07:00
Bharat Viswanadham 5c2ae7e493 HDDS-496. Ozone tools module is incorrectly classified as 'hdds' component. Contributed by Dinesh Chitlangia. 2018-09-18 14:51:03 -07:00
Bharat Viswanadham 5896372761 HDDS-495. Ozone docs and ozonefs packages have undefined hadoop component. Contributed by Dinesh Chitlangia. 2018-09-18 13:50:39 -07:00
Xiaoyu Yao 295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer f938925bde HDDS-464. Fix TestCloseContainerHandlingByClient. 
Contributed by Lokesh Jain.
 2018-09-18 10:45:51 -07:00
Anu Engineer 48319d6eee HDDS-483. Update ozone Documentation to fix below issues. 
Contributed by  Namit Maheshwari.
 2018-09-18 10:23:36 -07:00
Márton Elek 001611cca3 HDDS-481. Classes are missing from the shaded ozonefs jar. Contributed by Bharat Viswanadham. 
(cherry picked from commit e043783917)
 2018-09-18 10:32:36 +02:00
Bharat Viswanadham 8b2f5e60fa HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton. 2018-09-17 17:13:52 -07:00
Arpit Agarwal 0a26c521f0 HDDS-487. Doc files are missing ASF license headers. Contributed by Namit Maheshwari. 2018-09-17 16:21:10 -07:00
Anu Engineer 8af8453589 HDDS-435. Enhance the existing ozone documentation. 
Contributed by Elek, Marton.
 2018-09-17 10:46:28 -07:00
Nanda kumar 846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Arpit Agarwal 07385f886e HDDS-470. Ozone acceptance tests are failing. Contributed by Elek, Marton. 
(cherry picked from commit dca8d0c261)
 2018-09-16 14:31:29 -07:00
Arpit Agarwal 82fbbd546c HDDS-469. Rename 'ozone oz' to 'ozone sh'. Contributed by Arpit Agarwal. 2018-09-15 22:12:47 -07:00
Nanda kumar c9fa081897 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar. 2018-09-15 23:11:39 +05:30
Márton Elek 985f3bf3fb HDDS-409. Ozone acceptance-test and integration-test packages have undefined hadoop component. Contributed by Dinesh Chitlangia. 2018-09-15 13:21:32 +02:00
Bharat Viswanadham b95aa56062 HDDS-446. Provide shaded artifact to start ozone service as a datanode plugin. Contributed by Elek Marton 2018-09-14 14:12:03 -07:00
Xiaoyu Yao 6f037468bc HDDS-419. ChunkInputStream bulk read api does not read from all the chunks. Contributed by Lokesh Jain and Mukul Kumar. 2018-09-14 13:45:38 -07:00
Nanda kumar 5470de420b HDDS-454. TestChunkStreams#testErrorReadGroupInputStream & TestChunkStreams#testReadGroupInputStream are failing. Contributed by chencan. 2018-09-15 01:38:57 +05:30
Nanda kumar c1df3084ff HDDS-389. Remove XceiverServer and XceiverClient and related classes. Contributed by chencan. 2018-09-15 00:20:19 +05:30
Arpit Agarwal a12f12f1af HDDS-438. 'ozone oz' should print usage when command or sub-command is missing. Contributed by Dinesh Chitlangia. 2018-09-14 07:02:28 -07:00
Hanisha Koneru 291dcf2247 HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton. 2018-09-13 16:37:44 -07:00
Hanisha Koneru 4441fe9201 HDDS-414. Fix sbin/stop-ozone.sh to stop Ozone daemons. Contributed by Elek, Marton. 2018-09-13 13:34:22 -07:00
Arpit Agarwal 76a0fdfed9 HDDS-456. TestOzoneShell#init is breaking due to Null Pointer Exception. Contributed by Dinesh Chitlangia. 2018-09-13 13:00:35 -07:00
Mukul Kumar Singh c9e0b69ab3 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 2018-09-13 19:01:07 +05:30
Márton Elek e084627150 HDDS-415. 'ozone om' with incorrect argument first logs all the STARTUP_MSG. Contributed by Namit Maheshwari. 2018-09-13 14:01:53 +02:00
Anu Engineer 6e2129cf4e HDDS-428. OzoneManager lock optimization. 
Contributed by Nanda Kumar.
 2018-09-12 10:38:36 -07:00
Márton Elek 9011567169 HDDS-425. Move unit test of the genconf tool to hadoop-ozone/tools module. Contributed by Dinesh Chitlangia. 2018-09-12 11:11:12 +02:00
Anu Engineer a406f6f60e HDDS-424. Consolidate ozone oz parameters to use GNU convention. 
Contributed by Elek, Marton.
 2018-09-11 16:47:33 -07:00
Xiaoyu Yao 1d567c25d0 HDDS-416. Remove currentPosition from ChunkInputStreamEntry. Contributed by Lokesh Jain. 2018-09-11 15:15:24 -07:00
Anu Engineer 7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution. 
Contributed by Elek, Marton.
 2018-09-11 10:19:50 -07:00
Xiaoyu Yao 8fe4062bfc HDDS-403. Fix createdOn and modifiedOn timestamp for volume, bucket, key. Contributed by Dinesh Chitlangia. 2018-09-10 08:45:49 -07:00
Márton Elek 585a4f96d7 HDDS-417. Ambiguous error message when using genconf tool. Contributed by Dinesh Chitlangia. 2018-09-10 13:37:48 +02:00