Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,307 Commits 326 Branches 371 Tags
Commit Graph

20307 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jitendra Pandey
b51bc6b93f HDDS-629. Make ApplyTransaction calls in ContainerStateMachine idempotent. Contributed by Shashikant Banerjee. 2018-10-15 13:31:08 -07:00
Jitendra Pandey
a619d120a6 HDDS-579. ContainerStateMachine should fail subsequent transactions per container in case one fails. Contributed by Shashikant Banerjee. 2018-10-15 13:30:53 -07:00
Jitendra Pandey
0008357940 HDDS-603. Add BlockCommitSequenceId field per Container and expose it in Container Reports. Contributed by Shashikant Banerjee. 2018-10-15 13:30:39 -07:00
Márton Elek
abfff4cccb HDDS-519. Implement ListBucket REST endpoint. Contributed by LiXin Ge. 2018-10-14 12:10:31 +02:00
Anu Engineer
39ffed2a11 HDDS-653. TestMetadataStore#testIterator fails on Windows. 
Contributed by Yiqun Lin.

(cherry picked from commit 9227f3d22412f94d22f4cae6a4fb3a52ead9b011)
 2018-10-13 10:46:58 -07:00
Arpit Agarwal
690da72cd4 HDDS-654. Add ServiceLoader resource for OzoneFileSystem. Contributed by Jitendra Nath Pandey. 
(cherry picked from commit addb84600fa2f9e010768c642db3fdc2ec497d52)
 2018-10-13 09:19:54 -07:00
Márton Elek
37f1f6dd17 HDDS-518. Implement PutObject Rest endpoint. Contributed by chencan. 
(cherry picked from commit ae268b48943dcce1adacd4bf01231fcb21d76f3a)
 2018-10-13 15:57:17 +02:00
Márton Elek
820d1ec5d2 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:58:32 +02:00
Bharat Viswanadham
cc21ce955d HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham. 
(cherry picked from commit 28ca5c9d1647837a1b2480d8935deffc6f68d807)
 2018-10-12 17:00:09 -07:00
Anu Engineer
9e219e3707 HDDS-445. Create a logger to print out all of the incoming requests. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 3c1fe073d2fef76676660144e7dce2050761ae64)
 2018-10-12 16:29:42 -07:00
Arpit Agarwal
1a9bb57b09 HDDS-646. TestChunkStreams.testErrorReadGroupInputStream fails. Contributed by Nanda kumar. 
(cherry picked from commit ddc964932817b4c4e4f4dc848dae764d5285e875)
 2018-10-12 15:06:53 -07:00
Nandakumar
c141a912f0 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 
(cherry picked from commit 5c8e023ba32da3e65193f6ced354efe830dba75d)
 2018-10-13 03:23:53 +05:30
Anu Engineer
9aa6c7b2ad HDDS-645. Enable OzoneFS contract tests by default. 
Contributed by Arpit Agarwal.

(cherry picked from commit c07b95bdfcd410aa82acdb1fed28e84981ff06f9)
 2018-10-12 14:46:40 -07:00
Arpit Agarwal
86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham. 
(cherry picked from commit 3a684a2b23517df996a8c30731d9b5cb3282cc2a)
 2018-10-12 14:44:56 -07:00
Anu Engineer
7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception. 
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e0779369f1363df2bb0437945fe9a271c)
 2018-10-12 14:29:59 -07:00
Bharat Viswanadham
252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham. 
(cherry picked from commit 8ae8a5004f8fbe2638a3e27ab8efbe0e2e27cb8c)
 2018-10-12 14:00:25 -07:00
Arpit Agarwal
ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 56b18b9df14b91c02cf3b7f548ab58755475b374)
 2018-10-12 13:33:45 -07:00
Xiaoyu Yao
2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh. 
(cherry picked from commit 07d55292dc1536d3b34a89d4a45edf688d62a9e5)
 2018-10-12 13:26:29 -07:00
Xiaoyu Yao
4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh. 
(cherry picked from commit e12edb3d8f05ff6206c6de1b81ecfa1a03abb193)
 2018-10-12 13:26:29 -07:00
Arpit Agarwal
2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 85ccab7d3f87b71170e4f71c76f5663d1fe34886)
 2018-10-12 11:31:06 -07:00
Anu Engineer
7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48cedb0d70ca154771fec48e5c4129cf29a)
 2018-10-12 11:18:10 -07:00
Bharat Viswanadham
645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham. 
(cherry picked from commit 38fe447d9362f9ce8b7e4587f32efe2c29ddb8be)
 2018-10-12 10:03:31 -07:00
Yiqun Lin
54a229c332 HDDS-628. Fix outdated names used in HDDS documentations. 
(cherry picked from commit 5da042227cfce440eddc263b377a70ed5b3743fb)
 2018-10-12 14:01:47 +08:00
Bharat Viswanadham
67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru. 
(cherry picked from commit 74db993a61e201d2e8d33bb42f787e0a71388d0d)
 2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze
d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Anu Engineer
587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir. 
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a3bd30644debaf192cec3cf80dfa36d)
 2018-10-11 17:26:02 -07:00
Arpit Agarwal
ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal. 
(cherry picked from commit 50552479c42d2e84cfeec83d4d67b050c5659b06)
 2018-10-11 17:21:46 -07:00
Jitendra Pandey
077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao
72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh. 
(cherry picked from commit c05b260069511f2993a67683555ed2e1aea49a0a)
 2018-10-11 15:12:06 -07:00
Hanisha Koneru
43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception. 
(cherry picked from commit eb34b5f8aff538e90c7820c0114322d2dd75f6e6)
 2018-10-11 13:48:02 -07:00
Arpit Agarwal
e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma. 
(cherry picked from commit 47eeb3eb7bffa20f2c3526a5cbb85cae9af667bd)
 2018-10-11 09:20:20 -07:00
Arpit Agarwal
d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 2bd000c85195416b9bcd06a3abb5100aeeda9727)
 2018-10-10 17:37:29 -07:00
Nanda kumar
79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 90552b1ea8380c1155f7000bd9e4c23e709e6970)
 2018-10-10 20:51:23 +05:30
Márton Elek
b64fcc71f1 HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge. 
(cherry picked from commit cd280514b84e8a2915f274883a07f152b772ebad)
 2018-10-10 15:38:53 +02:00
Bharat Viswanadham
056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari. 
(cherry picked from commit 6a39739316795a4828833e99d78aadc684270f98)
 2018-10-09 15:21:50 -07:00
Bharat Viswanadham
308c614d4a HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton. 
(cherry picked from commit d5dd6f31fc35b890cfa241d5fce404d6774e98c6)
 2018-10-09 12:44:24 -07:00
Arpit Agarwal
d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari. 
(cherry picked from commit 03d66b1f5d8936e8006b87511af7a647ed1c3fcd)
 2018-10-09 11:05:23 -07:00
Nanda kumar
abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333bf332b300e0acd6e7501ce8139a1998)
 2018-10-09 22:31:19 +05:30
Nanda kumar
4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri. 
(cherry picked from commit 9e9915ddab7ff79224b075889f67c38920fde9f0)
 2018-10-09 22:30:31 +05:30
Eric Yang
347ea38581 YARN-8763. Added node manager websocket API for accessing containers. 
Contributed by Zian Chen
 2018-10-08 13:56:47 -04:00
Inigo Goiri
745f64012a YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R. 2018-10-08 10:05:18 -07:00
Haibo Chen
7c13872cbb YARN-8659. RMWebServices returns only RUNNING apps when filtered with queue. (Contributed by Szilard Nemeth) 2018-10-08 09:40:37 -07:00
Márton Elek
d7c7f68c26 HDDS-521. Implement DeleteBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-08 16:17:42 +02:00
Sunil G
228dc192f1 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB. 2018-10-08 11:54:56 +05:30
Vidura Mudalige
907ef6c285
YARN-8788. mvn package -Pyarn-ui fails on JDK9 
This closes #421

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-10-07 16:48:30 +09:00
Inigo Goiri
3bfff0f79e HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 2018-10-06 10:40:49 -07:00
Vidura Mudalige
b85ee0d75d
YARN-8819. Fix findbugs warnings in YarnServiceUtils 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-10-07 00:53:53 +09:00
Ajay Kumar
cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Jason Lowe
9bb2801e8c YARN-4254. ApplicationAttempt stuck for ever due to UnknownHostException. Contributed by Bibin A Chundatt 2018-10-05 15:52:46 -05:00
Haibo Chen
c968365650 YARN-8644. Improve unit test for RMAppImpl.FinalTransition. (Contributed by Szilard Nemeth) 2018-10-05 09:32:30 -07:00