Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,289 Commits 326 Branches 371 Tags
Commit Graph

20289 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu Yao
4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh. 
(cherry picked from commit e12edb3d8f05ff6206c6de1b81ecfa1a03abb193)
 2018-10-12 13:26:29 -07:00
Arpit Agarwal
2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 85ccab7d3f87b71170e4f71c76f5663d1fe34886)
 2018-10-12 11:31:06 -07:00
Anu Engineer
7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2. 
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48cedb0d70ca154771fec48e5c4129cf29a)
 2018-10-12 11:18:10 -07:00
Bharat Viswanadham
645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham. 
(cherry picked from commit 38fe447d9362f9ce8b7e4587f32efe2c29ddb8be)
 2018-10-12 10:03:31 -07:00
Yiqun Lin
54a229c332 HDDS-628. Fix outdated names used in HDDS documentations. 
(cherry picked from commit 5da042227cfce440eddc263b377a70ed5b3743fb)
 2018-10-12 14:01:47 +08:00
Bharat Viswanadham
67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru. 
(cherry picked from commit 74db993a61e201d2e8d33bb42f787e0a71388d0d)
 2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze
d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Anu Engineer
587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir. 
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a3bd30644debaf192cec3cf80dfa36d)
 2018-10-11 17:26:02 -07:00
Arpit Agarwal
ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal. 
(cherry picked from commit 50552479c42d2e84cfeec83d4d67b050c5659b06)
 2018-10-11 17:21:46 -07:00
Jitendra Pandey
077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao
72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh. 
(cherry picked from commit c05b260069511f2993a67683555ed2e1aea49a0a)
 2018-10-11 15:12:06 -07:00
Hanisha Koneru
43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception. 
(cherry picked from commit eb34b5f8aff538e90c7820c0114322d2dd75f6e6)
 2018-10-11 13:48:02 -07:00
Arpit Agarwal
e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma. 
(cherry picked from commit 47eeb3eb7bffa20f2c3526a5cbb85cae9af667bd)
 2018-10-11 09:20:20 -07:00
Arpit Agarwal
d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 2bd000c85195416b9bcd06a3abb5100aeeda9727)
 2018-10-10 17:37:29 -07:00
Nanda kumar
79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 90552b1ea8380c1155f7000bd9e4c23e709e6970)
 2018-10-10 20:51:23 +05:30
Márton Elek
b64fcc71f1 HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge. 
(cherry picked from commit cd280514b84e8a2915f274883a07f152b772ebad)
 2018-10-10 15:38:53 +02:00
Bharat Viswanadham
056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari. 
(cherry picked from commit 6a39739316795a4828833e99d78aadc684270f98)
 2018-10-09 15:21:50 -07:00
Bharat Viswanadham
308c614d4a HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton. 
(cherry picked from commit d5dd6f31fc35b890cfa241d5fce404d6774e98c6)
 2018-10-09 12:44:24 -07:00
Arpit Agarwal
d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari. 
(cherry picked from commit 03d66b1f5d8936e8006b87511af7a647ed1c3fcd)
 2018-10-09 11:05:23 -07:00
Nanda kumar
abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee. 
(cherry picked from commit 7367ff333bf332b300e0acd6e7501ce8139a1998)
 2018-10-09 22:31:19 +05:30
Nanda kumar
4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri. 
(cherry picked from commit 9e9915ddab7ff79224b075889f67c38920fde9f0)
 2018-10-09 22:30:31 +05:30
Eric Yang
347ea38581 YARN-8763. Added node manager websocket API for accessing containers. 
Contributed by Zian Chen
 2018-10-08 13:56:47 -04:00
Inigo Goiri
745f64012a YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R. 2018-10-08 10:05:18 -07:00
Haibo Chen
7c13872cbb YARN-8659. RMWebServices returns only RUNNING apps when filtered with queue. (Contributed by Szilard Nemeth) 2018-10-08 09:40:37 -07:00
Márton Elek
d7c7f68c26 HDDS-521. Implement DeleteBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-08 16:17:42 +02:00
Sunil G
228dc192f1 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB. 2018-10-08 11:54:56 +05:30
Vidura Mudalige
907ef6c285
YARN-8788. mvn package -Pyarn-ui fails on JDK9 
This closes #421

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-10-07 16:48:30 +09:00
Inigo Goiri
3bfff0f79e HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 2018-10-06 10:40:49 -07:00
Vidura Mudalige
b85ee0d75d
YARN-8819. Fix findbugs warnings in YarnServiceUtils 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-10-07 00:53:53 +09:00
Ajay Kumar
cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Jason Lowe
9bb2801e8c YARN-4254. ApplicationAttempt stuck for ever due to UnknownHostException. Contributed by Bibin A Chundatt 2018-10-05 15:52:46 -05:00
Haibo Chen
c968365650 YARN-8644. Improve unit test for RMAppImpl.FinalTransition. (Contributed by Szilard Nemeth) 2018-10-05 09:32:30 -07:00
Inigo Goiri
73c660b43f HDFS-13958. Miscellaneous Improvements for FsVolumeSpi. Contributed by BELUGA BEHR. 2018-10-05 09:32:19 -07:00
Jason Lowe
f13e231025 HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe 2018-10-05 09:06:02 -05:00
Márton Elek
25b1e8a48e HDDS-512. Addendum: update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:32:47 +02:00
Márton Elek
0e28ef35be HDDS-512. update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:20:27 +02:00
Nanda kumar
f362037527 HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh. 2018-10-05 16:47:01 +05:30
Steve Loughran
273cc2d4e9
HADOOP-15809. ABFS: better exception handling when making getAccessToken call. 
Contributed by Da Zhou
 2018-10-05 11:29:03 +01:00
Sunil G
94d82f4162 YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB. 2018-10-05 14:29:12 +05:30
Márton Elek
9bc8b1cfd3 HDDS-578. om-audit-log4j2.properties must be packaged in ozone-dist . Contributed by Dinesh Chitlangia. 2018-10-05 04:33:19 -04:00
Sunil G
751f626e50 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB. 2018-10-05 12:28:09 +05:30
Takanobu Asanuma
241cbec2da HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 2018-10-05 14:57:45 +09:00
Anu Engineer
153941b236 HDDS-479. Add more ozone fs tests in the robot integration framework. 
Contributed by  Nilotpal Nandi.
 2018-10-04 22:53:51 -07:00
Bharat Viswanadham
2a07617f85 HDDS-354. VolumeInfo.getScmUsed throws NPE. Contributed by Hanisha Koneru. 2018-10-04 21:46:17 -07:00
Anu Engineer
e6b77ad65f HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1. 
Contributed by Anu Engineer.
 2018-10-04 21:40:13 -07:00
Bharat Viswanadham
7fb91b8a53 HDDS-565. TestContainerPersistence fails regularly in Jenkins. Contributed by Dinesh Chitlangia. 2018-10-04 21:27:12 -07:00
Yiqun Lin
619e490333 HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap. 2018-10-05 09:55:08 +08:00
Adam Antal
cc2babc1f7 HDFS-13950. ACL documentation update to indicate that ACL entries are capped by 32. Contributed by Adam Antal. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-04 15:22:44 -07:00
Siyao Meng
396ce0d9f4 HDFS-13877. HttpFS: Implement GETSNAPSHOTDIFF. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-04 15:17:47 -07:00
Haibo Chen
e60b797c88 YARN-8750. Refactor TestQueueMetrics. (Contributed by Szilard Nemeth) 2018-10-04 13:00:31 -07:00