Commit Graph

20244 Commits

Author SHA1 Message Date
Arpit Agarwal 86c9418c16 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham.
(cherry picked from commit 3a684a2b23)
2018-10-12 14:44:56 -07:00
Anu Engineer 7daeaa9a98 HDDS-624.PutBlock fails with Unexpected Storage Container Exception.
Contributed by  Arpit Agarwal.

(cherry picked from commit 02e1ef5e07)
2018-10-12 14:29:59 -07:00
Bharat Viswanadham 252a44f8c1 HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham.
(cherry picked from commit 8ae8a5004f)
2018-10-12 14:00:25 -07:00
Arpit Agarwal ca1d4c46dd HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh.
(cherry picked from commit 56b18b9df1)
2018-10-12 13:33:45 -07:00
Xiaoyu Yao 2cad68b486 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh.
(cherry picked from commit 07d55292dc)
2018-10-12 13:26:29 -07:00
Xiaoyu Yao 4a0e137e04 HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh.
(cherry picked from commit e12edb3d8f)
2018-10-12 13:26:29 -07:00
Arpit Agarwal 2e34d1d7db HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh.
(cherry picked from commit 85ccab7d3f)
2018-10-12 11:31:06 -07:00
Anu Engineer 7e09290e84 HDDS-577. Support S3 buckets as first class objects in Ozone Manager - 2.
Contributed by Bharat Viswanadham.

(cherry picked from commit 5b7ba48ced)
2018-10-12 11:18:10 -07:00
Bharat Viswanadham 645585be64 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham.
(cherry picked from commit 38fe447d93)
2018-10-12 10:03:31 -07:00
Yiqun Lin 54a229c332 HDDS-628. Fix outdated names used in HDDS documentations.
(cherry picked from commit 5da042227c)
2018-10-12 14:01:47 +08:00
Bharat Viswanadham 67d516eb8a HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru.
(cherry picked from commit 74db993a61)
2018-10-11 21:04:19 -07:00
Tsz Wo Nicholas Sze d72acd6bd3 HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:49:33 +08:00
Anu Engineer 587e29909e HDDS-634. OzoneFS: support basic user group and permission for file/dir.
Contributed by Xiaoyu Yao.

(cherry picked from commit 604c27c33a)
2018-10-11 17:26:02 -07:00
Arpit Agarwal ed09883f2c HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal.
(cherry picked from commit 50552479c4)
2018-10-11 17:21:46 -07:00
Jitendra Pandey 077d36d8f5 HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:15:08 -07:00
Xiaoyu Yao 72ac4e8238 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh.
(cherry picked from commit c05b260069)
2018-10-11 15:12:06 -07:00
Hanisha Koneru 43ff801391 HDDS-601. On restart, SCM throws 'No such datanode' exception.
(cherry picked from commit eb34b5f8af)
2018-10-11 13:48:02 -07:00
Arpit Agarwal e66fba8a8a HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma.
(cherry picked from commit 47eeb3eb7b)
2018-10-11 09:20:20 -07:00
Arpit Agarwal d7d445b354 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia.
(cherry picked from commit 2bd000c851)
2018-10-10 17:37:29 -07:00
Nanda kumar 79d11e50a7 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh.
(cherry picked from commit 90552b1ea8)
2018-10-10 20:51:23 +05:30
Márton Elek b64fcc71f1 HDDS-517. Implement HeadObject REST endpoint. Contributed by LiXin Ge.
(cherry picked from commit cd280514b8)
2018-10-10 15:38:53 +02:00
Bharat Viswanadham 056f480093 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari.
(cherry picked from commit 6a39739316)
2018-10-09 15:21:50 -07:00
Bharat Viswanadham 308c614d4a HDDS-585. Handle common request identifiers in a transparent way. Contributed by Elek Marton.
(cherry picked from commit d5dd6f31fc)
2018-10-09 12:44:24 -07:00
Arpit Agarwal d08a538777 HDDS-590. Add unit test for HDDS-583. Contributed by Namit Maheshwari.
(cherry picked from commit 03d66b1f5d)
2018-10-09 11:05:23 -07:00
Nanda kumar abfd4ffdc9 HDDS-450. Generate BlockCommitSequenceId in ContainerStateMachine for every commit operation in Ratis. Contributed by Shashikant Banerjee.
(cherry picked from commit 7367ff333b)
2018-10-09 22:31:19 +05:30
Nanda kumar 4ba6dd4605 HDDS-599. Fix TestOzoneConfiguration TestOzoneConfigurationFields. Contributed by Sandeep Nemuri.
(cherry picked from commit 9e9915ddab)
2018-10-09 22:30:31 +05:30
Eric Yang 347ea38581 YARN-8763. Added node manager websocket API for accessing containers.
Contributed by Zian Chen
2018-10-08 13:56:47 -04:00
Inigo Goiri 745f64012a YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R. 2018-10-08 10:05:18 -07:00
Haibo Chen 7c13872cbb YARN-8659. RMWebServices returns only RUNNING apps when filtered with queue. (Contributed by Szilard Nemeth) 2018-10-08 09:40:37 -07:00
Márton Elek d7c7f68c26 HDDS-521. Implement DeleteBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-08 16:17:42 +02:00
Sunil G 228dc192f1 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB. 2018-10-08 11:54:56 +05:30
Vidura Mudalige 907ef6c285
YARN-8788. mvn package -Pyarn-ui fails on JDK9
This closes #421

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-10-07 16:48:30 +09:00
Inigo Goiri 3bfff0f79e HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 2018-10-06 10:40:49 -07:00
Vidura Mudalige b85ee0d75d
YARN-8819. Fix findbugs warnings in YarnServiceUtils
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-10-07 00:53:53 +09:00
Ajay Kumar cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Jason Lowe 9bb2801e8c YARN-4254. ApplicationAttempt stuck for ever due to UnknownHostException. Contributed by Bibin A Chundatt 2018-10-05 15:52:46 -05:00
Haibo Chen c968365650 YARN-8644. Improve unit test for RMAppImpl.FinalTransition. (Contributed by Szilard Nemeth) 2018-10-05 09:32:30 -07:00
Inigo Goiri 73c660b43f HDFS-13958. Miscellaneous Improvements for FsVolumeSpi. Contributed by BELUGA BEHR. 2018-10-05 09:32:19 -07:00
Jason Lowe f13e231025 HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe 2018-10-05 09:06:02 -05:00
Márton Elek 25b1e8a48e HDDS-512. Addendum: update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:32:47 +02:00
Márton Elek 0e28ef35be HDDS-512. update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:20:27 +02:00
Nanda kumar f362037527 HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh. 2018-10-05 16:47:01 +05:30
Steve Loughran 273cc2d4e9
HADOOP-15809. ABFS: better exception handling when making getAccessToken call.
Contributed by Da Zhou
2018-10-05 11:29:03 +01:00
Sunil G 94d82f4162 YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB. 2018-10-05 14:29:12 +05:30
Márton Elek 9bc8b1cfd3 HDDS-578. om-audit-log4j2.properties must be packaged in ozone-dist . Contributed by Dinesh Chitlangia. 2018-10-05 04:33:19 -04:00
Sunil G 751f626e50 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB. 2018-10-05 12:28:09 +05:30
Takanobu Asanuma 241cbec2da HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 2018-10-05 14:57:45 +09:00
Anu Engineer 153941b236 HDDS-479. Add more ozone fs tests in the robot integration framework.
Contributed by  Nilotpal Nandi.
2018-10-04 22:53:51 -07:00
Bharat Viswanadham 2a07617f85 HDDS-354. VolumeInfo.getScmUsed throws NPE. Contributed by Hanisha Koneru. 2018-10-04 21:46:17 -07:00
Anu Engineer e6b77ad65f HDDS-572. Support S3 buckets as first class objects in Ozone Manager - 1.
Contributed by Anu Engineer.
2018-10-04 21:40:13 -07:00