Commit Graph

16297 Commits

Author SHA1 Message Date
Weiwei Yang b4e5c55436 HDFS-11830. Ozone: Datanode needs to re-register to SCM if SCM is restarted. Contributed by Weiwei Yang. 2017-05-20 10:28:12 +08:00
Tsz-Wo Nicholas Sze 24eb26cfab HDFS-11843. Ozone: XceiverClientRatis should implement XceiverClientSpi.connect(). 2017-05-19 17:08:40 -07:00
Chen Liang 914ceb2587 HDFS-11835. Block Storage: Overwrite of blocks fails. Contributed by Mukul Kumar Singh. 2017-05-19 10:29:03 -07:00
Xiaoyu Yao 002bb5faa8 HDFS-11775. Ozone: KSM: add createBucket. Contributed by Nandakumar Vadivelu. 2017-05-18 13:39:21 -07:00
Weiwei Yang 63cafc0e29 HDFS-11824. Ozone: Fix javac warnings. Contributed by Yiqun Lin. 2017-05-18 14:02:52 +08:00
Weiwei Yang ac2d219007 HDFS-11836. Ozone : add sql debug CLI to hdfs script. Contributed by Chen Liang. 2017-05-18 11:09:31 +08:00
Xiaoyu Yao 7dbe89d017 HDFS-11831. Ozone: Improve the way of getting test file path in unit tests for Windows. Contributed by Yiqun Lin. 2017-05-16 15:48:51 -07:00
Anu Engineer a8393b4b87 HDFS-11769. Ozone: KSM: Add createVolume API. Contributed by Mukul Kumar Singh. 2017-05-15 21:38:08 -07:00
Xiaoyu Yao 6e8584fc13 HDFS-11693. Ozone:Add archive support to containers. Contributed by Anu Engineer. 2017-05-15 16:36:38 -07:00
Chen Liang 7bf7872759 HDFS-11650. Ozone: fix the consistently timeout test testUpgradeFromRel22Image. Contributed by Chen Liang. 2017-05-15 15:51:08 -07:00
Chen Liang e40e09540b HDFS-11694. Block Storage: Add Support for 2 BlockIDBuffers and also for periodic flush of BlockIDBuffer. Contributed by Mukul Kumar Singh 2017-05-15 10:35:44 -07:00
Xiaoyu Yao 055e556e67 HDFS-11815. CBlockManager#main should join() after start() service. Contributed by Chen Liang. 2017-05-14 06:12:19 -07:00
Xiaoyu Yao b8e063ebcb HDFS-11805. Ensure LevelDB DBIterator is closed. Contributed by Chen Liang. 2017-05-14 06:06:58 -07:00
Xiaoyu Yao 7e8b3e2540 HDFS-11811. Ozone: SCM: Support Delete Block. Contributed by Xiaoyu Yao. 2017-05-12 16:02:05 -07:00
Chen Liang 7bf301e20e HDFS-11802. Ozone : add DEBUG CLI support for open container db file. Contributed by Chen Liang 2017-05-12 13:13:55 -07:00
Anu Engineer 2796b3435e HDFS-11768. Ozone: KSM: Create Key Space manager service. Contributed by Anu Engineer. 2017-05-11 21:11:32 -07:00
Chen Liang 1b1b74a096 HDFS-11788. Ozone : add DEBUG CLI support for nodepool db file. Contributed by Chen Liang 2017-05-10 15:15:22 -07:00
Anu Engineer 5df9a1d2ca HDFS-11798. Ozone: Correct description for ozone.handler.type in ozone-default.xml. Contributed by Mukul Kumar Singh. 2017-05-10 14:43:53 -07:00
Anu Engineer 38e2697066 HDFS-11783. Ozone: Fix spotbugs warnings. Contributed by Weiwei Yang. 2017-05-10 11:40:06 -07:00
Weiwei Yang cee6438005 HDFS-11680. Ozone: SCM CLI: Implement info container command. Contributed by Yuanbo Liu. 2017-05-10 15:55:48 +08:00
Chen Liang 6516706eb2 HDFS-11756. Ozone : add DEBUG CLI support of blockDB file. Contributed by Chen Liang 2017-05-09 13:42:47 -07:00
Anu Engineer 97fd8c465c fix a merge issue from trunk. 2017-05-09 10:27:24 -07:00
Weiwei Yang 608605387e HDFS-11716. Ozone: SCM: CLI: Revisit delete container API. Contributed by Weiwei Yang. 2017-05-09 14:14:27 +08:00
Anu Engineer 86414507f4 Merge branch 'trunk' into HDFS-7240
Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
	hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/RemoteWasbAuthorizerImpl.java
2017-05-08 22:42:21 -07:00
Andrew Wang 54fd0e44b7 HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy. 2017-05-08 21:59:49 -07:00
Subru Krishnan 749e5c09b9 YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru)
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
2017-05-08 16:55:47 -07:00
Subru Krishnan cd9ff27ffc YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru). 2017-05-08 16:41:30 -07:00
Haibo Chen 1769b12a77 YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen) 2017-05-08 15:46:12 -07:00
Haohui Mai ff5ec3b841 HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints. 2017-05-08 15:28:45 -07:00
Jason Lowe 424887ecb7 YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R 2017-05-08 17:14:37 -05:00
Kihwal Lee cef2815cf4 HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah. 2017-05-08 08:27:37 -05:00
Andrew Wang a9a3d219fe HDFS-9342. Erasure coding: client should update and commit block based on acknowledged size. Contributed by SammiChen. 2017-05-07 14:45:26 -07:00
Andrew Wang 8065129d87 HADOOP-14298. TestHadoopArchiveLogsRunner fails. Contribute dby Akira Ajisaka. 2017-05-07 13:59:15 -07:00
Anu Engineer f713452e7e HDFS-11761. Ozone: Get container report should only report closed containers. Contributed by Weiwei Yang. 2017-05-06 09:44:07 -07:00
Weiwei Yang 2feec0045d HDFS-11759. Ozone : SCMNodeManager#close() should also close node pool manager object. Contributed by Chen Liang. 2017-05-06 23:12:54 +08:00
Subru Krishnan d6eed5acca YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru). 2017-05-05 16:27:49 -07:00
Chris Douglas e4f34ecb04 HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang 2017-05-05 12:10:50 -07:00
Chris Douglas a3954ccab1 HDFS-9807. Add an optional StorageID to writes. Contributed by Ewan Higgs 2017-05-05 12:01:26 -07:00
Steve Loughran 4e6bbd049d
HADOOP-14382 Remove usages of MoreObjects.toStringHelper.
Contributed by Andrew Wang
2017-05-05 13:03:09 +01:00
Yiqun Lin 97c2e576c9 HDFS-11530. Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault. Contributed by Yiqun Lin and Chen Liang. 2017-05-05 11:54:50 +08:00
Robert Kanter 3082552b3b YARN-6522. Make SLS JSON input file format simple and scalable (yufeigu via rkanter) 2017-05-04 17:21:46 -07:00
Arpit Agarwal 07761af357 HDFS-11448. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru. 2017-05-04 15:57:44 -07:00
Vrushali Channapattan 54e2b9e876 YARN-6375 App level aggregation should not consider metric values reported in the previous aggregation cycle (Varun Saxena via Vrushali C) 2017-05-04 15:25:56 -07:00
Anu Engineer a704a24757 HDFS-11698. Ozone: SCM: CLI: Add Debug command. Contributed by Chen Liang. 2017-05-04 13:55:07 -07:00
Jason Lowe 61858a5c37 HADOOP-14380. Make the Guava version Hadoop which builds with configurable. Contributed by Steve Loughran 2017-05-04 15:17:46 -05:00
Lei Xu 25f5d9ad5e HDFS-11687. Add new public encryption APIs required by Hive. (lei)
Change-Id: I4a23a00de63ad18022312ceb1f306a87d032d07c
2017-05-04 12:06:50 -07:00
Andrew Wang c2a52ef9c2 HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen. 2017-05-04 11:39:14 -07:00
Arpit Agarwal 81092b1f11 HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru. 2017-05-03 16:29:30 -07:00
Arpit Agarwal 30cd265134 Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
This reverts commit 08fb82d6d1.
2017-05-03 16:28:47 -07:00
Arpit Agarwal 08fb82d6d1 HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru. 2017-05-03 15:46:08 -07:00