Commit Graph

474 Commits

Author SHA1 Message Date
Vinayakumar B f2f1ada640 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-08 10:44:52 -07:00
Yiqun Lin 60a7f57b61 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-08 10:44:50 -07:00
Andrew Wang 0a09e1f29d HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev. 2017-06-08 10:44:50 -07:00
Andrew Wang b876bbd936 Update maven version for 3.0.0-alpha4 development 2017-06-08 10:44:47 -07:00
Kihwal Lee 46bad64684 HDFS-11856. Ability to re-add Upgrading Nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-08 10:44:46 -07:00
Kai Zheng 6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan 0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Sunil G 8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Akira Ajisaka 1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Weiwei Yang 23d7d613df HDFS-11779. Ozone: KSM: add listBuckets. Contributed by Weiwei Yang. 2017-06-08 17:38:48 +08:00
Xiaoyu Yao da8bc385a7 HDFS-11880. Ozone: KSM: Remove protobuf formats from KSM wrappers. Contributed by Nandakumar Vadivelu. 2017-06-07 14:49:44 -07:00
Xiaoyu Yao 18706f433f HDFS-11777. Ozone: KSM: add deleteBucket. Contributed by Nandakumar Vadivelu. 2017-06-07 09:45:34 -07:00
Weiwei Yang 245c6fed97 HDFS-11887. Shared XceiverClient should be closed if there is no open clients to avoid resource leak. Contributed by Mukul Kumar Singh. 2017-06-06 21:20:20 +08:00
Weiwei Yang d50c8de46c HDFS-11781. Ozone: KSM: Add deleteKey. Contributed by Yuanbo Liu. 2017-06-05 21:04:25 +08:00
Anu Engineer c7dd72e2fe HDFS-11771. Ozone: KSM: Add checkVolumeAccess. Contributed by Mukul Kumar Singh. 2017-06-02 17:04:10 -07:00
Anu Engineer 988b25419c HDFS-11894. Ozone: Cleanup imports. Contributed by Weiwei Yang. 2017-06-01 13:07:20 -07:00
Xiaoyu Yao 9cb63fdba0 HDFS-11774. Ozone: KSM: add deleteVolume. Contributed by Mukul Kumar Singh. 2017-05-31 14:21:17 -07:00
Xiaoyu Yao 3983e94f0d HDFS-11776. Ozone: KSM: add SetBucketProperty. Contributed by Nandakumar Vadivelu. 2017-05-31 08:37:09 -07:00
Xiaoyu Yao 122d660f78 HDFS-11853. Ozone: KSM: Add getKey. Contributed by Chen Liang. 2017-05-30 15:15:55 -07:00
Tsz-Wo Nicholas Sze c1d714d933 HDFS-11865. Ozone: Do not initialize Ratis cluster during datanode startup. 2017-05-28 15:19:32 +08:00
Xiaoyu Yao e641bee7b7 HDFS-11780. Ozone: KSM: Add putKey. Contributed by Chen Liang. 2017-05-25 22:06:17 -07:00
Xiaoyu Yao 41d5a45e59 HDFS-11778. Ozone: KSM: add getBucketInfo. Contributed by Nandakumar Vadivelu. 2017-05-24 12:25:22 -07:00
Xiaoyu Yao 9f7b8a166b HDFS-11859. Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol. Contributed by Xiaoyu Yao. 2017-05-23 10:56:45 -07:00
Xiaoyu Yao 3ff857f63e HDFS-11770. Ozone: KSM: Add setVolumeProperty. Contributed by Mukul Kumar Singh. 2017-05-22 13:50:35 -07:00
Chen Liang b72ac9273e HDFS-11850. Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient. Contributed by Mukul Kumar Singh. 2017-05-22 10:20:04 -07:00
Tsz-Wo Nicholas Sze 24eb26cfab HDFS-11843. Ozone: XceiverClientRatis should implement XceiverClientSpi.connect(). 2017-05-19 17:08:40 -07:00
Chen Liang 914ceb2587 HDFS-11835. Block Storage: Overwrite of blocks fails. Contributed by Mukul Kumar Singh. 2017-05-19 10:29:03 -07:00
Xiaoyu Yao 002bb5faa8 HDFS-11775. Ozone: KSM: add createBucket. Contributed by Nandakumar Vadivelu. 2017-05-18 13:39:21 -07:00
Anu Engineer a8393b4b87 HDFS-11769. Ozone: KSM: Add createVolume API. Contributed by Mukul Kumar Singh. 2017-05-15 21:38:08 -07:00
Xiaoyu Yao 6e8584fc13 HDFS-11693. Ozone:Add archive support to containers. Contributed by Anu Engineer. 2017-05-15 16:36:38 -07:00
Xiaoyu Yao 7e8b3e2540 HDFS-11811. Ozone: SCM: Support Delete Block. Contributed by Xiaoyu Yao. 2017-05-12 16:02:05 -07:00
Anu Engineer 2796b3435e HDFS-11768. Ozone: KSM: Create Key Space manager service. Contributed by Anu Engineer. 2017-05-11 21:11:32 -07:00
Weiwei Yang cee6438005 HDFS-11680. Ozone: SCM CLI: Implement info container command. Contributed by Yuanbo Liu. 2017-05-10 15:55:48 +08:00
Weiwei Yang 608605387e HDFS-11716. Ozone: SCM: CLI: Revisit delete container API. Contributed by Weiwei Yang. 2017-05-09 14:14:27 +08:00
Anu Engineer 86414507f4 Merge branch 'trunk' into HDFS-7240
Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/log4j.properties
	hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/RemoteWasbAuthorizerImpl.java
2017-05-08 22:42:21 -07:00
Andrew Wang 54fd0e44b7 HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy. 2017-05-08 21:59:49 -07:00
Kihwal Lee cef2815cf4 HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah. 2017-05-08 08:27:37 -05:00
Andrew Wang a9a3d219fe HDFS-9342. Erasure coding: client should update and commit block based on acknowledged size. Contributed by SammiChen. 2017-05-07 14:45:26 -07:00
Chris Douglas a3954ccab1 HDFS-9807. Add an optional StorageID to writes. Contributed by Ewan Higgs 2017-05-05 12:01:26 -07:00
Lei Xu 25f5d9ad5e HDFS-11687. Add new public encryption APIs required by Hive. (lei)
Change-Id: I4a23a00de63ad18022312ceb1f306a87d032d07c
2017-05-04 12:06:50 -07:00
Andrew Wang c2a52ef9c2 HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen. 2017-05-04 11:39:14 -07:00
Anu Engineer 9352ecfb04 HDFS-11747. Ozone : need to fix OZONE_SCM_DEFAULT_PORT. Contributed by Chen Liang. 2017-05-03 13:48:06 -07:00
Anu Engineer c3f397eead HDFS-11675. Ozone: SCM CLI: Implement delete container command. Contributed by Weiwei Yang. 2017-05-01 09:26:35 -07:00
Lei Xu 19a7e94ee4 HDFS-11718. DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException. (Manoj Govindassamy via lei)
Change-Id: I4cc226b80c64a0d900a3b1ce71e51f051cd29c22
2017-04-28 17:06:14 -07:00
Kai Zheng cb672a45a0 HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang 2017-04-28 13:18:50 +08:00
Akira Ajisaka 249cb210f5
HDFS-11697. Add javadoc for storage policy and erasure coding policy. Contributed by Kai Sasaki. 2017-04-27 16:12:27 +09:00
Akira Ajisaka 93fa48fcf2
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore. 2017-04-26 17:43:29 +09:00
Chris Douglas 2f73396b59 HDFS-6708. StorageType should be encoded in the block token. Contributed by Ewan Higgs 2017-04-25 23:57:00 -07:00
Yongjun Zhang 20e3ae260b HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files. (Manoj Govindassamy via Yongjun Zhang) 2017-04-21 20:35:48 -07:00
Yongjun Zhang 5078df7be3 HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang. 2017-04-21 13:36:31 -07:00