6427 Commits

Author SHA1 Message Date
Andrew Wang
40e677a400 Update 3.0.0-alpha3 changes, release notes, jdiff. 2017-06-08 10:44:47 -07:00
Andrew Wang
b876bbd936 Update maven version for 3.0.0-alpha4 development 2017-06-08 10:44:47 -07:00
Inigo Goiri
02f1eea06f Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri. 2017-06-08 10:44:47 -07:00
Kihwal Lee
0dbcd01de5 HDFS-11817. A faulty node can cause a lease leak and NPE on accessing data. Contributed by Kihwal Lee. 2017-06-08 10:44:46 -07:00
Arpit Agarwal
ad32d5f4ef HDFS-11879. Fix JN sync interval in case of exception. Contributed by Hanisha Koneru. 2017-06-08 10:44:46 -07:00
Kihwal Lee
46bad64684 HDFS-11856. Ability to re-add Upgrading Nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-08 10:44:46 -07:00
Arpit Agarwal
48f83077ad HDFS-11878. Fix journal missing log httpServerUrl address in JournalNodeSyncer. Contributed by Hanisha Koneru. 2017-06-08 10:44:45 -07:00
Brahma Reddy Battula
f5d3faba5f HDFS-11445. FSCK shows overall health stauts as corrupt even one replica is corrupt. Contributed by Brahma Reddy Battula. 2017-06-08 10:44:45 -07:00
Akira Ajisaka
527c9dde40 HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu. 2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang
c90e190507 Revert "HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory."
This reverts commit 6a38d118d86b7907009bcec34f1b788d076f1d1c.
2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang
71626483f4 Revert "HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang."
This reverts commit bc7aff7cec07bbc3fed63a00c8f1584c34670998.
2017-06-08 10:44:44 -07:00
Arpit Agarwal
0646fb2fa5 HDFS-11877. FileJournalManager#getLogFile should ignore in progress edit logs during JN sync. Contributed by Hanisha Koneru. 2017-06-08 10:44:44 -07:00
Jing Zhao
a02b908e6a HDFS-11823. Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy. Contributed by Takanobu Asanuma. 2017-06-08 10:44:44 -07:00
Kai Zheng
6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan
0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Arpit Agarwal
641d6c0822 HDFS-11419. Performance analysis of new DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal
8348d2b13b HDFS-11866. JournalNode Sync should be off by default in hdfs-default.xml. Contributed by Hanisha Koneru. 2017-06-08 10:44:43 -07:00
Brahma Reddy Battula
9b09503c8b HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 2017-06-08 10:44:43 -07:00
Sunil G
8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal
c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Arpit Agarwal
5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Akira Ajisaka
1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Kihwal Lee
915b9f7fcf HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-06-08 10:44:40 -07:00
Akira Ajisaka
eec43a8c56 HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-06-08 10:44:40 -07:00
Jason Lowe
0fe0687c3e HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-06-08 10:44:40 -07:00
Vinayakumar B
be303c2990 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-06-08 10:44:40 -07:00
Andrew Wang
b78d4b20fd HDFS-11757. Query StreamCapabilities when creating balancer's lock file. Contributed by SammiChen. 2017-06-08 10:44:39 -07:00
Chris Douglas
39e6331772 HDFS-11681. DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set Contributed by Virajith Jalaparti 2017-06-08 10:44:39 -07:00
Kihwal Lee
070a4830f6 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-06-08 10:44:39 -07:00
Jason Lowe
b7b758ab11 HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 2017-06-08 10:44:39 -07:00
Andrew Wang
06c940a317 HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2. 2017-06-08 10:44:37 -07:00
Xiaoyu Yao
058129bca7 HDFS-11952. Ozone: Fix TestContainerSQLCli#testConvertContainerDB. Contributed by Weiwei Yang. 2017-06-08 10:07:16 -07:00
Weiwei Yang
23d7d613df HDFS-11779. Ozone: KSM: add listBuckets. Contributed by Weiwei Yang. 2017-06-08 17:38:48 +08:00
Xiaoyu Yao
da8bc385a7 HDFS-11880. Ozone: KSM: Remove protobuf formats from KSM wrappers. Contributed by Nandakumar Vadivelu. 2017-06-07 14:49:44 -07:00
Xiaoyu Yao
18706f433f HDFS-11777. Ozone: KSM: add deleteBucket. Contributed by Nandakumar Vadivelu. 2017-06-07 09:45:34 -07:00
Anu Engineer
9961fa3da0 HDFS-11926. Ozone: Implement a common helper to return a range of KVs in levelDB. Contributed by Weiwei Yang. 2017-06-06 23:07:17 -07:00
Anu Engineer
74ab303993 HDFS-11568. Ozone: Create metadata path automatically after null checking. Contributed by Mukul Kumar Singh. 2017-06-06 16:46:15 -07:00
Weiwei Yang
245c6fed97 HDFS-11887. Shared XceiverClient should be closed if there is no open clients to avoid resource leak. Contributed by Mukul Kumar Singh. 2017-06-06 21:20:20 +08:00
Anu Engineer
b8f4713861 HDFS-11919. Ozone: SCM: TestNodeManager takes too long to execute. Contributed by Yiqun Lin. 2017-06-05 21:34:32 -07:00
Chen Liang
7f50a36749 HDFS-11822. Block Storage: Fix TestCBlockCLI, failing because of " Address already in use". Contributed by Mukul Kumar Singh. 2017-06-05 10:33:00 -07:00
Weiwei Yang
d50c8de46c HDFS-11781. Ozone: KSM: Add deleteKey. Contributed by Yuanbo Liu. 2017-06-05 21:04:25 +08:00
Anu Engineer
c7dd72e2fe HDFS-11771. Ozone: KSM: Add checkVolumeAccess. Contributed by Mukul Kumar Singh. 2017-06-02 17:04:10 -07:00
Anu Engineer
776d2d4de7 HDFS-11796. Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly. Contributed by Mukul Kumar Singh. 2017-06-02 16:24:16 -07:00
Anu Engineer
5cdd880078 HDFS-11913. Ozone: TestKeySpaceManager#testDeleteVolume fails. Contributed by Weiwei Yang. 2017-06-02 00:48:39 -07:00
Anu Engineer
f289e8e737 HDFS-11597. Ozone: Add Ratis management API. Contributed by Tsz Wo Nicholas Sze. 2017-06-01 15:36:58 -07:00
Anu Engineer
988b25419c HDFS-11894. Ozone: Cleanup imports. Contributed by Weiwei Yang. 2017-06-01 13:07:20 -07:00
Mingliang Liu
9e2873db29 HDFS-11903. Ozone: Cleaning up local storage when closing MiniOzoneCluster. Contributed by Mingliang Liu 2017-05-31 15:00:09 -07:00
Xiaoyu Yao
9cb63fdba0 HDFS-11774. Ozone: KSM: add deleteVolume. Contributed by Mukul Kumar Singh. 2017-05-31 14:21:17 -07:00
Xiaoyu Yao
3983e94f0d HDFS-11776. Ozone: KSM: add SetBucketProperty. Contributed by Nandakumar Vadivelu. 2017-05-31 08:37:09 -07:00
Xiaoyu Yao
122d660f78 HDFS-11853. Ozone: KSM: Add getKey. Contributed by Chen Liang. 2017-05-30 15:15:55 -07:00