Commit Graph

6566 Commits

Author SHA1 Message Date
Yiqun Lin 7d1d49603d HDFS-11929. Document missing processor of hdfs oiv_legacy command. Contributed by LiXin Ge. 2017-06-08 10:44:52 -07:00
Vinayakumar B f2f1ada640 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-08 10:44:52 -07:00
Brahma Reddy Battula 7d3bbf2d37 HDFS-11711. DN should not delete the block On "Too many open files" Exception. Contributed by Brahma Reddy Battula. 2017-06-08 10:44:52 -07:00
Andrew Wang bbf158de74 HDFS-11840. Log HDFS Mover exception message of exit to its own log. Contributed by LiXin Ge. 2017-06-08 10:44:52 -07:00
Arpit Agarwal df7d952f12 HDFS-11932. BPServiceActor thread name is not correctly set. Contributed by Chen Liang. 2017-06-08 10:44:52 -07:00
Brahma Reddy Battula cc8bcf1efd HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he. 2017-06-08 10:44:51 -07:00
Yongjun Zhang 23b15b223a HDFS-11914. Add more diagnosis info for fsimage transfer failure. Contributed by Yongjun Zhang. 2017-06-08 10:44:51 -07:00
Arpit Agarwal b55a34639d HDFS-11928. Segment overflow in FileDistributionCalculator. Contributed by LiXin Ge. 2017-06-08 10:44:51 -07:00
Kihwal Lee 14f782b6b9 HDFS-10816. TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor. Contributed by Eric Badger. 2017-06-08 10:44:51 -07:00
Yiqun Lin fe76c59954 HDFS-11899. ASF License warnings generated intermittently in trunk. Contributed by Yiqun Lin. 2017-06-08 10:44:50 -07:00
Brahma Reddy Battula 6618442809 HADOOP-14436. Remove the redundant colon in ViewFs.md. Contributed by maobaolong. 2017-06-08 10:44:50 -07:00
Yiqun Lin 60a7f57b61 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-08 10:44:50 -07:00
Andrew Wang 0a09e1f29d HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev. 2017-06-08 10:44:50 -07:00
Xiao Chen 36914a7291 HDFS-11904. Reuse iip in unprotectedRemoveXAttrs calls. 2017-06-08 10:44:50 -07:00
Xiao Chen cb622bc619 HDFS-11741. Long running balancer may fail due to expired DataEncryptionKey. Contributed by Wei-Chiu Chuang and Xiao Chen. 2017-06-08 10:44:49 -07:00
Brahma Reddy Battula 93f2aaf826 HDFS-11905. Fix license header inconsistency in hdfs. Contributed by Yeliang Cang. 2017-06-08 10:44:49 -07:00
Brahma Reddy Battula 173e391c4e HDFS-11893. Fix TestDFSShell.testMoveWithTargetPortEmpty failure. Contributed by Brahma Reddy Battula. 2017-06-08 10:44:49 -07:00
Kihwal Lee 5a81e70c44 HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-08 10:44:49 -07:00
Brahma Reddy Battula c48a7a0e9e HDFS-11901. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin. 2017-06-08 10:44:48 -07:00
Lei Xu 611d452bcf HDFS-11659. TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery. Contributed by Lei (Eddy) Xu. 2017-06-08 10:44:48 -07:00
Akira Ajisaka 8897b3b3eb HDFS-11832. Switch leftover logs to slf4j format in BlockManager.java. Contributed by Hui Xu and Chen Liang. 2017-06-08 10:44:47 -07:00
Yiqun Lin 9e3d5e29b3 HDFS-11446. TestMaintenanceState#testWithNNAndDNRestart fails intermittently. Contributed by Yiqun Lin. 2017-06-08 10:44:47 -07:00
Andrew Wang 40e677a400 Update 3.0.0-alpha3 changes, release notes, jdiff. 2017-06-08 10:44:47 -07:00
Andrew Wang b876bbd936 Update maven version for 3.0.0-alpha4 development 2017-06-08 10:44:47 -07:00
Inigo Goiri 02f1eea06f Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri. 2017-06-08 10:44:47 -07:00
Kihwal Lee 0dbcd01de5 HDFS-11817. A faulty node can cause a lease leak and NPE on accessing data. Contributed by Kihwal Lee. 2017-06-08 10:44:46 -07:00
Arpit Agarwal ad32d5f4ef HDFS-11879. Fix JN sync interval in case of exception. Contributed by Hanisha Koneru. 2017-06-08 10:44:46 -07:00
Kihwal Lee 46bad64684 HDFS-11856. Ability to re-add Upgrading Nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-08 10:44:46 -07:00
Arpit Agarwal 48f83077ad HDFS-11878. Fix journal missing log httpServerUrl address in JournalNodeSyncer. Contributed by Hanisha Koneru. 2017-06-08 10:44:45 -07:00
Brahma Reddy Battula f5d3faba5f HDFS-11445. FSCK shows overall health stauts as corrupt even one replica is corrupt. Contributed by Brahma Reddy Battula. 2017-06-08 10:44:45 -07:00
Akira Ajisaka 527c9dde40 HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu. 2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang c90e190507 Revert "HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory."
This reverts commit 6a38d118d8.
2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang 71626483f4 Revert "HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang."
This reverts commit bc7aff7cec.
2017-06-08 10:44:44 -07:00
Arpit Agarwal 0646fb2fa5 HDFS-11877. FileJournalManager#getLogFile should ignore in progress edit logs during JN sync. Contributed by Hanisha Koneru. 2017-06-08 10:44:44 -07:00
Jing Zhao a02b908e6a HDFS-11823. Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy. Contributed by Takanobu Asanuma. 2017-06-08 10:44:44 -07:00
Kai Zheng 6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan 0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Arpit Agarwal 641d6c0822 HDFS-11419. Performance analysis of new DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal 8348d2b13b HDFS-11866. JournalNode Sync should be off by default in hdfs-default.xml. Contributed by Hanisha Koneru. 2017-06-08 10:44:43 -07:00
Brahma Reddy Battula 9b09503c8b HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 2017-06-08 10:44:43 -07:00
Sunil G 8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Arpit Agarwal 5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Akira Ajisaka 1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Kihwal Lee 915b9f7fcf HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-06-08 10:44:40 -07:00
Akira Ajisaka eec43a8c56 HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-06-08 10:44:40 -07:00
Jason Lowe 0fe0687c3e HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-06-08 10:44:40 -07:00
Vinayakumar B be303c2990 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-06-08 10:44:40 -07:00
Akira Ajisaka ccdcc34490 HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-06-08 10:44:39 -07:00
Andrew Wang b78d4b20fd HDFS-11757. Query StreamCapabilities when creating balancer's lock file. Contributed by SammiChen. 2017-06-08 10:44:39 -07:00