Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,499 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3236 Commits

Author SHA1 Message Date
Arpit Agarwal 9f4585c95f HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 2017-04-11 11:43:25 -07:00
Arpit Agarwal f2d1d3d159 Revert "HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Xiaobing Zhou." 
This reverts commit ac76dc10dd.
 2017-04-11 11:42:57 -07:00
Xiaobing Zhou ac76dc10dd HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Xiaobing Zhou. 2017-04-11 11:16:36 -07:00
Xiaobing Zhou ea38aa727a HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:34:40 -07:00
Masatake Iwasaki 0ece3c8dd9 HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit ca3ede5fda)
 2017-03-28 18:17:45 +09:00
Zhe Zhang 4cc53b51f6 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a8)
(cherry picked from commit f98f4bb6ca)
(cherry picked from commit 8ca9915d0f)
 2017-03-22 22:48:04 -07:00
Wei-Chiu Chuang 830a602375 HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 
(cherry picked from commit 385d2cb777)

 Conflicts:
    hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java

(cherry picked from commit 60be2e5d8a)

 Conflicts:
    hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-03-13 13:45:12 -07:00
Zhe Zhang 33f4263345 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 
(cherry picked from commit d269b488a7)
(cherry picked from commit 5fb785e154)
(cherry picked from commit 265ddb20c3)
 2017-02-28 09:07:23 -08:00
Xiao Chen c2a4ce7717 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 2017-02-17 15:38:55 -08:00
Wei-Chiu Chuang f133e0161c HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae)
(cherry picked from commit a8531d5d52)
(cherry picked from commit 4c47cb68e8)
 2017-02-15 03:05:01 -08:00
Zhe Zhang 03a67e1e62 HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 2017-01-26 10:34:00 -08:00
Akira Ajisaka ab62484240 HDFS-11352. Add missing entry in CHANGES.txt. 2017-01-24 14:57:21 +09:00
Akira Ajisaka 3acc96edbf HDFS-11352. Potential deadlock in NN when failing over. Contributed by Erik Krogen. 2017-01-24 14:55:27 +09:00
Akira Ajisaka b0b3966851 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b)
(cherry picked from commit db47bd15dd)
 2017-01-24 14:19:21 +09:00
Vinitha Reddy Gankidi a6625e69a2 HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:59:37 -08:00
Haohui Mai 977fb0c524 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2017-01-04 21:16:20 -08:00
Brahma Reddy Battula a3f4ee53c8 Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit d90f7412f2.
 2017-01-03 19:32:39 +05:30
Haohui Mai d90f7412f2 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:12:28 -08:00
Brahma Reddy Battula 3e0bd9951f HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a73)
 2016-12-20 21:30:18 +05:30
Wei-Chiu Chuang bbf380a493 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java

(cherry picked from commit 18be0447cde622dfaaad27f7c2b9cccb30469fef)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeImpl.java
 2016-12-16 13:40:20 -08:00
Wei-Chiu Chuang 2123b664ca HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b44)
(cherry picked from commit fa3b2bee61)
 2016-12-10 09:34:05 -08:00
Akira Ajisaka 6d8df4e81e HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-03 11:11:50 +09:00
Akira Ajisaka 45bc79d135 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c)
(cherry picked from commit 0c895e8a62)
 2016-11-29 19:59:33 +09:00
Akira Ajisaka c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b)
(cherry picked from commit 6fe5ffd05d)
 2016-11-25 21:31:11 +09:00
Kihwal Lee 01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Xiaoyu Yao 0da0bf0de2 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498)
(cherry picked from commit c443ecb267)
 2016-11-18 09:52:02 -08:00
Konstantin V Shvachko f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Zhe Zhang ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Zhe Zhang cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Wei-Chiu Chuang 81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Erik Krogen c997fc629d HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c8)
 2016-11-13 15:04:34 -08:00
Anu Engineer 95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang 49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang 85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177d)
(cherry picked from commit efe9ae9fc6)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Erik Krogen d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:10:26 -07:00
Kihwal Lee a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dc)
 2016-10-27 14:23:20 -05:00
Mingliang Liu cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e32)
 2016-10-26 14:18:16 -07:00
Kihwal Lee fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89b)
 2016-10-26 09:19:45 -05:00
Zhe Zhang c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
(cherry picked from commit 262518fa5b)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 06:21:46 +05:30
Steve Loughran 897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:54:09 +05:30
Kihwal Lee 6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula 1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c)
(cherry picked from commit 5f754e8638)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko 4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb714)
(cherry picked from commit 1524e63206)
 2016-10-18 10:32:16 -07:00
Xiao Chen d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40)
 2016-10-18 10:16:30 -07:00
Yongjun Zhang b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd)
(cherry picked from commit 96e68e722f)
 2016-10-18 09:09:06 -07:00
Vinitha Reddy Gankidi 86f291f057 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 19:08:52 -07:00
Vinitha Reddy Gankidi 1fcaba9b14 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a7)
 2016-10-17 18:37:44 -07:00