Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,473 Commits 326 Branches 371 Tags
Commit Graph

3224 Commits

Author SHA1 Message Date
Akira Ajisaka
3acc96edbf HDFS-11352. Potential deadlock in NN when failing over. Contributed by Erik Krogen. 2017-01-24 14:55:27 +09:00
Akira Ajisaka
b0b3966851 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b572894e769f052aea2340fc3f23c78)
(cherry picked from commit db47bd15dd80a4a5727607832c16635cb0ec7726)
 2017-01-24 14:19:21 +09:00
Vinitha Reddy Gankidi
a6625e69a2 HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:59:37 -08:00
Haohui Mai
977fb0c524 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2017-01-04 21:16:20 -08:00
Brahma Reddy Battula
a3f4ee53c8 Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit d90f7412f2162550d3cc9a3ae33f330e7114bc5c.
 2017-01-03 19:32:39 +05:30
Haohui Mai
d90f7412f2 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:12:28 -08:00
Brahma Reddy Battula
3e0bd9951f HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a734df4e23a79b3bd89c816a1fc0de574)
 2016-12-20 21:30:18 +05:30
Wei-Chiu Chuang
bbf380a493 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d91d113e7fbe229f90a61a33433cecb9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java

(cherry picked from commit 18be0447cde622dfaaad27f7c2b9cccb30469fef)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeImpl.java
 2016-12-16 13:40:20 -08:00
Wei-Chiu Chuang
2123b664ca HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b4494ba1a1073b32b3f89d95e72f3204d)
(cherry picked from commit fa3b2bee618c72bae57890f011b475522fe2ff47)
 2016-12-10 09:34:05 -08:00
Akira Ajisaka
6d8df4e81e HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-03 11:11:50 +09:00
Akira Ajisaka
45bc79d135 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c23af38e697cd7c6c29e3f00d744e54)
(cherry picked from commit 0c895e8a62b4b69a020a5f004e97323520a1b1d0)
 2016-11-29 19:59:33 +09:00
Akira Ajisaka
c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b6f32646412b292d061ce5721f5dbe1)
(cherry picked from commit 6fe5ffd05d41727552834e54695d69a26eddd8d8)
 2016-11-25 21:31:11 +09:00
Kihwal Lee
01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Xiaoyu Yao
0da0bf0de2 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
(cherry picked from commit c443ecb267b25577f7abc058b0b5e13592d4c040)
 2016-11-18 09:52:02 -08:00
Konstantin V Shvachko
f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Zhe Zhang
ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Zhe Zhang
cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Wei-Chiu Chuang
81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Erik Krogen
c997fc629d HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c823d865ddfc017e71c82d12c8328e53)
 2016-11-13 15:04:34 -08:00
Anu Engineer
95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang
49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang
85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
(cherry picked from commit efe9ae9fc68e4eec4b7388b971c520328e95fe76)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Erik Krogen
d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8fa82a0ac87a207d7afa2061d90a9bd)
 2016-10-27 16:10:26 -07:00
Kihwal Lee
a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dce8d0eae4571fc64e6850d602bae688)
 2016-10-27 14:23:20 -05:00
Mingliang Liu
cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e3221941321e6f5e04b334246c5f23027)
 2016-10-26 14:18:16 -07:00
Kihwal Lee
fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89ba2741aeca20ead47699587b14f0de8)
 2016-10-26 09:19:45 -05:00
Zhe Zhang
c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44a88cb5eb7edffb015b10b657504a61)
(cherry picked from commit ff806cbfc7f5d1bdccd51a1802b6d69f4777219e)
(cherry picked from commit 262518fa5b2f0e06c9d9158ec8b37a2ac3cc6981)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula
d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-21 06:21:46 +05:30
Steve Loughran
897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e809a1889a0bcccc8c6f1ecdad13481.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula
f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-20 21:54:09 +05:30
Kihwal Lee
6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0cb824a8a2751bcd0dc3e15ce081727)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula
1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
(cherry picked from commit 5f754e8638d5a35ab12765edec6561228312f71c)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko
4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki
fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb7145860ecda394d764da5fc7063406fee)
(cherry picked from commit 1524e6320659df7d066ac96fd2c190d7a7c5b932)
 2016-10-18 10:32:16 -07:00
Xiao Chen
d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40effcdb26461a393379c6bddaa29bed)
 2016-10-18 10:16:30 -07:00
Yongjun Zhang
b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
(cherry picked from commit 96e68e722f0fe99d1609b38377014c04ef5b6640)
 2016-10-18 09:09:06 -07:00
Vinitha Reddy Gankidi
86f291f057 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 19:08:52 -07:00
Vinitha Reddy Gankidi
1fcaba9b14 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a739dc92cb90017d759217265a4fd969)
 2016-10-17 18:37:44 -07:00
Akira Ajisaka
8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
(cherry picked from commit 43cf0b29732ebafb8b5b23b06d6015fe4c7777b4)
 2016-10-13 14:32:47 +09:00
Andrew Wang
165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
(cherry picked from commit 67f0319db667ed724a3c19cc2ab745ef661fc5f8)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze
b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff15daa0efd09e98efd70351f474c8cb)
 2016-10-07 11:01:29 -07:00
Zhe Zhang
47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula
7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Wei-Chiu Chuang
039c3a7351 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-10-05 13:29:20 -07:00
Zhe Zhang
5c99959b2d HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 2016-10-04 16:52:56 -07:00
Kihwal Lee
3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:17:59 -05:00
Arpit Agarwal
c08346ea2d HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 
(cherry-picked from a349c54603c5cb7327d3bbb22285bd8e686c4790)
 2016-09-30 16:18:23 -07:00
Mingliang Liu
bdc97f74fe HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:49:30 -07:00
Brahma Reddy Battula
5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula
1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30