Commit Graph

4253 Commits

Author SHA1 Message Date
Brahma Reddy Battula 64e532393b HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula
(cherry picked from commit 5f4ae85bd8)
2016-10-15 22:29:55 +05:30
Akira Ajisaka 35832901e8 HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J.
(cherry picked from commit 5ad037df25)
2016-10-15 22:17:55 +09:00
Vinitha Reddy Gankidi 863e1020c0 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi.
(cherry picked from commit 391ce535a7)
2016-10-14 18:25:52 -07:00
Lei Xu 78cb79fa91 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 15:00:27 -07:00
Mingliang Liu bbcbf78f0f HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu
(cherry picked from commit 76cc84e6d4)
2016-10-14 14:43:58 -07:00
Kihwal Lee 1c0f2ef82f Revert "HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)"
This reverts commit aa8593f923.
2016-10-14 16:38:25 -05:00
Lei Xu aa8593f923 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)
(cherry picked from commit 8c520a27cb)
2016-10-14 13:43:26 -07:00
Andrew Wang 86325e4346 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu.
(cherry picked from commit 0007360c33)
2016-10-14 11:41:36 -07:00
Benoy Antony 156b92e36b HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException
(cherry picked from commit 701c27a776)
2016-10-14 10:29:42 -07:00
Kihwal Lee 6e0b55fe79 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin.
(cherry picked from commit 8a9f6635a3)
2016-10-14 11:40:11 -05:00
Andrew Wang dc78e0e7fc Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin."
This reverts commit 2e153bc8ab.
2016-10-13 13:23:04 -07:00
Kihwal Lee c5a1303704 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula.
(cherry picked from commit 332a61fd74)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
2016-10-13 14:55:22 -05:00
Andrew Wang 2e153bc8ab HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin.
(cherry picked from commit fdce515091)
2016-10-13 11:42:03 -07:00
Brahma Reddy Battula b60e545a08 10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu
(cherry picked from commit 29aa11b1a252e007ed62fad362096ca43aa408af)
2016-10-13 21:41:25 +05:30
Kihwal Lee a6197c1fa8 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee.
(cherry picked from commit 9454dc5e80)
2016-10-13 08:48:33 -05:00
Akira Ajisaka 43cf0b2973 HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu.
(cherry picked from commit 901eca004d)
2016-10-13 14:30:45 +09:00
Mingliang Liu b36aaa913c HDFS-10903. Replace config key literal strings with config key names II: hadoop hdfs. Contributed by Chen Liang 2016-10-12 17:26:11 -07:00
Kihwal Lee 5305a392c3 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
(cherry picked from commit 85cd06f663)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-10-12 15:22:51 -05:00
Mingliang Liu e341e5151a HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou
(cherry picked from commit f340d286d441d78c847722b529939b78abf9d2f3)
2016-10-11 19:59:36 -07:00
Xiaoyu Yao 2c77aca782 HDFS-10984. Expose nntop output as metrics. Contributed by Siddharth Wagle.
(cherry picked from commit 61f0490a73)
2016-10-11 15:56:12 -07:00
Andrew Wang a52c33fdb8 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore.
(cherry picked from commit dacd3ec66b)
2016-10-11 15:07:22 -07:00
Wei-Chiu Chuang 402856a8a7 HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. 2016-10-11 13:18:48 -07:00
Mingliang Liu 11e748394d HDFS-10988. Refactor TestBalancerBandwidth. Contributed by Brahma Reddy Battula
(cherry picked from commit b963818621)
2016-10-10 13:23:10 -07:00
Mingliang Liu 6c137ea94e HDFS-10972. Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'. Contributed by Xiaobing Zhou
(cherry picked from commit 3441c746b5)
2016-10-10 11:45:43 -07:00
Xiao Chen 5c96ef365d HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory.
(cherry picked from commit 3ea027e970ec7c95a10e581435cdb6c3a6b64abb)
2016-10-07 17:37:23 -07:00
Kihwal Lee 7f05306895 HDFS-10980. Optimize check for existence of parent directory. Contributed by Daryn Sharp.
(cherry picked from commit e57fa81d95)
2016-10-07 17:21:28 -05:00
Kihwal Lee 5ea87e4aeb HDFS-10979. Pass IIP for FSDirDeleteOp methods. Contributed by Daryn Sharp.
(cherry picked from commit 3565c9af17)
2016-10-07 14:35:28 -05:00
Kihwal Lee 76c03acc6d HDFS-10939. Reduce performance penalty of encryption zones. Contributed by Daryn Sharp. 2016-10-07 13:20:05 -05:00
Brahma Reddy Battula cddd35e1f0 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin
(cherry picked from commit be3cb10f53)
2016-10-07 22:19:21 +05:30
Kihwal Lee e3a9666d28 HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. 2016-10-06 16:32:12 -05:00
Chris Nauroth a28ffd0fde HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
(cherry picked from commit 1d330fbaf6)
2016-10-06 13:22:35 -07:00
Mingliang Liu 7aee005c03 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-06 08:59:49 -07:00
Brahma Reddy Battula d9e4ad78ca HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
(cherry picked from commit b90fc70d67)
2016-10-06 17:48:49 +05:30
Mingliang Liu a868cf4046 Revert "HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu"
This reverts commit 14bacd2b99.
2016-10-05 23:10:28 -07:00
Mingliang Liu 14bacd2b99 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-05 22:54:27 -07:00
Wei-Chiu Chuang 434403a2a0 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
(cherry picked from commit c5ca216915)
2016-10-05 17:46:46 -07:00
Andrew Wang 6b2a853dd7 HDFS-10962. TestRequestHedgingProxyProvider is flaky.
(cherry picked from commit e68c7b96c7)
2016-10-05 15:09:11 -07:00
Kihwal Lee b565fa8e05 HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp.
(cherry picked from commit 44f48ee96e)
2016-10-04 15:26:42 -05:00
Kihwal Lee a9a2f64e56 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah.
(cherry picked from commit 382307cbdd)
2016-10-04 11:10:29 -05:00
Brahma Reddy Battula 560e524f93 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore
(cherry picked from commit ef7f06f7d1)
2016-10-04 18:51:40 +05:30
Brahma Reddy Battula c9df3c5f21 HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N
(cherry picked from commit 5ea0210c7f)
2016-10-04 18:37:43 +05:30
Mingliang Liu 612aa0cc0b HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger
(cherry picked from commit f61e3d13e9)
2016-10-03 22:47:09 -04:00
Mingliang Liu d963ecb918 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:59:31 -04:00
Xiao Chen d9b686a2bd HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
(cherry picked from commit 853d65a157)
2016-10-03 16:02:07 -07:00
Xiaoyu Yao 6f3744195d HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu.
(cherry picked from commit 607705c488)
2016-10-03 11:00:15 -07:00
Kihwal Lee 03b797a6ac HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp.
(cherry picked from commit 744208431f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
2016-10-03 11:41:19 -05:00
Kihwal Lee ebfbce3b5f HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 10:48:14 -05:00
Kihwal Lee 2ee47f02cf HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp.
(cherry picked from commit 90020624b0)
2016-10-03 09:20:08 -05:00
Arpit Agarwal 6dd747b6bc Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock."
This reverts commit 9873ed32c6.
2016-09-30 23:12:07 -07:00
Arpit Agarwal 9873ed32c6 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:22 -07:00