Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,247 Commits 326 Branches 371 Tags
Commit Graph

4275 Commits

Author SHA1 Message Date
Brahma Reddy Battula
cddd35e1f0 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin 
(cherry picked from commit be3cb10f5301c2d526d0ba37dbe82f426683a801)
 2016-10-07 22:19:21 +05:30
Kihwal Lee
e3a9666d28 HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. 2016-10-06 16:32:12 -05:00
Chris Nauroth
a28ffd0fde HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth. 
(cherry picked from commit 1d330fbaf6b50802750aa461640773fb788ef884)
 2016-10-06 13:22:35 -07:00
Mingliang Liu
7aee005c03 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-06 08:59:49 -07:00
Brahma Reddy Battula
d9e4ad78ca HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen 
(cherry picked from commit b90fc70d671481564e468550c770c925f25d7db0)
 2016-10-06 17:48:49 +05:30
Mingliang Liu
a868cf4046 Revert "HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu" 
This reverts commit 14bacd2b999c91a3f7a19b38fd63404e6f91c4a0.
 2016-10-05 23:10:28 -07:00
Mingliang Liu
14bacd2b99 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-05 22:54:27 -07:00
Wei-Chiu Chuang
434403a2a0 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca2169151a5eec57152775789b6f53664e102c)
 2016-10-05 17:46:46 -07:00
Andrew Wang
6b2a853dd7 HDFS-10962. TestRequestHedgingProxyProvider is flaky. 
(cherry picked from commit e68c7b96c76b243da53ae539e7c760bf2c08f26e)
 2016-10-05 15:09:11 -07:00
Kihwal Lee
b565fa8e05 HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96ee6b2a3909911c37bfddb0c963d5ffc)
 2016-10-04 15:26:42 -05:00
Kihwal Lee
a9a2f64e56 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:10:29 -05:00
Brahma Reddy Battula
560e524f93 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1561db13bd3b07a5f62815ec29e1cdf)
 2016-10-04 18:51:40 +05:30
Brahma Reddy Battula
c9df3c5f21 HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7fea1324973e7f69256bc53f31ee4cf7)
 2016-10-04 18:37:43 +05:30
Mingliang Liu
612aa0cc0b HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9610cbd09886359553f27d6480f6735)
 2016-10-03 22:47:09 -04:00
Mingliang Liu
d963ecb918 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:59:31 -04:00
Xiao Chen
d9b686a2bd HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157362661ccab10379c2d82e780382f83)
 2016-10-03 16:02:07 -07:00
Xiaoyu Yao
6f3744195d HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488fa5263d851cee578a2d319e6e52ecd)
 2016-10-03 11:00:15 -07:00
Kihwal Lee
03b797a6ac HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 744208431f7365bf054e6b773b86af2583001e1d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
 2016-10-03 11:41:19 -05:00
Kihwal Lee
ebfbce3b5f HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 10:48:14 -05:00
Kihwal Lee
2ee47f02cf HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b05230ad4a7fbd666d0177ecb107a4d6)
 2016-10-03 09:20:08 -05:00
Arpit Agarwal
6dd747b6bc Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9873ed32c63a62b39760126a123ed759c3222eb9.
 2016-09-30 23:12:07 -07:00
Arpit Agarwal
9873ed32c6 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:22 -07:00
Kihwal Lee
2551ff80b7 HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 2016-09-30 15:59:40 -05:00
Zhe Zhang
dfca0f4abb HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75dc3d87513e49290ac9999148ff5163c)
 2016-09-30 13:30:31 -07:00
Kihwal Lee
10222cd54e HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88852cd7c4d6774bff06c7c588558739)
 2016-09-30 08:58:38 -05:00
Mingliang Liu
a7c1636296 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 
(cherry picked from commit 84c626407925e03ee2ef11faba9324d5c55b8e93)
 2016-09-28 16:09:09 -07:00
Andrew Wang
b12f004474 HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 
(cherry picked from commit 92e5e9159850c01635091ea6ded0d8ee76691a9a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java
 2016-09-28 16:03:16 -07:00
Kihwal Lee
087c61192d HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 
(cherry picked from commit 5f34402adae191232fe78e62990396ca07f314bb)
 2016-09-28 17:58:53 -05:00
Arpit Agarwal
50888471d9 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:08 -07:00
Brahma Reddy Battula
e9a34ae29c HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-28 10:50:50 +05:30
Mingliang Liu
54ca505c41 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:42:47 -07:00
Wangda Tan
269401dc83 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
 2016-09-27 11:27:25 -07:00
Arpit Agarwal
80628ee2c3 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:22 -07:00
Masatake Iwasaki
d17f03b625 HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit f55eb981dd408ca61d49488f83c99c1fc1f83134)
 2016-09-28 01:40:55 +09:00
Arpit Agarwal
b3c0656e90 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:00:39 -07:00
Brahma Reddy Battula
61368c8039 HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:34:38 +05:30
Arpit Agarwal
809a45a60c HDFS-9895. Remove unnecessary conf cache from DataNode. Contributed by Xiaobing Zhou. 2016-09-26 19:24:16 -07:00
Wei-Chiu Chuang
bde787db23 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 3ae652f82110a52bf239f3c1849b48981558eb19)
 2016-09-26 14:44:48 -07:00
Brahma Reddy Battula
74962e3451 HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N 
(cherry picked from commit 3e37e243ee041e843e060b17c622ab50c8f9ff11)
 2016-09-25 11:04:30 +05:30
Wei-Chiu Chuang
6c98455728 HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy. 
(cherry picked from commit 74b3dd514c86b46197e2e19d9824a423715cab30)
 2016-09-23 13:28:18 -07:00
Konstantin V Shvachko
c872ecaab4 HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 
(cherry picked from commit a5bb88c8e0fd4bd19b6d377fecbe1d2d441514f6)
 2016-09-23 10:40:09 -07:00
Brahma Reddy Battula
347131fe8d HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 
(cherry picked from commit bbdf350ff9fb624fe736c1eb9271c5dcb4e14b06)
 2016-09-23 19:32:37 +05:30
Masatake Iwasaki
1b91ebb714 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java
 2016-09-21 10:40:56 +09:00
Xiao Chen
81df2be017 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
 2016-09-20 16:57:34 -07:00
Xiao Chen
4e376f162f HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen. 
(cherry picked from commit e52d6e7a46ceef74dd8d8a3d49c49420e3271365)
 2016-09-19 21:45:05 -07:00
Xiao Chen
b6a60d715d HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 
(cherry picked from commit ea839bd48e4478fc7b6d0a69e0eaeae2de5e0f0d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-09-19 16:38:18 -07:00
Andrew Wang
b03a0be7a3 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator. 
(cherry picked from commit 8a40953058d50d421d62b71067a13b626b3cba1f)
 2016-09-16 15:37:49 -07:00
Akira Ajisaka
214b6d16d5 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani. 
(cherry picked from commit b09a03cd7d26cf96ec26a81ba11f00778241eb3e)
 2016-09-16 16:12:19 +09:00
Arpit Agarwal
853e1e6946 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:24 -07:00
Andrew Wang
abaad976cd HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing. 
(cherry picked from commit db6d243cf89d25fefbffd4c8721e14d9246b5a16)
 2016-09-13 11:02:43 -07:00