Tsz-wo Sze
b2976af140
HDFS-5157. Add StorageType to FsVolume. Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521743 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 06:30:01 +00:00
Arpit Agarwal
23bf148a2f
Merging r1520450 through r1521565 from trunk to branch HDFS-2832
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521566 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 18:03:08 +00:00
Colin McCabe
3a9cd79e9d
HDFS-5120. Add command-line support for manipulating cache pools.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1521240 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 18:53:01 +00:00
Andrew Wang
4f2bf68b73
HDFS-5170. BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging. (Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520961 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 04:54:57 +00:00
Tsz-wo Sze
282be1b38e
HDFS-5134. Move blockContentsStale, heartbeatedSinceFailover and firstBlockReport from DatanodeDescriptor to DatanodeStorageInfo; and fix a synchronization problem in DatanodeStorageInfo.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520938 13f79535-47bb-0310-9956-ffa450edef68
2013-09-08 22:53:36 +00:00
Andrew Wang
efc1048ffe
Revert HADOOP-9877 because of breakage reported in HADOOP-9912
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520713 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 22:57:44 +00:00
Colin McCabe
7a74ca3694
HDFS-5169. hdfs.c: translateZCRException: null pointer deref when translating some exceptions (Contributed by Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1520679 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 20:07:38 +00:00
Colin McCabe
6431192c0e
HDFS-4879. Add BlockedArrayList collection to avoid CMS full GCs (Contributed by Todd Lipcon)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520667 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 19:05:26 +00:00
Colin McCabe
f41f8b8842
HDFS-5163. Miscellaneous cache pool RPC fixes (Contributed by Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1520665 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 18:52:50 +00:00
Jing Zhao
36d0b822ef
HDS-5118. Provide testing support for DFSClient to drop RPC responses. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520637 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 17:17:30 +00:00
Colin McCabe
a628391955
HDFS-5164. DeleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock (contributed by Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520492 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 05:23:54 +00:00
Chris Nauroth
e10dbf41bc
HDFS-4491. Add/delete files missed in prior commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520482 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 03:14:20 +00:00
Chris Nauroth
5eb618ee1f
HDFS-4491. Parallel testing HDFS. Contributed by Andrey Klochkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520479 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 03:06:41 +00:00
Arpit Agarwal
bbce64c8c5
Merging r1519884 through r1520449 from trunk to branch HDFS-2832
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520454 13f79535-47bb-0310-9956-ffa450edef68
2013-09-05 23:01:00 +00:00
Aaron Myers
8aea748ec3
HDFS-5159. Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520363 13f79535-47bb-0310-9956-ffa450edef68
2013-09-05 16:21:26 +00:00
Colin McCabe
d56d0b46e1
commit correct version of HDFS-5121
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1520090 13f79535-47bb-0310-9956-ffa450edef68
2013-09-04 18:23:51 +00:00
Arpit Agarwal
f353769d0c
Merging r1518852 through r1519883 from trunk to branch HDFS-2832
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519885 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 23:20:45 +00:00
Arpit Agarwal
ec57e3019f
Merge r1518851 from trunk (reconcile branch conflicts with the fix for HDFS-5077)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519882 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 23:15:28 +00:00
Colin McCabe
97b7267977
HDFS-5121. Add RPCs for creating and manipulating cache pools. (Contributed by Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1519841 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 20:38:45 +00:00
Andrew Wang
fde0e615f2
Add missing file from HDFS-5141
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1519819 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 19:56:31 +00:00
Tsz-wo Sze
336c0344f5
Merge r1517887 through r1518850 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519796 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 19:01:19 +00:00
Tsz-wo Sze
3f070e83b1
HDFS-5009. Include storage information in the LocatedBlock.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519691 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 14:03:35 +00:00
Kihwal Lee
c28c964612
HDFS-5150. Allow per NN SPN for internal SPNEGO. Contributed By Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519681 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 13:49:25 +00:00
Tsz-wo Sze
f7e3bc553d
HDFS-5154. Fix TestBlockManager and TestDatanodeDescriptor after HDFS-4987. Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519548 13f79535-47bb-0310-9956-ffa450edef68
2013-09-03 04:04:22 +00:00
Andrew Wang
fc14a92c6b
HDFS-5141. Add cache status information to datanode heartbeat. (Contributed by Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1519101 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 22:15:51 +00:00
Jing Zhao
25d4c2fd53
HDFS-5140. Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518899 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 07:36:45 +00:00
Suresh Srinivas
daa0713eb0
HDFS-5144. Document time unit to NameNodeMetrics. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518895 13f79535-47bb-0310-9956-ffa450edef68
2013-08-30 07:01:47 +00:00
Konstantin Shvachko
eb484bb562
HDFS-5077. NPE in FSNamesystem.commitBlockSynchronization(). Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518851 13f79535-47bb-0310-9956-ffa450edef68
2013-08-29 23:08:02 +00:00
Tsz-wo Sze
5d9d702607
HDFS-4987. Namenode changes to track multiple storages per datanode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1518087 13f79535-47bb-0310-9956-ffa450edef68
2013-08-28 06:30:15 +00:00
Kihwal Lee
dfaa2e305d
Adding the new test file for HDFS-3245 that was accidentally dropped
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517994 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 21:14:12 +00:00
Kihwal Lee
1bfcab9689
HDFS-5132. Deadlock in NameNode between SafeModeMonitor#run and DatanodeManager#handleHeartbeat. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517989 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 21:04:24 +00:00
Kihwal Lee
10a62366a5
HDFS-5128. Allow multiple net interfaces to be used with HA namenode RPC server. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517981 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 20:53:31 +00:00
Kihwal Lee
39252995c4
HDFS-3245. Add metrics and web UI for cluster version summary. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517937 13f79535-47bb-0310-9956-ffa450edef68
2013-08-27 19:21:15 +00:00
Arpit Agarwal
395f0ae567
HDFS-5000. DataNode configuration should allow specifying storage type (Adding file missed in last commit
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517499 13f79535-47bb-0310-9956-ffa450edef68
2013-08-26 11:32:26 +00:00
Arpit Agarwal
73d14311bc
HDFS-5000. DataNode configuration should allow specifying storage type
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517417 13f79535-47bb-0310-9956-ffa450edef68
2013-08-26 03:18:40 +00:00
Colin McCabe
b992219fa1
HDFS-5050. Add DataNode support for mlock and munlock (contributed by Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1517106 13f79535-47bb-0310-9956-ffa450edef68
2013-08-24 03:41:25 +00:00
Arpit Agarwal
c41df254fe
Merge all changes from trunk to branch HDFS-2832
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517030 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 20:57:00 +00:00
Jonathan Turner Eagles
e588ffe3c0
HDFS-4329. DFSShell issues with directories with spaces in name (Cristina L. Abad via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516904 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 15:48:43 +00:00
Jing Zhao
7cfbfe52f1
HDFS-5124. DelegationTokenSecretManager#retrievePassword can cause deadlock in NameNode. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516671 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 00:55:53 +00:00
Colin McCabe
920b4cc06f
HDFS-5052. Add cacheRequest/uncacheRequest support to NameNode. (Contributed by Colin Patrick McCabe.)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1516669 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 23:37:51 +00:00
Arpit Agarwal
6f699e8ea5
HDFS-5115. Make StorageID a UUID.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516666 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 23:21:07 +00:00
Jing Zhao
6fd8766a51
HDFS-5045. Add more unit tests for retry cache to cover all AtMostOnce methods. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516348 13f79535-47bb-0310-9956-ffa450edef68
2013-08-22 01:06:57 +00:00
Arpit Agarwal
5e27288c1e
HDFS-4985. Add storage type to the protocol and expose it in block report and block locations
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516323 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 23:07:29 +00:00
Kihwal Lee
2499a86664
HDFS-4994. Audit log getContentSummary() calls. Contributed by Robert Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516237 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 18:15:26 +00:00
Luke Lu
782191f1ba
HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516128 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 10:12:13 +00:00
Chris Nauroth
5e68bc4cd6
HDFS-4594. WebHDFS open sets Content-Length header to what is specified by length parameter rather than how much data is actually returned. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515989 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 22:15:22 +00:00
Andrew Wang
b7a6c5ebb4
HADOOP-9877. Fix listing of snapshot directories in globStatus. (Binglin Chang via Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515955 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 20:19:07 +00:00
Andrew Wang
67f86baab0
HDFS-4953. Enable HDFS local reads via mmap. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1515906 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 18:07:47 +00:00
Arpit Agarwal
3015429368
HDFS-2933. Improve DataNode Web UI Index Page. (Vivek Ganesan via Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515890 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 17:18:53 +00:00
Brandon Li
214d4377fc
HDFS-5104 Support dotdot name in NFS LOOKUP operation. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515042 13f79535-47bb-0310-9956-ffa450edef68
2013-08-17 21:16:50 +00:00
Jing Zhao
52f0259502
HADOOP-9880. SASL changes from HADOOP-9421 breaks Secure HA NN. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514913 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 22:35:19 +00:00
Chris Nauroth
9ba95136e2
HDFS-5106. TestDatanodeBlockScanner fails on Windows due to incorrect path format. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514911 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 22:28:41 +00:00
Arpit Agarwal
218ea7380c
HDFS-5105. TestFsck fails on Windows. (Contributed by Chuan Liu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514852 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 19:04:43 +00:00
Jing Zhao
8d21926c26
HDFS-5102. Snapshot names should not be allowed to contain slash characters. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514797 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 17:14:34 +00:00
Chris Nauroth
d9de6a928d
HDFS-5103. TestDirectoryScanner fails on Windows. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514576 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 04:38:03 +00:00
Chris Nauroth
99064ec905
HDFS-5100. TestNamenodeRetryCache fails on Windows due to incorrect cleanup. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514573 13f79535-47bb-0310-9956-ffa450edef68
2013-08-16 04:17:08 +00:00
Colin McCabe
8df7e7deec
HADOOP-9865. FileContext#globStatus has a regression with respect to relative path. (Contributed by Chaun Lin)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514531 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 23:05:41 +00:00
Konstantin Shvachko
10ec8a248e
HDFS-2994. If lease soft limit is recovered successfully the append can fail. Contributed by Tao Luo.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514500 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 21:21:10 +00:00
Chris Nauroth
2fc7e14e39
HDFS-5099. Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514481 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 20:43:46 +00:00
Jing Zhao
02b19e0738
HDFS-5076. Add MXBean methods to query NN's transaction information and JournalNode's journal status. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514422 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 18:22:52 +00:00
Jing Zhao
8172215e56
HDFS-5080. BootstrapStandby not working with QJM when the existing NN is active. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514386 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 17:19:52 +00:00
Chris Nauroth
26c5a490e5
HDFS-5093. TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514366 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 16:51:07 +00:00
Chris Nauroth
97d04ae132
HDFS-4632. globStatus using backslash for escaping does not work on Windows. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514168 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 06:03:07 +00:00
Tsz-wo Sze
0182ea16d3
HDFS-4898. BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514156 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 04:52:52 +00:00
Konstantin Shvachko
4c8db60092
HDFS-5079. Cleaning up NNHAStatusHeartbeat.State from DatanodeProtocolProtos. Contributed by Tao Luo.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514118 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 01:29:16 +00:00
Konstantin Shvachko
9cf82b6a7b
HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514114 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 01:12:21 +00:00
Suresh Srinivas
b32ace11f1
HDFS-5051. nn fails to download checkpointed image from snn in some setups. Contributed by Vinay and Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514110 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 00:45:48 +00:00
Andrew Wang
dd00bb71aa
merge trunk into HDFS-4949 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1514105 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 00:15:11 +00:00
Andrew Wang
49a892056d
HDFS-4816. transitionToActive blocks if the SBN is doing checkpoint image transfer. (Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514095 13f79535-47bb-0310-9956-ffa450edef68
2013-08-14 23:32:29 +00:00
Alejandro Abdelnur
8451ab5c01
HADOOP-9872. Improve protoc version handling and detection. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514068 13f79535-47bb-0310-9956-ffa450edef68
2013-08-14 22:15:04 +00:00
Jing Zhao
2bea314456
HDFS-5091. Support for spnego keytab separate from the JournalNode keytab for secure HA. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513700 13f79535-47bb-0310-9956-ffa450edef68
2013-08-14 00:19:35 +00:00
Doug Cutting
36cedca874
HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS. Contributed by Allan Yan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513684 13f79535-47bb-0310-9956-ffa450edef68
2013-08-13 23:04:55 +00:00
Colin McCabe
70527c8754
merge trunk into HDFS-4949 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513658 13f79535-47bb-0310-9956-ffa450edef68
2013-08-13 21:19:53 +00:00
Colin McCabe
52ccc6c6d5
HDFS-5051. Propagate cache status information from the DataNode to the NameNode (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513653 13f79535-47bb-0310-9956-ffa450edef68
2013-08-13 21:05:09 +00:00
Alejandro Abdelnur
19b36f0900
HADOOP-9845. Update protobuf to 2.5 from 2.4.x. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513281 13f79535-47bb-0310-9956-ffa450edef68
2013-08-12 22:15:10 +00:00
Andrew Wang
d748123e2c
TestGlobPath symlink tests fail to cleanup properly. (cmccabe via wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513251 13f79535-47bb-0310-9956-ffa450edef68
2013-08-12 20:44:23 +00:00
Ivan Mitic
5726834cae
HDFS-5065. TestSymlinkHdfsDisable fails on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512870 13f79535-47bb-0310-9956-ffa450edef68
2013-08-11 04:38:19 +00:00
Kihwal Lee
2f988135e3
HDFS-4993. Fsck can fail if a file is renamed or deleted. Contributed by Robert Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512451 13f79535-47bb-0310-9956-ffa450edef68
2013-08-09 19:13:22 +00:00
Colin McCabe
2a4031940c
HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1512427 13f79535-47bb-0310-9956-ffa450edef68
2013-08-09 18:14:07 +00:00
Kihwal Lee
81f9786ae6
HDFS-5047. Supress logging of full stack trace of quota and lease exceptions. Contributed by Robert Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512057 13f79535-47bb-0310-9956-ffa450edef68
2013-08-08 21:46:34 +00:00
Brandon Li
6c65076e8e
HDFS-4763 Add script changes/utility for starting NFS gateway
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511519 13f79535-47bb-0310-9956-ffa450edef68
2013-08-07 22:21:42 +00:00
Jing Zhao
54e144059e
HDFS-4926. namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link. Contributed by Vivek Ganesan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511477 13f79535-47bb-0310-9956-ffa450edef68
2013-08-07 20:34:39 +00:00
Andrew Wang
95f9a515aa
HADOOP-9817. FileSystem#globStatus and FileContext#globStatus need to work with symlinks. (Colin Patrick McCabe via Andrew Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510807 13f79535-47bb-0310-9956-ffa450edef68
2013-08-05 23:28:14 +00:00
Chris Nauroth
ed2c62012a
HDFS-4905. Add appendToFile command to "hdfs dfs". Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510773 13f79535-47bb-0310-9956-ffa450edef68
2013-08-05 22:05:10 +00:00
Kihwal Lee
ccdb978603
HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. Contributed by Derek Dagit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510724 13f79535-47bb-0310-9956-ffa450edef68
2013-08-05 20:48:59 +00:00
Suresh Srinivas
390d689816
HDFS-5061. Make FSNameSystem#auditLoggers an unmodifiable list. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510611 13f79535-47bb-0310-9956-ffa450edef68
2013-08-05 17:08:09 +00:00
Colin McCabe
f216f22915
HADOOP-9761. ViewFileSystem#rename fails when using DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509874 13f79535-47bb-0310-9956-ffa450edef68
2013-08-02 21:42:38 +00:00
Tsz-wo Sze
c04a7d974a
HDFS-5028. LeaseRenewer throws ConcurrentModificationException when timeout. Contributed by zhaoyunjiong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509565 13f79535-47bb-0310-9956-ffa450edef68
2013-08-02 07:08:35 +00:00
Tsz-wo Sze
1f2d08fbe5
HDFS-4513. Clarify in the WebHDFS REST API that all JSON respsonses may contain additional properties.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509075 13f79535-47bb-0310-9956-ffa450edef68
2013-08-01 03:47:39 +00:00
Tsz-wo Sze
134557da47
HADOOP-9803. Add a generic type parameter to RetryInvocationHandler.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509070 13f79535-47bb-0310-9956-ffa450edef68
2013-08-01 02:20:33 +00:00
Colin McCabe
9ad19eec6f
HADOOP-9758. Provide configuration option for FS/FC symlink resolution. (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509064 13f79535-47bb-0310-9956-ffa450edef68
2013-08-01 01:04:29 +00:00
Brandon Li
4f68aa0600
HDFS-5043. For HdfsFileStatus, set default value of childrenNum to -1 instead of 0 to avoid confusing applications. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508694 13f79535-47bb-0310-9956-ffa450edef68
2013-07-31 00:49:47 +00:00
Suresh Srinivas
8c7a7e6196
HDFS-5025. Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508332 13f79535-47bb-0310-9956-ffa450edef68
2013-07-30 07:51:38 +00:00
Aaron Myers
215d6331d6
HDFS-5027. On startup, DN should scan volumes in parallel. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508165 13f79535-47bb-0310-9956-ffa450edef68
2013-07-29 18:28:07 +00:00
Konstantin Boudnik
dc17bda4b6
HDFS-5004. Add additional JMX bean for NameNode status data. Contributed by Trevor Lorimer.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507530 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 23:59:37 +00:00
Colin McCabe
02d5830a00
HDFS-5035. getFileLinkStatus and rename do not correctly check permissions of symlinks (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507525 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 23:54:17 +00:00
Colin McCabe
07b076917e
HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507406 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 19:21:31 +00:00
Colin McCabe
55dfadec80
reverting HDFS-5034 because jenkins did not run on it
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507373 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 17:20:18 +00:00
Colin McCabe
569e609c38
HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507369 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 17:13:11 +00:00
Tsz-wo Sze
a690a215db
HADOOP-9756. Remove the deprecated getServer(..) methods from RPC. Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507259 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 10:59:20 +00:00
Suresh Srinivas
7723b139d5
HDFS-5016. Deadlock in pipeline recovery causes Datanode to be marked dead. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507189 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 04:42:41 +00:00
Suresh Srinivas
1b531c1dbb
HDFS-4979. Implement retry cache on Namenode. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507170 13f79535-47bb-0310-9956-ffa450edef68
2013-07-26 01:09:27 +00:00
Jing Zhao
f138ae68f9
HDFS-5024. Make DatanodeProtocol#commitBlockSynchronization idempotent. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506789 13f79535-47bb-0310-9956-ffa450edef68
2013-07-25 00:32:40 +00:00
Jing Zhao
538653d94c
HDFS-5020. Make DatanodeProtocol#blockReceivedAndDeleted idempotent. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506421 13f79535-47bb-0310-9956-ffa450edef68
2013-07-24 07:18:11 +00:00
Suresh Srinivas
d35f66f3f0
HDFS-4974. Add Idempotent and AtMostOnce annotations to namenode protocol methods. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505911 13f79535-47bb-0310-9956-ffa450edef68
2013-07-23 06:40:33 +00:00
Suresh Srinivas
9dbd2e7efc
HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505875 13f79535-47bb-0310-9956-ffa450edef68
2013-07-23 01:40:58 +00:00
Jing Zhao
11c073134a
HDFS-5008. Make ClientProtocol#abandonBlock() idempotent. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505761 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 18:22:38 +00:00
Colin McCabe
c1314eb2a3
HDFS-4817. Make HDFS advisory caching configurable on a per-file basis. (Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505753 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 18:15:18 +00:00
Colin McCabe
74906216fe
HADOOP-9435. Support building the JNI code against the IBM JVM. (Tian Hong Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505744 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 17:52:03 +00:00
Tsz-wo Sze
3eb61be352
HADOOP-9754. Remove unnecessary "throws IOException/InterruptedException", and fix generic and other javac warnings.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505610 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 07:22:14 +00:00
Jing Zhao
febcf4d669
HDFS-5018. Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale(). Contributed by Ted Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505603 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 05:28:36 +00:00
Uma Maheswara Rao G
731a583c2b
HDFS-4602. TestBookKeeperHACheckpoints fails. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505362 13f79535-47bb-0310-9956-ffa450edef68
2013-07-21 12:27:38 +00:00
Kihwal Lee
313dd02505
HDFS-5010. Reduce the frequency of getCurrentUser() calls from namenode. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505160 13f79535-47bb-0310-9956-ffa450edef68
2013-07-20 16:22:11 +00:00
Harsh J
0dc5824a83
HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is disabled but security is turned on. Contributed by Kousuke Saruta. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504784 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 07:00:40 +00:00
Jing Zhao
7e2aba0ab5
HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504764 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 05:41:33 +00:00
Chris Nauroth
e2efe52ac8
HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 21:57:24 +00:00
Chris Nauroth
a5cd4b9bee
HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 03:28:19 +00:00
Jing Zhao
68faa67f1b
HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 00:04:28 +00:00
Kihwal Lee
d26334b410
HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 01:57:35 +00:00
Jason Darrell Lowe
febc5040b9
HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503954 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 00:06:48 +00:00
Colin McCabe
badab7ed5e
HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503862 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 20:07:42 +00:00
Colin McCabe
32076136f7
HADOOP-9618. thread which detects GC pauses (Todd Lipcon via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503806 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 17:48:24 +00:00
Tsz-wo Sze
2d6049f1d6
HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 14:04:33 +00:00
Suresh Srinivas
afaec5f52d
HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 06:33:40 +00:00
Todd Lipcon
0880be20ac
HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502682 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 20:44:45 +00:00
Suresh Srinivas
b47df4e3b9
HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 17:44:00 +00:00
Jing Zhao
3630a23c55
HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 00:11:31 +00:00
Colin McCabe
8767e4cde1
HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 21:31:04 +00:00
Chris Nauroth
2409882a47
HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:20:38 +00:00
Chris Nauroth
19346d8ca6
HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502328 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:04:26 +00:00
Chris Nauroth
da8e962e39
HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 05:35:29 +00:00
Alejandro Abdelnur
c6eaa8b37f
HDFS-4969. WebhdfsFileSystem expects non-standard WEBHDFS Json element. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501868 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:32:05 +00:00
Kihwal Lee
3a3109f8bf
HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501841 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 16:39:37 +00:00
Tsz-wo Sze
6770de7ec4
HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500580 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 05:29:10 +00:00
Harsh J
81620ca1c9
HADOOP-8844. Add a plaintext fs -text test-case. Contributed by Akira AJISAKA. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500190 13f79535-47bb-0310-9956-ffa450edef68
2013-07-06 02:16:27 +00:00
Konstantin Boudnik
ed70fb1608
HDFS-4860. Add additional attributes to JMX beans. Contributed by Trevor Lorimer
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500139 13f79535-47bb-0310-9956-ffa450edef68
2013-07-05 21:36:20 +00:00
Aaron Myers
5428bfbf53
HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499659 13f79535-47bb-0310-9956-ffa450edef68
2013-07-04 05:52:13 +00:00
Tsz-wo Sze
05fd0a706a
HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498962 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 14:58:35 +00:00
Colin McCabe
6735b70b4a
HADOOP-9414. Refactor out FSLinkResolver and relevant helper methods.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 22:09:52 +00:00
Kihwal Lee
ead7fa0413
HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498665 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 20:20:27 +00:00
Tsz-wo Sze
feb5b9641d
HDFS-4797. BlockScanInfo does not override equals(..) and hashCode() consistently.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498202 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 01:28:22 +00:00
Chris Nauroth
750442812c
HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498055 13f79535-47bb-0310-9956-ffa450edef68
2013-06-30 03:38:09 +00:00
Colin McCabe
b6c7de68bc
HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497176 13f79535-47bb-0310-9956-ffa450edef68
2013-06-27 01:22:43 +00:00
Chris Nauroth
ca1058b27a
HDFS-4932. Avoid a wide line on the name node webUI if we have more Journal nodes. Contributed by Fengdong Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497141 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 22:20:31 +00:00
Colin McCabe
03601136dd
HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496690 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 00:35:39 +00:00
Chris Nauroth
d74908bdb6
HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496350 13f79535-47bb-0310-9956-ffa450edef68
2013-06-25 05:05:20 +00:00
Jason Darrell Lowe
1087be1df4
HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495648 13f79535-47bb-0310-9956-ffa450edef68
2013-06-22 00:41:34 +00:00
Sanjay Radia
6cb5ad16d0
HADOOP-9619 Mark stability of .proto files (sanjay Radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495564 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 19:53:21 +00:00
Konstantin Shvachko
92cbba386f
HDFS-4883. complete() should verify fileId. Contributed by Tao Luo.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495302 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 07:28:38 +00:00
Brandon Li
6ecf78a99b
HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495253 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 00:32:23 +00:00
Tsz-wo Sze
c02953dbc3
HDFS-4908. Reduce snapshot inode memory usage.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494858 13f79535-47bb-0310-9956-ffa450edef68
2013-06-20 05:10:39 +00:00
Tsz-wo Sze
c68b1d1b31
HDFS-4914. Use DFSClient.Conf instead of Configuration.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494854 13f79535-47bb-0310-9956-ffa450edef68
2013-06-20 04:43:07 +00:00
Suresh Srinivas
571aa3900c
HDFS-4917. Start-dfs.sh cannot pass the parameters correctly. Contributed by Fengdong Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494433 13f79535-47bb-0310-9956-ffa450edef68
2013-06-19 03:53:10 +00:00
Colin McCabe
57006e1c8c
HDFS-4461. DirectoryScanner: volume prefix takes up memory for every block that is scanned (Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494401 13f79535-47bb-0310-9956-ffa450edef68
2013-06-19 00:34:08 +00:00
Aaron Myers
1c309f763b
HDFS-4906. HDFS Output streams should not accept writes after being closed. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494303 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 21:05:16 +00:00
Chris Nauroth
364b379cb8
HDFS-4818. Several HDFS tests that attempt to make directories unusable do not work correctly on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494023 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 04:47:16 +00:00
Colin McCabe
52ebd9c389
HDFS-4626. ClientProtocol#getLinkTarget should throw an exception for non-symlink and non-existent paths. (Andrew Wang via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493980 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 01:07:13 +00:00
Jing Zhao
eff5e6da1d
HDFS-4875. Add a test for testing snapshot file length. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493850 13f79535-47bb-0310-9956-ffa450edef68
2013-06-17 17:23:45 +00:00
Chris Nauroth
5694c34040
HDFS-4866. Protocol buffer support cannot compile under C. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493300 13f79535-47bb-0310-9956-ffa450edef68
2013-06-15 03:52:40 +00:00
Chris Nauroth
0d1a994fbb
HDFS-4904. Remove JournalService. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493235 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 20:27:17 +00:00
Chris Nauroth
0ef156a86e
HDFS-4783. TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493149 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 16:44:22 +00:00
Tsz-wo Sze
4cd605413a
HDFS-4845. FSNamesystem.deleteInternal should acquire write-lock before changing the inode map. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492941 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 03:12:08 +00:00
Jing Zhao
7e1744ccf9
HDFS-4902. DFSClient#getSnapshotDiffReport should use string path rather than o.a.h.fs.Path. Contributed by Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492791 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 18:11:42 +00:00
Chris Nauroth
c5821cf38b
HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492297 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 17:21:47 +00:00
Tsz-wo Sze
f9186f3ae8
HDFS-4819. Update Snapshot doc to clarify that nested snapshots are not allowed.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492062 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 05:43:35 +00:00
Jing Zhao
390eca2cde
HDFS-4873. callGetBlockLocations returns incorrect number of blocks for snapshotted files. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491957 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 21:03:09 +00:00
Konstantin Shvachko
8e0f166cf3
HDFS-4878. On Remove Block, block is not removed from neededReplications queue. Contributed by Tao Luo.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491671 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 01:39:32 +00:00
Suresh Srinivas
8e23270e0d
HDFS-4752. TestRBWBlockInvalidation fails on Windows due to file locking. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491631 13f79535-47bb-0310-9956-ffa450edef68
2013-06-10 22:37:36 +00:00
Ivan Mitic
cb11d68f40
HDFS-4677. Editlog should support synchronous writes. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491096 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 23:28:37 +00:00
Kihwal Lee
2a76cddcd5
HDFS-4832. Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490803 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 20:01:55 +00:00
Suresh Srinivas
a764da16d6
HDFS-4880. Print the image and edits file loaded by the namenode in the logs. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490746 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 17:35:34 +00:00
Kihwal Lee
0e889e77c5
HDFS-4862. SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490486 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 01:15:28 +00:00
Konstantin Shvachko
8854c210bd
HDFS-4867. metaSave NPEs when there are invalid blocks in repl queue. Contributed by Plamen Jeliazkov and Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490433 13f79535-47bb-0310-9956-ffa450edef68
2013-06-06 20:44:40 +00:00
Jing Zhao
d46e160862
HDFS-4877. Snapshot: fix the scenario where a directory is renamed under its prior descendant. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490421 13f79535-47bb-0310-9956-ffa450edef68
2013-06-06 20:15:07 +00:00
Jing Zhao
496b80b28c
HDFS-4850. Fix OfflineImageViewer to work on fsimages with empty files or snapshots. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490080 13f79535-47bb-0310-9956-ffa450edef68
2013-06-05 23:32:53 +00:00
Tsz-wo Sze
e00f828b11
HDFS-4876. Fix the javadoc of FileWithSnapshot and move FileDiffList to FileWithSnapshot.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489708 13f79535-47bb-0310-9956-ffa450edef68
2013-06-05 05:26:32 +00:00
Aaron Myers
8171203692
HDFS-4815. TestRBWBlockInvalidation: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed. Contributed by Tian Hong Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489668 13f79535-47bb-0310-9956-ffa450edef68
2013-06-04 23:01:37 +00:00
Kihwal Lee
c4382e7565
HDFS-4840. ReplicationMonitor gets NPE during shutdown. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489634 13f79535-47bb-0310-9956-ffa450edef68
2013-06-04 21:43:08 +00:00
Colin McCabe
4ee1ec2126
Remove extra code that code erroneously committed in HDFS-3934 (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489083 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 17:58:44 +00:00
Colin McCabe
4c13c986e1
Add needed file for HDFS-3934 (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489068 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 17:29:37 +00:00
Colin McCabe
a7bfb25d2b
HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489065 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 17:14:27 +00:00
Jason Darrell Lowe
85623a2d75
HADOOP-9287. Parallel-testing hadoop-common. Contributed by Andrey Klochkov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488040 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 22:43:16 +00:00
Brandon Li
bf99961d67
HDFS-4848. copyFromLocal and renaming a file to .snapshot should output that .snapshot is a reserved name. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487942 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 17:26:25 +00:00
Jing Zhao
a0abed41a0
HDFS-4863. The root directory should be added to the snapshottable directory list while loading fsimage. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487698 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 01:38:54 +00:00
Jing Zhao
01f27f5c23
HDFS-4857. Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487655 13f79535-47bb-0310-9956-ffa450edef68
2013-05-29 22:22:44 +00:00
Brandon Li
719034c12c
HDFS-4846. Clean up snapshot CLI commands output stacktrace for invalid arguments. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487647 13f79535-47bb-0310-9956-ffa450edef68
2013-05-29 21:25:01 +00:00
Jing Zhao
973017cab7
HDFS-4842. Identify the correct prior snapshot when deleting a snapshot under a renamed subtree. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487643 13f79535-47bb-0310-9956-ffa450edef68
2013-05-29 20:54:53 +00:00
Devaraj Das
4bb72210c2
HDFS-4827. Slight update to the implementation of API for handling favored nodes in DFSClient. Contributed by Devaraj Das.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487093 13f79535-47bb-0310-9956-ffa450edef68
2013-05-28 20:17:39 +00:00
Kihwal Lee
45b9d19f9d
HDFS-4780. Use the correct relogin method for services. Contributed by Robert Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1486974 13f79535-47bb-0310-9956-ffa450edef68
2013-05-28 15:47:56 +00:00
Kihwal Lee
359ea88016
HDFS-4714. Log short messages in Namenode RPC server for exceptions meant for clients. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485881 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 22:28:06 +00:00
Kihwal Lee
2ad7397c49
HDFS-4807. createSocketForPipeline() should not include timeout extension on connect. Contributed by Cristina Abad.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485861 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 21:35:32 +00:00
Aaron Myers
8c62c46046
HDFS-4298. StorageRetentionManager spews warnings when used with QJM. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485371 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 19:37:41 +00:00
Vinod Kumar Vavilapalli
27e6673ec3
MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 06:36:24 +00:00
Kihwal Lee
98a692fd63
HDFS-3875. Issue handling checksum errors in write pipeline. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484808 13f79535-47bb-0310-9956-ffa450edef68
2013-05-21 13:42:23 +00:00
Todd Lipcon
9fdb117476
HDFS-4824. FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483641 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 03:39:18 +00:00
Aaron Myers
0cd0f64656
HDFS-4830. Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483603 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 23:21:35 +00:00
Aaron Myers
58e191f0c5
HDFS-4787. Create a new HdfsConfiguration before each TestDFSClientRetries testcases. Contributed by Tian Hong Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483235 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 08:11:23 +00:00
Tsz-wo Sze
da05873e0e
HDFS-4826. TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk. Contributed by Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483150 13f79535-47bb-0310-9956-ffa450edef68
2013-05-16 02:00:03 +00:00
Tsz-wo Sze
f7af4a014c
HDFS-3180. Add socket timeouts to WebHdfsFileSystem. Contributed by Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482661 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 02:23:56 +00:00
Tsz-wo Sze
5c82a0cd1a
HDFS-4813. Add volatile to BlocksMap.blocks so that the replication thread can see the updated value. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482658 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 02:18:27 +00:00
Kihwal Lee
d027b947d6
HDFS-4805. Webhdfs client is fragile to token renewal errors. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482121 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 22:03:43 +00:00
Aaron Myers
09593530fb
HDFS-4300. TransferFsImage.downloadEditsToStorage should use a tmp file for destination. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481987 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 17:47:04 +00:00
Aaron Myers
6521b5ee42
HDFS-4765. Permission check of symlink deletion incorrectly throws UnresolvedLinkException. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481976 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 17:22:00 +00:00
Aaron Myers
945cb2ecaa
HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481200 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 21:45:32 +00:00
Suresh Srinivas
b1603b44c5
HDFS-4533. start-dfs.sh ignores additional parameters besides -upgrade. Contributed by Fengdong Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481178 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 20:23:24 +00:00
Aaron Myers
b9a0286223
HDFS-4751. TestLeaseRenewer#testThreadName flakes. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481160 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 19:43:48 +00:00
Aaron Myers
4ed1fc58c0
HDFS-4698. Provide client-side metrics for remote reads, local reads, and short-circuit reads. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481121 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 17:58:07 +00:00
Kihwal Lee
1161ceb2c9
HDFS-4799. Corrupt replica can be prematurely removed from corruptReplicas map. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481084 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 16:36:20 +00:00
Aaron Myers
7e5b63af13
HDFS-4810. several HDFS HA tests have timeouts that are too short. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480841 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 00:16:18 +00:00
Aaron Myers
a18fd620d0
HDFS-4661. A few little code cleanups of some HDFS-347-related code. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480839 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 00:03:17 +00:00
Tsz-wo Sze
5980139140
HDFS-4809. When a QuotaExceededException is thrown during rename, the quota usage should be subtracted back. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480508 13f79535-47bb-0310-9956-ffa450edef68
2013-05-09 00:23:57 +00:00
Tsz-wo Sze
37d6f14560
Merge r1479733 through r1480439 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480440 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 20:20:56 +00:00
Tsz-wo Sze
08ec505d6b
HDFS-4806. In INodeDirectoryWithSnapshot, use isInLatestSnapshot() to determine if an added/removed child should be recorded in the snapshot diff. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480146 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 01:17:24 +00:00
Aaron Myers
3ad40e9dad
HDFS-4804. WARN when users set the block balanced preference percent below 0.5 or above 1.0. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480098 13f79535-47bb-0310-9956-ffa450edef68
2013-05-07 21:40:50 +00:00
Tsz-wo Sze
41312abe84
HDFS-4802. Disallowing snapshot on / twice should throw SnapshotException but not IllegalStateException. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480015 13f79535-47bb-0310-9956-ffa450edef68
2013-05-07 18:45:03 +00:00
Tsz-wo Sze
393188c445
Merge r1477868 through r1479732 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
2013-05-07 00:17:50 +00:00
Tsz-wo Sze
98b416f5ac
HDFS-4801. lsSnapshottableDir throws IllegalArgumentException when root is snapshottable. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479709 13f79535-47bb-0310-9956-ffa450edef68
2013-05-06 22:48:54 +00:00
Tsz-wo Sze
0aab1ef996
HDFS-4800. Fix INodeDirectoryWithSnapshot#cleanDeletedINode. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479707 13f79535-47bb-0310-9956-ffa450edef68
2013-05-06 22:45:00 +00:00
Tsz-wo Sze
424b270c94
HDFS-4798. Update computeContentSummary() for the reference nodes in snapshots.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479671 13f79535-47bb-0310-9956-ffa450edef68
2013-05-06 18:48:24 +00:00
Tsz-wo Sze
72d783374c
HDFS-4791. Update and fix deletion of reference inode. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479198 13f79535-47bb-0310-9956-ffa450edef68
2013-05-04 22:10:55 +00:00
Suresh Srinivas
a4bae51b7d
HDFS-4784. NPE in FSDirectory.resolvePath(). Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478276 13f79535-47bb-0310-9956-ffa450edef68
2013-05-02 06:02:12 +00:00
Suresh Srinivas
03ba436d42
HDFS-4785. Concat operation does not remove concatenated files from InodeMap. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478267 13f79535-47bb-0310-9956-ffa450edef68
2013-05-02 04:51:21 +00:00
Tsz-wo Sze
7c14f1557b
HDFS-4781. Fix a NullPointerException when listing .snapshot under a non-existing directory.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1478135 13f79535-47bb-0310-9956-ffa450edef68
2013-05-01 18:33:08 +00:00
Sanjay Radia
6096cb3435
HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477994 13f79535-47bb-0310-9956-ffa450edef68
2013-05-01 13:31:08 +00:00
Tsz-wo Sze
faca77f227
Merge r1476453 through r1477867 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 23:02:35 +00:00
Tsz-wo Sze
98c0421fbf
HDFS-4758. Disallow nested snapshottable directories and unwrap RemoteException.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477867 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 22:55:38 +00:00
Devaraj Das
2542d69d65
HDFS-4778. Fixes some issues that the first patch on HDFS-2576 missed. Contributed by Devaraj Das.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477849 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 21:46:02 +00:00
Tsz-wo Sze
3a3e0f5731
HDFS-4760. Update inodeMap after node replacement. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477827 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 21:05:20 +00:00
Suresh Srinivas
3704e091a8
HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute. Contrbitued by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477427 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 00:35:53 +00:00
Suresh Srinivas
e2091275dc
HDFS-4610. Reverting the patch Jenkins build is not run.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477396 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 22:40:03 +00:00
Suresh Srinivas
fb30240b87
HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477385 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 22:26:53 +00:00
Tsz-wo Sze
e097f8404b
HDFS-4773. Fix bugs in quota usage computation and OfflineImageViewer. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477367 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 22:03:23 +00:00
Aaron Myers
ce7e5565f4
HDFS-4305. Add a configurable limit on number of blocks per file, and min block size. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477354 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 21:28:48 +00:00
Aaron Myers
ce73b3b01f
HDFS-4687. TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477344 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 21:10:50 +00:00
Tsz-wo Sze
884cbb681a
HDFS-4578. Restrict snapshot IDs to 24-bit wide. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477181 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 16:37:30 +00:00
Suresh Srinivas
e17d5a9683
HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476877 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 02:07:58 +00:00
Suresh Srinivas
3e00835dad
HDFS-4705. Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476610 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 16:16:19 +00:00
Suresh Srinivas
f55fd818e0
HDFS-4722. TestGetConf#testFederation times out on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476597 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:53:37 +00:00
Suresh Srinivas
fbf10b2604
HDFS-4740. Fixes for a few test failures on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476596 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:47:15 +00:00
Suresh Srinivas
0181ce03af
HDFS-4743. TestNNStorageRetentionManager fails on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476591 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:38:02 +00:00
Suresh Srinivas
90612f6423
HDFS-4748. MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476587 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:29:41 +00:00
Suresh Srinivas
fe3853484e
HADOOP-9290. Some tests cannot load native library on windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476586 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:24:02 +00:00
Suresh Srinivas
b7afde6d52
HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476585 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:16:32 +00:00
Suresh Srinivas
4e21c347d2
HDFS-4768. File handle leak in datanode when a block pool is removed. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476579 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 14:08:34 +00:00
Tsz-wo Sze
5276f4e04d
HDFS-4767. If a directory is snapshottable, do not replace it when clearing quota. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476454 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 00:05:49 +00:00
Tsz-wo Sze
60341dae19
Merge r1476010 through r1476452 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476453 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 23:50:17 +00:00
Tsz-wo Sze
75b4231a8c
HDFS-4761. When resetting FSDirectory, the inodeMap should also be reset. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476452 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 23:47:57 +00:00
Tsz-wo Sze
a5ae562d70
HDFS-4650. When passing two non-existing snapshot names to snapshotDiff, it returns success if the names are the same. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476408 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 21:30:53 +00:00
Tsz-wo Sze
d2495d553f
HDFS-4721. Speed up lease recovery by avoiding stale datanodes and choosing the datanode with the most recent heartbeat as the primary. Contributed by Varun Sharma
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476399 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 20:51:45 +00:00
Devaraj Das
5d2ffde68e
HDFS-2576. Enhances the DistributedFileSystem's create API so that clients can specify favored datanodes for a file's blocks. Contributed by Devaraj Das and Pritam Damania.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476395 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 20:39:51 +00:00
Tsz-wo Sze
9da3865841
HDFS-4650. Fix a bug in FSDirectory and add more unit tests for rename with existence of snapshottable directories and snapshots. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476012 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 01:31:43 +00:00
Tsz-wo Sze
fa500825fa
Merge r1471229 through r1476009 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476011 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 01:19:00 +00:00
Tsz-wo Sze
76b80b48ec
HDFS-4755. Fix AccessControlException message and moves "implements LinkedElement" from INode to INodeWithAdditionalFields.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476009 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 01:05:47 +00:00
Tsz-wo Sze
43ac0739ce
svn merge -c -1476006 . for reverting the previous trunk merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476008 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 01:02:45 +00:00
Tsz-wo Sze
a259e0ba79
Merge r1471229 through r1476005 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476006 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 00:55:45 +00:00
Tsz-wo Sze
06fb184d4d
HDFS-4757. Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476005 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 00:50:09 +00:00
Tsz-wo Sze
36f43dcb4f
HDFS-4742. Fix appending to a renamed file with snapshot. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475903 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 18:53:14 +00:00
Tsz-wo Sze
745bfa0311
HDFS-4749. Use INodeId to identify the corresponding directory node in FSImage saving/loading. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475902 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 18:51:00 +00:00
Suresh Srinivas
16ef8dd3a5
HDFS-4745. TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1475623 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 04:25:58 +00:00
Aaron Myers
e6b5b01561
HDFS-4739. NN can miscalculate the number of extra edit log segments to retain. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471769 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 23:29:30 +00:00
Tsz-wo Sze
e8b64d3851
HDFS-4729. Fix OfflineImageViewer and permission checking for snapshot operations. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471665 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 20:47:13 +00:00
Tsz-wo Sze
0fa5cad0b2
HDFS-4686. Update quota computation for rename and INodeReference. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471647 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 20:31:06 +00:00
Tsz-wo Sze
5f1e3b561a
Merge r1470760 through r1471228 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471229 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 02:21:58 +00:00
Tsz-wo Sze
3a812e9f3a
HDFS-4738. Changes AbstractINodeDiff to implement Comparable<Integer>, and fix javadoc and other warnings.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471228 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 02:11:18 +00:00
Aaron Myers
4c662fd3fe
HDFS-4737. JVM path embedded in fuse binaries. Contributed by Sean Mackrory.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471215 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 00:47:13 +00:00
Tsz-wo Sze
65752c09ab
HDFS-4735. DisallowSnapshot throws IllegalStateException for nested snapshottable directories. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471214 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 00:28:07 +00:00
Tsz-wo Sze
631be95398
HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to failure to unpack old image tarball that contains hard links. Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471090 13f79535-47bb-0310-9956-ffa450edef68
2013-04-23 18:47:47 +00:00
Tsz-wo Sze
fd24c6e833
HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, OfflineEditsBinaryLoader and some tests. Contributed by Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470771 13f79535-47bb-0310-9956-ffa450edef68
2013-04-23 01:18:36 +00:00
Tsz-wo Sze
10a2d82b45
HDFS-4719. Remove AbstractINodeDiff.Factory and move its methods to AbstractINodeDiffList. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470759 13f79535-47bb-0310-9956-ffa450edef68
2013-04-23 00:11:51 +00:00
Tsz-wo Sze
92e0416ced
HDFS-4727. Update inodeMap after deleting files/directories/snapshots. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470756 13f79535-47bb-0310-9956-ffa450edef68
2013-04-23 00:00:47 +00:00
Tsz-wo Sze
43bdc22e92
HDFS-4726. Fix test failures after merging the INodeId-INode mapping from trunk. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470735 13f79535-47bb-0310-9956-ffa450edef68
2013-04-22 22:13:58 +00:00
Tsz-wo Sze
cb229db4bd
HDFS-4708. Add snapshot user documentation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470665 13f79535-47bb-0310-9956-ffa450edef68
2013-04-22 19:13:18 +00:00
Suresh Srinivas
27b3f84fe5
Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470225 13f79535-47bb-0310-9956-ffa450edef68
2013-04-20 20:22:21 +00:00
Suresh Srinivas
0b101bd7e8
HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470194 13f79535-47bb-0310-9956-ffa450edef68
2013-04-20 16:57:44 +00:00
Suresh Srinivas
9af0babe7e
Merging trunk after fixing conflict with HDFS-4434.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470089 13f79535-47bb-0310-9956-ffa450edef68
2013-04-20 00:02:43 +00:00
Kihwal Lee
16cc4a6e86
HDFS-4699. TestPipelinesFailover#testPipelineRecoveryStress fails sporadically. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469839 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 14:08:29 +00:00
Tsz-wo Sze
9ab8fa36f2
HDFS-4717. Change the path parameter type of the snapshot methods in HdfsAdmin from String to Path.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469664 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 02:07:52 +00:00
Suresh Srinivas
980e6c54ba
HDFS-4434. Provide a mapping from INodeId to INode. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469644 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 00:10:09 +00:00
Tsz-wo Sze
419fd3999c
HDFS-4706. Do not replace root inode for disallowSnapshot.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469122 13f79535-47bb-0310-9956-ffa450edef68
2013-04-18 01:39:12 +00:00
Tsz-wo Sze
0ad27ad3e3
HDFS-4707. Add snapshot methods to FilterFileSystem and fix findbugs warnings.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469119 13f79535-47bb-0310-9956-ffa450edef68
2013-04-18 01:28:00 +00:00
Tsz-wo Sze
2186912ff9
Merge r1467713 through r1469041 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469042 13f79535-47bb-0310-9956-ffa450edef68
2013-04-17 19:41:50 +00:00
Suresh Srinivas
d090a3b600
HDFS-4695. TestEditLog leaks open file handles between tests. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469015 13f79535-47bb-0310-9956-ffa450edef68
2013-04-17 18:11:31 +00:00
Tsz-wo Sze
9280468b1a
HDFS-4550. Refactor INodeDirectory.INodesInPath to a standalone class.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468725 13f79535-47bb-0310-9956-ffa450edef68
2013-04-17 02:41:38 +00:00
Tsz-wo Sze
38bd7061c1
HDFS-4529. Disallow concat when one of the src files is in some snapshot.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468667 13f79535-47bb-0310-9956-ffa450edef68
2013-04-16 23:16:02 +00:00
Tsz-wo Sze
6bda1f20ad
HDFS-4700. Fix the undo section of rename with snapshots. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468632 13f79535-47bb-0310-9956-ffa450edef68
2013-04-16 22:03:58 +00:00
Suresh Srinivas
1822529e88
HDFS-4693. Some test cases in TestCheckpoint do not clean up after themselves. Contributed by Arpit Agarwal and Suresh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468457 13f79535-47bb-0310-9956-ffa450edef68
2013-04-16 15:10:47 +00:00
Tsz-wo Sze
d13f6ebe20
HDFS-4666. Define ".snapshot" as a reserved inode name so that users cannot create a file/directory with ".snapshot" as the name. If ".snapshot" is used in a previous version of HDFS, it must be renamed before upgrade; otherwise, upgrade will fail.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468238 13f79535-47bb-0310-9956-ffa450edef68
2013-04-15 21:42:06 +00:00
Tsz-wo Sze
bf807063bc
Merging r1466653 through r1467712 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467713 13f79535-47bb-0310-9956-ffa450edef68
2013-04-13 23:05:54 +00:00
Tsz-wo Sze
0f78c50ea7
HDFS-4692. Use timestamp as default snapshot names.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467706 13f79535-47bb-0310-9956-ffa450edef68
2013-04-13 21:41:33 +00:00
Tsz-wo Sze
9c6a7bebe2
HDFS-4675. Fix rename across snapshottable directories. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467540 13f79535-47bb-0310-9956-ffa450edef68
2013-04-13 02:48:34 +00:00
Aaron Myers
801b484f97
HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467538 13f79535-47bb-0310-9956-ffa450edef68
2013-04-13 02:13:59 +00:00
Konstantin Shvachko
242028a3fb
HDFS-4639. startFileInternal() should not increment generation stamp. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467534 13f79535-47bb-0310-9956-ffa450edef68
2013-04-13 01:35:58 +00:00
Aaron Myers
b7aaa1b74c
Merge trunk into the HDFS-347 branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 23:05:28 +00:00
Kihwal Lee
f863543206
HDFS-4477. Secondary namenode may retain old tokens. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467307 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 15:18:07 +00:00
Suresh Srinivas
fd1000bcef
HDFS-4679. Namenode operation checks should be done in a consistent manner. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466721 13f79535-47bb-0310-9956-ffa450edef68
2013-04-10 22:45:23 +00:00
Tsz-wo Sze
4c00514ede
HDFS-4684. Use INode id for image serialization when writing INodeReference.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1466718 13f79535-47bb-0310-9956-ffa450edef68
2013-04-10 22:24:30 +00:00
Tsz-wo Sze
3209d4a3c4
Merge r1464808 through r1466652 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1466658 13f79535-47bb-0310-9956-ffa450edef68
2013-04-10 20:17:39 +00:00
Todd Lipcon
f0351527d5
HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466253 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 21:34:12 +00:00
Suresh Srinivas
d9593621b5
HDFS-4669. TestBlockPoolManager fails using IBM java. Contributed by Tian Hong Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466176 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 19:04:28 +00:00
Suresh Srinivas
e73db45185
HDFS-4674. TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466148 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 17:33:05 +00:00
Suresh Srinivas
425f495591
HDFS-4676. TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466099 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 16:17:06 +00:00
Suresh Srinivas
f680865d99
HDFS-3940. Add Gset#clear method and clear the block map when namenode is shutdown. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465851 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 01:21:48 +00:00
Suresh Srinivas
19201622be
HDFS-4339. Persist inode id in fsimage and editlog. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465835 13f79535-47bb-0310-9956-ffa450edef68
2013-04-08 23:57:31 +00:00
Todd Lipcon
087acf8fd6
HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465751 13f79535-47bb-0310-9956-ffa450edef68
2013-04-08 19:57:16 +00:00
Uma Maheswara Rao G
c5bb615317
HDFS-4525. Provide an API for knowing that whether file is closed or not. Contributed by SreeHari.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465434 13f79535-47bb-0310-9956-ffa450edef68
2013-04-07 18:01:17 +00:00
Aaron Myers
a9d515aed8
HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465183 13f79535-47bb-0310-9956-ffa450edef68
2013-04-06 04:08:09 +00:00
Konstantin Boudnik
bcbe100541
HDFS-4646. createNNProxyWithClientProtocol ignores configured timeout value. Contributed by Jagane Sundar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465121 13f79535-47bb-0310-9956-ffa450edef68
2013-04-05 20:41:04 +00:00
Tsz-wo Sze
07d7d92179
Merge r1462698 through r1464807 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464815 13f79535-47bb-0310-9956-ffa450edef68
2013-04-05 02:43:29 +00:00
Tsz-wo Sze
ca848beb53
HDFS-4647. Rename should call setLocalName after an inode is removed from snapshots. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464795 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 23:52:38 +00:00
Suresh Srinivas
999ce497f0
HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464780 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 22:54:09 +00:00
Kihwal Lee
547d2b0bac
HDFS-4548. Webhdfs doesn't renegotiate SPNEGO token. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464548 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 13:50:31 +00:00
Luke Lu
d088d2ddea
HDFS-4665. Move TestNetworkTopologyWithNodeGroup to common. (Junping Du via llu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464303 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 07:12:28 +00:00
Kihwal Lee
8293e22565
HDFS-4649. Webhdfs cannot list large directories. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463698 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 19:11:56 +00:00
Aaron Myers
9c26c28c87
HDFS-4658. Standby NN will log that it has received a block report "after becoming active". Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463643 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 17:49:58 +00:00
Aaron Myers
ef9e1ba763
HDFS-4656. DN heartbeat loop can be briefly tight. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463357 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 02:11:07 +00:00
Aaron Myers
329fb1f433
HDFS-4655. DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463355 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 02:05:55 +00:00
Tsz-wo Sze
1096917649
HDFS-4611. Update FSImage for INodeReference.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463332 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 23:24:42 +00:00
Tsz-wo Sze
8ee6ecaea4
HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly created directory to an INodeDirectoryWithSnapshot. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463075 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 01:53:21 +00:00
Tsz-wo Sze
9602869d19
HDFS-4648. For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462865 13f79535-47bb-0310-9956-ffa450edef68
2013-03-30 23:57:27 +00:00
Tsz-wo Sze
f5bbc2d950
Merge r1460409 through r1462697 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462698 13f79535-47bb-0310-9956-ffa450edef68
2013-03-30 03:50:03 +00:00
Todd Lipcon
bbb24fbf5d
Merge trunk into branch.
...
Conflicts resolved:
C hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestShortCircuitLocalRead.java
! C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/SocketCache.java
C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderLocal.java
(thanks to Colin for help resolving)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1462652 13f79535-47bb-0310-9956-ffa450edef68
2013-03-29 21:33:35 +00:00
Todd Lipcon
1611b51a97
HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 20:58:45 +00:00
Tsz-wo Sze
25aab4203c
HDFS-4636. Update quota usage when deleting files/dirs that were created after taking the latest snapshot. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462192 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 16:18:04 +00:00
Sanjay Radia
0e6604aab3
HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly (Chris Nauroth via Sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461846 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 20:49:48 +00:00
Todd Lipcon
694a672131
HDFS-4538. Allow use of legacy blockreader. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1461818 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 19:28:12 +00:00
Todd Lipcon
4809bfa6ed
HDFS-4618. Default transaction interval for checkpoints is too low. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461783 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:46:32 +00:00
Todd Lipcon
81192e4e41
HDFS-4621. Additional logging to help diagnose slow QJM syncs. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461777 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:42:43 +00:00
Kihwal Lee
c9f5052803
HDFS-4581. DataNode.checkDiskError should not be called on network errors. Contributed by Rohit Kochar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461597 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 14:21:13 +00:00
Suresh Srinivas
fdf1e6e07e
HDFS-4635. Move BlockManager#computeCapacity to LightWeightGSet. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461364 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 23:01:03 +00:00
Tsz-wo Sze
ca3e09bab5
HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461040 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 09:54:48 +00:00
Tsz-wo Sze
cc2f96f655
HDFS-4612. Not to use INode.getParent() when generating snapshot diff report. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460590 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 10:21:30 +00:00
Suresh Srinivas
698e3f8ae5
Merging trunk to branch HDFS-2802
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460410 13f79535-47bb-0310-9956-ffa450edef68
2013-03-24 15:56:18 +00:00
Suresh Srinivas
993a76f2dd
HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460389 13f79535-47bb-0310-9956-ffa450edef68
2013-03-24 14:53:52 +00:00
Tsz-wo Sze
7ed618e324
HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459592 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:56:06 +00:00
Tsz-wo Sze
c2e186bae6
HDFS-4615. Fix TestDFSShell failures on Windows. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459586 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:48:39 +00:00
Tsz-wo Sze
e976294d35
HDFS-4609. TestAuditLogs should release log handles between tests. Contributed by Ivan Mitic
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459576 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:18:26 +00:00
Tsz-wo Sze
1b98d8dda3
HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows. Contributed by Ivan Mitic
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459573 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:11:20 +00:00
Aaron Myers
036c168f4f
HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459549 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 21:59:02 +00:00
Tsz-wo Sze
ca7c588185
HDFS-4616. Update the FilesDeleted metric while deleting file/dir in the current tree. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1459485 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 19:30:35 +00:00
Aaron Myers
a10fbb93e7
HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459475 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 18:58:06 +00:00
Aaron Myers
c92b59fd8d
HDFS-4614. FSNamesystem#getContentSummary should use getPermissionChecker helper method. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458593 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 00:36:13 +00:00
Tsz-wo Sze
9701555899
HDFS-4534. Add INodeReference in order to support rename with snapshots.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1458164 13f79535-47bb-0310-9956-ffa450edef68
2013-03-19 06:27:26 +00:00
Aaron Myers
64741f4635
HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 17:20:13 +00:00
Tsz-wo Sze
a5a66330a8
Merge r1455389 through r1457712 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457716 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 11:45:07 +00:00
Tsz-wo Sze
77f7bfa9ef
HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script. Contributed by Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457712 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 11:36:59 +00:00
Suresh Srinivas
415d038319
HDFS-4604. TestJournalNode fails on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457069 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:59:20 +00:00
Suresh Srinivas
9c7c2f4f27
HDFS-4603. TestMiniDFSCluster fails on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457057 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:41:18 +00:00
Aaron Myers
807e08334e
HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456630 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 20:01:03 +00:00
Aaron Myers
bcabbcdf4c
HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456578 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 18:04:04 +00:00
Daryn Sharp
2c42337545
HDFS-3367. WebHDFS doesn't use the logged in user when opening connections (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456469 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 15:14:13 +00:00
Kihwal Lee
7987bcf3f4
HDFS-3344. Unreliable corrupt blocks counting in TestProcessCorruptBlocks. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456172 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 21:58:19 +00:00
Aaron Myers
3bf09c5150
HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 19:51:19 +00:00
Suresh Srinivas
1f3a18ff44
HDFS-4582. TestHostsFiles fails on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456060 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 17:43:34 +00:00
Suresh Srinivas
c390683bcc
HDFS-4583. TestNodeCount fails. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456052 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 17:15:38 +00:00
Suresh Srinivas
8c20a8f495
HDFS-4595. When short circuit read is fails, DFSClient does not fallback to regular reads. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456047 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 16:45:31 +00:00
Suresh Srinivas
e4e13618e8
HDFS-4593. TestSaveNamespace fails on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455956 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 14:28:55 +00:00
Suresh Srinivas
b8f3133e04
Adding file missed in the revision 1455805
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455807 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 06:06:21 +00:00
Suresh Srinivas
719c313be1
HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455805 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 06:05:00 +00:00
Aaron Myers
06f711d819
HDFS-4484. libwebhdfs compilation broken with gcc 4.6.2. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455782 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:59:00 +00:00
Aaron Myers
7c8419f14f
HDFS-4522. LightWeightGSet expects incrementing a volatile to be atomic. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455780 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:55:20 +00:00
Aaron Myers
86a940f7ad
HDFS-4592. Default values for access time precision are out of sync between hdfs-default.xml and the code. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455777 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:32:44 +00:00
Suresh Srinivas
c5017c71e4
HDFS-4013. TestHftpURLTimeouts throws NPE. Contributed by Chao Shi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455755 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 23:37:03 +00:00
Aaron Myers
813e97494a
HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455708 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 20:55:33 +00:00
Tsz-wo Sze
3b3ea5c422
HDFS-4563. Update namespace/diskspace usage after deleting snapshots.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455396 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 02:41:25 +00:00
Tsz-wo Sze
f35cd45811
Merge r1454237 through r1455388 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455390 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 01:58:43 +00:00
Suresh Srinivas
9daa958c5a
HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455360 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 23:13:55 +00:00
Aaron Myers
9d62cdd680
HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 21:44:25 +00:00
Tsz-wo Sze
43f8d0b9c9
HDFS-4574. Move Diff to the util package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454988 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 03:45:52 +00:00
Suresh Srinivas
d32fb8a62b
HDFS-4579. Annotate snapshot tests. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454748 13f79535-47bb-0310-9956-ffa450edef68
2013-03-09 18:14:30 +00:00
Suresh Srinivas
c1fabc5e91
HDFS-4573. Fix TestINodeFile on Windows. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454616 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 22:54:50 +00:00
Kihwal Lee
140076fb57
HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454517 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 20:01:58 +00:00
Alejandro Abdelnur
a549d6fa2c
HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454475 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 17:23:47 +00:00
Kihwal Lee
94a22114b9
HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454460 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 16:56:34 +00:00
Suresh Srinivas
82230367ba
Merging trunk
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454238 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 04:13:41 +00:00
Suresh Srinivas
4909821aa9
HDFS-4569. Small image transfer related cleanups. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454233 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 03:37:21 +00:00
Tsz-wo Sze
8d95784bf1
HDFS-4557. Fix FSDirectory#delete when INode#cleanSubtree returns 0. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454138 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 22:34:51 +00:00
Daryn Sharp
8a4f03cb70
HDFS-4566. Webdhfs token cancelation should use authentication (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454059 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 19:58:04 +00:00
Suresh Srinivas
301079b4bf
HDFS-4546. Use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454021 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 19:23:13 +00:00
Daryn Sharp
97c4668312
HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453955 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 16:56:19 +00:00
Tsz-wo Sze
3145cf1ab2
Merge r1449958 through r1453659 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1453669 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 02:57:40 +00:00
Jonathan Turner Eagles
b427fe9de8
HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:17:14 +00:00
Suresh Srinivas
638801cce1
HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:15:18 +00:00
Suresh Srinivas
456064d899
HDFS-4544. Error in deleting blocks should not do check disk, for all types of errors. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453436 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 17:18:46 +00:00
Suresh Srinivas
56c7e7a12e
HDFS-4519. Support overriding jsvc binary and log file locations when launching secure datanode. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453050 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 22:37:04 +00:00
Suresh Srinivas
a82e67af6c
HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453025 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 21:47:22 +00:00
Kihwal Lee
97ccd64401
HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452978 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 20:17:56 +00:00
Tsz-wo Sze
b1333e5b56
HDFS-4545. With snapshots, FSDirectory.unprotectedSetReplication(..) always changes file replication but it may or may not changes block replication.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1452636 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 02:23:34 +00:00
Suresh Srinivas
3ea26d3408
HDFS-4541. Set hadoop.log.dir and hadoop.id.str when starting secure datanode to write the logs to right dir by default. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452461 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 19:34:15 +00:00
Daryn Sharp
d8ca9c655b
HDFS-4532. RPC call queue may fill due to current user lookup (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452435 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 18:36:30 +00:00
Daryn Sharp
cfa86e6110
HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452384 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 16:44:23 +00:00
Suresh Srinivas
2e02b92664
HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451348 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 21:13:59 +00:00
Tsz-wo Sze
c7cf85ccb4
HDFS-4507. Update quota verification for snapshots.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1451081 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 03:08:08 +00:00
Tsz-wo Sze
e2a618e1cc
HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1450477 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 22:04:35 +00:00
Aaron Myers
7e2d98da40
HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449984 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 00:44:52 +00:00
Tsz-wo Sze
aa82b03823
Merge r1448505 through r1449957 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449976 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 00:10:17 +00:00
Tsz-wo Sze
59e968a114
HDFS-4514. Add CLI for supporting snapshot rename, diff report, and snapshottable directory listing. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449956 13f79535-47bb-0310-9956-ffa450edef68
2013-02-25 23:14:58 +00:00
Aaron Myers
63522b3224
HADOOP-8569. CMakeLists.txt: define _GNU_SOURCE and _LARGEFILE_SOURCE. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449922 13f79535-47bb-0310-9956-ffa450edef68
2013-02-25 22:07:45 +00:00
Tsz-wo Sze
d8ccf4e521
Add the new test file by HDFS-4520.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449863 13f79535-47bb-0310-9956-ffa450edef68
2013-02-25 19:49:52 +00:00
Tsz-wo Sze
5ddbbd9d65
HDFS-4520. Support listing snapshots under a snapshottable directory using ls. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449862 13f79535-47bb-0310-9956-ffa450edef68
2013-02-25 19:49:05 +00:00
Tsz-wo Sze
0deff1727e
HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449265 13f79535-47bb-0310-9956-ffa450edef68
2013-02-23 02:44:05 +00:00