Commit Graph

1206 Commits

Author SHA1 Message Date
Jitendra Nath Pandey e90d0ef396 Merged r1410691 from trunk for HDFS-4105.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410702 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 06:38:46 +00:00
Aaron Myers cd3e17fb0a HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410590 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:59:54 +00:00
Daryn Sharp 0cb4b2039d svn merge -c 1409988 FIXES: HDFS-4186 logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409992 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:35:16 +00:00
Uma Maheswara Rao G 210941550a Merge HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409907 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:28:29 +00:00
Daryn Sharp dc2fee69d5 svn merge -c 1409848 FIXES: HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409850 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 15:55:36 +00:00
Robert Joseph Evans 9a5a5082c6 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409821 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:59:27 +00:00
Robert Joseph Evans d0a66f405f svn merge -c 1409311 FIXES: HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409316 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 19:29:17 +00:00
Robert Joseph Evans eeced257c0 svn merge -r 1409090:1409089 reverting HDFS-4171 until test failures can be fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409268 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 17:35:42 +00:00
Eli Collins a32639ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409093 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:19:20 +00:00
Alejandro Abdelnur 502d6b940d HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409090 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:18:04 +00:00
Uma Maheswara Rao G 0ce462007e Merge HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409072 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 03:18:32 +00:00
Suresh Srinivas 09774b8005 HDFS-4106. Merging change r1403075 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409039 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 00:03:15 +00:00
Daryn Sharp 6ef30552db svn merge -c 1408779 FIXES: HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408780 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 15:31:17 +00:00
Aaron Myers 067eabb820 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408534 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:30:34 +00:00
Eli Collins 4321bc1d5c HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408533 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:29:51 +00:00
Eli Collins 748284170a HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408478 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:22:01 +00:00
Robert Joseph Evans cc384335f9 svn merge -c 1408401 FIXES: HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408403 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 18:54:57 +00:00
Thomas White d488a59497 Merge -r 1407657:1407658 from trunk to branch-2. Fixes: HADOOP-8860. Split MapReduce and YARN sections in documentation navigation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408290 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 13:57:19 +00:00
Suresh Srinivas e9042a0db7 Moving HDFS-4080 to Incompatible Change section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407572 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:16:38 +00:00
Suresh Srinivas bcc35e1ac3 HDFS-4080. Merging change r1407566 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407571 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:15:14 +00:00
Suresh Srinivas f0c5611551 HDFS-4162. Merging 1407556 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407557 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:44:29 +00:00
Eli Collins 3d73261636 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407346 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 03:13:43 +00:00
Daryn Sharp 6b264008a9 svn merge -c 1407333 FIXES: HDFS-3990. NN's health report has severe performance problems (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407334 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 00:56:50 +00:00
Uma Maheswara Rao G 2b3934f43d HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407209 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 18:36:37 +00:00
Konstantin Shvachko 990e085be8 Move HDFS-3625 and HDFS-4138 under 2.0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407191 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 18:02:37 +00:00
Konstantin Shvachko 61c432b31e HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406743 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 18:07:18 +00:00
Konstantin Shvachko 824fd2d4be HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406740 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 18:01:29 +00:00
Tsz-wo Sze a92a1b238c svn merge -c 1406382 from trunk for HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406383 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:35:52 +00:00
Todd Lipcon 01aee565e2 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406373 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:05:39 +00:00
Daryn Sharp cf4a167525 svn merge -c 1406278 FIXES: HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406279 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 19:29:06 +00:00
Daryn Sharp f963c2eb96 svn merge -c 1406198 FIXES: HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406203 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 16:13:05 +00:00
Suresh Srinivas da10dc0d9a HDFS-4046. Merge the CHANGES.txt change from trunk revision 1406019
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406020 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 00:23:33 +00:00
Suresh Srinivas 8b0db38ec8 HDFS-4046. Merging changes 1406011 and 1406012 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406013 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:56:01 +00:00
Tsz-wo Sze 4dabf4874a svn merge -c 1405237 from trunk for HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1405241 13f79535-47bb-0310-9956-ffa450edef68
2012-11-03 00:27:42 +00:00
Todd Lipcon aa12dd4f77 HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1405150 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 20:35:54 +00:00
Daryn Sharp 330562868f svn merge -c 1404985 FIXES: HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1404986 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 14:59:31 +00:00
Suresh Srinivas c092ee4c4c HDFS-3916. Merge 1403922 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403925 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 23:19:40 +00:00
Uma Maheswara Rao G ef6b842f0e Removed .org files added in previous commit HDFS-3809
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403847 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 19:57:54 +00:00
Uma Maheswara Rao G d640907599 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403846 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 19:56:02 +00:00
Uma Maheswara Rao G ff362d8fca Revert HDFS-3809 from branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403806 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 18:00:08 +00:00
Daryn Sharp bf335b6124 svn merge -c 1403714 FIXES: HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403717 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 14:23:18 +00:00
Suresh Srinivas 4fbfe304bc HDFS-4127. Merge change 1403616 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403619 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:56:24 +00:00
Uma Maheswara Rao G f1cf299d02 removed unnecessary .org files added as part of previous commit. HDFS-3809
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403607 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 02:28:58 +00:00
Uma Maheswara Rao G 1cc0b55c68 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403606 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 02:25:31 +00:00
Uma Maheswara Rao G 59df5eb19f HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403603 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 01:55:39 +00:00
Uma Maheswara Rao G 394d07c6a2 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403600 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 01:32:07 +00:00
Uma Maheswara Rao G c44e61588f HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon and Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403594 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 01:09:58 +00:00
Suresh Srinivas 7634ab0bef HDFS-4122. Merging change r1403120 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403579 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 23:42:50 +00:00
Suresh Srinivas 17fc6ed3b8 HDFS-3920. Merging change 1403173 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1403174 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 05:15:11 +00:00
Suresh Srinivas 35e59f0475 HDFS-4121. Merging change r1402836 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1402841 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:36:22 +00:00
Tsz-wo Sze 7692aa392b svn merge -c 1402608 from trunk for HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads
may not be shutdown properly in DataNode.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1402609 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:24:09 +00:00
Tsz-wo Sze d1c730d716 svn merge -c 1402599 from trunk for HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1402602 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:13:59 +00:00
Tsz-wo Sze 6f91542707 svn merge -c 1402270 from trunk for HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1402273 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:58:35 +00:00
Tsz-wo Sze 1711ef5bfb svn merge -c 1402265 from trunk for HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1402271 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:53:50 +00:00
Daryn Sharp 96cc1ad304 svn merge -c 1401309 FIXES: HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1401315 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 15:12:43 +00:00
Tsz-wo Sze 35bd16ad62 svn merge -c 1400986 from trunk for HDFS-4099. Clean up replication code and add more javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1400987 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 18:32:48 +00:00
Uma Maheswara Rao G c1b6cc54ab Merge (r1400578) from trunk HDFS-4022. Replication not happening for appended block. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1400581 13f79535-47bb-0310-9956-ffa450edef68
2012-10-21 06:41:44 +00:00
Tsz-wo Sze 01557d0464 svn merge -c 1400345 from trunk for HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1400346 13f79535-47bb-0310-9956-ffa450edef68
2012-10-20 00:08:14 +00:00
Alejandro Abdelnur 60cd4f4c7a reverting commit 1399959 (HADOOP-8887 again)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399971 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 05:30:30 +00:00
Suresh Srinivas 887e8a22d5 HDFS-4072. Merging change 1399965 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399966 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 04:58:55 +00:00
Alejandro Abdelnur c6f60985a8 HADOOP-8887. Use a Maven plugin to build the native code using CMake. (cmccabe via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399959 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 03:59:39 +00:00
Suresh Srinivas a2b01168e2 HDFS-8887 reverting commit r1399904 due to build failure and other issues
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399949 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 02:22:24 +00:00
Alejandro Abdelnur 26e7aae08e HADOOP-8887. Use a Maven plugin to build the native code using CMake. (cmccabe via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399904 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:49:07 +00:00
Eli Collins a38d2b8c78 HADOOP-8925. Remove the packaging. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399901 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:43:35 +00:00
Tsz-wo Sze d75c1dd9cd svn merge -c 1399866 from trunk for HDFS-4074. Remove the unused default constructor from INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399869 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:30:33 +00:00
Tsz-wo Sze a0fb053e7b svn merge -c 1399861 from trunk for HDFS-4073. Two minor improvements to FSDirectory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399862 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:22:04 +00:00
Eli Collins cd89989aac HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399444 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 21:38:03 +00:00
Suresh Srinivas 32b27ebec1 HFS-4059. Merging change r1398949 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399391 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 18:54:59 +00:00
Eli Collins 7b10aa9f80 HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399097 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 05:00:04 +00:00
Eli Collins c21eece8d2 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399094 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 04:39:28 +00:00
Aaron Myers 6b11a5e94a HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399063 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 01:12:02 +00:00
Eli Collins bd6c745418 HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399020 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 22:14:52 +00:00
Eli Collins 20a5d16b2d HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398875 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 16:29:40 +00:00
Eli Collins 85bd8e0b72 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398617 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 02:25:25 +00:00
Aaron Myers b6d441277c HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398608 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:59:31 +00:00
Aaron Myers 32728e64bb HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398604 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:31:43 +00:00
Todd Lipcon 7a9f21aeaf HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398590 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 00:54:47 +00:00
Tsz-wo Sze 0822195ff2 svn merge -c 1398293 from trunk for HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398294 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 14:08:25 +00:00
Tsz-wo Sze 1f109df2c6 svn merge -c 1398288 from trunk for HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1398289 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 13:55:18 +00:00
Jason Darrell Lowe 5e2b9b88ef svn merge -c 1397704 FIXES: HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397708 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 20:00:31 +00:00
Suresh Srinivas 5f571ab869 HDFS-4044. Merging change 1397580 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397584 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 14:34:42 +00:00
Suresh Srinivas 3a9aadc3c7 HADOOP-8911. CRLF characters in source and text files (trunk equivalent patch). Contributed Raja Aluri.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397435 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:48:40 +00:00
Suresh Srinivas 5fa60ed91f HDFS-4041. Merging partial of change r1397362 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397420 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 02:29:54 +00:00
Suresh Srinivas caf5213a50 HDFS-3912. Merging change 1397211 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397219 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 18:30:36 +00:00
Suresh Srinivas 93a18b3cd6 HADOOP-8913. Merging change 1396904 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396907 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 05:20:21 +00:00
Aaron Myers 98c80d3ec5 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396882 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 00:34:58 +00:00
Jason Darrell Lowe eb50c308b8 svn merge -c 1396798 FIXES: HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396807 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 21:25:10 +00:00
Eli Collins 70e7ec1f47 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396727 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 18:43:13 +00:00
Thomas Graves 1f4ba537fa merge -r 1396704:1396705 from trunk. FIXES: HDFS-3824
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396706 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 17:37:54 +00:00
Eli Collins 2715385c4e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395822 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:22:37 +00:00
Todd Lipcon 88a3f46ddb HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395730 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:19:13 +00:00
Eli Collins 2a2fec7128 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395701 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:12:29 +00:00
Eli Collins 99e7354cd5 HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395388 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:50:14 +00:00
Eli Collins d61d75abe5 HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395386 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:22:31 +00:00
Aaron Myers 9a69c2d501 HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394866 13f79535-47bb-0310-9956-ffa450edef68
2012-10-06 00:16:08 +00:00
Thomas Graves 6827ab09c3 merge -r 1394608:1394609 from trunk. FIXES: HDFS-3829
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394610 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 15:52:18 +00:00
Aaron Myers 49959f95ff HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394341 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 00:56:09 +00:00
Alejandro Abdelnur 437ce1aff0 HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394170 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 17:46:39 +00:00
Eli Collins 3be0d367f4 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393896 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 03:03:17 +00:00
Eli Collins 5705cffc35 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393885 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:42:19 +00:00
Eli Collins 3bb5fb6f08 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393831 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 23:38:28 +00:00
Eli Collins dd16390e9c HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393778 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:31:04 +00:00
Eli Collins 04988bb77b HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393188 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 21:15:10 +00:00
Robert Joseph Evans 76aa144c64 Preparing for release 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391806 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:18:27 +00:00
Aaron Myers f15b6b9959 HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391764 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 07:31:48 +00:00
Aaron Myers d95daf370d HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391709 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 00:53:23 +00:00
Robert Joseph Evans 587f499b88 svn merge -c 1391121 FIXES: HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391122 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 17:32:53 +00:00
Eli Collins 1e1591788d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390843 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 05:08:06 +00:00
Eli Collins 31bd01c15d HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390730 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 21:26:54 +00:00
Tsz-wo Sze ff5f50532a svn merge -c 1390466 from trunk for HDFS-3373. Change DFSClient input stream socket cache to global static and add
a thread to cleanup expired cache entries.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390470 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 13:26:21 +00:00
Harsh J de4204cce5 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1388891 13f79535-47bb-0310-9956-ffa450edef68
2012-09-22 20:09:23 +00:00
Eli Collins cb0f0fc3dd HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1388336 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 06:17:36 +00:00
Eli Collins d2ecafd64f HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1388332 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 05:53:33 +00:00
Eli Collins b3e947bc50 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1388323 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 04:56:34 +00:00
Eli Collins 7c886009aa HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387839 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 01:35:01 +00:00
Alejandro Abdelnur 03c1c9e951 Reverting HADOOP-8805
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387698 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 18:10:52 +00:00
Alejandro Abdelnur 6a83162aee HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387689 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 17:40:13 +00:00
Alejandro Abdelnur 634c337640 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387300 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 18:18:17 +00:00
Eli Collins c03ca579de HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387281 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:52:11 +00:00
Eli Collins 6ad11b963c HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387275 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:34:32 +00:00
Eli Collins d1e2d368a4 HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387264 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:08:56 +00:00
Alejandro Abdelnur b568b09f4e HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1386995 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 05:46:47 +00:00
Alejandro Abdelnur 002c001d71 HDFS-3938. remove current limitations from HttpFS docs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384843 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:29:49 +00:00
Thomas White 9e1860bfbf Merge -r 1384832:1384833 from trunk to branch-2. Fixes: HADOOP-8780. Update DeprecatedProperties apt file.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384835 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:15:20 +00:00
Aaron Myers ac103a4314 HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384628 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:50:35 +00:00
Aaron Myers 39133e9fa1 HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384603 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:49:06 +00:00
Suresh Srinivas 042f9102fe HDFS-3703. Merging change 1384209 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384210 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 06:08:07 +00:00
Eli Collins 4af46e7860 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384098 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 19:21:49 +00:00
Eli Collins 2e7d2b2e6b HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384083 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:39:52 +00:00
Todd Lipcon 4c983a3108 HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384079 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:33:03 +00:00
Eli Collins 797e4760d9 HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383761 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:29:59 +00:00
Eli Collins 08f061b366 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383756 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:12:49 +00:00
Eli Collins 8644881db7 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383619 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 21:28:53 +00:00
Todd Lipcon ee6f83bc89 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383098 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 20:24:16 +00:00
Eli Collins 7296dee763 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383053 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 19:07:05 +00:00
Tsz-wo Sze 2b75e1d80c svn merge -c 1382836 from trunk for HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1382841 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 13:48:16 +00:00
Arun Murthy f403be7569 Set version in branch-2 to 2.0.3-SNAPSHOT
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1382809 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 12:57:48 +00:00
Eli Collins bda287a486 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1382410 13f79535-47bb-0310-9956-ffa450edef68
2012-09-09 06:39:50 +00:00
Arun Murthy c76e05c1b7 Set date for hadoop-2.0.2-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1382198 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:37:55 +00:00
Arun Murthy d47f6bb16e Preparing for hadoop-2.0.2-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1382195 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:34:25 +00:00
Alejandro Abdelnur 3d928ddeb8 HDFS-3895. hadoop-client must include commons-cli (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381720 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 19:05:57 +00:00
Daryn Sharp 0258234ba8 svn merge -c 1381606 FIXES: HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381608 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:15:15 +00:00
Eli Collins 5ef8a80920 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381478 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 06:48:55 +00:00
Eli Collins a58e65c926 HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381474 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 06:44:23 +00:00
Eli Collins 1c71954df8 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381321 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:44:47 +00:00
Todd Lipcon e2553a01ae HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380987 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:52:57 +00:00
Todd Lipcon 407a68f3ee HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380981 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:39:49 +00:00
Tsz-wo Sze 1da2d2f37d svn merge -c 1380939 from trunk for HDFS-3888. Clean up BlockPlacementPolicyDefault.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380940 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 00:04:11 +00:00
Tsz-wo Sze 555e93493e svn merge -c 1380934 from trunk for HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380936 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 23:52:59 +00:00
Alejandro Abdelnur a42a7fccf5 HDFS-3866. HttpFS POM should have property where to download tomcat from (zero45 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380928 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 22:56:46 +00:00
Robert Joseph Evans 8d310aad55 pdating CHANGES.txt for 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380907 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 21:48:58 +00:00
Uma Maheswara Rao G 2257cd8123 Merge HDFS-3469 (r1380003) from trunk (HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1380006 13f79535-47bb-0310-9956-ffa450edef68
2012-09-02 16:41:24 +00:00
Tsz-wo Sze 8f68f49c3d svn merge -c 1379743 from trunk for HDFS-3871. Change NameNodeProxies to use RetryUtils.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379744 13f79535-47bb-0310-9956-ffa450edef68
2012-09-01 11:48:13 +00:00
Eli Collins f0f25c6c04 HDFS-3879. Fix findbugs warning in TransferFsImage on branch-2. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379651 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 22:39:52 +00:00
Owen O'Malley 89efe23ef2 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab.
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379648 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 22:33:52 +00:00
Daryn Sharp dbe5edbfaa svn merge -c 1379623 FIXES: HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379626 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:33:17 +00:00
Daryn Sharp 59005f8f98 svn merge -c 1379615 FIXES: HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379618 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:26:09 +00:00
Suresh Srinivas 5f9c37562d HDFS-3833. Merging 1379525 from trunk. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379594 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:37:29 +00:00
Eli Collins 1f767d9bd9 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379281 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 04:12:37 +00:00
Eli Collins d1b90a3e93 HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379185 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 22:09:42 +00:00
Daryn Sharp fb2d784ef9 merge -r 1379092:1379093 from trunk. FIXES: HDFS-3861
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379096 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:50:24 +00:00
Aaron Myers a210679c9a HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378414 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 01:22:38 +00:00
Aaron Myers 3880b0dff3 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378365 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 22:12:10 +00:00
Aaron Myers a12b8e3d6c HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378229 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 17:02:33 +00:00
Eli Collins aa92e2ab65 Fixup CHANGELOG for HDFS-3856.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377937 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 01:45:58 +00:00
Eli Collins 7abd25795b HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377935 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 01:42:52 +00:00
Eli Collins 0e5d96e3ee HDFS-3731. Release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377548 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 01:07:04 +00:00
Eli Collins 804c45867a HDFS-3853. Port MiniDFSCluster enableManagedDfsDirsRedundancy. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377545 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 00:11:39 +00:00
Aaron Myers 6cac9aa7f9 HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377368 13f79535-47bb-0310-9956-ffa450edef68
2012-08-26 00:32:08 +00:00
Suresh Srinivas 5998a179b4 HDFS-3844. Merge change 1377168 from trunk. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377176 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:23:52 +00:00
Tsz-wo Sze a26cfc347f svn merge -c 1376928 from trunk for HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376937 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:24:59 +00:00
Eli Collins f068e8db4b Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376702 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 21:09:23 +00:00
Eli Collins 7f16809a3b Amend previous commit to remove TestFileCreationNamenodeRestart.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376699 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 21:03:25 +00:00
Eli Collins 7138f2b44f HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376692 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 20:52:30 +00:00
Jitendra Nath Pandey 041a1e0a52 Merged from trunk for HDFS-3819.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 04:05:12 +00:00
Aaron Myers 4e75deb4e7 HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376189 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:48:32 +00:00
Suresh Srinivas 8c28ebabcd HDFS-3832. Merging change 1376139 from trunk to branch-2. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376145 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 17:05:38 +00:00
Eli Collins 8340bb151e HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376130 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:28:22 +00:00
Eli Collins 095553e7a6 HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376122 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:19:43 +00:00
Suresh Srinivas 63810d26ae HDFS-2686. Merging change 1375800 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375806 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:33:17 +00:00
Tsz-wo Sze c0b9b996f9 svn merge -c 1375450 from trunk for HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375453 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 09:49:00 +00:00
Eli Collins 08bd69a851 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375384 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 03:49:28 +00:00
Eli Collins 566f3d5917 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375338 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 00:01:43 +00:00
Tsz-wo Sze fa76c71e62 svn merge -c 1374696 from trunk for HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374697 13f79535-47bb-0310-9956-ffa450edef68
2012-08-19 05:51:37 +00:00
Suresh Srinivas b082909c32 HDFS-3816. Merging 1374645 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374648 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 19:57:36 +00:00
Eli Collins 7da3b52623 HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374474 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:24:36 +00:00
Aaron Myers 8ab1c7a47b HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374359 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 17:03:32 +00:00
Daryn Sharp a8f10869a8 svn merge -c 1374271 FIXES: HADOOP-7967. Need generalized multi-token filesystem support (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374346 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 16:26:01 +00:00
Tsz-wo Sze aa9bf3b472 svn merge -c 1374127 from trunk for HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374128 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:55:33 +00:00
Tsz-wo Sze c849ef9bea svn merge -c 1374122 from trunk for HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374124 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:44:31 +00:00
Aaron Myers 2fc30022d0 HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374107 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 23:48:23 +00:00
Eli Collins 841dda010b HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374042 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 20:37:32 +00:00
Eli Collins ac63450f02 HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373932 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 17:16:52 +00:00
Tsz-wo Sze 1294ad1df7 svn merge -c 1373683 from trunk for HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373686 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 01:42:16 +00:00
Eli Collins 3f1998b7ba HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373665 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 22:45:05 +00:00
Thomas White 15b9897255 Merge -r 1373573:1373574 from trunk to branch-2. Fixes: HADOOP-8278 - Make sure components declare correct set of dependencies
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373594 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 19:28:51 +00:00
Todd Lipcon e8eca906d4 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373558 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 18:36:15 +00:00
Tsz-wo Sze 2f7382cd07 svn merge -c 1373253 from trunk for HDFS-3802. StartupOption.name in HdfsServerConstants should be final.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373258 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 08:09:44 +00:00
Tsz-wo Sze 8b18a6f5be svn merge -c 1373193 from trunk for HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373195 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 02:25:09 +00:00
Suresh Srinivas 34e596611f HDFS-3723. Merging change r1373173 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373185 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 01:03:11 +00:00
Suresh Srinivas c738a9964b HDFS-3803. Merging change 1373174 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373182 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:56:32 +00:00
Eli Collins 997cd514c7 Amend HDFS-3150 to fix TestMiniDFSCluster.java.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373144 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 22:18:25 +00:00
Eli Collins 3cdd6a9a2d HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373143 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 22:15:57 +00:00
Daryn Sharp 2964cc0f59 svn merge -c 1373090 FIXES: HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373095 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 21:01:34 +00:00
Todd Lipcon d0e5d7e971 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373060 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:11:31 +00:00
Tsz-wo Sze 4a84c9020d svn merge -c 1372707 from trunk for HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. (szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 03:39:27 +00:00
Aaron Myers 080455d1cc HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372678 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:05:42 +00:00
Alejandro Abdelnur b344870bdd HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372642 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:56:31 +00:00
Todd Lipcon b2511abfc8 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372627 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:26:12 +00:00
Todd Lipcon f4ad5b20ce HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372603 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:51:21 +00:00
Todd Lipcon 6697240114 HDFS-2330. In NNStorage.java, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372599 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:47:14 +00:00
Aaron Myers d3427c7d93 Revert HDFS-3719. See discussion there and HDFS-3770 for more info.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372545 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 18:44:49 +00:00
Eli Collins ae6b1ea89c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371556 13f79535-47bb-0310-9956-ffa450edef68
2012-08-10 03:47:12 +00:00
Todd Lipcon ced2087998 HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371508 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:58:29 +00:00
Aaron Myers 49e89472a9 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371496 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:33:20 +00:00
Aaron Myers cc33d7b2ce HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371232 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 14:45:08 +00:00
Todd Lipcon ecc88a6dd7 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370936 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:15:31 +00:00
Aaron Myers 82ee5ce47e HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 19:33:03 +00:00
Aaron Myers 208da340c3 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370650 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 02:54:59 +00:00
Eli Collins 84314d99e5 HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370496 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 20:23:11 +00:00
Alejandro Abdelnur faf54e5b2a Merge -r 1370386:1370387 from trunk to branch. FIXES: HDFS-3291
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370392 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 17:46:24 +00:00
Aaron Myers 9c8485f099 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 16:46:03 +00:00
Aaron Myers 7f92566e21 HDFS-3579. libhdfs: fix exception handling. (Colin Patrick McCabe via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370016 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 21:03:57 +00:00
Aaron Myers b86332b8e1 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1369851 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 14:03:52 +00:00
Alejandro Abdelnur 99050a6508 Merge -r 1368732:1368733 from trunk to branch. FIXES: HDFS-3756
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368735 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 22:12:58 +00:00
Alejandro Abdelnur f5dfa69617 Merge -r 1368307:1368308 from trunk to branch. FIXES: HDFS-3724
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368310 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:16:48 +00:00
Alejandro Abdelnur 6406fb59f7 Merge -r 1368303:1368304 from trunk to branch. FIXES: HDFS-3513
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368305 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:10:26 +00:00
Eli Collins afd9e523cd HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368259 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 21:30:06 +00:00
Eli Collins f23d581bfd HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368256 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 21:27:12 +00:00
Aaron Myers af6d62a9c1 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367845 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 02:22:30 +00:00
Tsz-wo Sze 15a9b9829a svn merge -c 1367841 from trunk for HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367842 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 01:44:03 +00:00
Tsz-wo Sze cfedcc9e27 svn merge -c -1366602 for reverting HDFS-3667.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367408 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 04:36:35 +00:00
Robert Joseph Evans 59d4ea2c64 svn merge -c 1367202 FIXES: HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367203 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:12:29 +00:00
Aaron Myers cb94513c1f HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367201 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:07:53 +00:00
Tsz-wo Sze 9d30ba3753 svn merge -c 1366601 from trunk for HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366602 13f79535-47bb-0310-9956-ffa450edef68
2012-07-28 06:07:22 +00:00
Suresh Srinivas 117c16edfe HDFS-3679. merging change 1366545 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366546 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 21:53:13 +00:00
Daryn Sharp af0cc1c7c0 svn merge -c 1366471 FIXES: HDFS-3553. Hftp proxy tokens are broken (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366501 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 19:08:10 +00:00
Daryn Sharp b1109c152e svn merge -c 1366440 FIXES: HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366450 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 16:53:38 +00:00
Aaron Myers 8a8461ef31 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366245 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 00:22:54 +00:00
Alejandro Abdelnur 1849fca985 Merge -r 1365989:1365990 from trunk to branch. FIXES: HDFS-3113
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365991 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:43:17 +00:00
Alejandro Abdelnur c7bbda5ec9 Merge -r 1365987:1365988 from trunk to branch. FIXES: HDFS-3113
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365989 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:41:09 +00:00
Tsz-wo Sze d86cffd7ef svn merge -c 1365839 from trunk for HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365842 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 23:43:17 +00:00
Todd Lipcon d7fdcea8bf HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365803 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:52:43 +00:00
Aaron Myers 477a0dcc64 HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365763 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:22:00 +00:00
Robert Joseph Evans bd7735fe79 svn merge -c 1365588 FIXES: HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365589 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 13:57:54 +00:00
Aaron Myers 4fdf282b6a HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365125 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 15:27:10 +00:00
Eli Collins 74e514f59a HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1364866 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 01:55:26 +00:00
Todd Lipcon 0db50a9d99 HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1364699 13f79535-47bb-0310-9956-ffa450edef68
2012-07-23 16:28:04 +00:00
Aaron Myers 5d110e145e HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363948 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:44:56 +00:00
Aaron Myers 1721ae0511 HDFS-3608. fuse_dfs: detect changes in UID ticket cache. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363906 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 19:17:50 +00:00
Todd Lipcon 75a419f15b HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363900 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 18:59:17 +00:00
Eli Collins 86273d0cf4 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363577 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 23:06:39 +00:00
Robert Joseph Evans 560a5d04ee Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363548 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 21:16:33 +00:00
Eli Collins 74d51ada99 HDFS-1249. With fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363467 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:38:13 +00:00
Eli Collins e646e4f6ab HDFS-3675. libhdfs: follow documented return codes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363460 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:26:20 +00:00
Eli Collins 0d0e551efd HDFS-3673. libhdfs: fix some compiler warnings. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363458 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:23:15 +00:00
Robert Joseph Evans 48a86fbe8f svn merge -c 1363435 FIXES: HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363437 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 17:48:33 +00:00
Todd Lipcon fb87050e00 HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363176 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:42:20 +00:00
Daryn Sharp 22022a8760 svn merge -c 1363170 FIXES: HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363172 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:27:21 +00:00
Eli Collins e8b0614072 HDFS-2966. TestNameNodeMetrics tests can fail under load. Contributed by Steve Loughran
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362985 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:42:19 +00:00
Tsz-wo Sze 7221b08042 svn merge -c 1362976 from trunk for HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362977 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:14:38 +00:00
Eli Collins ab129035bf Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362765 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:50 +00:00
Eli Collins 3f4826881d Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362764 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:09 +00:00
Eli Collins 9404bc7cad HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362274 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:30:42 +00:00
Eli Collins d3b1109de8 MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362207 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:10:26 +00:00
Eli Collins c56bbc7a00 HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362179 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 18:34:09 +00:00
Eli Collins fa26901c01 HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362127 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 16:54:49 +00:00
Harsh J 2c418eecf6 Backport of HDFS-3659 from trunk. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361895 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 03:07:49 +00:00
Eli Collins 5685eb30bb HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361777 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 19:48:15 +00:00
Eli Collins 30d0104c0e HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361566 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:19:26 +00:00
Eli Collins d03fb9c0d2 Amend HDFS-799. Remove unnecessary tls check. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361563 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:03:24 +00:00
Eli Collins a9629c6fe7 HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361465 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 01:10:19 +00:00
Eli Collins 2e63754888 HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361461 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:53:07 +00:00
Eli Collins e8cc5cb4aa HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361455 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:36:32 +00:00
Eli Collins 03e8648d17 HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361450 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:22:55 +00:00
Eli Collins bb00c0ce20 HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361447 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:04:36 +00:00
Eli Collins 849dc6da07 HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:28:23 +00:00
Harsh J 0565cb3c03 HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361060 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:21:18 +00:00
Eli Collins 0d9ef3c516 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361022 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:46:13 +00:00
Eli Collins 1a76841335 HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361009 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:10:26 +00:00
Eli Collins c1c388bbb6 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361006 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 23:53:12 +00:00
Eli Collins dce88a6dbc HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360896 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:59:20 +00:00
Eli Collins 790e970931 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360867 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:23:39 +00:00
Eli Collins ef21cbf70a HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360331 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 18:04:23 +00:00
Aaron Myers 786aaca2ab HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360256 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 16:10:50 +00:00
Eli Collins 267a83df9f HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360053 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:14:46 +00:00
Harsh J 6ff0e1fc3a Backport of HDFS-3611 from trunk. svn merge -c 1360001 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360002 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:37:55 +00:00
Harsh J 0b91df4d1a Backport of HDFS-3613 from trunk. svn merge -c 1359999 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360000 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:15:54 +00:00
Harsh J 6df36b322b Backport of HDFS-3629 from trunk. svn merge -c 1359905 ../../trunk (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359906 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 21:15:21 +00:00
Aaron Myers 1ed7052a82 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359826 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:31:25 +00:00
Harsh J 1bdd4f4d38 Backport of HDFS-3555 from trunk. svn merge -c 1359619 ../../trunk. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359621 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 11:53:39 +00:00
Aaron Myers d07d0f1a51 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359330 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 18:32:38 +00:00
Daryn Sharp 7212c3d638 svn merge -c 1296016 FIXES: HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359242 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 16:07:10 +00:00
Eli Collins 0628876901 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358850 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 22:06:25 +00:00
Eli Collins b4c8c50456 HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358824 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 19:42:30 +00:00
Eli Collins 9f79f45b8c HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358811 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:29:17 +00:00
Eli Collins 7dcf9b6b8f Fixup CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358807 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:20:22 +00:00
Eli Collins ac8b210736 HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358806 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:19:43 +00:00
Uma Maheswara Rao G 2f7ad820e8 Merge from trunk r:1358794 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay.
Submitted by:Vivay	
Reviewed by:	Uma Maheswara Rao G, Kihwal Lee, Aaron


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358798 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 17:56:41 +00:00
Harsh J 215c8add4e Backport of HDFS-2988 from trunk. svn merge -c 1358683 from trunk. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358685 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 00:40:02 +00:00
Eli Collins 31c7f73f7b HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358660 13f79535-47bb-0310-9956-ffa450edef68
2012-07-07 22:35:39 +00:00
Aaron Myers fbb1760459 Fix issue with NN/DN re-registration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358348 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 19:00:06 +00:00
Todd Lipcon 5f6a138ca0 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1357969 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 22:18:16 +00:00
Eli Collins d222e91bfa HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356972 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:43:48 +00:00
Todd Lipcon aec6b65fcb HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356937 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:55:10 +00:00
Todd Lipcon e60abcb8ab HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356930 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:46:42 +00:00
Eli Collins 2d05f1a749 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356514 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:48:05 +00:00
Alejandro Abdelnur 1142e13bd4 Merge -r 1356329:1356330 from trunk to branch. FIXES: HDFS-3575
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356332 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 16:42:28 +00:00
Tsz-wo Sze 2de013e0a8 svn merge -c 1356086 from trunk for HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356095 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 07:39:02 +00:00
Eli Collins 2b938bea99 HADOOP-8538. CMake builds fail on ARM. Contributed by Trevor Robinson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356042 13f79535-47bb-0310-9956-ffa450edef68
2012-07-01 22:51:13 +00:00
Harsh J 6f299e4e25 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension (backported from trunk) (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355637 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 05:05:41 +00:00
Alejandro Abdelnur b51d32719d Merge -r 1355592:1355593 from trunk to branch. FIXES: HDFS-3580
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355595 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:59:09 +00:00
Todd Lipcon 535fd7de15 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355583 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:23:53 +00:00
Alejandro Abdelnur 30c8f2bc9c Merge -r 1355555:1355556 from trunk to branch. FIXES: HDFS-3491
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355558 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 21:05:43 +00:00
Aaron Myers 232169c414 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355143 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 20:08:08 +00:00
Eli Collins 3cce51f2f2 HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355090 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:57:05 +00:00
Todd Lipcon 3fe00a6c77 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354766 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 22:41:26 +00:00
Alejandro Abdelnur 2277017dfc Amendment to previous commit JIRA is HDFS-3481
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354607 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:18:58 +00:00
Alejandro Abdelnur c4cbc45d05 Merge -r 1354598:1354599 from trunk to branch. FIXES: HDFS-3113
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354603 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:13:35 +00:00
Tsz-wo Sze 078670046d svn merge -c 1354316 from trunk for HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354317 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 02:53:20 +00:00
Eli Collins eea9ffe8ac HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354147 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 18:18:19 +00:00
Tsz-wo Sze f753503beb svn merge -c 1353800 from trunk for HDFS-3516. Check content-type in WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1353802 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 02:01:17 +00:00
Tsz-wo Sze 2106c8bec8 svn merge -c 1350825 from trunk for HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if he given HDFS is healthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1350826 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 23:02:46 +00:00
Tsz-wo Sze 94a5971872 svn merge -c 1350384 from trunk for HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1350385 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 20:18:36 +00:00
Eli Collins 401f9ace50 HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349644 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:53:48 +00:00
Aaron Myers cbd17834c0 HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349640 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:34:19 +00:00
Eli Collins 788592aa3b HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349630 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 03:38:14 +00:00
Eli Collins bc5f311bb8 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349617 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:48:26 +00:00
Alejandro Abdelnur 12201fca35 Merge -r 1349554:1349555 from trunk to branch. FIXES: HDFS-3428
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349557 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:03:52 +00:00
Uma Maheswara Rao G 1bfab40533 Updated CHANGES.txt for Merge r:1349466 HDFS-3389. Document the BKJM usage in Namenode HA. Contributed by Uma Maheswara Rao G and Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349470 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 18:28:38 +00:00
Uma Maheswara Rao G 148f7e2dd7 Merge r:1349456 and r:1349459 HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349462 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 18:04:31 +00:00
Eli Collins 2acc997daa Revert HADOOP-8491
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349135 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 06:23:43 +00:00
Tsz-wo Sze 4c831ec671 svn merge -c 1349124 from trunk for HDFS-3504.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349126 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:33:54 +00:00
Eli Collins 8e1730243b HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349118 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:01:50 +00:00
Tsz-wo Sze abfd7dba32 svn merge -c 1349088 from trunk for HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349090 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 01:59:24 +00:00
Tsz-wo Sze 97ab65f3ab svn merge -c 1348998 from trunk for HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349089 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 01:57:38 +00:00
Eli Collins 9d83af831b HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349025 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 21:26:06 +00:00
Eli Collins bc18206bbe HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349005 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:53:08 +00:00
Alejandro Abdelnur f27f122609 Merge -r 1348956:1348957 from trunk to branch. FIXES: HADOOP-8368
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348959 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:44:57 +00:00
Eli Collins d781e8efdf HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348953 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:20:41 +00:00
Tsz-wo Sze 1f564d1135 svn merge -c 1348287 from trunk for HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348288 13f79535-47bb-0310-9956-ffa450edef68
2012-06-09 00:55:47 +00:00
Todd Lipcon 4b531693d3 HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson.
(svn merge -c 1312029 from trunk)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348257 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:45:54 +00:00
Todd Lipcon caa6f4ab98 HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson.
(svn merge -c 1348207 from trunk)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348249 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:23:35 +00:00
Todd Lipcon 5b43977af1 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson.
(svn merge -c 1311556 from trunk)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348247 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:19:17 +00:00
Todd Lipcon e6c0425996 HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson.
(svn merge -c 1310185 from trunk)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348246 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:16:34 +00:00
Todd Lipcon 2ce56df137 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
(svn merge -c 1303474 from trunk)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1348217 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 20:01:32 +00:00
Aaron Myers 4757836b75 HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347898 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 07:04:58 +00:00
Todd Lipcon 913ba74512 Move HDFS-3042 changes into main CHANGES.txt files for branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347805 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:30:54 +00:00
Todd Lipcon d7e171d5b8 Merge HDFS-3042 (automatic failover) to branch-2 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347804 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:25:34 +00:00
Todd Lipcon 4db45a7f7a Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347797 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:06:41 +00:00