Commit Graph

3973 Commits

Author SHA1 Message Date
Todd Lipcon a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:05:34 +00:00
Tsz-wo Sze 1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 21:04:32 +00:00
Daryn Sharp 54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 19:27:47 +00:00
Robert Joseph Evans b68bd472dc YARN-202. Log Aggregation generates a storm of fsync() for namenode (Kihwal Lee via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406269 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 18:48:49 +00:00
Suresh Srinivas b13a5cdcb7 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 16:12:43 +00:00
Daryn Sharp 3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:57:58 +00:00
Robert Joseph Evans 5605b54010 HADOOP-9012. IPC Client sends wrong connection context (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406184 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:37:14 +00:00
Suresh Srinivas dca8dd7a20 Add HDFS-4046 to Release 2.0.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406019 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 00:22:23 +00:00
Suresh Srinivas 159e507995 HDFS-4046. Adding the missed file in revision 1406011
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406012 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:50:29 +00:00
Suresh Srinivas e0ce1b2475 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406011 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:49:33 +00:00
Tsz-wo Sze 7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:26:34 +00:00
Robert Joseph Evans 0eadfcfcf5 MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 21:52:06 +00:00
Robert Joseph Evans b1aa62a848 HADOOP-9010. Map UGI authenticationMethod to RPC authMethod (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405910 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 18:37:39 +00:00
Robert Joseph Evans 8303175db8 HADOOP-9009. Add SecurityUtil methods to get/set authentication method (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405904 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 18:26:49 +00:00
Robert Joseph Evans 05b6dc647e Localization update
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405846 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 15:43:54 +00:00
Tsz-wo Sze d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-03 00:20:03 +00:00
Todd Lipcon a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 20:35:51 +00:00
Robert Joseph Evans 1783f209f0 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 15:00:56 +00:00
Daryn Sharp 19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 14:56:22 +00:00
Jason Darrell Lowe 42d1eaf237 MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 22:59:43 +00:00
Robert Joseph Evans b50a3c5de3 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 17:02:52 +00:00
Vinod Kumar Vavilapalli a124297cf0 YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the dispatcher. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404431 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 00:32:37 +00:00
Robert Joseph Evans 50993e9d48 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 19:13:03 +00:00
Robert Joseph Evans ab8fa651f7 YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404247 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 16:56:23 +00:00
Robert Joseph Evans 9f55dd3a54 YARN-159. RM web ui applications page should be sorted to display last app first (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404228 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 16:22:34 +00:00
Robert Joseph Evans c15c192ad0 YARN-165. RM should point tracking URL to RM web page for app when AM fails (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404211 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 15:47:11 +00:00
Thomas Graves aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 14:57:12 +00:00
Suresh Srinivas 07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 02:33:44 +00:00
Suresh Srinivas cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 23:12:12 +00:00
Uma Maheswara Rao G b2822e3742 Moved HDFS-3809 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:32:01 +00:00
Uma Maheswara Rao G 7ccdb67d5c Moved HDFS-3789 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403765 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:22:42 +00:00
Uma Maheswara Rao G 52df4b3e78 Moved HDFS-3695 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403748 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:51:49 +00:00
Robert Joseph Evans 12eb3b8abc HADOOP-8986. Server$Call object is never released after it is sent (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403745 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:46:15 +00:00
Uma Maheswara Rao G 1e07fece6e Moved HDFS-3573 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403740 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:38:12 +00:00
Daryn Sharp deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 14:21:00 +00:00
Suresh Srinivas 7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:48:58 +00:00
Alejandro Abdelnur 16e21dfe92 MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:41:59 +00:00
Suresh Srinivas ba7a2e3898 Moved HDFS-4122 to Release 2.0.3 section. It is also moved to Incompatible Changes section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403570 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 22:43:58 +00:00
Suresh Srinivas 1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 14:11:04 +00:00
Suresh Srinivas 4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 05:10:29 +00:00
Suresh Srinivas cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 23:10:53 +00:00
Suresh Srinivas fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 19:03:57 +00:00
Suresh Srinivas abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 18:59:11 +00:00
Suresh Srinivas 22377ebae5 HADOOP-8985. Add namespace declarations in .proto files for languages other than java. Thank you Binglin Chan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402845 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:44:15 +00:00
Suresh Srinivas b6d09f67ab Moving HDFS-4121 from trunk to Release 2.0.3 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402843 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:41:43 +00:00
Suresh Srinivas cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:25:02 +00:00
Thomas Graves a577f757f7 HADOOP-8713. TestRPCCompatibility fails intermittently with JDK7 Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402660 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:03:29 +00:00
Jason Darrell Lowe 286c171987 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:02:52 +00:00
Thomas White b54e794fb0 YARN-145. Add a Web UI to the fair share scheduler. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402657 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 20:55:57 +00:00
Tsz-wo Sze 3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:22:49 +00:00