Commit Graph

3960 Commits

Author SHA1 Message Date
Tsz-wo Sze 2d5f195730 svn merge -c 1442755 from trunk for HADOOP-9278. Fix the file handle leak in HarMetaData.parseMetaData() in HarFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442756 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 21:24:05 +00:00
Jason Darrell Lowe 7126958734 svn merge -c 1442639 FIXES: HADOOP-9260. Hadoop version may be not correct when starting name node or data node. Contributed by Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442641 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 16:06:58 +00:00
Aaron Myers 98678962c4 MAPREDUCE-4953. HadoopPipes misuses fprintf. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442472 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 04:54:28 +00:00
Aaron Myers 400ea0cba2 HDFS-4344. dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442466 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 04:09:59 +00:00
Aaron Myers 0da09ea945 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442462 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 03:23:46 +00:00
Siddharth Seth 992ba4c79c merge YARN-360 from trunk. Allow apps to concurrently register tokens for renewal. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442442 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 00:27:36 +00:00
Tsz-wo Sze 412062c0ba svn merge -c 1442386 from trunk for HADOOP-9252. In StringUtils, humanReadableInt(..) has a race condition and the synchronization of limitDecimalTo2(double) can be avoided.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442387 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 21:43:27 +00:00
Aaron Myers f2db75247d HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442378 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 21:32:02 +00:00
Hitesh Shah ca765ecb05 merge -c 1442312 from trunk to branch-2 to fix HADOOP-9276. Allow BoundedByteArrayOutputStream to be resettable. Contributed by Arun Murthy
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442316 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 19:46:48 +00:00
Robert Joseph Evans 54ce586b8d svn merge -c r1427945 FIXES: MAPREDUCE-4884. Streaming tests fail to start MiniMRCluster due to missing queue configuration. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442174 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 16:54:43 +00:00
Uma Maheswara Rao G 40033359d1 Merge HDFS-4445. All BKJM ledgers are not checked while tailing, So failover will fail. Contributed Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441936 13f79535-47bb-0310-9956-ffa450edef68
2013-02-03 17:37:12 +00:00
Suresh Srinivas 0267141ec6 HDFS-4350. Merging change 1441819 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441821 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 22:37:51 +00:00
Konstantin Shvachko 6db7aa6f89 HDFS-4452. getAdditionalBlock() can create multiple blocks if the client times out and retries. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441682 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 02:09:09 +00:00
Siddharth Seth 392a96bd64 merge MAPREDUCE-4971 from trunk. Minor extensibility enhancements to Counters & FileOutputFormat. Contributed by Arun C Murthy
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441672 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 00:49:17 +00:00
Hitesh Shah 6eead06fa2 merge -c 1441668 from trunk to branch-2 to fix YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to hadoop-yarn-common. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441669 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 00:45:37 +00:00
Robert Joseph Evans 925c21650a svn merge -c 1441628 FIXES: HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441635 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 21:17:35 +00:00
Alejandro Abdelnur 1d068dee85 HDFS-4456. Add concat to HttpFS and WebHDFS REST API docs. (plamenj2003 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441606 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 19:46:14 +00:00
Thomas White a4abf4f573 Merge -r 1441474:1441475 from trunk to branch-2. Fixes: HADOOP-9124. SortedMapWritable violates contract of Map interface for equals() and hashCode(). Contributed by Surenkumar Nihalani
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441476 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 15:05:32 +00:00
Jason Darrell Lowe 3946c10b13 svn merge -c 1441239 FIXES: YARN-364. AggregatedLogDeletionService can take too long to delete logs. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441244 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 22:51:49 +00:00
Suresh Srinivas e3aca293e5 HDFS-4451. Merge change 1441113 and 1441123 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441128 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 19:03:15 +00:00
Suresh Srinivas a83b272a36 MAPREDUCE-4969. Merge change 1441069 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1441070 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 17:17:21 +00:00
Aaron Myers 3b1002517d HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440866 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 07:34:03 +00:00
Suresh Srinivas df1a40364b HADOOP-8981. Merge r1440780 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440781 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 01:40:49 +00:00
Vinod Kumar Vavilapalli a11e8bef64 MAPREDUCE-4893. Fixed MR ApplicationMaster to do optimal assignment of containers to get maximum locality. Contributed by Bikas Saha.
svn merge --ignore-ancestry -c 1440749 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440752 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 00:29:36 +00:00
Thomas Graves 1456adb9e1 YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440460 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 15:18:40 +00:00
Konstantin Shvachko c4e9838d53 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440291 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 06:53:26 +00:00
Aaron Myers c1eb3db9ca Move HADOOP-9221 to correct section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440247 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 02:01:45 +00:00
Aaron Myers e8738643c4 merge HADOOP-9221 from trunk. Convert remaining xdocs to APT.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440246 13f79535-47bb-0310-9956-ffa450edef68
2013-01-30 01:56:42 +00:00
Kihwal Lee 64c6dd8f5c merge -r 1440191:1440192 from trunk to branch-2 to fix HDFS-4288
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440194 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 22:49:17 +00:00
Alejandro Abdelnur 1cc2fcd3b2 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440080 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 19:40:20 +00:00
Thomas Graves fc5e5a09ed HADOOP-9190. packaging docs is broken. (Andy Isaacson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439966 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 16:08:57 +00:00
Harsh J e743b0520d Revert HADOOP-9241 from branch-2 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439772 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 08:01:50 +00:00
Siddharth Seth 6f146b15d3 merge MAPREDUCE-4838 from trunk. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439715 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 00:23:27 +00:00
Kihwal Lee 02f11f149d merge -r 1439652:1439653 Merging YARN-133
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439655 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 21:55:49 +00:00
Thomas Graves 4200f0a75d HADOOP-9255. relnotes.py missing last jira (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439601 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:55:33 +00:00
Siddharth Seth 6431b24f04 merge MAPREDUCE-4803 from trunk. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439591 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:19:52 +00:00
Alejandro Abdelnur 26e597010f Reverting MAPREDUCE-2264
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439564 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:59:32 +00:00
Suresh Srinivas e6d3fceb09 HDFS-4444. Mrege 1439559 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439562 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:59:05 +00:00
Suresh Srinivas 8a20446beb HADOOP-9247. Merge r1438698 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439531 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 17:59:12 +00:00
Harsh J 1590ccc486 HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439130 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:53:04 +00:00
Harsh J 91c35f4464 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439127 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:43:09 +00:00
Tsz-wo Sze 8caa368fc9 svn merge -c 1438808 from trunk for HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438809 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 01:19:36 +00:00
Alejandro Abdelnur 7ac9d3b1c5 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438800 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:50:17 +00:00
Alejandro Abdelnur d8cdee8360 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438796 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:41:12 +00:00
Alejandro Abdelnur cf67cccd7c MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438795 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:40:21 +00:00
Alejandro Abdelnur 7a6b9f3609 MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438794 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:39:27 +00:00
Alejandro Abdelnur c4c039bb29 MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438793 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:38:38 +00:00
Alejandro Abdelnur 578bc2ce0c HADOOP-8857. hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1438604 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 17:28:30 +00:00
Jason Darrell Lowe 1321717f60 svn merge -c 1437775 FIXES: YARN-354. WebAppProxyServer exits immediately after startup. Contributed by Lian Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1437776 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 22:10:50 +00:00
Suresh Srinivas eaf5cea54f HDFS-4426. Merge change 1437627 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1437628 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 19:02:57 +00:00