Commit Graph

1357 Commits

Author SHA1 Message Date
Tsz-wo Sze 796b009348 svn merge -c 1171611 from trunk for HDFS-2318.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189418 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 20:00:33 +00:00
Tsz-wo Sze 6d0c068978 svn merge -c 1171379 from trunk for HDFS-2338.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189415 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 19:51:59 +00:00
Tsz-wo Sze 0c6c92e672 svn merge -c 1171136 from trunk for HDFS-2333.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189411 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 19:47:10 +00:00
Tsz-wo Sze 20a31036c8 svn merge -c 1170996 from trunk for HDFS-2331.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189410 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 19:45:12 +00:00
Tsz-wo Sze eda4dbbb76 svn merge -c 1170085 from trunk for HDFS-2317.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189405 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 19:33:44 +00:00
Tsz-wo Sze 23fb417305 svn merge -c 1166009 from trunk for HDFS-2284.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189384 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:59:30 +00:00
Tsz-wo Sze 800d0f27c3 svn merge -c 1167662 from trunk for HDFS-2284.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189375 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:48:53 +00:00
Arun Murthy 4cfc89a9a4 Merge -c 1189314 from trunk to branch-0.23 to fix HADOOP-7764.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189315 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 17:05:29 +00:00
Arun Murthy b211fc72cc Merge -c 1189036 from trunk to branch-0.23 to fix for MAPREDUCE-2858.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189037 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 06:32:26 +00:00
Mahadev Konar 383b8ed9d9 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev) - Merging r1189023 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189024 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 04:35:40 +00:00
Arun Murthy b0384fc087 Merge -c 1189012 from trunk to branch-0.23 to complete fix for MAPREDUCE-2977.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189013 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:58:00 +00:00
Arun Murthy 4dd5c3169d Merge -c 1188999 from trunk to branch-0.23 to complete fix for MAPREDUCE-3269.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189000 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:17:05 +00:00
Arun Murthy d78033e453 Merge -c 1188997 from trunk to branch-0.23 to complete fix for MAPREDUCE-3263.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188998 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:13:29 +00:00
Arun Murthy d22a142f94 Merge -c 1188842 from trunk to branch-0.23 to complete fix for MAPREDUCE-3253.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188843 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 18:14:45 +00:00
Arun Murthy 1bef05715d Merge -c 1188528 from trunk to branch-0.23 to complete fix for MAPREDUCE-2821.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188529 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:27:24 +00:00
Mahadev Konar ddccefbefb MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) - Merging r1188522 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188524 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:12:14 +00:00
Todd Lipcon 635d78c25f Amend MAPREDUCE-3159. Fix JavaDoc warnings in previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188478 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:13:55 +00:00
Arun Murthy 88c24ca831 Merge -c 1188466 from trunk to branch-0.23 to complete fix for MAPREDUCE-3159.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188468 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 00:42:56 +00:00
Arun Murthy 1527edc627 Merge -c 1188388 from trunk to branch-0.23 to complete fix for MAPREDUCE-3252.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 00:41:52 +00:00
Todd Lipcon 21ded50c4d MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188423 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 22:32:47 +00:00
Arun Murthy 28d52eabfa Merge -c 1188377 from trunk to branch-0.23 to complete fix for MAPREDUCE-3028.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188378 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:03:22 +00:00
Vinod Kumar Vavilapalli df7a66844b MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188261 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 17:59:30 +00:00
Vinod Kumar Vavilapalli 6069c2a82d MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
svn merge -c r1188043 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188044 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 08:44:54 +00:00
Konstantin Shvachko 8f5c47794f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187969 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 20:28:30 +00:00
Steve Loughran ca1aa84fd5 HDFS-2485
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187889 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 14:15:09 +00:00
Vinod Kumar Vavilapalli b9e90a3319 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
svn merge -c r1187669 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 08:13:20 +00:00
Vinod Kumar Vavilapalli 56072a170d MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash.
svn merge -c r1187658 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187659 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:48:42 +00:00
Vinod Kumar Vavilapalli 1605fb7dbc MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
svn merge -c r1187654 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187655 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:17:25 +00:00
Mahadev Konar abae89ed32 MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev) - Merging r1187587 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187589 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 22:48:29 +00:00
Thomas White 101dafff16 HADOOP-7564. Remove test-patch SVN externals
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187573 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 22:02:11 +00:00
Mahadev Konar cbd1258918 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev) - Merging r1187556 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187558 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 21:38:45 +00:00
Arun Murthy 59348f53a1 Merge -c 1187496 from trunk to branch-0.23 to complete fix for MAPREDUCE-3070.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187497 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:48:07 +00:00
Mahadev Konar 1edb5c8f9e MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev) - Merging r1187491 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187492 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:38:26 +00:00
Todd Lipcon 5acc010db8 MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187182 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 05:20:14 +00:00
Arun Murthy fe370841e6 Merge -c 1187116 from trunk to branch-0.23 to complete fix for MAPREDUCE-3226.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187119 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 22:45:08 +00:00
Todd Lipcon ac21f20ac6 HADOOP-7749. Add a NetUtils createSocketAddr call which provides more help in exception messages. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187102 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 22:26:19 +00:00
Vinod Kumar Vavilapalli 9a8b923418 MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
svn merge -c r1186748 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186754 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 12:01:54 +00:00
Suresh Srinivas 50ad8ec904 HDFS-2471. Add documentation for HDFS federation feature. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 00:29:12 +00:00
Arun Murthy ffccd70d7a Merge -c 1186554 from trunk to branch-0.23 to complete fix for MAPREDUCE-3188.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186555 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 23:00:07 +00:00
Arun Murthy 2115478185 Merge -c 1186552 from trunk to branch-0.23 to complete fix for MAPREDUCE-3179.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186553 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:55:07 +00:00
Arun Murthy 68bea3dc46 Merge -c 1186550 from trunk to branch-0.23 to complete fix for HDFS-2445.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186551 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:52:29 +00:00
Arun Murthy ca752e8dd8 Merge -c 1186548 from trunk to branch-0.23 to complete fix for HADOOP-7744.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186549 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:49:24 +00:00
Arun Murthy 797ee4c4d3 Merge -c 1186546 from trunk to branch-0.23 to complete fix for MAPREDUCE-3212.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186547 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:43:27 +00:00
Arun Murthy c56916f582 Merge -c 1186542 from trunk to branch-0.23 to complete fix for MAPREDUCE-3208.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186544 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:38:53 +00:00
Arun Murthy 38a73eebaf Merge -c 1186529 from trunk to branch-0.23 to complete fix for MAPREDUCE-2693.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:02:57 +00:00
Arun Murthy 9895a6353b Merge -c 1186467 from trunk to branch-0.23 to complete fix for MAPREDUCE-2788.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186468 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:37:51 +00:00
Arun Murthy cad9bc8843 Merge -c 1186458 from trunk to branch-0.23 to complete fix for MAPREDUCE-3181.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186459 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:28:49 +00:00
Vinod Kumar Vavilapalli 3b39b29b9c MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah.
svn merge -c r1186368 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186369 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 17:58:32 +00:00
Vinod Kumar Vavilapalli db1c89fd51 MAPREDUCE-3162. Separated application-init and container-init event types in NodeManager's Application state machine. Contributed by Todd Lipcon.
svn merge -c r1185988 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185990 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 06:42:38 +00:00
Vinod Kumar Vavilapalli e3b9d11da8 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
svn merge -c r1185976 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 05:28:22 +00:00