Commit Graph

1125 Commits

Author SHA1 Message Date
Arun Murthy b9a5fd5190 MAPREDUCE-2917. Fixed corner case in container reservation which led to starvation and hung jobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163768 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 19:52:20 +00:00
Vinod Kumar Vavilapalli ade0f0560f MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 11:38:32 +00:00
Mahadev Konar 5786efbfa6 MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for common daemon. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163490 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 05:48:02 +00:00
Tsz-wo Sze f10c97d390 HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads(). Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163465 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 01:16:47 +00:00
Matthew Foley 1cd3791172 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163463 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 00:58:19 +00:00
Tsz-wo Sze 8c9c8c72cc Remove svn:mergeinfo from TestSequenceFile.java
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163462 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 00:56:25 +00:00
Tsz-wo Sze 4b661b3670 HADOOP-7576. Fix findbugs warnings and javac warnings in hadoop-auth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163456 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 00:18:55 +00:00
Tsz-wo Sze aba0e225fc HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163081 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 04:02:22 +00:00
Arun Murthy c2b851b0f2 MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163069 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 01:22:28 +00:00
Mahadev Konar fb6ecb9b27 MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 23:27:47 +00:00
Mahadev Konar aad81a15ec MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth and Mahadev Konar via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162979 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 20:23:17 +00:00
Arun Murthy 3380d8f70c MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and clean up of stale refs to pre-mavenized Hadoop Common and HDFS. Contributed by Sharad Agarwal and Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162954 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 19:36:26 +00:00
Mahadev Konar 602dd3c7dc HADOOP-7589. Prefer mvn test -DskipTests over mvn compile in test-patch.sh (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162928 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 18:24:21 +00:00
Arun Murthy b9259a2710 MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162613 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 00:04:06 +00:00
Arun Murthy 00d2263908 MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. Contributed by acmurthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162499 13f79535-47bb-0310-9956-ffa450edef68
2011-08-28 11:41:36 +00:00
Arun Murthy c9cbd8e4e6 MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in ClientProtocolProvider services file. Contributed by Liang-Chi Hsieh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162491 13f79535-47bb-0310-9956-ffa450edef68
2011-08-28 10:37:24 +00:00
Arun Murthy 8b56463315 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162421 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 19:07:04 +00:00
Arun Murthy d8c3e63dce MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in HADOOP_COMMON_HOME/libexec.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162188 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 17:55:53 +00:00
Tsz-wo Sze 56dd8ba0b8 HADOOP-7547. Add generic type in WritableComparable subclasses. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162008 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 06:58:52 +00:00
Todd Lipcon 23e7fc4f46 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162005 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 06:51:57 +00:00
Todd Lipcon 7cf49f5d9c HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162003 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 06:44:13 +00:00
Hairong Kuang 73451ed2d9 HDFS-395. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161992 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:46:42 +00:00
Hairong Kuang e680023f8b Revert 1161976 since the log message was incorrectly marked the issue as HDFS-349.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161991 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:41:52 +00:00
Hairong Kuang 522fe14a89 Move change log for HDFS-395 from 0.23 section to trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161987 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:16:20 +00:00
Hairong Kuang e6339be188 HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161976 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 03:10:13 +00:00
Giridharan Kesavan 0ee0fa45d2 MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161782 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:30:42 +00:00
Mahadev Konar a415733cf6 HADOOP-7578. Adding needed files in svn (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161781 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:27:24 +00:00
Mahadev Konar e096d0b225 HADOOP-7578. Fix a mess up in svn move (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161777 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:12:27 +00:00
Arun Murthy a44ffcc0be Preparing for hadoop-0.24.0 development.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:32:04 +00:00
Arun Murthy 5675dad8b7 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161722 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:01:59 +00:00
Arun Murthy ee05510c42 Preparing for release 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:39:15 +00:00
Mahadev Konar 01f24e1af7 HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161711 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:31:02 +00:00
Arun Murthy 58676edf98 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:13:50 +00:00
Arun Murthy 1dd113b24a MAPREDUCE-2796. Set start times for MR applications for clients to see. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161704 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:12:35 +00:00
Mahadev Konar 7c85f33ce1 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:16:36 +00:00
Tsz-wo Sze 31903fec4e Setup svn:ignore in hadoop-auth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161526 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 11:54:58 +00:00
Sharad Agarwal f2b91a8367 MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161408 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 06:35:58 +00:00
Arun Murthy 6316e66279 HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161335 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:20:52 +00:00
Arun Murthy cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:14:24 +00:00
Arun Murthy bb0005cfec HADOOP-7563. Setup HADOOP_HDFS_HOME, HADOOP_MAPRED_HOME and classpath correction. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161329 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:06:53 +00:00
Owen O'Malley ebf61db566 MAPREDUCE-2846. Fix missing synchronization in the task log management.
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161324 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 23:52:08 +00:00
Thomas White fdae3cda85 HADOOP-7567. 'mvn eclipse:eclipse' fails for hadoop-alfredo (auth). Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161304 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 22:28:54 +00:00
Thomas White 71c2f73175 HADOOP-7561. Make test-patch only run tests for changed modules.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161291 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 21:35:38 +00:00
Giridharan Kesavan 1eb272051d MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160987 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 06:47:01 +00:00
Todd Lipcon ec559db68e HDFS-1480. All replicas of a block can end up on the same rack when some datanodes are decommissioning. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160897 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:15 +00:00
Arun Murthy 61cbfa5fde MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160896 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:10 +00:00
Todd Lipcon b04aafee50 HDFS-2267. DataXceiver thread name incorrect while waiting on op during keepalive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160873 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 19:47:14 +00:00
Arun Murthy 8af5c4b24a MAPREDUCE-2649. Handling of finished applications in RM. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160521 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 01:32:32 +00:00
Tsz-wo Sze 2892f6d817 HDFS-2266. Add Namesystem and SafeMode interfaces to avoid directly referring to FSNamesystem in BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160493 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 23:14:24 +00:00
Tsz-wo Sze 513f17d115 HDFS-2273. Refactor BlockManager.recentInvalidateSets to a new class.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160475 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:28:17 +00:00