Commit Graph

986 Commits

Author SHA1 Message Date
Siddharth Seth b28f134e9c MAPREDUCE-3869. Fix classpath for DistributedShell application. (Contributed by Devaraj K)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311523 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:01:49 +00:00
Thomas White 241e3d40ac MAPREDUCE-4105. Yarn RackResolver ignores rack configurations. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311520 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 23:32:43 +00:00
Robert Joseph Evans 48ab08f1c6 MAPREDUCE-4117. mapred job -status throws NullPointerException (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311479 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 21:52:50 +00:00
Robert Joseph Evans b435e2202d MAPREDUCE-4110. Fix tests in TestMiniMRClasspath & TestMiniMRWithDFSWithDistinctUsers (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310546 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:56:55 +00:00
Arun Murthy 5af7077dcd Added toString to ContainerToken. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310537 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:41:06 +00:00
Robert Joseph Evans c156906c73 MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310528 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:09:09 +00:00
Robert Joseph Evans 2bb3407af9 MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310431 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:04:40 +00:00
Robert Joseph Evans b447d94094 MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310418 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:57:39 +00:00
Robert Joseph Evans adeef5ec8f MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310409 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:49:52 +00:00
Robert Joseph Evans c76b264196 MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310056 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:27:55 +00:00
Thomas Graves 98df316058 MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:11:52 +00:00
Alejandro Abdelnur 1d6038ecfb MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309583 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:24:01 +00:00
Todd Lipcon 1b93f8e5c3 MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:46:22 +00:00
Robert Joseph Evans db075f93ae MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309481 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 16:23:29 +00:00
Robert Joseph Evans 594dd9eb25 MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309453 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:28:17 +00:00
Thomas Graves 4e44259cbd MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309440 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:08:39 +00:00
Alejandro Abdelnur da1b01c9e3 MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:56:13 +00:00
Thomas Graves d99c2958dd MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:17:22 +00:00
Thomas Graves 1f4197984c MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 20:39:08 +00:00
Robert Joseph Evans 7b387f55c3 MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:37:46 +00:00
Robert Joseph Evans b45c450026 MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:29:40 +00:00
Robert Joseph Evans 20184e7ddc MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:01:43 +00:00
Robert Joseph Evans 949b34e722 Missed a test file as part of MAPREDUCE-4062
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 17:03:10 +00:00
Robert Joseph Evans 2b5c36b695 MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 16:59:26 +00:00
Thomas Graves 00eb28d927 MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 15:27:46 +00:00
Robert Joseph Evans 8c8dbba8a6 MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:47:35 +00:00
Robert Joseph Evans 4d876c7800 MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:19:29 +00:00
Robert Joseph Evans 01ce7ba3a4 MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:06:16 +00:00
Thomas Graves bb74427da2 MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:20:41 +00:00
Eli Collins 354025b6e7 MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:04:31 +00:00
Robert Joseph Evans 3a8d123ccb MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:51:06 +00:00
Robert Joseph Evans 57af34b776 Preping for 0.23.3 stabilization.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:13:53 +00:00
Ravi Gummadi 170ff8d81c MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 08:24:15 +00:00
Alejandro Abdelnur c4c7ee5b8c MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:30:11 +00:00
Alejandro Abdelnur d1893c8f5b MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 13:40:48 +00:00
Alejandro Abdelnur 57e175fddf hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:43:50 +00:00
Eli Collins d05cc8e5cd MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:53:44 +00:00
Robert Joseph Evans f11a5dc5f6 MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:18:41 +00:00
Arun Murthy 9bb6a025de MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 07:45:45 +00:00
Siddharth Seth db3e592df0 REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 02:02:17 +00:00
Aaron Myers 991eddd043 Change "0.23.3" to "2.0.0" in CHANGES.txt files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
Arun Murthy 67a74198b1 Changed version in trunk to 3.0.0-SNAPSHOT.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
Robert Joseph Evans 1650a49993 MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:23:31 +00:00
Arun Murthy 1a9385d516 MAPREDUCE-3353. Fixed commit msg to point to right jira.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:29:02 +00:00
Harsh J d5836856a2 MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 13:21:36 +00:00
Arun Murthy 606114d602 MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 05:45:29 +00:00
Robert Joseph Evans f67c2d1bd0 MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 20:46:18 +00:00
Arun Murthy 4e58186987 Removed some logs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304099 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:20:29 +00:00
Ravi Gummadi 7b3a98cfcd MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:42:23 +00:00
Alejandro Abdelnur a24d12bdec MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303076 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 18:36:56 +00:00
Robert Joseph Evans 40a8293d36 MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302980 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 16:29:42 +00:00
Todd Lipcon 04a47dea74 MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302754 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 02:28:53 +00:00
Robert Joseph Evans 9d8d02b68b MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302645 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 20:31:55 +00:00
Devaraj Das be5181ff2d Fixing an issue to do with setting of correct groups for tasks. Contributed by Aaron T Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 23:16:19 +00:00
Thomas Graves f58e3c8b12 MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301731 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 20:10:51 +00:00
Siddharth Seth 274d6909f3 MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301691 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:47:48 +00:00
Robert Joseph Evans 3e8c273f37 MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 14:39:01 +00:00
Steve Loughran e8ae52823f MAPREDUCE-3431
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301500 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:36:09 +00:00
Steve Loughran 8c7f5f2c7f MAPREDUCE-3431
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301496 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:33:32 +00:00
Steve Loughran 5a5307a255 MAPREDUCE-3970 ServiceOperations class
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300899 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:45:00 +00:00
Steve Loughran af0227e32a MAPREDUCE-3970 ServiceOperations class
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300894 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:39:17 +00:00
Alejandro Abdelnur 7609243e58 MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300750 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:02:53 +00:00
Thomas Graves 3f46a62ff9 MAPREDUCE-3974. Change to release 23.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 18:30:32 +00:00
Ravi Gummadi 7d60932060 MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299625 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 11:08:32 +00:00
Arun Murthy ed4c222d5c MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 23:34:49 +00:00
Vinod Kumar Vavilapalli 558cc8c0bf MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:13:42 +00:00
Harsh J 1c534d0f9d MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:07:33 +00:00
Vinod Kumar Vavilapalli ad3d3f54d5 MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:53:19 +00:00
Thomas White 4001b95cf2 MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 17:37:00 +00:00
Robert Joseph Evans 13ea1d575c MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 01:27:02 +00:00
Robert Joseph Evans 25cceb65ce MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:44:58 +00:00
Robert Joseph Evans c3a4de0ec0 MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:21:13 +00:00
Siddharth Seth 4ce5f6553f MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
Aaron Myers 1a0e088a19 MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:31:23 +00:00
Robert Joseph Evans a98b756c73 MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 16:17:41 +00:00
Arun Murthy b9fd9e1759 MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:52:10 +00:00
Alejandro Abdelnur 739f688f5a MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 23:56:46 +00:00
Robert Joseph Evans 774f809f15 MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 22:03:09 +00:00
Vinod Kumar Vavilapalli 7c1e857176 MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
.--This line, and those below, will be ignored--

M    hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M    hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M    hadoop-mapreduce-project/CHANGES.txt
M    hadoop-mapreduce-project/bin/mapred


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
Vinod Kumar Vavilapalli b73738d21e MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:29:29 +00:00
Ravi Gummadi 231e39462d MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 13:44:01 +00:00
Arun Murthy d5f4fcef5c MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
Arun Murthy 6d80dc2a84 MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:44:57 +00:00
Arun Murthy d41cb76b56 MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 21:14:53 +00:00
Arun Murthy bd38a29673 MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 17:14:23 +00:00
Vinod Kumar Vavilapalli 5f52156aa2 MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296747 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 05:23:16 +00:00
Vinod Kumar Vavilapalli fab57a144d MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296721 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 23:40:35 +00:00
Aaron Myers a1fc055489 HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay Radia, Mingjie Lai, and Gregory Chanan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296534 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:42:49 +00:00
Thomas White ce11ff73db MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296523 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:08:58 +00:00
Aaron Myers ffa527138b Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:43:28 +00:00
Siddharth Seth 99bf2902b2 MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296401 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 19:28:04 +00:00
Todd Lipcon 87d1c67944 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:48:32 +00:00
Tsz-wo Sze b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
Siddharth Seth 7ae1523865 MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295362 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:56:53 +00:00
Todd Lipcon 1ba357553a Merge trunk into HA branch.
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
Arun Murthy 7bf2f9559f MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295314 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:14:32 +00:00
Siddharth Seth 3cbb9d20d0 MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:48:09 +00:00
Alejandro Abdelnur 2659fded83 MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295245 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:05:10 +00:00
Alejandro Abdelnur a4ad12dd2d MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 16:20:40 +00:00
Thomas Graves 547ded7bfe MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:49:27 +00:00
Robert Joseph Evans defa1c5bab MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295147 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:19:51 +00:00
Vinod Kumar Vavilapalli 44a003d8ec MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294970 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 04:55:29 +00:00
Siddharth Seth 137aa0763f MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294901 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 23:50:47 +00:00
Robert Joseph Evans ffdf980b20 MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:06:53 +00:00
Aaron Myers 375c6b8f2e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:33:41 +00:00
Robert Joseph Evans ab29f5c5f9 MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 17:50:38 +00:00
Vinod Kumar Vavilapalli cfe214220f MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294446 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:35:37 +00:00
Aaron Myers 586bd479cb Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294445 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:21:42 +00:00
Vinod Kumar Vavilapalli 165cd626c5 MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:24:35 +00:00
Vinod Kumar Vavilapalli 7475e836dc MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294417 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:32:19 +00:00
Tsz-wo Sze dee6ca3d41 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:01:06 +00:00
Aaron Myers 5fd47e77ab Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294255 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 18:13:19 +00:00
Steve Loughran 008cf6a11d MAPREDUCE-3909
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294219 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:53:06 +00:00
Steve Loughran acf8e6f1b5 trailing whitespace on end of title lines
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294216 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:11 +00:00
Thomas Graves d6170f00b1 MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:44:05 +00:00
Vinod Kumar Vavilapalli f071323343 MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 08:32:30 +00:00
Vinod Kumar Vavilapalli f3cc891148 MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 06:49:21 +00:00
Aaron Myers ae9014ef6a Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 04:57:17 +00:00
Vinod Kumar Vavilapalli d83672d71c MAPREDUCE-2793. Reneabling commented out test from previous comment.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293521 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:30:55 +00:00
Vinod Kumar Vavilapalli 7a082ec2bd MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:03:59 +00:00
Arun Murthy 1de3fa8653 Preparing for 0.23.3 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
Robert Joseph Evans 4e64d7b447 MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:00:17 +00:00
Thomas Graves 582b97c3e7 MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
Vinod Kumar Vavilapalli c0572656ce MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
Vinod Kumar Vavilapalli 969b3809e4 MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:21:20 +00:00
Aaron Myers 328702891e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 14:49:38 +00:00
Siddharth Seth 6112940841 MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:12:06 +00:00
Aaron Myers f3026e1085 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 16:06:53 +00:00
Thomas Graves 81f5c5933d MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 15:50:53 +00:00
Amar Kamat 8a2073cc61 MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 10:41:07 +00:00
Alejandro Abdelnur 267bebeab0 MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292424 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:57:32 +00:00
Aaron Myers 60ab29759e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 16:24:40 +00:00
Vinod Kumar Vavilapalli b2172c394e MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:30:23 +00:00
Vinod Kumar Vavilapalli 5ee495e6f3 MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:08:25 +00:00
Aaron Myers f0db867292 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
Steve Loughran 3d8907fdd6 MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 13:22:47 +00:00
Arun Murthy 566f0b5ad2 MAPREDUCE-3880. Changed LCE binary to be 32-bit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 06:36:00 +00:00
Arun Murthy 3c5eb01263 MAPREDUCE-3856. Committing to 0.23.1.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:18:00 +00:00
Todd Lipcon ef5d7156db Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
Tsz-wo Sze b4c8567e1b MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:12:18 +00:00
Robert Joseph Evans ff33b38734 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:57:49 +00:00
Aaron Myers 53b7d6c6bc Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 18:19:31 +00:00
Ravi Gummadi 11c127bb51 MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245303 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:55:00 +00:00
Siddharth Seth a64046d16f MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245276 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 00:54:44 +00:00
Aaron Myers 833e96534f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
Robert Joseph Evans cfc4ad76a3 MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 17:49:20 +00:00
Todd Lipcon 20816218f0 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 05:53:25 +00:00
Aaron Myers 1fb0ab92f8 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
Alejandro Abdelnur 89bd2210a7 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 23:09:05 +00:00
Mahadev Konar 83ab8f087b MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 22:49:00 +00:00
Vinod Kumar Vavilapalli 16a44b6fa5 MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 21:39:59 +00:00
Aaron Myers 011611c765 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
Vinod Kumar Vavilapalli 1903e544a4 MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:24:00 +00:00
Vinod Kumar Vavilapalli 0515b3322f MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 00:06:37 +00:00
Konstantin Shvachko ce778462ee MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:12:03 +00:00
Todd Lipcon db187cf40e Merge trunk into HA branch.
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Mahadev Konar 5c46ba4d48 MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 05:37:11 +00:00
Thomas Graves 0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
Vinod Kumar Vavilapalli 56b6f4a8fc Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:55:15 +00:00
Aaron Myers 05d56e5e7e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
Thomas Graves 73a72e0ef9 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 14:30:00 +00:00
Todd Lipcon c14bb61a82 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Tsz-wo Sze 03ee90b9eb HADOOP-7923. Automate the updating of version numbers in the doc system.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:47:11 +00:00
Robert Joseph Evans b2d49acd08 MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241999 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:31:13 +00:00
Amar Kamat e5060d3bbb MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 10:15:41 +00:00
Arun Murthy 647f374607 Preparing for release 0.23.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:27:58 +00:00
Arun Murthy 1de681b896 MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:12:24 +00:00
Arun Murthy 4018798d4b MAPREDUCE-3415. Moving to 0.23.1 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:59:21 +00:00
Vinod Kumar Vavilapalli 7ae94c6678 MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241734 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 01:56:02 +00:00
Siddharth Seth 5fdfa2b4bd MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241721 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:56:28 +00:00
Arun Murthy 04f685ea76 MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241711 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:16:54 +00:00
Siddharth Seth ccc2807d86 MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241692 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:07:03 +00:00
Arun Murthy d8e9f84fb1 Fixed jira id in commit for MAPREDUCE-3826.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241688 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:04:29 +00:00
Arun Murthy 7dfe20d5a8 MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:59:58 +00:00
Arun Murthy 59b88655bc MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:08:55 +00:00
Vinod Kumar Vavilapalli 90bc439b66 MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:58:54 +00:00
Siddharth Seth fb498926be MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241620 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 20:55:10 +00:00
Mahadev Konar aaace5e84e MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:53:54 +00:00
Arun Murthy 6e376a39a0 MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:49:50 +00:00
Arun Murthy 35f12b9556 MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241319 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:41:28 +00:00
Mahadev Konar 59d1f07d6c MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241299 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:53:36 +00:00
Arun Murthy 8dbf374f16 MAPREDUCE-3811. Made jobclient-to-AM retries configurable. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241285 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:20:36 +00:00
Arun Murthy 75d2d6185e MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end of the task. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241282 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:13:40 +00:00
Vinod Kumar Vavilapalli 08479378c2 MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241253 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:16:37 +00:00
Arun Murthy 4f6839f23d MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
Robert Joseph Evans bdf837a64a MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241225 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:34:28 +00:00
Vinod Kumar Vavilapalli 9f2b77aee4 MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:16:26 +00:00
Arun Murthy c6282df3e5 MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241209 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:06:58 +00:00
Arun Murthy 28a2eb9d72 MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241205 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:01:22 +00:00
Aaron Myers db7c013877 HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241183 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:18:11 +00:00
Vinod Kumar Vavilapalli 3f02d8dd5c MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241177 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:04:30 +00:00
Arun Murthy c7007a8a35 MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240886 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 03:38:44 +00:00
Mahadev Konar 23e336a0ed MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 22:44:43 +00:00
Mahadev Konar f3c35222e6 MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:20:00 +00:00
Mahadev Konar c7d64769c1 MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:03:37 +00:00
Mahadev Konar f2280f612c MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240593 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 19:32:10 +00:00
Mahadev Konar caed1cfaf9 MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240590 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:55:03 +00:00
Mahadev Konar 2c32cd7008 MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:41:50 +00:00
Suresh Srinivas 1de317a945 MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240441 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:24:21 +00:00
Vinod Kumar Vavilapalli fe1cf3b0ac MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240428 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:21:12 +00:00
Vinod Kumar Vavilapalli 3343494d6c MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:03:51 +00:00
Vinod Kumar Vavilapalli 94242c9385 MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240413 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:04:53 +00:00
Alejandro Abdelnur b030231108 MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240410 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 23:48:48 +00:00
Vinod Kumar Vavilapalli a5c46c9165 MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:16:32 +00:00
Mahadev Konar 72d34e6594 MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 00:33:05 +00:00
Eli Collins 1950f97ab9 HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:45:07 +00:00
Arun Murthy cc74881acb MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 08:37:58 +00:00
Arun Murthy 70bc14f234 MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 02:31:05 +00:00
Siddharth Seth 6ba0375b21 MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 01:43:49 +00:00
Vinod Kumar Vavilapalli ef1a619a4d MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 00:41:09 +00:00
Siddharth Seth b4929bcf14 MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239402 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:33:58 +00:00
Arun Murthy ab75b8b420 MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239391 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:05:14 +00:00
Tsz-wo Sze 42d1c9b251 HADOOP-7470. Move up to Jackson 1.8.8. Contributed by Enis Soztutar
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239386 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 22:55:59 +00:00
Mahadev Konar 947ede4c4e MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239310 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 20:43:10 +00:00
Vinod Kumar Vavilapalli b33c66efc5 MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:55:20 +00:00
Alejandro Abdelnur e3d555a656 MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:03:27 +00:00
Arun Murthy f49ba355e5 MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:57:35 +00:00
Vinod Kumar Vavilapalli d1f805f942 MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:51:40 +00:00
Thomas White 05efddf28e MAPREDUCE-3749. ConcurrentModificationException in counter groups.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238734 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:30:58 +00:00
Arun Murthy a8b6ee0491 MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238721 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:08:11 +00:00
Arun Murthy 7f23d72352 MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 08:30:31 +00:00
Arun Murthy 7ed0f74997 MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 06:22:22 +00:00
Mahadev Konar 443d8f6c0b MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
Vinod Kumar Vavilapalli 76b653a367 MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
Mahadev Konar 7e4725db41 MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
Amar Kamat 5652e71992 MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 06:20:53 +00:00
Todd Lipcon 327c216c2f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Vinod Kumar Vavilapalli 5262b7ba4d MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
Aaron Myers 2b2e56056e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Alejandro Abdelnur 8a234f394e HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
Vinod Kumar Vavilapalli fe4bff77e1 MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
Mahadev Konar fdb9d51cec MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
Arun Murthy f57de0d6dd MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:49:18 +00:00
Arun Murthy 0cb3dd913b MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:44:19 +00:00
Vinod Kumar Vavilapalli 3cdc100369 MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
Vinod Kumar Vavilapalli 54f738575c MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
Mahadev Konar af6448e543 MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
Siddharth Seth 5283398187 MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236358 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:00 +00:00
Siddharth Seth 2bd728b366 MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236356 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:28:45 +00:00
Mahadev Konar faa6806df3 MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:10:11 +00:00
Aaron Myers 1c95060a72 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
Mahadev Konar 34a6a9f4bc MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236066 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:30:17 +00:00
Mahadev Konar d06948002f MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:36:52 +00:00
Arun Murthy fae75c2d7f MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236041 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:40:29 +00:00
Vinod Kumar Vavilapalli 21c9116309 MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00
Robert Joseph Evans 1149d9a13d MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235956 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:22:33 +00:00
Arun Murthy 9d1621da52 MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235858 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:17:55 +00:00
Aaron Myers 1853b9d188 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235856 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:07:43 +00:00
Siddharth Seth a02f07c4bc MAPREDUCE-3630. Fixes a NullPointer exception while running TeraGen - if a map is asked to generate 0 records. (Contributed by Mahadev Konar)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235641 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:30:09 +00:00
Mahadev Konar c43a5a992e MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235639 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:24:46 +00:00