Alejandro Abdelnur
da1b01c9e3
MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:56:13 +00:00
Thomas Graves
d99c2958dd
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:17:22 +00:00
Thomas Graves
1f4197984c
MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 20:39:08 +00:00
Robert Joseph Evans
7b387f55c3
MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:37:46 +00:00
Robert Joseph Evans
b45c450026
MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:29:40 +00:00
Robert Joseph Evans
20184e7ddc
MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:01:43 +00:00
Robert Joseph Evans
949b34e722
Missed a test file as part of MAPREDUCE-4062
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 17:03:10 +00:00
Robert Joseph Evans
2b5c36b695
MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 16:59:26 +00:00
Thomas Graves
00eb28d927
MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 15:27:46 +00:00
Robert Joseph Evans
8c8dbba8a6
MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:47:35 +00:00
Robert Joseph Evans
4d876c7800
MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:19:29 +00:00
Robert Joseph Evans
01ce7ba3a4
MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:06:16 +00:00
Thomas Graves
bb74427da2
MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:20:41 +00:00
Eli Collins
354025b6e7
MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:04:31 +00:00
Robert Joseph Evans
3a8d123ccb
MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:51:06 +00:00
Robert Joseph Evans
57af34b776
Preping for 0.23.3 stabilization.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:13:53 +00:00
Ravi Gummadi
170ff8d81c
MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 08:24:15 +00:00
Alejandro Abdelnur
c4c7ee5b8c
MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:30:11 +00:00
Alejandro Abdelnur
d1893c8f5b
MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 13:40:48 +00:00
Alejandro Abdelnur
57e175fddf
hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:43:50 +00:00
Eli Collins
d05cc8e5cd
MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:53:44 +00:00
Robert Joseph Evans
f11a5dc5f6
MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:18:41 +00:00
Arun Murthy
9bb6a025de
MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 07:45:45 +00:00
Siddharth Seth
db3e592df0
REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 02:02:17 +00:00
Aaron Myers
991eddd043
Change "0.23.3" to "2.0.0" in CHANGES.txt files.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
Arun Murthy
67a74198b1
Changed version in trunk to 3.0.0-SNAPSHOT.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
Robert Joseph Evans
1650a49993
MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:23:31 +00:00
Arun Murthy
1a9385d516
MAPREDUCE-3353. Fixed commit msg to point to right jira.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:29:02 +00:00
Harsh J
d5836856a2
MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 13:21:36 +00:00
Arun Murthy
606114d602
MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 05:45:29 +00:00
Robert Joseph Evans
f67c2d1bd0
MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 20:46:18 +00:00
Arun Murthy
4e58186987
Removed some logs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304099 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:20:29 +00:00
Ravi Gummadi
7b3a98cfcd
MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:42:23 +00:00
Alejandro Abdelnur
a24d12bdec
MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303076 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 18:36:56 +00:00
Robert Joseph Evans
40a8293d36
MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302980 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 16:29:42 +00:00
Todd Lipcon
04a47dea74
MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302754 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 02:28:53 +00:00
Robert Joseph Evans
9d8d02b68b
MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302645 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 20:31:55 +00:00
Devaraj Das
be5181ff2d
Fixing an issue to do with setting of correct groups for tasks. Contributed by Aaron T Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 23:16:19 +00:00
Thomas Graves
f58e3c8b12
MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301731 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 20:10:51 +00:00
Siddharth Seth
274d6909f3
MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301691 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:47:48 +00:00
Robert Joseph Evans
3e8c273f37
MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 14:39:01 +00:00
Steve Loughran
e8ae52823f
MAPREDUCE-3431
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301500 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:36:09 +00:00
Steve Loughran
8c7f5f2c7f
MAPREDUCE-3431
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301496 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:33:32 +00:00
Steve Loughran
5a5307a255
MAPREDUCE-3970 ServiceOperations class
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300899 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:45:00 +00:00
Steve Loughran
af0227e32a
MAPREDUCE-3970 ServiceOperations class
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300894 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:39:17 +00:00
Alejandro Abdelnur
7609243e58
MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300750 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:02:53 +00:00
Thomas Graves
3f46a62ff9
MAPREDUCE-3974. Change to release 23.3
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 18:30:32 +00:00
Ravi Gummadi
7d60932060
MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299625 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 11:08:32 +00:00
Arun Murthy
ed4c222d5c
MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 23:34:49 +00:00
Vinod Kumar Vavilapalli
558cc8c0bf
MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:13:42 +00:00
Harsh J
1c534d0f9d
MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:07:33 +00:00
Vinod Kumar Vavilapalli
ad3d3f54d5
MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:53:19 +00:00
Thomas White
4001b95cf2
MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 17:37:00 +00:00
Robert Joseph Evans
13ea1d575c
MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 01:27:02 +00:00
Robert Joseph Evans
25cceb65ce
MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:44:58 +00:00
Robert Joseph Evans
c3a4de0ec0
MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:21:13 +00:00
Siddharth Seth
4ce5f6553f
MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
Aaron Myers
1a0e088a19
MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:31:23 +00:00
Robert Joseph Evans
a98b756c73
MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 16:17:41 +00:00
Arun Murthy
b9fd9e1759
MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:52:10 +00:00
Alejandro Abdelnur
739f688f5a
MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 23:56:46 +00:00
Robert Joseph Evans
774f809f15
MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 22:03:09 +00:00
Vinod Kumar Vavilapalli
7c1e857176
MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
...
.--This line, and those below, will be ignored--
M hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M hadoop-mapreduce-project/CHANGES.txt
M hadoop-mapreduce-project/bin/mapred
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
Vinod Kumar Vavilapalli
b73738d21e
MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:29:29 +00:00
Ravi Gummadi
231e39462d
MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 13:44:01 +00:00
Arun Murthy
d5f4fcef5c
MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
Arun Murthy
6d80dc2a84
MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:44:57 +00:00
Arun Murthy
d41cb76b56
MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 21:14:53 +00:00
Arun Murthy
bd38a29673
MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 17:14:23 +00:00
Vinod Kumar Vavilapalli
5f52156aa2
MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296747 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 05:23:16 +00:00
Vinod Kumar Vavilapalli
fab57a144d
MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296721 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 23:40:35 +00:00
Aaron Myers
a1fc055489
HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay Radia, Mingjie Lai, and Gregory Chanan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296534 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:42:49 +00:00
Thomas White
ce11ff73db
MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296523 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:08:58 +00:00
Aaron Myers
ffa527138b
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:43:28 +00:00
Siddharth Seth
99bf2902b2
MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296401 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 19:28:04 +00:00
Todd Lipcon
87d1c67944
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:48:32 +00:00
Tsz-wo Sze
b2f67b4704
HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
Siddharth Seth
7ae1523865
MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295362 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:56:53 +00:00
Todd Lipcon
1ba357553a
Merge trunk into HA branch.
...
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
Arun Murthy
7bf2f9559f
MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295314 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:14:32 +00:00
Siddharth Seth
3cbb9d20d0
MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:48:09 +00:00
Alejandro Abdelnur
2659fded83
MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295245 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:05:10 +00:00
Alejandro Abdelnur
a4ad12dd2d
MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 16:20:40 +00:00
Thomas Graves
547ded7bfe
MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:49:27 +00:00
Robert Joseph Evans
defa1c5bab
MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295147 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:19:51 +00:00
Vinod Kumar Vavilapalli
44a003d8ec
MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294970 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 04:55:29 +00:00
Siddharth Seth
137aa0763f
MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294901 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 23:50:47 +00:00
Robert Joseph Evans
ffdf980b20
MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:06:53 +00:00
Aaron Myers
375c6b8f2e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:33:41 +00:00
Robert Joseph Evans
ab29f5c5f9
MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 17:50:38 +00:00
Vinod Kumar Vavilapalli
cfe214220f
MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294446 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:35:37 +00:00
Aaron Myers
586bd479cb
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294445 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:21:42 +00:00
Vinod Kumar Vavilapalli
165cd626c5
MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:24:35 +00:00
Vinod Kumar Vavilapalli
7475e836dc
MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294417 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:32:19 +00:00
Tsz-wo Sze
dee6ca3d41
Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:01:06 +00:00
Aaron Myers
5fd47e77ab
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294255 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 18:13:19 +00:00
Steve Loughran
008cf6a11d
MAPREDUCE-3909
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294219 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:53:06 +00:00
Steve Loughran
acf8e6f1b5
trailing whitespace on end of title lines
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294216 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:11 +00:00
Thomas Graves
d6170f00b1
MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:44:05 +00:00
Vinod Kumar Vavilapalli
f071323343
MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 08:32:30 +00:00
Vinod Kumar Vavilapalli
f3cc891148
MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 06:49:21 +00:00
Aaron Myers
ae9014ef6a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 04:57:17 +00:00
Vinod Kumar Vavilapalli
d83672d71c
MAPREDUCE-2793. Reneabling commented out test from previous comment.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293521 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:30:55 +00:00
Vinod Kumar Vavilapalli
7a082ec2bd
MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:03:59 +00:00
Arun Murthy
1de3fa8653
Preparing for 0.23.3 release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
Robert Joseph Evans
4e64d7b447
MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:00:17 +00:00
Thomas Graves
582b97c3e7
MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
Vinod Kumar Vavilapalli
c0572656ce
MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
Vinod Kumar Vavilapalli
969b3809e4
MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:21:20 +00:00
Aaron Myers
328702891e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 14:49:38 +00:00
Siddharth Seth
6112940841
MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:12:06 +00:00
Aaron Myers
f3026e1085
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 16:06:53 +00:00
Thomas Graves
81f5c5933d
MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 15:50:53 +00:00
Amar Kamat
8a2073cc61
MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 10:41:07 +00:00
Alejandro Abdelnur
267bebeab0
MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292424 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:57:32 +00:00
Aaron Myers
60ab29759e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 16:24:40 +00:00
Vinod Kumar Vavilapalli
b2172c394e
MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:30:23 +00:00
Vinod Kumar Vavilapalli
5ee495e6f3
MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:08:25 +00:00
Aaron Myers
f0db867292
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
Steve Loughran
3d8907fdd6
MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 13:22:47 +00:00
Arun Murthy
566f0b5ad2
MAPREDUCE-3880. Changed LCE binary to be 32-bit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 06:36:00 +00:00
Arun Murthy
3c5eb01263
MAPREDUCE-3856. Committing to 0.23.1.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:18:00 +00:00
Todd Lipcon
ef5d7156db
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
Tsz-wo Sze
b4c8567e1b
MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:12:18 +00:00
Robert Joseph Evans
ff33b38734
MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:57:49 +00:00
Aaron Myers
53b7d6c6bc
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 18:19:31 +00:00
Ravi Gummadi
11c127bb51
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245303 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:55:00 +00:00
Siddharth Seth
a64046d16f
MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245276 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 00:54:44 +00:00
Aaron Myers
833e96534f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
Robert Joseph Evans
cfc4ad76a3
MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 17:49:20 +00:00
Todd Lipcon
20816218f0
MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 05:53:25 +00:00
Aaron Myers
1fb0ab92f8
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
Alejandro Abdelnur
89bd2210a7
MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 23:09:05 +00:00
Mahadev Konar
83ab8f087b
MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 22:49:00 +00:00
Vinod Kumar Vavilapalli
16a44b6fa5
MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 21:39:59 +00:00
Aaron Myers
011611c765
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
Vinod Kumar Vavilapalli
1903e544a4
MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:24:00 +00:00
Vinod Kumar Vavilapalli
0515b3322f
MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 00:06:37 +00:00
Konstantin Shvachko
ce778462ee
MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:12:03 +00:00
Todd Lipcon
db187cf40e
Merge trunk into HA branch.
...
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Mahadev Konar
5c46ba4d48
MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 05:37:11 +00:00
Thomas Graves
0bf146b0dd
MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
Vinod Kumar Vavilapalli
56b6f4a8fc
Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:55:15 +00:00
Aaron Myers
05d56e5e7e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
Thomas Graves
73a72e0ef9
MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 14:30:00 +00:00
Todd Lipcon
c14bb61a82
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Tsz-wo Sze
03ee90b9eb
HADOOP-7923. Automate the updating of version numbers in the doc system.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:47:11 +00:00
Robert Joseph Evans
b2d49acd08
MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241999 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:31:13 +00:00
Amar Kamat
e5060d3bbb
MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 10:15:41 +00:00
Arun Murthy
647f374607
Preparing for release 0.23.1
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:27:58 +00:00
Arun Murthy
1de681b896
MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:12:24 +00:00
Arun Murthy
4018798d4b
MAPREDUCE-3415. Moving to 0.23.1 section.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:59:21 +00:00
Vinod Kumar Vavilapalli
7ae94c6678
MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241734 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 01:56:02 +00:00
Siddharth Seth
5fdfa2b4bd
MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241721 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:56:28 +00:00
Arun Murthy
04f685ea76
MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241711 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:16:54 +00:00
Siddharth Seth
ccc2807d86
MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241692 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:07:03 +00:00
Arun Murthy
d8e9f84fb1
Fixed jira id in commit for MAPREDUCE-3826.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241688 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:04:29 +00:00
Arun Murthy
7dfe20d5a8
MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:59:58 +00:00
Arun Murthy
59b88655bc
MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:08:55 +00:00
Vinod Kumar Vavilapalli
90bc439b66
MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:58:54 +00:00
Siddharth Seth
fb498926be
MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241620 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 20:55:10 +00:00
Mahadev Konar
aaace5e84e
MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:53:54 +00:00
Arun Murthy
6e376a39a0
MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:49:50 +00:00
Arun Murthy
35f12b9556
MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241319 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:41:28 +00:00
Mahadev Konar
59d1f07d6c
MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241299 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:53:36 +00:00
Arun Murthy
8dbf374f16
MAPREDUCE-3811. Made jobclient-to-AM retries configurable. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241285 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:20:36 +00:00
Arun Murthy
75d2d6185e
MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end of the task. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241282 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:13:40 +00:00
Vinod Kumar Vavilapalli
08479378c2
MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241253 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:16:37 +00:00
Arun Murthy
4f6839f23d
MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
Robert Joseph Evans
bdf837a64a
MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241225 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:34:28 +00:00
Vinod Kumar Vavilapalli
9f2b77aee4
MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:16:26 +00:00
Arun Murthy
c6282df3e5
MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241209 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:06:58 +00:00
Arun Murthy
28a2eb9d72
MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241205 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:01:22 +00:00
Aaron Myers
db7c013877
HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241183 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:18:11 +00:00
Vinod Kumar Vavilapalli
3f02d8dd5c
MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241177 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:04:30 +00:00
Arun Murthy
c7007a8a35
MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240886 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 03:38:44 +00:00
Mahadev Konar
23e336a0ed
MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 22:44:43 +00:00
Mahadev Konar
f3c35222e6
MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:20:00 +00:00
Mahadev Konar
c7d64769c1
MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:03:37 +00:00
Mahadev Konar
f2280f612c
MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240593 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 19:32:10 +00:00
Mahadev Konar
caed1cfaf9
MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240590 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:55:03 +00:00
Mahadev Konar
2c32cd7008
MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:41:50 +00:00
Suresh Srinivas
1de317a945
MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240441 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:24:21 +00:00
Vinod Kumar Vavilapalli
fe1cf3b0ac
MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240428 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:21:12 +00:00
Vinod Kumar Vavilapalli
3343494d6c
MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:03:51 +00:00
Vinod Kumar Vavilapalli
94242c9385
MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240413 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:04:53 +00:00
Alejandro Abdelnur
b030231108
MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240410 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 23:48:48 +00:00
Vinod Kumar Vavilapalli
a5c46c9165
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:16:32 +00:00
Mahadev Konar
72d34e6594
MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 00:33:05 +00:00
Eli Collins
1950f97ab9
HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:45:07 +00:00
Arun Murthy
cc74881acb
MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 08:37:58 +00:00
Arun Murthy
70bc14f234
MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 02:31:05 +00:00
Siddharth Seth
6ba0375b21
MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 01:43:49 +00:00
Vinod Kumar Vavilapalli
ef1a619a4d
MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 00:41:09 +00:00
Siddharth Seth
b4929bcf14
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239402 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:33:58 +00:00
Arun Murthy
ab75b8b420
MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239391 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:05:14 +00:00
Tsz-wo Sze
42d1c9b251
HADOOP-7470. Move up to Jackson 1.8.8. Contributed by Enis Soztutar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239386 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 22:55:59 +00:00
Mahadev Konar
947ede4c4e
MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239310 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 20:43:10 +00:00
Vinod Kumar Vavilapalli
b33c66efc5
MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:55:20 +00:00
Alejandro Abdelnur
e3d555a656
MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:03:27 +00:00
Arun Murthy
f49ba355e5
MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:57:35 +00:00
Vinod Kumar Vavilapalli
d1f805f942
MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:51:40 +00:00
Thomas White
05efddf28e
MAPREDUCE-3749. ConcurrentModificationException in counter groups.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238734 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:30:58 +00:00
Arun Murthy
a8b6ee0491
MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238721 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:08:11 +00:00
Arun Murthy
7f23d72352
MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 08:30:31 +00:00
Arun Murthy
7ed0f74997
MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 06:22:22 +00:00
Mahadev Konar
443d8f6c0b
MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
Vinod Kumar Vavilapalli
76b653a367
MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
Mahadev Konar
7e4725db41
MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
Amar Kamat
5652e71992
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 06:20:53 +00:00
Todd Lipcon
327c216c2f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Vinod Kumar Vavilapalli
5262b7ba4d
MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
Aaron Myers
2b2e56056e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Alejandro Abdelnur
8a234f394e
HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
Vinod Kumar Vavilapalli
fe4bff77e1
MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
Mahadev Konar
fdb9d51cec
MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
Arun Murthy
f57de0d6dd
MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:49:18 +00:00
Arun Murthy
0cb3dd913b
MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:44:19 +00:00
Vinod Kumar Vavilapalli
3cdc100369
MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
Vinod Kumar Vavilapalli
54f738575c
MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
Mahadev Konar
af6448e543
MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
Siddharth Seth
5283398187
MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236358 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:00 +00:00
Siddharth Seth
2bd728b366
MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236356 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:28:45 +00:00
Mahadev Konar
faa6806df3
MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:10:11 +00:00
Aaron Myers
1c95060a72
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
Mahadev Konar
34a6a9f4bc
MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236066 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:30:17 +00:00
Mahadev Konar
d06948002f
MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:36:52 +00:00
Arun Murthy
fae75c2d7f
MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236041 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:40:29 +00:00
Vinod Kumar Vavilapalli
21c9116309
MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00
Robert Joseph Evans
1149d9a13d
MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235956 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:22:33 +00:00
Arun Murthy
9d1621da52
MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235858 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:17:55 +00:00
Aaron Myers
1853b9d188
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235856 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:07:43 +00:00
Siddharth Seth
a02f07c4bc
MAPREDUCE-3630. Fixes a NullPointer exception while running TeraGen - if a map is asked to generate 0 records. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235641 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:30:09 +00:00
Mahadev Konar
c43a5a992e
MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235639 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:24:46 +00:00
Mahadev Konar
c7642a135c
MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235566 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 00:14:26 +00:00
Vinod Kumar Vavilapalli
078ae89a47
MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235545 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 23:18:05 +00:00
Vinod Kumar Vavilapalli
dc615c312b
MAPREDUCE-3710. Improved FileInputFormat to return better locality for the last split. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 21:29:39 +00:00
Alejandro Abdelnur
f73daf6af1
MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235391 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:21:27 +00:00
Aaron Myers
83bcb1bbf4
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:59:14 +00:00
Eli Collins
5dfe62d845
HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Arun Murthy
9a153334ac
MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235103 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 01:00:51 +00:00
Todd Lipcon
fa4a33a566
Merge trunk into HA branch.
...
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 00:00:05 +00:00
Mahadev Konar
27c56b02b3
MAPREDUCE-3646. Remove redundant URL info from "mapred job" output. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235034 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:22:53 +00:00
Mahadev Konar
4b36997b1b
MAPREDUCE-3702. internal server error trying access application master via proxy with filter enabled. (Thomas Graves via mahadev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234991 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:22:09 +00:00
Mahadev Konar
c415dee2b7
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:15:55 +00:00
Aaron Myers
e42bbfbca2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
Mahadev Konar
355ba01374
MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234227 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 01:15:24 +00:00
Mahadev Konar
8a1719e999
MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
Mahadev Konar
b49aae0635
MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234148 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:27:39 +00:00
Mahadev Konar
c6923061d0
MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234120 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 20:44:17 +00:00
Aaron Myers
2abe5c818d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
Eli Collins
6861560098
MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233605 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:23:53 +00:00
Aaron Myers
6177bf6c8f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 23:02:17 +00:00
Alejandro Abdelnur
10325d9732
MAPREDUCE-3582. Move successfully passing MR1 tests to MR2 maven tree.(ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233090 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:10:12 +00:00
Thomas White
8b2f6909ec
MAPREDUCE-3684. LocalDistributedCacheManager does not shut down its thread pool.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232981 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 18:20:13 +00:00
Arun Murthy
d737c323a6
MAPREDUCE-3669. Allow clients to talk to MR HistoryServer using both delegation tokens and kerberos. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232580 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 21:25:08 +00:00
Arun Murthy
d05e6d2671
MAPREDUCE-2450. Fixed a corner case with interrupted communication threads leading to a long timeout in Task. Contributed by Rajesh Balamohan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 06:10:50 +00:00
Aaron Myers
940eeb866c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
Vinod Kumar Vavilapalli
4a343c9d4a
MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232182 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:56:14 +00:00
Mahadev Konar
c81995e370
MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232167 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:22:21 +00:00
Mahadev Konar
a24339e50d
MAPREDUCE-3649. Job End notification gives an error on calling back. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232126 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 19:35:06 +00:00
Vinod Kumar Vavilapalli
b62c1b8563
MAPREDUCE-3404. Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231395 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 23:41:23 +00:00
Vinod Kumar Vavilapalli
90f096d86c
MAPREDUCE-3532. Modified NM to report correct http address when an ephemeral web port is configured. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231342 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:21:33 +00:00
Vinod Kumar Vavilapalli
0c278b0f63
MAPREDUCE-3656. Fixed a race condition in MR AM which is failing the sort benchmark consistently. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:31:40 +00:00
Siddharth Seth
78ff0b720e
MAPREDUCE-3596. Fix scheduler to handle cleaned up containers, which NMs may subsequently report as running. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231297 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:15:22 +00:00
Aaron Myers
58f2da1c85
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231242 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 18:54:02 +00:00
Jitendra Nath Pandey
f717c5785e
MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230708 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:11:33 +00:00
Aaron Myers
8610a9231a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00
Vinod Kumar Vavilapalli
74697f2317
MAPREDUCE-3512. Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230353 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:42:10 +00:00
Mahadev Konar
0086014703
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 00:15:35 +00:00
Mahadev Konar
5f79f180f6
MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230330 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:59:23 +00:00
Mahadev Konar
0510e0659c
MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:50:09 +00:00
Mahadev Konar
d0f89303e9
MAPREDUCE-3645. TestJobHistory fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230307 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:53:36 +00:00
Mahadev Konar
c832b46d0b
MAPREDUCE-3651. TestQueueManagerRefresh fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:32:56 +00:00
Aaron Myers
ede7f21278
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 20:53:50 +00:00
Mahadev Konar
c4c6d8ece3
MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230202 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:37:52 +00:00
Vinod Kumar Vavilapalli
39b8bbe663
MAPREDUCE-3618. Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229906 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 06:53:10 +00:00
Mahadev Konar
bc4b1f48d3
MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229855 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 01:50:10 +00:00
Vinod Kumar Vavilapalli
7712e70090
MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR AM. Improved the earlier patch to not to JobHistoryServer repeatedly. Contributed by Anupam Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:07:54 +00:00
Vinod Kumar Vavilapalli
bc374626be
MAPREDUCE-3299. Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers. (Jonathan Eagles via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229766 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 22:26:45 +00:00
Vinod Kumar Vavilapalli
44e0bb831b
MAPREDUCE-3382. Enhanced MR AM to use a proxy to ping the job-end notification URL. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229736 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 21:08:34 +00:00
Vinod Kumar Vavilapalli
849c68c7b5
MAPREDUCE-3312. Modified MR AM to not send a stop-container request for a container that isn't launched at all. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229451 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 02:15:48 +00:00
Vinod Kumar Vavilapalli
48150cddaf
MAPREDUCE-3639. Fixed TokenCache to work with absent FileSystem canonical service-names. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229444 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 01:38:27 +00:00
Vinod Kumar Vavilapalli
428529b58f
MAPREDUCE-3528. Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229403 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:37:00 +00:00
Siddharth Seth
239a5549ea
MAPREDUCE-3616. Thread pool for launching containers in MR AM not expanding as expected. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229394 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:20:23 +00:00
Vinod Kumar Vavilapalli
e8645636ce
MAPREDUCE-3511. Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 21:04:58 +00:00
Aaron Myers
ade897636d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 18:01:55 +00:00
Arun Murthy
5ba6477099
MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228354 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 19:12:02 +00:00
Aaron Myers
d680080da0
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
Alejandro Abdelnur
5f5561d057
Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 21:55:43 +00:00
Arun Murthy
2919ce8c8b
MAPREDUCE-3617. Removed wrong default value for yarn.resourcemanager.principal and yarn.nodemanager.principal. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227808 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:11:09 +00:00
Arun Murthy
7440a8aa37
MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227801 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:01:20 +00:00
Arun Murthy
4404f20671
MAPREDUCE-3326. Added detailed information about queue's to the CapacityScheduler web-ui. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227788 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:50:18 +00:00
Alejandro Abdelnur
6d45b9e31d
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
Aaron Myers
3187a3ae05
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
Siddharth Seth
a2bcb867e1
MAPREDUCE-3615. Fix some ant test failures. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227741 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:47:59 +00:00
Siddharth Seth
03d46dc571
MAPREDUCE-3569. TaskAttemptListener holds a global lock for all task-updates. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227485 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 05:19:44 +00:00
Arun Murthy
08f8abf563
MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227426 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:37:13 +00:00
Arun Murthy
0870734787
MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227422 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:29:52 +00:00
Mahadev Konar
e793ba8cba
MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:13:39 +00:00