Commit Graph

949 Commits

Author SHA1 Message Date
Thomas Graves 5caef48947 MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414873 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 19:19:16 +00:00
Robert Joseph Evans b43deb9af8 MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414840 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 17:52:45 +00:00
Robert Joseph Evans 481f451ca2 MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413739 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 17:37:05 +00:00
Jason Darrell Lowe 6c5f37e46d MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412377 13f79535-47bb-0310-9956-ffa450edef68
2012-11-22 00:05:26 +00:00
Alejandro Abdelnur 0f0caede29 MAPREDUCE-4800. Cleanup o.a.h.mapred.MapTaskStatus - remove unused code. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410700 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 06:08:06 +00:00
Robert Joseph Evans d2b9a604bd MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410498 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 17:30:22 +00:00
Robert Joseph Evans f13da263bf MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410131 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 00:52:43 +00:00
Robert Joseph Evans d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:57:23 +00:00
Eli Collins 905b17876c MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409601 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 00:16:35 +00:00
Robert Joseph Evans 7e2ecffd88 MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409580 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 00:01:07 +00:00
Robert Joseph Evans 316c23dd7e MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409525 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 23:02:29 +00:00
Thomas Graves b2f7a66e50 MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409032 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 23:47:57 +00:00
Robert Joseph Evans cf6ab9b2e7 MAPREDUCE-4786. Job End Notification retry interval is 5 milliseconds by default (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408444 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 20:32:04 +00:00
Robert Joseph Evans c493d06b1b MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408360 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 17:15:45 +00:00
Robert Joseph Evans 1a45b7e357 MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408355 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 17:06:07 +00:00
Robert Joseph Evans dd72ca3536 MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408314 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 15:15:52 +00:00
Robert Joseph Evans 7c9778e2c3 MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407679 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 22:55:57 +00:00
Jonathan Turner Eagles 3ccc76c29b MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407669 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 22:14:06 +00:00
Robert Joseph Evans ca1c683b47 MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407551 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:26:40 +00:00
Robert Joseph Evans 1f40b8b4e8 MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407505 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 15:52:33 +00:00
Robert Joseph Evans 6ee6eb8430 MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407118 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 15:17:34 +00:00
Thomas White 8d483fff2c MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406645 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 14:11:59 +00:00
Robert Joseph Evans 0eadfcfcf5 MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 21:52:06 +00:00
Robert Joseph Evans 1783f209f0 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 15:00:56 +00:00
Jason Darrell Lowe 42d1eaf237 MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 22:59:43 +00:00
Robert Joseph Evans b50a3c5de3 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 17:02:52 +00:00
Robert Joseph Evans 50993e9d48 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 19:13:03 +00:00
Thomas Graves aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 14:57:12 +00:00
Alejandro Abdelnur 16e21dfe92 MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:41:59 +00:00
Jason Darrell Lowe 286c171987 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:02:52 +00:00
Vinod Kumar Vavilapalli 895029b2f2 MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 01:26:30 +00:00
Jason Darrell Lowe 1e45b1f1fd MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
2012-10-24 15:45:35 +00:00
Daryn Sharp aaa07fc01b Updating credits for MAPREDUCE-4229.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:23:21 +00:00
Siddharth Seth 382b565e8c MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:02:22 +00:00
Daryn Sharp def0b949d4 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:57:36 +00:00
Jason Darrell Lowe 49beea562a MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 19:50:23 +00:00
Suresh Srinivas 5be6e234c5 Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400314 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:08:28 +00:00
Suresh Srinivas c195ce4d67 MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400313 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:05:30 +00:00
Vinod Kumar Vavilapalli 1195f844a9 MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 20:18:46 +00:00
Robert Joseph Evans a234472d1c MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 17:51:33 +00:00
Vinod Kumar Vavilapalli 022f7b4a25 MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 05:57:57 +00:00
Suresh Srinivas adcf7d10b9 MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399952 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 02:37:59 +00:00
Robert Joseph Evans c63811790a MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 14:58:08 +00:00
Robert Joseph Evans 0e9f40df97 MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 22:00:03 +00:00
Suresh Srinivas 94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:35:42 +00:00
Arun Murthy f174adfc15 MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 17:21:45 +00:00
Thomas White aa934616dd MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 14:37:46 +00:00
Harsh J 0aa8188d18 MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 13:39:26 +00:00
Harsh J 5c3a331040 MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 09:58:21 +00:00
Siddharth Seth 8ac3910ae0 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 03:23:07 +00:00