Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,812 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

1296 Commits

Author SHA1 Message Date
Jason Darrell Lowe 92774331cc MAPREDUCE-4842. Shuffle race can hang reducer. Contributed by Mariappan Asokan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425071 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 18:24:25 +00:00
Luke Lu 1a49c85438 YARN-223. Update process tree instead of getting new process trees. (Radim Kolar via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424244 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 00:20:53 +00:00
Doug Cutting aa30056d09 MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions with poor implementations of Object#hashCode(). Contributed by Radim Kolar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424158 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 21:50:17 +00:00
Thomas White 9189917be5 MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423470 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 15:23:49 +00:00
Alejandro Abdelnur 8329fae686 MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422345 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 20:23:08 +00:00
Alejandro Abdelnur 803e5155d1 MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422341 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 20:18:23 +00:00
Thomas White 4993314895 MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420634 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 12:12:10 +00:00
Alejandro Abdelnur c5080ef336 MAPREDUCE-4861. Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420345 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 19:26:57 +00:00
Jason Darrell Lowe b72b36009a YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping string properly. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420232 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 15:45:10 +00:00
Alejandro Abdelnur 054270cc28 MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419618 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:07:20 +00:00
Arun Murthy b096f61fe2 MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418173 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 02:36:33 +00:00
Jonathan Turner Eagles fdcfef0a26 MAPREDUCE-4836. Elapsed time for running tasks on AM web UI tasks page is 0. (Ravi Prakash via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415860 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 21:43:43 +00:00
Thomas Graves 5caef48947 MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414873 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:19:16 +00:00
Robert Joseph Evans b43deb9af8 MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414840 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 17:52:45 +00:00
Robert Joseph Evans 481f451ca2 MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413739 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 17:37:05 +00:00
Jason Darrell Lowe 6c5f37e46d MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412377 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-22 00:05:26 +00:00
Siddharth Seth c271f3cded MAPREDUCE-4723 amendment. Fix JobHistory Event handling. (Contributed by Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411292 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-19 16:43:29 +00:00
Thomas White e464607b7d YARN-129. Simplify classpath construction for mini YARN tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411235 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-19 15:12:22 +00:00
Alejandro Abdelnur 0f0caede29 MAPREDUCE-4800. Cleanup o.a.h.mapred.MapTaskStatus - remove unused code. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410700 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-17 06:08:06 +00:00
Robert Joseph Evans d2b9a604bd MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410498 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 17:30:22 +00:00
Robert Joseph Evans f13da263bf MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410131 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 00:52:43 +00:00
Robert Joseph Evans d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 14:57:23 +00:00
Eli Collins 905b17876c MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409601 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 00:16:35 +00:00
Robert Joseph Evans 7e2ecffd88 MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409580 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 00:01:07 +00:00
Robert Joseph Evans 316c23dd7e MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409525 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 23:02:29 +00:00
Jason Darrell Lowe 397c261433 YARN-216. Remove jquery theming support. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409313 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 19:22:11 +00:00
Thomas Graves b2f7a66e50 MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409032 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 23:47:57 +00:00
Robert Joseph Evans cf6ab9b2e7 MAPREDUCE-4786. Job End Notification retry interval is 5 milliseconds by default (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408444 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 20:32:04 +00:00
Robert Joseph Evans c493d06b1b MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408360 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 17:15:45 +00:00
Robert Joseph Evans 1a45b7e357 MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408355 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 17:06:07 +00:00
Robert Joseph Evans dd72ca3536 MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408314 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 15:15:52 +00:00
Thomas White 42f4691ead Add new files missed from HADOOP-8860 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408288 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 13:54:27 +00:00
Robert Joseph Evans 7c9778e2c3 MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407679 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 22:55:57 +00:00
Jonathan Turner Eagles 3ccc76c29b MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407669 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 22:14:06 +00:00
Alejandro Abdelnur 9d5205aadd HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407658 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 21:44:00 +00:00
Robert Joseph Evans ca1c683b47 MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407551 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 17:26:40 +00:00
Robert Joseph Evans 1f40b8b4e8 MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407505 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 15:52:33 +00:00
Robert Joseph Evans 6ee6eb8430 MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407118 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 15:17:34 +00:00
Thomas White 8d483fff2c MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406645 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 14:11:59 +00:00
Robert Joseph Evans 0eadfcfcf5 MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 21:52:06 +00:00
Robert Joseph Evans 1783f209f0 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 15:00:56 +00:00
Jason Darrell Lowe 42d1eaf237 MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 22:59:43 +00:00
Robert Joseph Evans b50a3c5de3 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 17:02:52 +00:00
Robert Joseph Evans 50993e9d48 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 19:13:03 +00:00
Thomas Graves aac5c149c7 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 14:57:12 +00:00
Alejandro Abdelnur 16e21dfe92 MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 05:41:59 +00:00
Jason Darrell Lowe 286c171987 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 21:02:52 +00:00
Vinod Kumar Vavilapalli 895029b2f2 MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 01:26:30 +00:00
Jason Darrell Lowe 1e45b1f1fd MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 15:45:35 +00:00
Jason Darrell Lowe 614a743fea YARN-139. Interrupted Exception within AsyncDispatcher leads to user confusion. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401726 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 15:20:58 +00:00
Daryn Sharp aaa07fc01b Updating credits for MAPREDUCE-4229. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:23:21 +00:00
Siddharth Seth 382b565e8c MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:02:22 +00:00
Daryn Sharp def0b949d4 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:57:36 +00:00
Jason Darrell Lowe 49beea562a MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 19:50:23 +00:00
Suresh Srinivas 5be6e234c5 Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400314 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:08:28 +00:00
Suresh Srinivas c195ce4d67 MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400313 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:05:30 +00:00
Vinod Kumar Vavilapalli 1195f844a9 MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 20:18:46 +00:00
Robert Joseph Evans a234472d1c MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 17:51:33 +00:00
Vinod Kumar Vavilapalli 022f7b4a25 MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 05:57:57 +00:00
Suresh Srinivas adcf7d10b9 MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399952 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 02:37:59 +00:00
Eli Collins 57ee22e589 HADOOP-8925. Remove the packaging. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:30:11 +00:00
Robert Joseph Evans c63811790a MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 14:58:08 +00:00
Robert Joseph Evans 0e9f40df97 MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 22:00:03 +00:00
Suresh Srinivas 94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Arun Murthy f174adfc15 MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 17:21:45 +00:00
Thomas White aa934616dd MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 14:37:46 +00:00
Harsh J 0aa8188d18 MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 13:39:26 +00:00
Harsh J 5c3a331040 MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 09:58:21 +00:00
Siddharth Seth 8ac3910ae0 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 03:23:07 +00:00
Siddharth Seth c074cfd6f0 YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395841 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 01:56:05 +00:00
Robert Joseph Evans 49b20c2ed1 MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395769 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 20:50:40 +00:00
Thomas Graves a047fa9b23 MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395724 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:03:43 +00:00
Siddharth Seth 803828b996 MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393775 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:24:55 +00:00
Arun Murthy b146f9f9ca HADOOP-8738. Reverted since it broke MR based system tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392675 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-01 22:42:46 +00:00
Harsh J 7137503eb7 MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392446 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-01 17:10:11 +00:00
Arun Murthy 57807d50bf MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392075 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-30 17:01:00 +00:00
Robert Joseph Evans af647bb3ce Preparing for release 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 14:15:39 +00:00
Harsh J 34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 10:57:53 +00:00
Robert Joseph Evans b897d6c35a MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391679 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 22:17:32 +00:00
Jason Darrell Lowe 03b7ad04fa MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391671 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 21:55:45 +00:00
Harsh J e45b103655 MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391551 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 16:48:01 +00:00
Harsh J 6d77365a83 MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml. Contributed by Todd Lipcon (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391498 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-28 15:08:48 +00:00
Arun Murthy 036530fc12 Reverted MAPREDUCE-4253. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390652 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 18:41:08 +00:00
Thomas Graves 050fd3a117 MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 15:22:21 +00:00
Harsh J 462ba6a3de MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes. Contributed by Chris Nauroth. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390446 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 12:52:41 +00:00
Harsh J 2610acf0fb MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390372 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 10:21:17 +00:00
Arun Murthy 1eedee177e MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390224 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 23:49:09 +00:00
Konstantin Shvachko 33a3efcd18 MAPREDUCE-4651. Benchmarking random reads with DFSIO. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390159 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 21:32:29 +00:00
Konstantin Shvachko 78fa84a08a Move MAPREDUCE-4645 under 0.23.4 release section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389576 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 21:01:05 +00:00
Konstantin Shvachko b26ed9d6f8 MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389568 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 20:54:20 +00:00
Eli Collins eb547be607 MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388661 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 20:15:07 +00:00
Thomas White d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Aaron Myers d8e386f01a HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 01:44:23 +00:00
Vinod Kumar Vavilapalli 229a79bbc3 MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 00:59:15 +00:00
Eli Collins dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 21:24:12 +00:00
Thomas White c406e65f24 Update CHANGES.txt for MAPREDUCE-4607 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383423 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 14:06:51 +00:00
Thomas White 3b46295c28 MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383422 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 14:04:03 +00:00
Arun Murthy 681408f898 Set date for hadoop-2.0.2-alpha 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:39:45 +00:00
Arun Murthy 7851676f22 Preparing for hadoop-2.0.2-alpha release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 22:09:48 +00:00
Alejandro Abdelnur a7998921a7 MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 17:05:11 +00:00
Robert Joseph Evans 77805c7ae4 MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 16:45:03 +00:00
Arun Murthy 0056914773 MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381868 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 04:56:32 +00:00
Robert Joseph Evans 09038b741d MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 22:20:15 +00:00
Robert Joseph Evans 5dcb594cb8 MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 14:20:43 +00:00
Eli Collins aa049397f1 Fix MAPREDUCE-4580 build breakage. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381315 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 19:34:03 +00:00
Suresh Srinivas 60af999c73 YARN-84. Use Builder to build RPC server. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380921 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 22:24:04 +00:00
Robert Joseph Evans f5943c1eef Updated CHANGES.txt for 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-04 21:45:33 +00:00
Konstantin Shvachko ab986d7cf6 MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-03 18:54:27 +00:00
Jonathan Turner Eagles 94129df354 MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 21:25:25 +00:00
Thomas Graves 25e96e455b MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:43:46 +00:00
Robert Joseph Evans 63f941d2ad MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:37:41 +00:00
Robert Joseph Evans 015256524c MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 20:25:27 +00:00
Vinod Kumar Vavilapalli 65e447cd8b MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 21:02:55 +00:00
Robert Joseph Evans 6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:58:07 +00:00
Thomas White 2f1a133dcf MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379022 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 17:12:14 +00:00
Thomas White 95af351615 MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378873 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 09:57:45 +00:00
Robert Joseph Evans 963d01a0af MAPREDUCE-4600. TestTokenCache.java from MRV1 no longer compiles (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378255 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 18:29:17 +00:00
Alejandro Abdelnur 54d4630d9b HADOOP-8738. junit JAR is showing up in the distro (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378175 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 15:30:43 +00:00
Vinod Kumar Vavilapalli cfe25b8828 MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 02:03:26 +00:00
Siddharth Seth 24e47ebc18 MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 00:40:02 +00:00
Siddharth Seth ffd2e01604 YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377180 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 02:18:49 +00:00
Alejandro Abdelnur 7b541d619f MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 23:36:55 +00:00
Robert Joseph Evans aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 18:06:56 +00:00
Alejandro Abdelnur f909a1d4d7 MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 00:22:14 +00:00
Aaron Myers 0555a2145d MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376297 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 22:43:50 +00:00
Alejandro Abdelnur dc33a0765c MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 21:18:34 +00:00
Robert Joseph Evans ca2dc3e785 MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 17:46:07 +00:00
Robert Joseph Evans 0c2887b617 MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 15:20:21 +00:00
Thomas Graves 7fc6ad661d YARN-25. remove old aggregated logs (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374424 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 20:29:38 +00:00
Daryn Sharp 8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 14:05:11 +00:00
Thomas White 3204b1f450 MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 13:26:12 +00:00
Tsz-wo Sze 3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Alejandro Abdelnur 8fcad7e8e9 MAPREDUCE-4511. Add IFile readahead (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 23:08:40 +00:00
Thomas White 4e09b481e7 HADOOP-8278. Make sure components declare correct set of dependencies. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373574 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 19:10:52 +00:00
Thomas Graves dfad16fed2 MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:48:33 +00:00
Alejandro Abdelnur 4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Robert Joseph Evans 201d0ecb78 MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 17:29:36 +00:00
Arun Murthy e1fdf62123 YARN-1. Promote YARN to be a sub-project of Apache Hadoop. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 05:22:27 +00:00
Alejandro Abdelnur 1799046f7a MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:15:25 +00:00
Alejandro Abdelnur c2cac2748e MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:11:22 +00:00
Alejandro Abdelnur 117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 18:14:47 +00:00
Jonathan Turner Eagles 72789336b2 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-03 20:29:29 +00:00
Siddharth Seth 3eb0cb27e8 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 21:55:37 +00:00
Thomas Graves 28320c5220 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 22:14:13 +00:00
Eli Collins ade55f9573 HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368257 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 21:28:49 +00:00
Jonathan Turner Eagles 5938c86352 MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 21:26:08 +00:00
Robert Joseph Evans 123c4f57d3 MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367783 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 21:08:40 +00:00
Thomas Graves 9d42fb2e8e MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 20:52:41 +00:00
Robert Joseph Evans 27eb14c3c3 MAPREDUCE-4483. 2.0 build does not work (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367726 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:43:51 +00:00
Robert Joseph Evans 89c59bbe3d MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367719 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:34:29 +00:00
Thomas Graves 735b50e8bd MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 19:20:03 +00:00
Robert Joseph Evans a37272e0e3 MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367601 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 15:08:47 +00:00
Thomas Graves e9bf6c56c5 MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 14:46:57 +00:00
Thomas Graves a3e695ab2c MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 13:39:41 +00:00
Alejandro Abdelnur e217a05255 MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367352 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 22:56:15 +00:00
Thomas Graves d87b545165 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 01:48:09 +00:00
Alejandro Abdelnur 9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:23:05 +00:00
Alejandro Abdelnur 515a332912 MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365322 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 22:08:27 +00:00
Thomas Graves cdef12644b MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 19:27:29 +00:00
Arun Murthy 3ef19e9dbd MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365185 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 17:33:15 +00:00
Robert Joseph Evans 97ed48e035 MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364764 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-23 19:31:33 +00:00
Alejandro Abdelnur 9c9f29ac7e MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 23:19:23 +00:00
Thomas Graves d45922de2c svn merge --change -1363454 for reverting MAPREDUCE-4423 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363935 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:18:48 +00:00
Eli Collins 370c65f282 Revert MAPREDUCE-3868. Reenable Raid. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363572 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 22:30:36 +00:00
Thomas Graves 8e69f883a0 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 18:19:59 +00:00
Alejandro Abdelnur 12979570be MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 22:43:01 +00:00
Robert Joseph Evans 1efd2e1d45 MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363067 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 19:40:36 +00:00
Alejandro Abdelnur c700642308 MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 03:36:46 +00:00
Alejandro Abdelnur 2e00d28f14 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 23:31:16 +00:00
Daryn Sharp e9aa5aac68 MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362618 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:32:14 +00:00
Robert Joseph Evans 603418c173 MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:14:33 +00:00
Robert Joseph Evans 8e576570a9 MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362608 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 19:01:42 +00:00
Robert Joseph Evans 177f6feaa1 MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362495 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 13:50:35 +00:00
Arun Murthy 7f2b1eadc1 MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362332 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-17 01:43:03 +00:00
Robert Joseph Evans e1c5e7dd2b MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362209 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 19:11:08 +00:00
Eli Collins 18f1feb64b MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 19:09:33 +00:00
Robert Joseph Evans 612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Arun Murthy ae6cc14611 MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 21:46:07 +00:00
Eli Collins bf34f62e43 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361438 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 23:04:21 +00:00
Alejandro Abdelnur 27b5f5a0e6 MAPREDUCE-3451. Amendment, excluding findbugs warnings (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361436 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 22:56:08 +00:00
Robert Joseph Evans 17de78a43e MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:53:43 +00:00
Robert Joseph Evans 228736ab51 MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:48 +00:00
Alejandro Abdelnur 9dcd317d9b MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:00 +00:00
Harsh J af0e0b1676 MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361273 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 15:22:15 +00:00
Harsh J bea60b6c86 Reverting MAPREDUCE-4422 from trunk until all comments are addressed 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361107 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 08:52:03 +00:00
Harsh J 48c1a2bdfc MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361061 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:26:54 +00:00
Alejandro Abdelnur 1ef64e64c0 MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:43:01 +00:00
Robert Joseph Evans 26910fd058 MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 15:52:12 +00:00
Harsh J e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:06:42 +00:00
Eli Collins 43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:21:22 +00:00
Eli Collins 151a1b0185 Revert previous commit, accidentally included HADOOP-8587. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:19:59 +00:00
Eli Collins c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:10:00 +00:00
Vinod Kumar Vavilapalli 3bfb26ad3b MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:26:48 +00:00
Robert Joseph Evans 6804ef32fc MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359747 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 16:10:14 +00:00
Thomas Graves 11782dd3a5 MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359399 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 21:08:40 +00:00
Alejandro Abdelnur 820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 19:19:00 +00:00
Alejandro Abdelnur 1153780655 MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359303 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 17:40:31 +00:00
Robert Joseph Evans 832ba3bae1 MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359252 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 16:14:24 +00:00
Harsh J 80875153c3 MAPREDUCE-3906. Fix inconsistency in documentation regarding mapreduce.jobhistory.principal. Contributed by Eugene Koontz. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358896 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 02:12:22 +00:00
Harsh J c3b0bed21e MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358892 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 02:01:54 +00:00