0eadfcfcf5
MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 21:52:06 +00:00
1783f209f0
MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 15:00:56 +00:00
42d1eaf237
MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 22:59:43 +00:00
b50a3c5de3
MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 17:02:52 +00:00
50993e9d48
MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 19:13:03 +00:00
aac5c149c7
MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 14:57:12 +00:00
16e21dfe92
MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:41:59 +00:00
286c171987
MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:02:52 +00:00
895029b2f2
MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 01:26:30 +00:00
1e45b1f1fd
MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
2012-10-24 15:45:35 +00:00
614a743fea
YARN-139. Interrupted Exception within AsyncDispatcher leads to user confusion. Contributed by Vinod Kumar Vavilapalli
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401726 13f79535-47bb-0310-9956-ffa450edef68
2012-10-24 15:20:58 +00:00
aaa07fc01b
Updating credits for MAPREDUCE-4229.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:23:21 +00:00
382b565e8c
MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:02:22 +00:00
def0b949d4
MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:57:36 +00:00
49beea562a
MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 19:50:23 +00:00
5be6e234c5
Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400314 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:08:28 +00:00
c195ce4d67
MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400313 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:05:30 +00:00
1195f844a9
MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 20:18:46 +00:00
a234472d1c
MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 17:51:33 +00:00
022f7b4a25
MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 05:57:57 +00:00
adcf7d10b9
MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399952 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 02:37:59 +00:00
57ee22e589
HADOOP-8925. Remove the packaging. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:30:11 +00:00
c63811790a
MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 14:58:08 +00:00
0e9f40df97
MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 22:00:03 +00:00
94ed14c48c
HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:35:42 +00:00
f174adfc15
MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 17:21:45 +00:00
aa934616dd
MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 14:37:46 +00:00
0aa8188d18
MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 13:39:26 +00:00
5c3a331040
MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 09:58:21 +00:00
8ac3910ae0
MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 03:23:07 +00:00
c074cfd6f0
YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395841 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 01:56:05 +00:00
49b20c2ed1
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 20:50:40 +00:00
a047fa9b23
MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395724 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:03:43 +00:00
803828b996
MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393775 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:24:55 +00:00
b146f9f9ca
HADOOP-8738. Reverted since it broke MR based system tests.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392675 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 22:42:46 +00:00
7137503eb7
MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392446 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 17:10:11 +00:00
57807d50bf
MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392075 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 17:01:00 +00:00
af647bb3ce
Preparing for release 0.23.4
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:15:39 +00:00
34becbb019
HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 10:57:53 +00:00
b897d6c35a
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391679 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 22:17:32 +00:00
03b7ad04fa
MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391671 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 21:55:45 +00:00
e45b103655
MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391551 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 16:48:01 +00:00
6d77365a83
MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml. Contributed by Todd Lipcon (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391498 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 15:08:48 +00:00
036530fc12
Reverted MAPREDUCE-4253.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390652 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 18:41:08 +00:00
050fd3a117
MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 15:22:21 +00:00
462ba6a3de
MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes. Contributed by Chris Nauroth. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390446 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 12:52:41 +00:00
2610acf0fb
MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390372 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 10:21:17 +00:00
1eedee177e
MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390224 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 23:49:09 +00:00
33a3efcd18
MAPREDUCE-4651. Benchmarking random reads with DFSIO.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390159 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 21:32:29 +00:00
78fa84a08a
Move MAPREDUCE-4645 under 0.23.4 release section in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389576 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 21:01:05 +00:00
b26ed9d6f8
MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389568 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 20:54:20 +00:00
eb547be607
MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388661 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 20:15:07 +00:00
d89828573d
HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:05:30 +00:00
d8e386f01a
HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:44:23 +00:00
229a79bbc3
MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 00:59:15 +00:00
dc1fd84bd1
HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 21:24:12 +00:00
c406e65f24
Update CHANGES.txt for MAPREDUCE-4607 commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383423 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 14:06:51 +00:00
3b46295c28
MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383422 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 14:04:03 +00:00
681408f898
Set date for hadoop-2.0.2-alpha
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
7851676f22
Preparing for hadoop-2.0.2-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
a7998921a7
MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 17:05:11 +00:00
77805c7ae4
MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 16:45:03 +00:00
0056914773
MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381868 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 04:56:32 +00:00
09038b741d
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:20:15 +00:00
5dcb594cb8
MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:20:43 +00:00
aa049397f1
Fix MAPREDUCE-4580 build breakage.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381315 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:34:03 +00:00
60af999c73
YARN-84. Use Builder to build RPC server. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380921 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 22:24:04 +00:00
f5943c1eef
Updated CHANGES.txt for 0.23.4
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 21:45:33 +00:00
ab986d7cf6
MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68
2012-09-03 18:54:27 +00:00
94129df354
MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:25:25 +00:00
25e96e455b
MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:43:46 +00:00
63f941d2ad
MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:37:41 +00:00
015256524c
MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:25:27 +00:00
65e447cd8b
MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 21:02:55 +00:00
6f6e170325
HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:58:07 +00:00
2f1a133dcf
MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379022 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 17:12:14 +00:00
95af351615
MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378873 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 09:57:45 +00:00
963d01a0af
MAPREDUCE-4600. TestTokenCache.java from MRV1 no longer compiles (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378255 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 18:29:17 +00:00
54d4630d9b
HADOOP-8738. junit JAR is showing up in the distro (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378175 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 15:30:43 +00:00
cfe25b8828
MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 02:03:26 +00:00
24e47ebc18
MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 00:40:02 +00:00
ffd2e01604
YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377180 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 02:18:49 +00:00
7b541d619f
MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 23:36:55 +00:00
aeb364d8b5
HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:06:56 +00:00
f909a1d4d7
MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:22:14 +00:00
0555a2145d
MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376297 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 22:43:50 +00:00
dc33a0765c
MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 21:18:34 +00:00
ca2dc3e785
MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 17:46:07 +00:00
0c2887b617
MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 15:20:21 +00:00
7fc6ad661d
YARN-25. remove old aggregated logs (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374424 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 20:29:38 +00:00
8fa10b184e
HADOOP-7967. Need generalized multi-token filesystem support (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 14:05:11 +00:00
3204b1f450
MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 13:26:12 +00:00
3cab01ba6e
HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 01:32:10 +00:00
8fcad7e8e9
MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 23:08:40 +00:00
4e09b481e7
HADOOP-8278. Make sure components declare correct set of dependencies.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373574 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 19:10:52 +00:00
dfad16fed2
MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:48:33 +00:00
4bca22005f
HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:52:56 +00:00
201d0ecb78
MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 17:29:36 +00:00
e1fdf62123
YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:22:27 +00:00
1799046f7a
MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:15:25 +00:00
c2cac2748e
MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:11:22 +00:00
117145f1ad
MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 18:14:47 +00:00
72789336b2
MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:29:29 +00:00
3eb0cb27e8
MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 21:55:37 +00:00
28320c5220
MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 22:14:13 +00:00
ade55f9573
HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368257 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 21:28:49 +00:00
5938c86352
MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 21:26:08 +00:00
123c4f57d3
MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367783 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 21:08:40 +00:00
9d42fb2e8e
MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 20:52:41 +00:00
27eb14c3c3
MAPREDUCE-4483. 2.0 build does not work (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367726 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:43:51 +00:00
89c59bbe3d
MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367719 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:34:29 +00:00
735b50e8bd
MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:20:03 +00:00
a37272e0e3
MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367601 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 15:08:47 +00:00
e9bf6c56c5
MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 14:46:57 +00:00
a3e695ab2c
MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 13:39:41 +00:00
e217a05255
MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367352 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 22:56:15 +00:00
d87b545165
MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 01:48:09 +00:00
9d16c9354b
MAPREDUCE-4417. add support for encrypted shuffle (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:23:05 +00:00
515a332912
MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365322 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 22:08:27 +00:00
cdef12644b
MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 19:27:29 +00:00
3ef19e9dbd
MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365185 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 17:33:15 +00:00
97ed48e035
MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364764 13f79535-47bb-0310-9956-ffa450edef68
2012-07-23 19:31:33 +00:00
9c9f29ac7e
MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 23:19:23 +00:00
d45922de2c
svn merge --change -1363454 for reverting MAPREDUCE-4423
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363935 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:18:48 +00:00
370c65f282
Revert MAPREDUCE-3868. Reenable Raid.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363572 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 22:30:36 +00:00
8e69f883a0
MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:19:59 +00:00
12979570be
MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 22:43:01 +00:00
1efd2e1d45
MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363067 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 19:40:36 +00:00
c700642308
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 03:36:46 +00:00
2e00d28f14
MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 23:31:16 +00:00
e9aa5aac68
MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362618 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:32:14 +00:00
603418c173
MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:14:33 +00:00
8e576570a9
MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362608 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:01:42 +00:00
177f6feaa1
MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362495 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 13:50:35 +00:00
7f2b1eadc1
MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362332 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 01:43:03 +00:00
e1c5e7dd2b
MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362209 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:11:08 +00:00
18f1feb64b
MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:09:33 +00:00
612443951b
MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 14:19:36 +00:00
ae6cc14611
MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 21:46:07 +00:00
bf34f62e43
HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361438 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:04:21 +00:00
27b5f5a0e6
MAPREDUCE-3451. Amendment, excluding findbugs warnings (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361436 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 22:56:08 +00:00
17de78a43e
MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:53:43 +00:00
228736ab51
MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:42:48 +00:00
9dcd317d9b
MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:42:00 +00:00
af0e0b1676
MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361273 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 15:22:15 +00:00
bea60b6c86
Reverting MAPREDUCE-4422 from trunk until all comments are addressed
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361107 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 08:52:03 +00:00
48c1a2bdfc
MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361061 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:26:54 +00:00
1ef64e64c0
MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:43:01 +00:00
26910fd058
MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 15:52:12 +00:00
e5ea2aa765
HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 15:06:42 +00:00
43e37b96f8
HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:21:22 +00:00
151a1b0185
Revert previous commit, accidentally included HADOOP-8587.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:19:59 +00:00
c41b97860d
HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:10:00 +00:00
3bfb26ad3b
MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 21:26:48 +00:00
6804ef32fc
MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359747 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 16:10:14 +00:00
11782dd3a5
MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359399 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 21:08:40 +00:00
820be7cbef
MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 19:19:00 +00:00
1153780655
MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359303 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 17:40:31 +00:00
832ba3bae1
MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359252 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 16:14:24 +00:00
80875153c3
MAPREDUCE-3906. Fix inconsistency in documentation regarding mapreduce.jobhistory.principal. Contributed by Eugene Koontz. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358896 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 02:12:22 +00:00
c3b0bed21e
MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358892 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 02:01:54 +00:00
52a4678a1d
MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358788 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 17:23:40 +00:00
0e7204c9e7
MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 17:19:13 +00:00
072292219e
MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358201 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 13:38:11 +00:00
3d5a44f919
MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357937 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 21:36:02 +00:00
c1bf8a3f03
MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357776 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 18:09:09 +00:00
72fb517469
MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357723 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 16:29:09 +00:00
161ed29087
HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:46:55 +00:00
eff5abb4f7
MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356414 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 19:02:51 +00:00
dcc1d3b7f0
HADOOP-8538. CMake builds fail on ARM. Contributed by Trevor Robinson
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356041 13f79535-47bb-0310-9956-ffa450edef68
2012-07-01 22:47:48 +00:00
e967e98f74
MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355766 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 16:49:24 +00:00
cd9ce99740
MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 20:57:20 +00:00
d1f05ce29f
Reverting MAPREDUCE-4371 to address test failures.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355382 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 13:41:46 +00:00
78c27ca2e3
MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355139 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:59:19 +00:00
aad2a6f0fc
MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:28:42 +00:00
f105784d6a
svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:25:32 +00:00
44389399d4
HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:11:22 +00:00
1b21c9836e
Reverting MAPREDUCE-4346 r1353757
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354656 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 18:29:42 +00:00
bb9ac4fe4c
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354531 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 14:28:08 +00:00
03f2f9b580
MAPREDUCE-4228. mapreduce.job.reduce.slowstart.completedmaps is not working properly (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354181 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 19:17:33 +00:00
d9bbd5997d
MAPREDUCE-4355. Add JobStatus getJobStatus(JobID) to JobClient. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353757 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 21:55:44 +00:00
5b36106934
MAPREDUCE-2289. Permissions race can make getStagingDir fail on local filesystem (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353750 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 21:36:17 +00:00
75269b5488
MAPREDUCE-4290. Fix Yarn Applicaiton Status to MR JobState conversion. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353684 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 17:54:48 +00:00
db31b6c0e4
MAPREDUCE-4336. Distributed Shell fails when used with the CapacityScheduler (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353625 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 15:58:55 +00:00
18052795a7
MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353039 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 21:45:59 +00:00
a945336368
MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 21:40:35 +00:00
126dd6adef
MAPREDUCE-4295. RM crashes due to DNS issue (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352638 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 18:14:22 +00:00
b91910dd3e
MAPREDUCE-4320. gridmix mainClass wrong in pom.xml (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352550 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 15:01:35 +00:00
b685486fbb
MAPREDUCE-4356. [Rumen] Provide access to the method ParsedTask.obtainTaskAttempts(). (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352415 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 05:44:20 +00:00
cf5dd32932
MAPREDUCE-3889. job client tries to use /tasklog interface, but that doesn't exist anymore (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352330 13f79535-47bb-0310-9956-ffa450edef68
2012-06-20 21:22:33 +00:00
daa28cc6ce
MAPREDUCE-4306. Fix distributed shell to work with users other than the one running the daemons. (Contributed by Ahmed Radwan)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351876 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 22:00:45 +00:00
10bc39ea02
MAPREDUCE-4270. Move the data_join test classes to the correct path. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351869 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 21:51:15 +00:00
49feb6a039
MAPREDUCE-4267. mavenize pipes (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351818 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 19:40:44 +00:00
01b2040810
MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351762 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 16:17:21 +00:00
01b61c76a8
MAPREDUCE-4311. Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings (Karthik Kambatla via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351700 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 13:06:51 +00:00
277b3dd736
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351548 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 00:55:28 +00:00
f9c938666b
HDFS-3389. Document the BKJM usage in Namenode HA. Contributed by Uma Maheswara Rao G and Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349466 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 18:19:46 +00:00
eff9fa1aad
MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349065 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 23:14:06 +00:00
13ad756796
MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348997 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:37:03 +00:00
8a9e63e468
HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348957 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:34:40 +00:00
27d1c74a0c
MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348846 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 13:54:46 +00:00
9368be0e73
MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348123 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 15:47:50 +00:00
743cbf6ef3
svn merge -c -1347092 for reverting HADOOP-8368 again.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347738 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 17:56:04 +00:00
9ae7639405
Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 21:19:33 +00:00
8ad1fcb3c3
svn merge -c -1346491 for re-committing HADOOP-8368. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347092 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 20:17:23 +00:00
67cbc289e4
MAPREDUCE-3873. Fixed NodeManagers' decommissioning at RM to accept IP addresses also. Contributed by xieguiming and vinodkv.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346671 13f79535-47bb-0310-9956-ffa450edef68
2012-06-05 23:52:16 +00:00
d44513c376
svn merge -c -1345421 for reverting HADOOP-8368.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346491 13f79535-47bb-0310-9956-ffa450edef68
2012-06-05 17:56:20 +00:00
d6467bb3b1
MAPREDUCE-4313. TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346406 13f79535-47bb-0310-9956-ffa450edef68
2012-06-05 15:01:26 +00:00
119a8c7b15
Updated CHANGES.txt files to reflect the 2.0.0-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346150 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 20:53:15 +00:00
1e488138a8
MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346065 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 18:05:58 +00:00
358eda0bfa
MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346047 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 17:41:52 +00:00
1283ab51a9
MAPREDUCE-4301. Dedupe some strings in MRAM for memory savings (bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346002 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 15:14:27 +00:00
30807fec82
HADOOP-8450. Remove src/test/system. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345794 13f79535-47bb-0310-9956-ffa450edef68
2012-06-03 22:14:16 +00:00
18ba716922
MAPREDUCE-4307. TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem. Contributed by Ahmed Radwan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345546 13f79535-47bb-0310-9956-ffa450edef68
2012-06-02 18:47:40 +00:00
2db30031d2
HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345421 13f79535-47bb-0310-9956-ffa450edef68
2012-06-02 02:34:38 +00:00
1cf6010675
MAPREDUCE-4302. NM goes down if error encountered during log aggregation (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345362 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 21:54:49 +00:00
800cfd5c1c
HADOOP-8460. Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345304 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 18:18:16 +00:00
8bbacfaa31
MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344763 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 15:16:48 +00:00
0a80f82a30
MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344283 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 14:48:53 +00:00
515e29ac82
MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343804 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 16:10:59 +00:00
45be2c085d
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343755 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 14:43:40 +00:00
1fab229f30
HADOOP-8268. A few pom.xml across Hadoop project may fail XML validation. Contributed by Radim Kolar. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343272 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 14:51:05 +00:00
fcf47eb4b8
MAPREDUCE-3990. MRBench allows Long-sized input-lines value but parses CLI argument as an Integer. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343247 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:26:35 +00:00
0037bf5dc5
MAPREDUCE-2384. The job submitter should make sure to validate jobs before creation of necessary files. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343240 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:14:14 +00:00
2ebb1f47db
MAPREDUCE-3302. Remove the last dependency call from org.apache.hadoop.record package in MR. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342613 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 13:21:30 +00:00
c4f17d242d
MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 13:10:57 +00:00
6c544adeb3
Merge HDFS-3042 (automatic failover) to trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
cf7b017422
MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 22:22:55 +00:00
432c4a6ffc
MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 18:37:37 +00:00
d74bec2f88
MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:15:41 +00:00
2eebc21a55
MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341151 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:05:19 +00:00
d239307d00
MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 01:55:44 +00:00
260dfa367e
HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 21:13:17 +00:00
a37aa28e4a
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340630 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 07:41:56 +00:00
1a3bd5d42f
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 06:12:14 +00:00
bacb4080a0
MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339957 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 02:50:48 +00:00
dcf84707ab
MAPREDUCE-3543. Mavenize Gridmix. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339629 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 15:06:33 +00:00
e14e10fb86
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:47:37 +00:00
7e3d016845
MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339174 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 14:08:08 +00:00
9142dcac9e
Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 05:48:16 +00:00
2eeafa78c9
MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339000 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 04:15:02 +00:00
f35294eb95
MAPREDUCE-4238. mavenize data_join. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338835 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 19:09:59 +00:00
4cd70e87be
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 20:52:34 +00:00
a446ad2c26
MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337363 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 20:26:42 +00:00
cc9c6bdce2
HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop. Contributed by Roman Shaposhnik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337251 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:15:18 +00:00
aea890f7d2
MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
7e8e983620
HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 21:41:25 +00:00
0308423b9c
MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336399 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 21:08:53 +00:00
f6d6218348
MAPREDUCE-4231. Update RAID to use the new BlockCollection interface.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335661 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:53:15 +00:00
0caac704fb
MAPREDUCE-4215. RM app page shows 500 error on appid parse error (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335647 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:13:33 +00:00
67a514b647
MAPREDUCE-3850. Avoid redundant calls for tokens in TokenCache (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335585 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:25:08 +00:00
aa60da6c2e
MAPREDUCE-4162. Correctly set token service (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335567 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:07:40 +00:00
55cd161a35
MAPREDUCE-4226. ConcurrentModificationException in FileSystemCounterGroup.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335197 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:05:59 +00:00
d3599de399
MAPREDUCE-4220. RM apps page starttime/endtime sorts are incorrect (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335096 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:18:33 +00:00
407cfa3b56
MAPREDUCE-3958. RM: Remove RMNodeState and replace it with NodeState (Bikas Saha via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334043 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 15:47:02 +00:00
48f95779c1
MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334013 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 15:02:54 +00:00
0fca4fbaf3
MAPREDUCE-4205. retrofit all JVM shutdown hooks to use ShutdownHookManager (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333748 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 03:20:16 +00:00
48414b0827
MAPREDUCE-4163. consistently set the bind address (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333579 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 18:35:21 +00:00
f6c01e2f8e
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 02:14:01 +00:00
9d5799553f
HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:56:33 +00:00
ca5b406ac0
MAPREDUCE-4219. make default container-executor.conf.dir be a path relative to the container-executor binary. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333241 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 22:53:50 +00:00
f8ed2ad524
MAPREDUCE-4210. Expose listener address for WebApp (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333144 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 18:27:17 +00:00
1c96e52533
MAPREDUCE-3173. MRV2 UI doesn't work properly without internet (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333063 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 14:40:01 +00:00
70c392df0e
HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332853 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:46:58 +00:00
6fec13abdd
MAPREDUCE-4202. Updating changes to just be branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332731 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 16:14:16 +00:00
512fd2756a
MAPREDUCE-4202. TestYarnClientProtocolProvider is broken (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332716 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 15:59:36 +00:00
506232da5c
MAPREDUCE-4211. Error conditions (missing appid, appid not found) are masked in the RM app page (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332701 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 15:34:19 +00:00
2755a2e283
MAPREDUCE-4212. TestJobClientGetJob sometimes fails (Daryn Sharp via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332665 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 14:10:45 +00:00
47df4697ba
MAPREDUCE-4206. Sorting by Last Health-Update on the RM nodes page sorts does not work correctly (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332232 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 15:07:08 +00:00
7407d5cd0f
MAPREDUCE-4209. junit dependency in hadoop-mapreduce-client is missing scope test (Radim Kolar via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332226 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 14:48:22 +00:00
252568085a
MAPREDUCE-3883. Document yarn.nodemanager.delete.debug-delay-sec configuration property (Eugene Koontz via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332196 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 13:43:09 +00:00
1c0231cc74
MAPREDUCE-4189. TestContainerManagerSecurity is failing (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331046 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 19:40:48 +00:00
1a118d6a32
MAPREDUCE-4138. Reduce memory usage of counters due to non-static nested classes.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331023 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:39:22 +00:00
cda16311a9
MAPREDUCE-4169. Container Logs appear in unsorted order (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331012 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:27:05 +00:00
e7583d816a
MAPREDUCE-3613. web service calls header contains 2 content types (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330560 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 21:13:06 +00:00
719b719e3d
MAPREDUCE-4194. ConcurrentModificationError in DirectoryCollection (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330552 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:49:41 +00:00
bcfb66ebb2
MAPREDUCE-4193. broken doc link for yarn-default.xml in site.xml. Contributed by Patrick Hunt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330427 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:20:00 +00:00
f340d6c894
MAPREDUCE-4079. Allow MR AppMaster to limit ephemeral port range.(bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329694 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:03:15 +00:00
ebe0e9a99b
MAPREDUCE-4141. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329493 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 22:32:06 +00:00
80ab78c217
MAPREDUCE-4133. MR over viewfs is broken (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329403 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:44:30 +00:00
796e1a48ac
MAPREDUCE-4190. Improve web UI for task attempts userlog link (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329398 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:38:28 +00:00
589c68ae09
HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
1eb1d0ae4f
MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329282 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 15:26:35 +00:00
8d09ab0da2
MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328111 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:35:54 +00:00
df654cca49
MAPREDUCE-3867. MiniMRYarn/MiniYarn uses fixed ports (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328109 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:33:11 +00:00
7d2466c0c8
MAPREDUCE-4129. Lots of unneeded counters log messages (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328106 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:23:47 +00:00
d09cf903ab
MAPREDUCE-4093. Improve RM WebApp start up when proxy address is not set (Devaraj K vai bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328090 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:42:32 +00:00
5b35f7df64
MAPREDUCE-4165. Committing is misspelled as commiting in task logs (John Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:32:16 +00:00
e3806060ce
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328031 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:22:22 +00:00
97ae5b675f
MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327972 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 14:44:57 +00:00
3edc40e377
MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327816 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 04:26:53 +00:00
ca49126e3d
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 23:35:30 +00:00
32d511065a
MAPREDUCE-4161. create sockets consistently (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327621 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:46:34 +00:00
6b69ba6ba1
Reverting all commit booboos made on HADOOP-8290. Resetting to state before that. Sorry for so much noise. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327616 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:42:09 +00:00
14c61e6504
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327609 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:29:11 +00:00
2ada53f107
MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter strings. (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327461 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 11:59:38 +00:00
7d04a96027
MAPREDUCE-3972. Fix locking and exception issues in JobHistory server. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327354 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 01:59:16 +00:00
a15e69cb9f
MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327304 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 22:05:42 +00:00
ca9f62121e
MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327263 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 20:05:44 +00:00
b89b6bd75f
MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327233 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 19:21:34 +00:00
fe7711df98
MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327220 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 18:48:42 +00:00
159646f2a4
MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326795 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 20:46:30 +00:00
24d6a8b29c
MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326707 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 18:02:51 +00:00
9a10b4e773
MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325991 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 22:24:16 +00:00
27ea3ab6ba
MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325765 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 13:45:03 +00:00
02db5b7ef7
MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325573 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 00:10:30 +00:00
2ed825e66c
HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:42 +00:00
ecb30a48c4
MAPREDUCE-4050. For tasks without assigned containers, changes the node text on the UI to N/A instead of a link to null. (Contributed by Bhallamudi Venkata Siva Kamesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325435 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 18:39:49 +00:00
346d50782d
MAPREDUCE-4140. mapreduce classes incorrectly importing "clover.org.apache.*" classes. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325352 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:22:25 +00:00
d310c48ce4
MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325145 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 07:17:34 +00:00
aca6ca0059
MAPREDUCE-4107. Fix tests in org.apache.hadoop.ipc.TestSocketFactory (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325010 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 21:13:49 +00:00
7809acd67b
MAPREDUCE-3932. Fix the TaskAttempt state machine to handle CONTIANER_LAUNCHED and CONTIANER_LAUNCH_FAILED events in additional states. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324902 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 18:18:40 +00:00
cfafd8c29d
MAPREDUCE-4099 amendment. ApplicationMaster will remove staging directory after the history service is stopped. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324866 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:09:54 +00:00
13bfe4794b
MAPREDUCE-4040. History links should use hostname rather than IP address. (Contributed by Bhallamudi Venkata Siva Kamesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312076 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 02:50:02 +00:00
94843b848a
MAPREDUCE-4108. Fix tests in org.apache.hadoop.util.TestRunJar (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312018 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:09:00 +00:00
eb74ff0c3b
MAPREDUCE-4076. Stream job fails with ZipException when use yarn jar command (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312003 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 21:30:05 +00:00
2accda38a1
MAPREDUCE-4017. Add jobname to jobsummary log (tgraves and Koji Noguchi via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311972 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 20:36:09 +00:00
d9b740cb14
MAPREDUCE-4057. Update RAID for the HA and fsdataset changes. Contributed by Devaraj K
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311959 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 19:46:44 +00:00
793746870b
MAPREDUCE-4099. ApplicationMaster may fail to remove staging directory (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311926 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:57:34 +00:00
cbb5f61090
MAPREDUCE-4059. The history server should have a separate pluggable storage/query interface. (Robert Evans via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311896 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:11:26 +00:00
000859a534
MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311818 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 16:13:07 +00:00
b28f134e9c
MAPREDUCE-3869. Fix classpath for DistributedShell application. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311523 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:01:49 +00:00
241e3d40ac
MAPREDUCE-4105. Yarn RackResolver ignores rack configurations. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311520 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 23:32:43 +00:00
48ab08f1c6
MAPREDUCE-4117. mapred job -status throws NullPointerException (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311479 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 21:52:50 +00:00
b435e2202d
MAPREDUCE-4110. Fix tests in TestMiniMRClasspath & TestMiniMRWithDFSWithDistinctUsers (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310546 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:56:55 +00:00
5af7077dcd
Added toString to ContainerToken. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310537 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:41:06 +00:00
c156906c73
MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310528 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:09:09 +00:00
2bb3407af9
MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310431 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:04:40 +00:00
b447d94094
MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310418 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:57:39 +00:00
adeef5ec8f
MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310409 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:49:52 +00:00
c76b264196
MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310056 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:27:55 +00:00
98df316058
MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:11:52 +00:00
1d6038ecfb
MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309583 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:24:01 +00:00
1b93f8e5c3
MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:46:22 +00:00
db075f93ae
MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309481 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 16:23:29 +00:00
594dd9eb25
MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309453 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:28:17 +00:00
4e44259cbd
MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309440 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:08:39 +00:00
da1b01c9e3
MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:56:13 +00:00
d99c2958dd
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:17:22 +00:00
1f4197984c
MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 20:39:08 +00:00
7b387f55c3
MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:37:46 +00:00
b45c450026
MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:29:40 +00:00
20184e7ddc
MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:01:43 +00:00
949b34e722
Missed a test file as part of MAPREDUCE-4062
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 17:03:10 +00:00
2b5c36b695
MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 16:59:26 +00:00
00eb28d927
MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 15:27:46 +00:00
8c8dbba8a6
MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:47:35 +00:00
4d876c7800
MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:19:29 +00:00
01ce7ba3a4
MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:06:16 +00:00
bb74427da2
MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:20:41 +00:00
354025b6e7
MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:04:31 +00:00
3a8d123ccb
MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:51:06 +00:00
57af34b776
Preping for 0.23.3 stabilization.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:13:53 +00:00
170ff8d81c
MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 08:24:15 +00:00
c4c7ee5b8c
MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:30:11 +00:00
d1893c8f5b
MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 13:40:48 +00:00
57e175fddf
hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:43:50 +00:00
d05cc8e5cd
MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:53:44 +00:00
f11a5dc5f6
MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:18:41 +00:00
9bb6a025de
MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 07:45:45 +00:00
db3e592df0
REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 02:02:17 +00:00
991eddd043
Change "0.23.3" to "2.0.0" in CHANGES.txt files.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
67a74198b1
Changed version in trunk to 3.0.0-SNAPSHOT.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
1650a49993
MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:23:31 +00:00
1a9385d516
MAPREDUCE-3353. Fixed commit msg to point to right jira.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:29:02 +00:00
d5836856a2
MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 13:21:36 +00:00
606114d602
MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 05:45:29 +00:00
f67c2d1bd0
MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 20:46:18 +00:00
4e58186987
Removed some logs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304099 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:20:29 +00:00
7b3a98cfcd
MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:42:23 +00:00
a24d12bdec
MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303076 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 18:36:56 +00:00
40a8293d36
MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302980 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 16:29:42 +00:00
04a47dea74
MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302754 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 02:28:53 +00:00
9d8d02b68b
MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302645 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 20:31:55 +00:00
be5181ff2d
Fixing an issue to do with setting of correct groups for tasks. Contributed by Aaron T Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 23:16:19 +00:00
f58e3c8b12
MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301731 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 20:10:51 +00:00
274d6909f3
MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301691 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:47:48 +00:00
3e8c273f37
MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 14:39:01 +00:00
e8ae52823f
MAPREDUCE-3431
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301500 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:36:09 +00:00
8c7f5f2c7f
MAPREDUCE-3431
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301496 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:33:32 +00:00
5a5307a255
MAPREDUCE-3970 ServiceOperations class
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300899 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:45:00 +00:00
af0227e32a
MAPREDUCE-3970 ServiceOperations class
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300894 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:39:17 +00:00
7609243e58
MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300750 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:02:53 +00:00
3f46a62ff9
MAPREDUCE-3974. Change to release 23.3
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 18:30:32 +00:00
7d60932060
MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299625 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 11:08:32 +00:00
ed4c222d5c
MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 23:34:49 +00:00
558cc8c0bf
MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:13:42 +00:00
1c534d0f9d
MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:07:33 +00:00
ad3d3f54d5
MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:53:19 +00:00
4001b95cf2
MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 17:37:00 +00:00
13ea1d575c
MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 01:27:02 +00:00
25cceb65ce
MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:44:58 +00:00
c3a4de0ec0
MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:21:13 +00:00
4ce5f6553f
MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
1a0e088a19
MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:31:23 +00:00
a98b756c73
MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 16:17:41 +00:00
b9fd9e1759
MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:52:10 +00:00
739f688f5a
MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 23:56:46 +00:00
774f809f15
MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 22:03:09 +00:00
7c1e857176
MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
...
.--This line, and those below, will be ignored--
M hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M hadoop-mapreduce-project/CHANGES.txt
M hadoop-mapreduce-project/bin/mapred
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
b73738d21e
MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:29:29 +00:00
231e39462d
MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 13:44:01 +00:00
d5f4fcef5c
MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
6d80dc2a84
MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:44:57 +00:00
d41cb76b56
MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 21:14:53 +00:00
bd38a29673
MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 17:14:23 +00:00
5f52156aa2
MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296747 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 05:23:16 +00:00
fab57a144d
MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296721 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 23:40:35 +00:00
a1fc055489
HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay Radia, Mingjie Lai, and Gregory Chanan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296534 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:42:49 +00:00
ce11ff73db
MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296523 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:08:58 +00:00
ffa527138b
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:43:28 +00:00
99bf2902b2
MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296401 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 19:28:04 +00:00
87d1c67944
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:48:32 +00:00
b2f67b4704
HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
7ae1523865
MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295362 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:56:53 +00:00
1ba357553a
Merge trunk into HA branch.
...
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
7bf2f9559f
MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295314 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:14:32 +00:00
3cbb9d20d0
MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:48:09 +00:00
2659fded83
MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295245 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:05:10 +00:00
a4ad12dd2d
MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 16:20:40 +00:00
547ded7bfe
MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:49:27 +00:00
defa1c5bab
MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295147 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:19:51 +00:00
44a003d8ec
MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294970 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 04:55:29 +00:00
137aa0763f
MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294901 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 23:50:47 +00:00
ffdf980b20
MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:06:53 +00:00
375c6b8f2e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:33:41 +00:00
ab29f5c5f9
MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 17:50:38 +00:00
cfe214220f
MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294446 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:35:37 +00:00
586bd479cb
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294445 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:21:42 +00:00
165cd626c5
MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:24:35 +00:00
7475e836dc
MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294417 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:32:19 +00:00
dee6ca3d41
Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:01:06 +00:00
5fd47e77ab
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294255 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 18:13:19 +00:00
008cf6a11d
MAPREDUCE-3909
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294219 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:53:06 +00:00
acf8e6f1b5
trailing whitespace on end of title lines
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294216 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:11 +00:00
d6170f00b1
MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:44:05 +00:00
f071323343
MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 08:32:30 +00:00
f3cc891148
MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 06:49:21 +00:00
ae9014ef6a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 04:57:17 +00:00
d83672d71c
MAPREDUCE-2793. Reneabling commented out test from previous comment.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293521 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:30:55 +00:00
7a082ec2bd
MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:03:59 +00:00
1de3fa8653
Preparing for 0.23.3 release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
4e64d7b447
MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:00:17 +00:00
582b97c3e7
MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
c0572656ce
MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
969b3809e4
MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:21:20 +00:00
328702891e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 14:49:38 +00:00
6112940841
MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:12:06 +00:00
f3026e1085
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 16:06:53 +00:00
81f5c5933d
MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 15:50:53 +00:00
Robert Joseph Evans
Jason Darrell Lowe
Thomas Graves
Alejandro Abdelnur
Vinod Kumar Vavilapalli
Daryn Sharp
Siddharth Seth
Suresh Srinivas
Eli Collins
Arun Murthy
Thomas White
Harsh J
Konstantin Shvachko
Aaron Myers
Jonathan Turner Eagles
Tsz-wo Sze
Ravi Gummadi
Scott Chun-Yang Chen
Uma Maheswara Rao G
Todd Lipcon
Sanjay Radia
Amar Kamat
Devaraj Das
Steve Loughran