f3f7a11336
MAPREDUCE-5286. Change MapReduce to use ContainerTokenIdentifier instead of the entire Container in the startContainer call - YARN-684. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488087 13f79535-47bb-0310-9956-ffa450edef68
2013-05-31 04:17:33 +00:00
4394e5edb0
MAPREDUCE-5228. Bring back FileInputFormat.Counter and FileOuputFormat.Counter for binary compatibility with 1.x mapred APIs. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488060 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 23:53:21 +00:00
131bfc91a6
MAPREDUCE-5261. Reverting the patch as it is no longer needed.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488032 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 21:53:34 +00:00
982753dc8e
YARN-716. Making ApplicationID immutable. Contributed by Siddharth Seth.
...
MAPREDUCE-5282. Updating MR App to use immutable ApplicationID after YARN-716. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487994 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 20:18:39 +00:00
a720a524e9
MAPREDUCE-5263. Bring back old methods and fields in filecache.DistributedCache for binary compatibility with mapred in 1.x. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487695 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 01:23:16 +00:00
0edae7a96a
MAPREDUCE-5237. Add methods that were removed from ClusterStatus back into 2.x so as to be compatible with 1.x. Contributed by Zhijie Shen.
...
Incompatible as ClusterStatus.UNINITIALIZED_MEMORY_VALUE is a long now and so breaks 0.23.x but it shouldn't be a big deal in reality.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487175 13f79535-47bb-0310-9956-ffa450edef68
2013-05-29 00:43:13 +00:00
e1d5aca10b
HADOOP-8562. Fix CHANGES.txt to move 8562 and related tasks to 2.0.5 section
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1486334 13f79535-47bb-0310-9956-ffa450edef68
2013-05-25 14:57:06 +00:00
643155cbee
MAPREDUCE-5270. Migrated MR app from using BuilderUtil factory methods to individual record factory methods. Contributed by Jian He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1486271 13f79535-47bb-0310-9956-ffa450edef68
2013-05-25 01:46:14 +00:00
a791527dd1
MAPREDUCE-5230. Bring back NLineInputFormat.createFileSplit for binary compatibility with mapred in 1.x Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485906 13f79535-47bb-0310-9956-ffa450edef68
2013-05-24 00:42:22 +00:00
43876770d9
YARN-563. Add the concept of an application-type for each application. Contributed by Mayank Bansal.
...
MAPREDUCE-5246. Specify application-type at the time of job submission after YARN-563. Contributed by Mayank Bansal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485790 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 18:02:04 +00:00
9b284150f1
MAPREDUCE-5233. Add methods that are changed or removed from JobControl.Job when compared to 1.x. This breaks 0.23.x users of one API in Job. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485491 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 23:12:45 +00:00
27e6673ec3
MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 06:36:24 +00:00
4a4e42d919
MAPREDUCE-5261. Fix issues in TestRMContainerAllocator after YARN-617. Contributed by Omkar Vinit Joshi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485079 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 06:24:17 +00:00
6377bfc505
MAPREDUCE-5235. Bring back old fields and exceptions in Counters for binary compatibility with mapred in 1.x. Contributed by Mayank Bansal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484992 13f79535-47bb-0310-9956-ffa450edef68
2013-05-21 22:00:08 +00:00
6517c3f714
MAPREDUCE-5191. TestQueue#testQueue fails with timeout on Windows. (Contributed by Ivan Mitic)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484575 13f79535-47bb-0310-9956-ffa450edef68
2013-05-20 20:02:07 +00:00
9cf436aef5
MAPREDUCE-5257. Fix issues in TestContainerLauncherImpl after YARN-617. Contributed by Omkar Vinit Joshi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484349 13f79535-47bb-0310-9956-ffa450edef68
2013-05-19 21:15:11 +00:00
ca2265b581
MAPREDUCE-4927. Historyserver 500 error due to NPE when accessing specific counters page for failed job. Contributed by Ashwin Shankar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483974 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 20:19:48 +00:00
0b668c21b2
MAPREDUCE-5234. Change mapred.TaskReport and mapreduce.TaskReport for binary compatibility with mapred in 1.x but incompatible with 0.23.x. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483940 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 18:16:33 +00:00
4d8e350750
MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 23:43:53 +00:00
3472800eb6
MAPREDUCE-5244. Two functions changed their visibility in JobStatus. (zjshen via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482622 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 22:12:40 +00:00
febf951220
MAPREDUCE-5222. Bring back some methods and constants in Jobclient for binary compatibility with mapred in 1.x. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482208 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 05:52:11 +00:00
14d856be57
MAPREDUCE-5240. Fix a bug in MRAppMaster because of which OutputCommitter could not access credentials set by the user. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482175 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 02:48:53 +00:00
2103c80b77
MAPREDUCE-5220. Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482142 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 23:08:10 +00:00
7359dc32d3
MAPREDUCE-4067. Changed MRClientProtocol api to throw IOException only (Xuan Gong via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481695 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 03:34:25 +00:00
47d1ca402f
MAPREDUCE-5208. Modified ShuffleHandler to use SecureIOUtils for reading local files. Contributed by Omkar Vinit Joshi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481657 13f79535-47bb-0310-9956-ffa450edef68
2013-05-12 21:59:16 +00:00
2638bc67a4
YARN-634. Modified YarnRemoteException to be not backed by PB and introduced a separate SerializedException record. Contributed by Siddharth Seth.
...
MAPREDUCE-5239. Updated MR App to reflect YarnRemoteException changes after YARN-634. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481205 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 21:49:28 +00:00
d303f01297
MAPREDUCE-4942. mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480748 13f79535-47bb-0310-9956-ffa450edef68
2013-05-09 20:04:32 +00:00
9c4f86879c
YARN-630. Changed AMRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong.
...
MAPREDUCE-5226. Handling YarnRemoteException separately from IOException in MR App's use of AMRMProtocol after YARN-630. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480529 13f79535-47bb-0310-9956-ffa450edef68
2013-05-09 05:32:04 +00:00
0727ecaf50
YARN-631. Changed ClientRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong.
...
MAPREDUCE-5212. Handling YarnRemoteException separately from IOException in MR App after YARN-631. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480494 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 22:53:01 +00:00
e5692ecbe1
Fixing release date for 2.0.4-alpha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480480 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 21:57:44 +00:00
f6167ef6c6
MAPREDUCE-5157. Bring back old sampler related code so that we can support binary compatibility with hadoop-1 sorter example. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480474 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 21:42:47 +00:00
67d7d8f4d3
MAPREDUCE-5209. Fix units in a ShuffleScheduler log message.
...
Contributed by Tsuyoshi OZAWA
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480464 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 21:12:27 +00:00
8888d3fc49
MAPREDUCE-5159. Change ValueAggregatorJob to add APIs which can support binary compatibility with hadoop-1 examples. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480394 13f79535-47bb-0310-9956-ffa450edef68
2013-05-08 18:28:22 +00:00
92b7165a71
YARN-629. Make YarnRemoteException not be rooted at IOException. Contributed by Xuan Gong.
...
MAPREDUCE-5204. Handling YarnRemoteException separately from IOException in MR app after YARN-629. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479680 13f79535-47bb-0310-9956-ffa450edef68
2013-05-06 19:04:31 +00:00
6e37a7e5e1
MAPREDUCE-5205. Fixed MR App to load tokens correctly. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479016 13f79535-47bb-0310-9956-ffa450edef68
2013-05-04 00:27:47 +00:00
9b97df9abe
MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478422 13f79535-47bb-0310-9956-ffa450edef68
2013-05-02 15:58:53 +00:00
ca2c38fba1
MAPREDUCE-5193. A few MR tests use block sizes which are smaller than the default minimum block size. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478250 13f79535-47bb-0310-9956-ffa450edef68
2013-05-02 01:59:36 +00:00
71be8ad325
MAPREDUCE-5145. Changed default max-attempts to be more than one for MR jobs inline with YARN. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477889 13f79535-47bb-0310-9956-ffa450edef68
2013-05-01 00:42:32 +00:00
8f7ce62085
MAPREDUCE-5177. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477403 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 23:00:39 +00:00
ae393ab26e
MAPREDUCE-5179. Fix unit test in TestHSWebServices which fails when versionInfo has parantheses like when running on a git checkout. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476835 13f79535-47bb-0310-9956-ffa450edef68
2013-04-28 21:02:25 +00:00
fbb55784d9
YARN-562. Modified NM to reject any containers allocated by a previous ResourceManager. Contributed by Jian He.
...
MAPREDUCE-5167. Update MR App after YARN-562 to use the new builder API for the container. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476034 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 03:50:20 +00:00
448df18646
YARN-577. Add application-progress also to ApplicationReport. Contributed by Hitesh Shah.
...
MAPREDUCE-5178. Update MR App to set progress in ApplicationReport after YARN-577. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1475636 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 05:42:22 +00:00
e96077aaf4
MAPREDUCE-5181. RMCommunicator should not use AMToken from the env. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471816 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 02:50:16 +00:00
daaa73b657
MAPREDUCE-5166. Fix ConcurrentModificationException due to insufficient synchronization on updates to task Counters. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471796 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 00:54:04 +00:00
40e78c2ca2
MAPREDUCE-4737. Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour. Contributed by Arun C. Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471556 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 17:38:43 +00:00
0777474cc2
MAPREDUCE-5069. add concrete common implementations of CombineFileInputFormat (Sangjin Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471424 13f79535-47bb-0310-9956-ffa450edef68
2013-04-24 14:11:50 +00:00
27e8c86999
YARN-561. Modified NodeManager to set key information into the environment of every container that it launches. Contributed by Xuan Gong.
...
MAPREDUCE-5175. Updated MR App to not set envs that will be set by NMs anyways after YARN-561. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471156 13f79535-47bb-0310-9956-ffa450edef68
2013-04-23 21:39:51 +00:00
009af54d51
MAPREDUCE-5146. application classloader may be used too early to load classes. Contributed by Sangjin Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470694 13f79535-47bb-0310-9956-ffa450edef68
2013-04-22 20:07:06 +00:00
794f9bb3e4
MAPREDUCE-5066. Added a timeout for the job.end.notification.url. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470216 13f79535-47bb-0310-9956-ffa450edef68
2013-04-20 19:18:24 +00:00
febc52be37
MAPREDUCE-5147. Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly (Robert Parker via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470035 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 20:50:48 +00:00
c1ce3c5ad2
MAPREDUCE-4987. TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks (Chris Nauroth via bikas)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470003 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 19:32:33 +00:00
8e1c2823fc
YARN-441. Removed unused utility methods for collections from two API records. Contributed by Xuan Gong.
...
MAPREDUCE-5163. Update MR App to not use API utility methods for collections after YARN-441. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469657 13f79535-47bb-0310-9956-ffa450edef68
2013-04-19 01:33:13 +00:00
e222d1e783
MAPREDUCE-4932. mapreduce.job#getTaskCompletionEvents incompatible with Hadoop 1. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469587 13f79535-47bb-0310-9956-ffa450edef68
2013-04-18 21:42:03 +00:00
cb78a65a15
MAPREDUCE-5152. Make MR App to simply pass through the container from RM instead of extracting and populating information itself to start any container. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469544 13f79535-47bb-0310-9956-ffa450edef68
2013-04-18 20:13:40 +00:00
d12c463121
MAPREDUCE-4898. FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469523 13f79535-47bb-0310-9956-ffa450edef68
2013-04-18 18:51:45 +00:00
cd27afa71a
MAPREDUCE-5128. mapred-default.xml is missing a bunch of history server configs. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469095 13f79535-47bb-0310-9956-ffa450edef68
2013-04-17 23:14:34 +00:00
9e650d36b7
MAPREDUCE-5140. MR part of YARN-514 (Zhijie Shen via bikas)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469060 13f79535-47bb-0310-9956-ffa450edef68
2013-04-17 20:25:21 +00:00
2e789dd9a6
MAPREDUCE-5065. DistCp should skip checksum comparisons if block-sizes are different on source/target. Contributed by Mithun Radhakrishnan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468629 13f79535-47bb-0310-9956-ffa450edef68
2013-04-16 22:01:18 +00:00
9ea20fc537
MAPREDUCE-5015. Coverage fix for org.apache.hadoop.mapreduce.tools.CLI (Aleksey Gorshkov via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468483 13f79535-47bb-0310-9956-ffa450edef68
2013-04-16 16:11:35 +00:00
0e01f26821
YARN-444. Moved special container exit codes from YarnConfiguration to API where they belong. Contributed by Sandy Ryza.
...
MAPREDUCE-5151. Updated MR AM to use standard exit codes from the API after YARN-444. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468276 13f79535-47bb-0310-9956-ffa450edef68
2013-04-15 23:54:09 +00:00
947e97f354
MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468232 13f79535-47bb-0310-9956-ffa450edef68
2013-04-15 21:33:47 +00:00
41c4cd08a0
MAPREDUCE-4885. Streaming tests have multiple failures on Windows. (Chris Nauroth via bikas)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467158 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 03:00:29 +00:00
8e838bd03c
MAPREDUCE-4985. Add compression option to TestDFSIO usage. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467145 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 23:49:16 +00:00
3c8bd60616
MAPREDUCE-5094. Disabled memory monitoring by default in MiniMRYarnCluster to avoid some downstream tests failing. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467124 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 22:54:02 +00:00
5fd460e688
MAPREUDUCE-5059. Change average merge time on Job overview page to be the time delta between the end of the shuffle and the start of the reduce. Contributed by Omkar Vinit Joshi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467120 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 22:27:45 +00:00
21c14c0b02
MAPREDUCE-4981. Add WordMean, WordMedian, WordStandardDeviation to ExamplesDriver. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467076 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 20:28:30 +00:00
6d9c311840
Preparing for release 0.23.7
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467069 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 20:08:00 +00:00
e4c55e17fe
YARN-486. Changed NM's startContainer API to accept Container record given by RM as a direct parameter instead of as part of the ContainerLaunchContext record. Contributed by Xuan Gong.
...
MAPREDUCE-5139. Update MR AM to use the modified startContainer API after YARN-486. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467063 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 19:28:51 +00:00
8e86ffd91e
MAPREDUCE-5136. TestJobImpl->testJobNoTasks fails with IBM JAVA. Contributed by Amir Sanjar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467061 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 19:12:59 +00:00
d04e65b797
MAPREDUCE-5137. AM web UI: clicking on Map Task results in 500 error. Contributed by Thomas Graves
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466948 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 16:27:24 +00:00
972eb9bbfe
Additional fixes to CHANGES.txt to move jiras under the correct 2.x revision.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466778 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 07:21:43 +00:00
9e2a96a2ac
Undo the unnecessary changes to CHANGES.txt included in git-revision 06b93c7
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466777 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 07:21:00 +00:00
6a1c41111e
MAPREDUCE-5079. Changes job recovery to restore state directly from job history, instaed of simulating state machine events. Contributed by Jason Lowe and Robert Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466767 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 04:52:38 +00:00
3a54a5653b
YARN-112. Fixed a race condition during localization that fails containers. Contributed by Omkar Vinit Joshi.
...
MAPREDUCE-5138. Fix LocalDistributedCacheManager after YARN-112. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466196 13f79535-47bb-0310-9956-ffa450edef68
2013-04-09 19:56:10 +00:00
7f13207ed1
MAPREDUCE-5129. Allow tags to JobHistory for deeper analytics. Contributed by Billie Rinaldi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465188 13f79535-47bb-0310-9956-ffa450edef68
2013-04-06 05:30:56 +00:00
a5734cd38a
MAPREDUCE-5007. fix coverage org.apache.hadoop.mapreduce.v2.hs (Aleksey Gorshkov via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465017 13f79535-47bb-0310-9956-ffa450edef68
2013-04-05 15:43:53 +00:00
fc75d3f3dc
MAPREDUCE-5086. MR app master deletes staging dir when sent a reboot command from the RM. Contributed by Jian He
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464255 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 01:56:49 +00:00
070916130a
MAPREDUCE-5098. Fix findbugs warnings in gridmix. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464209 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 21:22:02 +00:00
d18cc69d4e
MAPREDUCE-5088. MR Client gets an renewer token exception while Oozie is submitting a job (daryn)
...
merge -c1463804 from branch-2.0.4-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464153 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 18:45:15 +00:00
38678cc3d9
MAPREDUCE-5117. Changed MRClientProtocolPBClientImpl to be closeable and thus fix failures in renewal of HistoryServer's delegations tokens. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463828 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 05:37:10 +00:00
75ef1b4845
MAPREDUCE-4991. coverage for gridmix (Aleksey Gorshkov via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463806 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 01:45:24 +00:00
6f0c4dca74
Reverted MAPREDUCE-4974 because of test failures.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463359 13f79535-47bb-0310-9956-ffa450edef68
2013-04-02 02:13:18 +00:00
806073867e
MAPREDUCE-5113. Streaming input/output types are ignored with java mapper/reducer. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463307 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 21:42:12 +00:00
b55756dd03
MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463221 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 17:45:07 +00:00
375584ae0f
MAPREDUCE-5006. Fix failing streaming tests due to MAPREDUCE-4994. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461541 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 11:47:06 +00:00
d41e67b966
MAPREDUCE-5077. Remove mapreduce.util.ResourceCalculatorPlugin and related code. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461251 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 18:15:40 +00:00
a0a844222d
MAPREDUCE-4875. coverage fixing for org.apache.hadoop.mapred (Aleksey Gorshkov via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461146 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 14:16:13 +00:00
46315a2d91
MAPREDUCE-5062. Fix MR AM to read max-retries from the RM. Contributed by *Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460923 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 22:33:43 +00:00
b8c74a8a25
MAPREDUCE-5083. MiniMRCluster should use a random component when creating an actual cluster. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459932 13f79535-47bb-0310-9956-ffa450edef68
2013-03-22 19:11:01 +00:00
6f92ad9868
MAPREDUCE-5014. Extend Distcp to accept a custom CopyListing. Contributed by Srikanth Sundarrajan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459690 13f79535-47bb-0310-9956-ffa450edef68
2013-03-22 10:09:06 +00:00
cd2c5fab8b
MAPREDUCE-3872. Fix an event handling races in ContainerLauncherImpl. (Contributed by Robert Kanter)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459547 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 21:55:31 +00:00
6610212dd3
MAPREDUCE-5078. TestMRAppMaster fails on Windows due to mismatched path separators. (Contributed by Chris Nauroth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459544 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 21:44:13 +00:00
f7df0cb7df
MAPREDUCE-4972. Coverage fixing for org.apache.hadoop.mapreduce.jobhistory (Aleksey Gorshkov via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458906 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 16:05:33 +00:00
efe93340ce
Move MAPREDUCE-5075 to 2.0.5-beta in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458749 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 10:47:15 +00:00
718f0f92a9
MAPREDUCE-5075. DistCp leaks input file handles since ThrottledInputStream does not close the wrapped InputStream. Contributed by Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458741 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 10:40:14 +00:00
c19633da5b
Reverting MAPREDUCE-5028 (commit 1457918)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458433 13f79535-47bb-0310-9956-ffa450edef68
2013-03-19 17:56:29 +00:00
523d3daac0
MAPREDUCE-5053. java.lang.InternalError from decompression codec cause reducer to fail (Robert Parker via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458350 13f79535-47bb-0310-9956-ffa450edef68
2013-03-19 15:45:35 +00:00
53e7aaa6dd
MAPREDUCE-5028. Maps fail when io.sort.mb is set to high value. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457918 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 18:56:40 +00:00
5ac6abe107
MAPREDUCE-4990. Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457914 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 18:45:55 +00:00
7d7553c4eb
MAPREDUCE-5042. Reducer unable to fetch for a map task that was recovered (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457119 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 21:09:25 +00:00
8c8ff3f5e0
MAPREDUCE-4716. TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7. (tgraves via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457065 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:55:22 +00:00
d412a1a1a8
MAPREDUCE-4571. TestHsWebServicesJobs fails on jdk7. (tgraves via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457061 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:50:51 +00:00
57803245ec
MAPREDUCE-5060. Fetch failures that time out only count against the first map task. Contributed by Robert Joseph Evans
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455740 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 22:51:28 +00:00
7122cb5bf4
MAPREDUCE-5023. History Server Web Services missing Job Counters (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454156 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 23:02:28 +00:00
80c2cf57fd
Preparing for bug-fix 2.0.4-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453886 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 14:21:40 +00:00
6942fd1db5
HADOOP-9372. Fix bad timeout annotations on tests. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453637 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 01:09:53 +00:00
50d136f9c9
HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453599 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 22:37:42 +00:00
df68c56267
MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is appropriately used and that on-disk segments are correctly sorted on file-size. Contributed by Anty Rao and Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453365 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 15:02:45 +00:00
e1062b8b78
MAPREDUCE-5027. Shuffle does not limit number of outstanding connections (Robert Parker via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453098 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 00:03:41 +00:00
ec13f1eb3a
MAPREDUCE-5043. Fetch failure processing can cause AM event queue to backup and eventually OOM (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452372 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 16:32:18 +00:00
38c4e17ec1
MAPREDUCE-4794. DefaultSpeculator generates error messages on normal shutdown (Jason Lowe via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451826 13f79535-47bb-0310-9956-ffa450edef68
2013-03-02 03:30:58 +00:00
5d6eca08bd
MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does not exist. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451452 13f79535-47bb-0310-9956-ffa450edef68
2013-03-01 01:28:18 +00:00
892846dc04
MAPREDUCE-4871. AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize (Jason Lowe via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451318 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 19:55:10 +00:00
979fb054f8
MAPREDUCE-4693. Historyserver should provide counters for failed tasks. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450956 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 21:03:19 +00:00
0b9ed2364a
MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' allocation on small clusters. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450912 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 18:49:37 +00:00
14089f1e57
MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450723 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 10:40:00 +00:00
42e987f11e
MAPREDUCE-5033. mapred shell script should respect usage flags (--help -help -h). Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450584 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 02:42:38 +00:00
0b73dde6ce
MAPREDUCE-4951. Container preemption interpreted as task failure. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448615 13f79535-47bb-0310-9956-ffa450edef68
2013-02-21 11:56:08 +00:00
87035a004c
MAPREDUCE-5013. mapred.JobStatus compatibility: MR2 missing constructors from MR1. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448602 13f79535-47bb-0310-9956-ffa450edef68
2013-02-21 11:42:48 +00:00
7555b4df74
MAPREDUCE-4846. Some JobQueueInfo methods are public in MR1 but protected in MR2. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448597 13f79535-47bb-0310-9956-ffa450edef68
2013-02-21 11:34:09 +00:00
c8f35bc3d2
MAPREDUCE-5009. Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member (Robert Parker via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447965 13f79535-47bb-0310-9956-ffa450edef68
2013-02-19 23:35:56 +00:00
1c49e77998
MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. Contributed by Adam Monsen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1447865 13f79535-47bb-0310-9956-ffa450edef68
2013-02-19 18:45:22 +00:00
ab330b33bb
MAPREDUCE-4994. Addendum fixing testcases failures. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446042 13f79535-47bb-0310-9956-ffa450edef68
2013-02-14 04:22:04 +00:00
43204f0c83
MAPREDUCE-5000. Fixes getCounters when speculating by fixing the selection of the best attempt for a task. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445871 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 19:20:31 +00:00
390d1fbef8
MAPREDUCE-4992. AM hangs in RecoveryService when recovering tasks with speculative attempts. Contributed by Robert Parker
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445456 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 02:11:36 +00:00
c2d6407070
MAPREDUCE-4989. JSONify DataTables input data for Attempts page. Contributed by Ravi Prakash
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445448 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 01:15:48 +00:00
7e615c7f75
MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445330 13f79535-47bb-0310-9956-ffa450edef68
2013-02-12 20:16:08 +00:00
35832053bf
MAPREDUCE-4671. AM does not tell the RM about container requests which are no longer needed. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443323 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 07:07:11 +00:00
ea94b7b9dd
MAPREDUCE-4822. Unnecessary conversions in History Events. Contributed by Chu Tong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443257 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 22:47:10 +00:00
17e72be6d8
MAPREDUCE-4977. Documentation for pluggable shuffle and pluggable sort. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443168 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 19:52:25 +00:00
79b12f6f4c
MAPREDUCE-4905. test org.apache.hadoop.mapred.pipes (Aleksey Gorshkov via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443027 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:50:23 +00:00
7cc2050041
Preparing for hadoop-2.0.3-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442959 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 13:31:52 +00:00
bdb5342b2d
MAPREDUCE-4953. HadoopPipes misuses fprintf. Contributed by Andy Isaacson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442471 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 04:53:32 +00:00
a04bee4567
MAPREDUCE-4971. Minor extensibility enhancements to Counters & FileOutputFormat. Contributed by Arun C Murthy
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441670 13f79535-47bb-0310-9956-ffa450edef68
2013-02-02 00:47:58 +00:00
ac21e15a39
MAPREDUCE-4969. TestKeyValueTextInputFormat test fails with Open JDK 7. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441069 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 17:11:36 +00:00
28c308d5e8
MAPREDUCE-4893. Fixed MR ApplicationMaster to do optimal assignment of containers to get maximum locality. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440749 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 00:28:10 +00:00
0f430e53fd
MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440076 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 19:38:40 +00:00
c163dc2fce
MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439714 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 00:21:58 +00:00
8a5fadc5a0
MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439590 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:18:35 +00:00
da4cab1099
Revering MAPREDUCE-2264
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439561 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:58:34 +00:00
759a3fae86
Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438799 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:44:56 +00:00
539153a679
MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:25:59 +00:00
74ffc7a74d
MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437103 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 19:07:08 +00:00
bb81a17e0b
MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437029 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 16:26:29 +00:00
73fd247c76
MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 14:10:42 +00:00
88c7fdd065
MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435386 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:41:19 +00:00
76f9af4ccf
MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435312 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 19:30:00 +00:00
1c308188bb
MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:40:58 +00:00
f266efcd10
Preparing for release 0.23.6
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434030 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 16:43:12 +00:00
26275e5323
MAPREDUCE-4924. flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433753 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 00:08:25 +00:00
dd6aa0cf12
MAPREDUCE-4936. JobImpl uber checks for cpu are wrong. Contributed by Arun C Murthy
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433445 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 14:45:08 +00:00
d9a21df34b
MAPREDUCE-4925. The pentomino option parser may be buggy. Contributed by Karthik Kambatla. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433414 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 13:53:18 +00:00
0b9a1f908a
Moving MAPREDUCE-4678's changes line to 0.23 section to prepare for backport.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433409 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 13:36:45 +00:00
86825d8390
MAPREDUCE-4938. Use token request messages defined in hadoop common. Contributed by Suresh Srinvias.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433227 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 00:11:16 +00:00
e7aeb9d129
MAPREDUCE-4934. Maven RAT plugin is not checking all source files (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432932 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 14:35:45 +00:00
12293f8a13
MAPREDUCE-4921. JobClient should acquire HS token with RM principal (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432230 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 19:00:51 +00:00
59d9d8bca9
MAPREDUCE-4907. TrackerDistributedCacheManager issues too many getFileStatus calls. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431166 13f79535-47bb-0310-9956-ffa450edef68
2013-01-10 00:50:03 +00:00
b16dfc125d
MAPREDUCE-4848. TaskAttemptContext cast error during AM recovery. Contributed by Jerry Chen
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431131 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 22:56:09 +00:00
0ba7078ef4
MAPREDUCE-1700. User supplied dependencies may conflict with MapReduce system JARs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430929 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 16:12:58 +00:00
5f7d4d2b45
MAPREDUCE-4810. Added new admin command options for MR AM. Contributed by Jerry Chen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430707 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 06:31:36 +00:00
2c5c8fdb80
MAPREDUCE-4520. Added support for MapReduce applications to request for CPU cores along-with memory post YARN-2. Contributed by Arun C. Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430688 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 05:28:40 +00:00
0f1f5491bc
MAPREDUCE-4278. Cannot run two local jobs in parallel from the same gateway. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430363 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 16:26:33 +00:00
b8a7a17191
MAPREDUCE-4920. Use security token protobuf definition from hadoop common. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429751 13f79535-47bb-0310-9956-ffa450edef68
2013-01-07 11:13:26 +00:00
bbc426f53a
MAPREDUCE-4913. TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429371 13f79535-47bb-0310-9956-ffa450edef68
2013-01-05 20:07:24 +00:00
64e4fb983e
MAPREDUCE-4819. AM can rerun job after reporting final job status to the client (bobby and Bikas Saha via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429114 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 20:35:56 +00:00
e17cecf550
MAPREDUCE-4894. Renewal / cancellation of JobHistory tokens (Siddharth Seth via tgraves
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429086 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 20:15:43 +00:00
78ab699fe9
MAPREDUCE-4832. MR AM can get in a split brain situation. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429040 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 19:15:21 +00:00
e229e25cc3
MAPREDUCE-4279. getClusterStatus() fails with null pointer exception when running jobs in local mode (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428482 13f79535-47bb-0310-9956-ffa450edef68
2013-01-03 17:09:18 +00:00
1f41061132
MAPREDUCE-4884. Streaming tests fail to start MiniMRCluster due to missing queue configuration. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427945 13f79535-47bb-0310-9956-ffa450edef68
2013-01-02 19:31:11 +00:00
402eb18513
MAPREDUCE-4813. AM timing out during job commit (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426536 13f79535-47bb-0310-9956-ffa450edef68
2012-12-28 15:01:46 +00:00
a7d444d002
MAPREDUCE-4902. Fix typo "receievd" should be "received" in log output. Contributed by Albert Chu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426018 13f79535-47bb-0310-9956-ffa450edef68
2012-12-26 20:47:39 +00:00
dae6f0b7d9
MAPREDUCE-4899. Implemented a MR specific plugin for tracking finished applications that YARN's ResourceManager doesn't keep track off anymore. Contributed by Derek Dagit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425225 13f79535-47bb-0310-9956-ffa450edef68
2012-12-22 01:47:51 +00:00
04db3ce177
MAPREDUCE-4890. Invalid TaskImpl state transitions when task fails while speculating. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425223 13f79535-47bb-0310-9956-ffa450edef68
2012-12-22 01:41:26 +00:00
02e940d6a4
MAPREDUCE-4272. SortedRanges.Range#compareTo was not spec compliant. (Yu Gao via llu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425180 13f79535-47bb-0310-9956-ffa450edef68
2012-12-21 23:10:52 +00:00
40c3b7f0b2
MAPREDUCE-4793. Problem with adding resources when using both -files and -file to hadoop streaming. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425177 13f79535-47bb-0310-9956-ffa450edef68
2012-12-21 23:05:54 +00:00
92692c863c
MAPREDUCE-4833. Task can get stuck in FAIL_CONTAINER_CLEANUP. Contributed by Robert Parker
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425167 13f79535-47bb-0310-9956-ffa450edef68
2012-12-21 22:27:54 +00:00
92774331cc
MAPREDUCE-4842. Shuffle race can hang reducer. Contributed by Mariappan Asokan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425071 13f79535-47bb-0310-9956-ffa450edef68
2012-12-21 18:24:25 +00:00
aa30056d09
MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions with poor implementations of Object#hashCode(). Contributed by Radim Kolar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424158 13f79535-47bb-0310-9956-ffa450edef68
2012-12-19 21:50:17 +00:00
9189917be5
MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423470 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 15:23:49 +00:00
8329fae686
MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422345 13f79535-47bb-0310-9956-ffa450edef68
2012-12-15 20:23:08 +00:00
803e5155d1
MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422341 13f79535-47bb-0310-9956-ffa450edef68
2012-12-15 20:18:23 +00:00
4993314895
MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420634 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 12:12:10 +00:00
c5080ef336
MAPREDUCE-4861. Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420345 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 19:26:57 +00:00
054270cc28
MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419618 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:07:20 +00:00
b096f61fe2
MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418173 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 02:36:33 +00:00
fdcfef0a26
MAPREDUCE-4836. Elapsed time for running tasks on AM web UI tasks page is 0. (Ravi Prakash via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415860 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 21:43:43 +00:00
5caef48947
MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414873 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 19:19:16 +00:00
b43deb9af8
MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414840 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 17:52:45 +00:00
481f451ca2
MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413739 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 17:37:05 +00:00
6c5f37e46d
MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412377 13f79535-47bb-0310-9956-ffa450edef68
2012-11-22 00:05:26 +00:00
0f0caede29
MAPREDUCE-4800. Cleanup o.a.h.mapred.MapTaskStatus - remove unused code. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410700 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 06:08:06 +00:00
d2b9a604bd
MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410498 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 17:30:22 +00:00
f13da263bf
MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410131 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 00:52:43 +00:00
d158daecb5
Updated CHANGES.txt in preparation for 0.23.5 release
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:57:23 +00:00
905b17876c
MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409601 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 00:16:35 +00:00
7e2ecffd88
MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409580 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 00:01:07 +00:00
316c23dd7e
MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409525 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 23:02:29 +00:00
b2f7a66e50
MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409032 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 23:47:57 +00:00
cf6ab9b2e7
MAPREDUCE-4786. Job End Notification retry interval is 5 milliseconds by default (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408444 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 20:32:04 +00:00
c493d06b1b
MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408360 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 17:15:45 +00:00
1a45b7e357
MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408355 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 17:06:07 +00:00
dd72ca3536
MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408314 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 15:15:52 +00:00
7c9778e2c3
MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407679 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 22:55:57 +00:00
3ccc76c29b
MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407669 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 22:14:06 +00:00
ca1c683b47
MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407551 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:26:40 +00:00
1f40b8b4e8
MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407505 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 15:52:33 +00:00
6ee6eb8430
MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407118 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 15:17:34 +00:00
8d483fff2c
MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406645 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 14:11:59 +00:00
0eadfcfcf5
MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 21:52:06 +00:00
1783f209f0
MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 15:00:56 +00:00
42d1eaf237
MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 22:59:43 +00:00
b50a3c5de3
MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68
2012-11-01 17:02:52 +00:00
50993e9d48
MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 19:13:03 +00:00
aac5c149c7
MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 14:57:12 +00:00
16e21dfe92
MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:41:59 +00:00
286c171987
MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:02:52 +00:00
895029b2f2
MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 01:26:30 +00:00
1e45b1f1fd
MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
2012-10-24 15:45:35 +00:00
aaa07fc01b
Updating credits for MAPREDUCE-4229.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:23:21 +00:00
382b565e8c
MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:02:22 +00:00
def0b949d4
MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:57:36 +00:00
49beea562a
MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 19:50:23 +00:00
5be6e234c5
Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400314 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:08:28 +00:00
c195ce4d67
MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400313 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:05:30 +00:00
1195f844a9
MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 20:18:46 +00:00
a234472d1c
MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 17:51:33 +00:00
022f7b4a25
MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 05:57:57 +00:00
adcf7d10b9
MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399952 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 02:37:59 +00:00
c63811790a
MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 14:58:08 +00:00
0e9f40df97
MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 22:00:03 +00:00
94ed14c48c
HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:35:42 +00:00
f174adfc15
MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 17:21:45 +00:00
aa934616dd
MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 14:37:46 +00:00
0aa8188d18
MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 13:39:26 +00:00
5c3a331040
MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 09:58:21 +00:00
8ac3910ae0
MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 03:23:07 +00:00
49b20c2ed1
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 20:50:40 +00:00
a047fa9b23
MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395724 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:03:43 +00:00
803828b996
MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393775 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:24:55 +00:00
7137503eb7
MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392446 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 17:10:11 +00:00
57807d50bf
MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392075 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 17:01:00 +00:00
af647bb3ce
Preparing for release 0.23.4
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:15:39 +00:00
b897d6c35a
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391679 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 22:17:32 +00:00
03b7ad04fa
MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391671 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 21:55:45 +00:00
e45b103655
MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391551 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 16:48:01 +00:00
6d77365a83
MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml. Contributed by Todd Lipcon (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391498 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 15:08:48 +00:00
036530fc12
Reverted MAPREDUCE-4253.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390652 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 18:41:08 +00:00
050fd3a117
MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 15:22:21 +00:00
462ba6a3de
MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes. Contributed by Chris Nauroth. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390446 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 12:52:41 +00:00
2610acf0fb
MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390372 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 10:21:17 +00:00
1eedee177e
MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390224 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 23:49:09 +00:00
33a3efcd18
MAPREDUCE-4651. Benchmarking random reads with DFSIO.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390159 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 21:32:29 +00:00
78fa84a08a
Move MAPREDUCE-4645 under 0.23.4 release section in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389576 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 21:01:05 +00:00
b26ed9d6f8
MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389568 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 20:54:20 +00:00
eb547be607
MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388661 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 20:15:07 +00:00
229a79bbc3
MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 00:59:15 +00:00
c406e65f24
Update CHANGES.txt for MAPREDUCE-4607 commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383423 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 14:06:51 +00:00
681408f898
Set date for hadoop-2.0.2-alpha
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
7851676f22
Preparing for hadoop-2.0.2-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
a7998921a7
MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 17:05:11 +00:00
77805c7ae4
MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 16:45:03 +00:00
0056914773
MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381868 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 04:56:32 +00:00
09038b741d
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:20:15 +00:00
5dcb594cb8
MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:20:43 +00:00
f5943c1eef
Updated CHANGES.txt for 0.23.4
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 21:45:33 +00:00
ab986d7cf6
MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68
2012-09-03 18:54:27 +00:00
94129df354
MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:25:25 +00:00
25e96e455b
MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:43:46 +00:00
63f941d2ad
MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:37:41 +00:00
015256524c
MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:25:27 +00:00
65e447cd8b
MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 21:02:55 +00:00
2f1a133dcf
MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379022 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 17:12:14 +00:00
95af351615
MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378873 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 09:57:45 +00:00
963d01a0af
MAPREDUCE-4600. TestTokenCache.java from MRV1 no longer compiles (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378255 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 18:29:17 +00:00
cfe25b8828
MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 02:03:26 +00:00
24e47ebc18
MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 00:40:02 +00:00
7b541d619f
MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 23:36:55 +00:00
f909a1d4d7
MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:22:14 +00:00
0555a2145d
MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376297 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 22:43:50 +00:00
dc33a0765c
MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 21:18:34 +00:00
ca2dc3e785
MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 17:46:07 +00:00
0c2887b617
MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 15:20:21 +00:00
3204b1f450
MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 13:26:12 +00:00
8fcad7e8e9
MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 23:08:40 +00:00
dfad16fed2
MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:48:33 +00:00
201d0ecb78
MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 17:29:36 +00:00
1799046f7a
MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:15:25 +00:00
c2cac2748e
MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:11:22 +00:00
117145f1ad
MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 18:14:47 +00:00
72789336b2
MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:29:29 +00:00
3eb0cb27e8
MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 21:55:37 +00:00
28320c5220
MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 22:14:13 +00:00
5938c86352
MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 21:26:08 +00:00
123c4f57d3
MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367783 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 21:08:40 +00:00
9d42fb2e8e
MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 20:52:41 +00:00
27eb14c3c3
MAPREDUCE-4483. 2.0 build does not work (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367726 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:43:51 +00:00
89c59bbe3d
MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367719 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:34:29 +00:00
735b50e8bd
MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:20:03 +00:00
a37272e0e3
MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367601 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 15:08:47 +00:00
e9bf6c56c5
MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 14:46:57 +00:00
a3e695ab2c
MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 13:39:41 +00:00
e217a05255
MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367352 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 22:56:15 +00:00
d87b545165
MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 01:48:09 +00:00
9d16c9354b
MAPREDUCE-4417. add support for encrypted shuffle (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:23:05 +00:00
515a332912
MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365322 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 22:08:27 +00:00
cdef12644b
MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 19:27:29 +00:00
3ef19e9dbd
MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365185 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 17:33:15 +00:00
97ed48e035
MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364764 13f79535-47bb-0310-9956-ffa450edef68
2012-07-23 19:31:33 +00:00
9c9f29ac7e
MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 23:19:23 +00:00
d45922de2c
svn merge --change -1363454 for reverting MAPREDUCE-4423
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363935 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:18:48 +00:00
8e69f883a0
MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:19:59 +00:00
12979570be
MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 22:43:01 +00:00
1efd2e1d45
MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363067 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 19:40:36 +00:00
c700642308
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 03:36:46 +00:00
2e00d28f14
MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 23:31:16 +00:00
e9aa5aac68
MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362618 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:32:14 +00:00
603418c173
MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:14:33 +00:00
8e576570a9
MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362608 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:01:42 +00:00
177f6feaa1
MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362495 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 13:50:35 +00:00
7f2b1eadc1
MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362332 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 01:43:03 +00:00
e1c5e7dd2b
MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362209 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:11:08 +00:00
18f1feb64b
MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:09:33 +00:00
612443951b
MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 14:19:36 +00:00
ae6cc14611
MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 21:46:07 +00:00
bf34f62e43
HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361438 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:04:21 +00:00
17de78a43e
MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:53:43 +00:00
228736ab51
MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:42:48 +00:00
9dcd317d9b
MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:42:00 +00:00
af0e0b1676
MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361273 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 15:22:15 +00:00
bea60b6c86
Reverting MAPREDUCE-4422 from trunk until all comments are addressed
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361107 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 08:52:03 +00:00
48c1a2bdfc
MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361061 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:26:54 +00:00
1ef64e64c0
MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:43:01 +00:00
26910fd058
MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 15:52:12 +00:00
3bfb26ad3b
MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 21:26:48 +00:00
6804ef32fc
MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359747 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 16:10:14 +00:00
11782dd3a5
MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359399 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 21:08:40 +00:00
820be7cbef
MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 19:19:00 +00:00
1153780655
MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359303 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 17:40:31 +00:00
832ba3bae1
MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359252 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 16:14:24 +00:00
80875153c3
MAPREDUCE-3906. Fix inconsistency in documentation regarding mapreduce.jobhistory.principal. Contributed by Eugene Koontz. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358896 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 02:12:22 +00:00
c3b0bed21e
MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358892 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 02:01:54 +00:00
52a4678a1d
MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358788 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 17:23:40 +00:00
0e7204c9e7
MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 17:19:13 +00:00
072292219e
MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358201 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 13:38:11 +00:00
3d5a44f919
MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357937 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 21:36:02 +00:00
c1bf8a3f03
MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357776 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 18:09:09 +00:00
72fb517469
MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357723 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 16:29:09 +00:00
eff5abb4f7
MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356414 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 19:02:51 +00:00
e967e98f74
MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355766 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 16:49:24 +00:00
cd9ce99740
MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 20:57:20 +00:00
d1f05ce29f
Reverting MAPREDUCE-4371 to address test failures.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355382 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 13:41:46 +00:00
78c27ca2e3
MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355139 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:59:19 +00:00
aad2a6f0fc
MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:28:42 +00:00
1b21c9836e
Reverting MAPREDUCE-4346 r1353757
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354656 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 18:29:42 +00:00
bb9ac4fe4c
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354531 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 14:28:08 +00:00
03f2f9b580
MAPREDUCE-4228. mapreduce.job.reduce.slowstart.completedmaps is not working properly (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354181 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 19:17:33 +00:00
d9bbd5997d
MAPREDUCE-4355. Add JobStatus getJobStatus(JobID) to JobClient. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353757 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 21:55:44 +00:00
5b36106934
MAPREDUCE-2289. Permissions race can make getStagingDir fail on local filesystem (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353750 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 21:36:17 +00:00
75269b5488
MAPREDUCE-4290. Fix Yarn Applicaiton Status to MR JobState conversion. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353684 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 17:54:48 +00:00
db31b6c0e4
MAPREDUCE-4336. Distributed Shell fails when used with the CapacityScheduler (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353625 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 15:58:55 +00:00
18052795a7
MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353039 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 21:45:59 +00:00
a945336368
MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 21:40:35 +00:00
126dd6adef
MAPREDUCE-4295. RM crashes due to DNS issue (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352638 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 18:14:22 +00:00
b91910dd3e
MAPREDUCE-4320. gridmix mainClass wrong in pom.xml (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352550 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 15:01:35 +00:00
b685486fbb
MAPREDUCE-4356. [Rumen] Provide access to the method ParsedTask.obtainTaskAttempts(). (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352415 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 05:44:20 +00:00
cf5dd32932
MAPREDUCE-3889. job client tries to use /tasklog interface, but that doesn't exist anymore (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352330 13f79535-47bb-0310-9956-ffa450edef68
2012-06-20 21:22:33 +00:00
daa28cc6ce
MAPREDUCE-4306. Fix distributed shell to work with users other than the one running the daemons. (Contributed by Ahmed Radwan)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351876 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 22:00:45 +00:00
10bc39ea02
MAPREDUCE-4270. Move the data_join test classes to the correct path. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351869 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 21:51:15 +00:00
49feb6a039
MAPREDUCE-4267. mavenize pipes (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351818 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 19:40:44 +00:00
01b2040810
MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351762 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 16:17:21 +00:00
01b61c76a8
MAPREDUCE-4311. Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings (Karthik Kambatla via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351700 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 13:06:51 +00:00
277b3dd736
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351548 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 00:55:28 +00:00
eff9fa1aad
MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349065 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 23:14:06 +00:00
13ad756796
MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348997 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:37:03 +00:00
27d1c74a0c
MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348846 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 13:54:46 +00:00
9368be0e73
MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348123 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 15:47:50 +00:00
9ae7639405
Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 21:19:33 +00:00
67cbc289e4
MAPREDUCE-3873. Fixed NodeManagers' decommissioning at RM to accept IP addresses also. Contributed by xieguiming and vinodkv.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346671 13f79535-47bb-0310-9956-ffa450edef68
2012-06-05 23:52:16 +00:00
d6467bb3b1
MAPREDUCE-4313. TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346406 13f79535-47bb-0310-9956-ffa450edef68
2012-06-05 15:01:26 +00:00
119a8c7b15
Updated CHANGES.txt files to reflect the 2.0.0-alpha release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346150 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 20:53:15 +00:00
358eda0bfa
MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346047 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 17:41:52 +00:00
1283ab51a9
MAPREDUCE-4301. Dedupe some strings in MRAM for memory savings (bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346002 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 15:14:27 +00:00
18ba716922
MAPREDUCE-4307. TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem. Contributed by Ahmed Radwan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345546 13f79535-47bb-0310-9956-ffa450edef68
2012-06-02 18:47:40 +00:00
1cf6010675
MAPREDUCE-4302. NM goes down if error encountered during log aggregation (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345362 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 21:54:49 +00:00
8bbacfaa31
MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344763 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 15:16:48 +00:00
0a80f82a30
MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344283 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 14:48:53 +00:00
515e29ac82
MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343804 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 16:10:59 +00:00
45be2c085d
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343755 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 14:43:40 +00:00
fcf47eb4b8
MAPREDUCE-3990. MRBench allows Long-sized input-lines value but parses CLI argument as an Integer. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343247 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:26:35 +00:00
0037bf5dc5
MAPREDUCE-2384. The job submitter should make sure to validate jobs before creation of necessary files. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343240 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:14:14 +00:00
2ebb1f47db
MAPREDUCE-3302. Remove the last dependency call from org.apache.hadoop.record package in MR. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342613 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 13:21:30 +00:00
c4f17d242d
MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 13:10:57 +00:00
cf7b017422
MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 22:22:55 +00:00
432c4a6ffc
MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 18:37:37 +00:00
d74bec2f88
MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:15:41 +00:00
2eebc21a55
MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341151 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:05:19 +00:00
d239307d00
MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 01:55:44 +00:00
a37aa28e4a
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340630 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 07:41:56 +00:00
bacb4080a0
MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339957 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 02:50:48 +00:00
dcf84707ab
MAPREDUCE-3543. Mavenize Gridmix. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339629 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 15:06:33 +00:00
7e3d016845
MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339174 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 14:08:08 +00:00
9142dcac9e
Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 05:48:16 +00:00
2eeafa78c9
MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339000 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 04:15:02 +00:00
f35294eb95
MAPREDUCE-4238. mavenize data_join. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338835 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 19:09:59 +00:00
a446ad2c26
MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337363 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 20:26:42 +00:00
aea890f7d2
MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
0308423b9c
MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336399 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 21:08:53 +00:00
f6d6218348
MAPREDUCE-4231. Update RAID to use the new BlockCollection interface.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335661 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:53:15 +00:00
0caac704fb
MAPREDUCE-4215. RM app page shows 500 error on appid parse error (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335647 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 17:13:33 +00:00
67a514b647
MAPREDUCE-3850. Avoid redundant calls for tokens in TokenCache (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335585 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:25:08 +00:00
aa60da6c2e
MAPREDUCE-4162. Correctly set token service (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335567 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 15:07:40 +00:00
55cd161a35
MAPREDUCE-4226. ConcurrentModificationException in FileSystemCounterGroup.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335197 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:05:59 +00:00
d3599de399
MAPREDUCE-4220. RM apps page starttime/endtime sorts are incorrect (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335096 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:18:33 +00:00
407cfa3b56
MAPREDUCE-3958. RM: Remove RMNodeState and replace it with NodeState (Bikas Saha via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334043 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 15:47:02 +00:00
48f95779c1
MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334013 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 15:02:54 +00:00
0fca4fbaf3
MAPREDUCE-4205. retrofit all JVM shutdown hooks to use ShutdownHookManager (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333748 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 03:20:16 +00:00
48414b0827
MAPREDUCE-4163. consistently set the bind address (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333579 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 18:35:21 +00:00
ca5b406ac0
MAPREDUCE-4219. make default container-executor.conf.dir be a path relative to the container-executor binary. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333241 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 22:53:50 +00:00
f8ed2ad524
MAPREDUCE-4210. Expose listener address for WebApp (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333144 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 18:27:17 +00:00
1c96e52533
MAPREDUCE-3173. MRV2 UI doesn't work properly without internet (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333063 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 14:40:01 +00:00
6fec13abdd
MAPREDUCE-4202. Updating changes to just be branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332731 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 16:14:16 +00:00
512fd2756a
MAPREDUCE-4202. TestYarnClientProtocolProvider is broken (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332716 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 15:59:36 +00:00
506232da5c
MAPREDUCE-4211. Error conditions (missing appid, appid not found) are masked in the RM app page (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332701 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 15:34:19 +00:00
2755a2e283
MAPREDUCE-4212. TestJobClientGetJob sometimes fails (Daryn Sharp via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332665 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 14:10:45 +00:00
47df4697ba
MAPREDUCE-4206. Sorting by Last Health-Update on the RM nodes page sorts does not work correctly (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332232 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 15:07:08 +00:00
7407d5cd0f
MAPREDUCE-4209. junit dependency in hadoop-mapreduce-client is missing scope test (Radim Kolar via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332226 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 14:48:22 +00:00
252568085a
MAPREDUCE-3883. Document yarn.nodemanager.delete.debug-delay-sec configuration property (Eugene Koontz via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332196 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 13:43:09 +00:00
1c0231cc74
MAPREDUCE-4189. TestContainerManagerSecurity is failing (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331046 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 19:40:48 +00:00
1a118d6a32
MAPREDUCE-4138. Reduce memory usage of counters due to non-static nested classes.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331023 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:39:22 +00:00
cda16311a9
MAPREDUCE-4169. Container Logs appear in unsorted order (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331012 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:27:05 +00:00
e7583d816a
MAPREDUCE-3613. web service calls header contains 2 content types (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330560 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 21:13:06 +00:00
719b719e3d
MAPREDUCE-4194. ConcurrentModificationError in DirectoryCollection (Jonathan Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330552 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:49:41 +00:00
bcfb66ebb2
MAPREDUCE-4193. broken doc link for yarn-default.xml in site.xml. Contributed by Patrick Hunt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330427 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:20:00 +00:00
f340d6c894
MAPREDUCE-4079. Allow MR AppMaster to limit ephemeral port range.(bobby via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329694 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:03:15 +00:00
ebe0e9a99b
MAPREDUCE-4141. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329493 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 22:32:06 +00:00
80ab78c217
MAPREDUCE-4133. MR over viewfs is broken (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329403 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:44:30 +00:00
796e1a48ac
MAPREDUCE-4190. Improve web UI for task attempts userlog link (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329398 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:38:28 +00:00
589c68ae09
HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
1eb1d0ae4f
MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329282 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 15:26:35 +00:00
8d09ab0da2
MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328111 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:35:54 +00:00
df654cca49
MAPREDUCE-3867. MiniMRYarn/MiniYarn uses fixed ports (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328109 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:33:11 +00:00
7d2466c0c8
MAPREDUCE-4129. Lots of unneeded counters log messages (Ahmed Radwan via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328106 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:23:47 +00:00
d09cf903ab
MAPREDUCE-4093. Improve RM WebApp start up when proxy address is not set (Devaraj K vai bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328090 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:42:32 +00:00
5b35f7df64
MAPREDUCE-4165. Committing is misspelled as commiting in task logs (John Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:32:16 +00:00
e3806060ce
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328031 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:22:22 +00:00
97ae5b675f
MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327972 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 14:44:57 +00:00
3edc40e377
MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327816 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 04:26:53 +00:00
32d511065a
MAPREDUCE-4161. create sockets consistently (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327621 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:46:34 +00:00
2ada53f107
MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter strings. (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327461 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 11:59:38 +00:00
7d04a96027
MAPREDUCE-3972. Fix locking and exception issues in JobHistory server. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327354 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 01:59:16 +00:00
a15e69cb9f
MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327304 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 22:05:42 +00:00
ca9f62121e
MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327263 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 20:05:44 +00:00
b89b6bd75f
MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327233 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 19:21:34 +00:00
fe7711df98
MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327220 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 18:48:42 +00:00
159646f2a4
MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326795 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 20:46:30 +00:00
24d6a8b29c
MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326707 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 18:02:51 +00:00
9a10b4e773
MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325991 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 22:24:16 +00:00
27ea3ab6ba
MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325765 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 13:45:03 +00:00
02db5b7ef7
MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325573 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 00:10:30 +00:00
ecb30a48c4
MAPREDUCE-4050. For tasks without assigned containers, changes the node text on the UI to N/A instead of a link to null. (Contributed by Bhallamudi Venkata Siva Kamesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325435 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 18:39:49 +00:00
346d50782d
MAPREDUCE-4140. mapreduce classes incorrectly importing "clover.org.apache.*" classes. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325352 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:22:25 +00:00
d310c48ce4
MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325145 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 07:17:34 +00:00
aca6ca0059
MAPREDUCE-4107. Fix tests in org.apache.hadoop.ipc.TestSocketFactory (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325010 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 21:13:49 +00:00
7809acd67b
MAPREDUCE-3932. Fix the TaskAttempt state machine to handle CONTIANER_LAUNCHED and CONTIANER_LAUNCH_FAILED events in additional states. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324902 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 18:18:40 +00:00
cfafd8c29d
MAPREDUCE-4099 amendment. ApplicationMaster will remove staging directory after the history service is stopped. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324866 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:09:54 +00:00
13bfe4794b
MAPREDUCE-4040. History links should use hostname rather than IP address. (Contributed by Bhallamudi Venkata Siva Kamesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312076 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 02:50:02 +00:00
94843b848a
MAPREDUCE-4108. Fix tests in org.apache.hadoop.util.TestRunJar (Devaraj K via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312018 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:09:00 +00:00
eb74ff0c3b
MAPREDUCE-4076. Stream job fails with ZipException when use yarn jar command (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312003 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 21:30:05 +00:00
2accda38a1
MAPREDUCE-4017. Add jobname to jobsummary log (tgraves and Koji Noguchi via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311972 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 20:36:09 +00:00
d9b740cb14
MAPREDUCE-4057. Update RAID for the HA and fsdataset changes. Contributed by Devaraj K
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311959 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 19:46:44 +00:00
793746870b
MAPREDUCE-4099. ApplicationMaster may fail to remove staging directory (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311926 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:57:34 +00:00
cbb5f61090
MAPREDUCE-4059. The history server should have a separate pluggable storage/query interface. (Robert Evans via tgraves).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311896 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:11:26 +00:00
b28f134e9c
MAPREDUCE-3869. Fix classpath for DistributedShell application. (Contributed by Devaraj K)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311523 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:01:49 +00:00
241e3d40ac
MAPREDUCE-4105. Yarn RackResolver ignores rack configurations. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311520 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 23:32:43 +00:00
48ab08f1c6
MAPREDUCE-4117. mapred job -status throws NullPointerException (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311479 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 21:52:50 +00:00
b435e2202d
MAPREDUCE-4110. Fix tests in TestMiniMRClasspath & TestMiniMRWithDFSWithDistinctUsers (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310546 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:56:55 +00:00
c156906c73
MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310528 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:09:09 +00:00
2bb3407af9
MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310431 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:04:40 +00:00
b447d94094
MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310418 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:57:39 +00:00
adeef5ec8f
MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310409 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 15:49:52 +00:00
c76b264196
MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310056 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:27:55 +00:00
98df316058
MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:11:52 +00:00
1d6038ecfb
MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309583 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:24:01 +00:00
1b93f8e5c3
MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:46:22 +00:00
db075f93ae
MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309481 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 16:23:29 +00:00
594dd9eb25
MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309453 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:28:17 +00:00
4e44259cbd
MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309440 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:08:39 +00:00
da1b01c9e3
MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309432 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:56:13 +00:00
d99c2958dd
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309401 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 14:17:22 +00:00
1f4197984c
MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 20:39:08 +00:00
7b387f55c3
MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:37:46 +00:00
b45c450026
MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:29:40 +00:00
20184e7ddc
MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:01:43 +00:00
2b5c36b695
MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309037 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 16:59:26 +00:00
00eb28d927
MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308976 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 15:27:46 +00:00
8c8dbba8a6
MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308957 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:47:35 +00:00
4d876c7800
MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308925 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:19:29 +00:00
01ce7ba3a4
MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:06:16 +00:00
bb74427da2
MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:20:41 +00:00
354025b6e7
MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308519 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:04:31 +00:00
3a8d123ccb
MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:51:06 +00:00
57af34b776
Preping for 0.23.3 stabilization.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:13:53 +00:00
170ff8d81c
MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 08:24:15 +00:00
c4c7ee5b8c
MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307623 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:30:11 +00:00
d1893c8f5b
MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307413 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 13:40:48 +00:00
57e175fddf
hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307124 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:43:50 +00:00
d05cc8e5cd
MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307102 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:53:44 +00:00
f11a5dc5f6
MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306901 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:18:41 +00:00
9bb6a025de
MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306736 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 07:45:45 +00:00
db3e592df0
REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306689 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 02:02:17 +00:00
991eddd043
Change "0.23.3" to "2.0.0" in CHANGES.txt files.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
1650a49993
MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305607 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:23:31 +00:00
1a9385d516
MAPREDUCE-3353. Fixed commit msg to point to right jira.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305457 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:29:02 +00:00
d5836856a2
MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 13:21:36 +00:00
606114d602
MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305230 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 05:45:29 +00:00
f67c2d1bd0
MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304587 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 20:46:18 +00:00
7b3a98cfcd
MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303330 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:42:23 +00:00
a24d12bdec
MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303076 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 18:36:56 +00:00
40a8293d36
MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302980 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 16:29:42 +00:00
04a47dea74
MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302754 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 02:28:53 +00:00
9d8d02b68b
MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302645 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 20:31:55 +00:00
f58e3c8b12
MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301731 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 20:10:51 +00:00
274d6909f3
MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301691 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:47:48 +00:00
3e8c273f37
MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 14:39:01 +00:00
e8ae52823f
MAPREDUCE-3431
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301500 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 13:36:09 +00:00
af0227e32a
MAPREDUCE-3970 ServiceOperations class
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300894 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 10:39:17 +00:00
7609243e58
MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300750 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:02:53 +00:00
3f46a62ff9
MAPREDUCE-3974. Change to release 23.3
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 18:30:32 +00:00
7d60932060
MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299625 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 11:08:32 +00:00
ed4c222d5c
MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 23:34:49 +00:00
558cc8c0bf
MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:13:42 +00:00
1c534d0f9d
MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:07:33 +00:00
ad3d3f54d5
MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:53:19 +00:00
4001b95cf2
MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 17:37:00 +00:00
13ea1d575c
MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 01:27:02 +00:00
25cceb65ce
MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:44:58 +00:00
c3a4de0ec0
MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:21:13 +00:00
4ce5f6553f
MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
1a0e088a19
MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:31:23 +00:00
a98b756c73
MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 16:17:41 +00:00
b9fd9e1759
MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:52:10 +00:00
739f688f5a
MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 23:56:46 +00:00
774f809f15
MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 22:03:09 +00:00
7c1e857176
MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
...
.--This line, and those below, will be ignored--
M hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M hadoop-mapreduce-project/CHANGES.txt
M hadoop-mapreduce-project/bin/mapred
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
b73738d21e
MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:29:29 +00:00
231e39462d
MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 13:44:01 +00:00
d5f4fcef5c
MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
6d80dc2a84
MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:44:57 +00:00
d41cb76b56
MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 21:14:53 +00:00
bd38a29673
MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 17:14:23 +00:00
Siddharth Seth
Vinod Kumar Vavilapalli
Suresh Srinivas
Hitesh Shah
Jason Darrell Lowe
Alejandro Abdelnur
Christopher Douglas
Thomas White
Aaron Myers
Arun Murthy
Robert Joseph Evans
Thomas Graves
Bikas Saha
Kihwal Lee
Konstantin Shvachko
Konstantin Boudnik
Amareshwari Sri Ramadasu
Tsz-wo Sze
Jonathan Turner Eagles
Harsh J
Luke Lu
Doug Cutting
Eli Collins
Daryn Sharp
Ravi Gummadi
Scott Chun-Yang Chen
Todd Lipcon
Sanjay Radia
Amar Kamat
Steve Loughran