582b97c3e7
MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
c0572656ce
MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
969b3809e4
MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:21:20 +00:00
328702891e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 14:49:38 +00:00
6112940841
MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:12:06 +00:00
f3026e1085
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 16:06:53 +00:00
81f5c5933d
MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 15:50:53 +00:00
8a2073cc61
MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 10:41:07 +00:00
267bebeab0
MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292424 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:57:32 +00:00
60ab29759e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 16:24:40 +00:00
b2172c394e
MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:30:23 +00:00
5ee495e6f3
MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:08:25 +00:00
f0db867292
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
3d8907fdd6
MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 13:22:47 +00:00
566f0b5ad2
MAPREDUCE-3880. Changed LCE binary to be 32-bit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 06:36:00 +00:00
3c5eb01263
MAPREDUCE-3856. Committing to 0.23.1.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:18:00 +00:00
ef5d7156db
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
b4c8567e1b
MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:12:18 +00:00
ff33b38734
MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:57:49 +00:00
53b7d6c6bc
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 18:19:31 +00:00
11c127bb51
MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245303 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:55:00 +00:00
a64046d16f
MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245276 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 00:54:44 +00:00
833e96534f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
cfc4ad76a3
MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245099 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 17:49:20 +00:00
20816218f0
MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 05:53:25 +00:00
1fb0ab92f8
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
89bd2210a7
MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 23:09:05 +00:00
83ab8f087b
MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 22:49:00 +00:00
16a44b6fa5
MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 21:39:59 +00:00
011611c765
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
1903e544a4
MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:24:00 +00:00
0515b3322f
MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 00:06:37 +00:00
ce778462ee
MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:12:03 +00:00
db187cf40e
Merge trunk into HA branch.
...
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
5c46ba4d48
MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 05:37:11 +00:00
0bf146b0dd
MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
56b6f4a8fc
Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:55:15 +00:00
05d56e5e7e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
73a72e0ef9
MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 14:30:00 +00:00
c14bb61a82
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
03ee90b9eb
HADOOP-7923. Automate the updating of version numbers in the doc system.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:47:11 +00:00
b2d49acd08
MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241999 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 17:31:13 +00:00
e5060d3bbb
MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 10:15:41 +00:00
647f374607
Preparing for release 0.23.1
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:27:58 +00:00
1de681b896
MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241791 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:12:24 +00:00
4018798d4b
MAPREDUCE-3415. Moving to 0.23.1 section.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:59:21 +00:00
7ae94c6678
MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241734 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 01:56:02 +00:00
5fdfa2b4bd
MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241721 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:56:28 +00:00
04f685ea76
MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241711 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 00:16:54 +00:00
ccc2807d86
MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241692 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:07:03 +00:00
d8e9f84fb1
Fixed jira id in commit for MAPREDUCE-3826.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241688 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 23:04:29 +00:00
7dfe20d5a8
MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241685 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:59:58 +00:00
59b88655bc
MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 22:08:55 +00:00
90bc439b66
MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 21:58:54 +00:00
fb498926be
MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241620 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 20:55:10 +00:00
aaace5e84e
MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241325 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:53:54 +00:00
6e376a39a0
MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:49:50 +00:00
35f12b9556
MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241319 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:41:28 +00:00
59d1f07d6c
MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241299 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:53:36 +00:00
8dbf374f16
MAPREDUCE-3811. Made jobclient-to-AM retries configurable. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241285 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:20:36 +00:00
75d2d6185e
MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end of the task. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241282 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:13:40 +00:00
08479378c2
MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241253 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:16:37 +00:00
4f6839f23d
MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
bdf837a64a
MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241225 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:34:28 +00:00
9f2b77aee4
MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241217 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:16:26 +00:00
c6282df3e5
MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241209 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:06:58 +00:00
28a2eb9d72
MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241205 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 22:01:22 +00:00
db7c013877
HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241183 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:18:11 +00:00
3f02d8dd5c
MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241177 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:04:30 +00:00
c7007a8a35
MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240886 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 03:38:44 +00:00
23e336a0ed
MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240634 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 22:44:43 +00:00
f3c35222e6
MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240603 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:20:00 +00:00
c7d64769c1
MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:03:37 +00:00
f2280f612c
MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240593 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 19:32:10 +00:00
caed1cfaf9
MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240590 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:55:03 +00:00
2c32cd7008
MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240587 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 18:41:50 +00:00
1de317a945
MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240441 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:24:21 +00:00
fe1cf3b0ac
MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240428 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:21:12 +00:00
3343494d6c
MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240421 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 01:03:51 +00:00
94242c9385
MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240413 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:04:53 +00:00
b030231108
MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240410 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 23:48:48 +00:00
a5c46c9165
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239971 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:16:32 +00:00
72d34e6594
MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239954 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 00:33:05 +00:00
1950f97ab9
HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:45:07 +00:00
cc74881acb
MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 08:37:58 +00:00
70bc14f234
MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239443 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 02:31:05 +00:00
6ba0375b21
MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239433 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 01:43:49 +00:00
ef1a619a4d
MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239422 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 00:41:09 +00:00
b4929bcf14
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239402 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:33:58 +00:00
ab75b8b420
MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239391 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 23:05:14 +00:00
42d1c9b251
HADOOP-7470. Move up to Jackson 1.8.8. Contributed by Enis Soztutar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239386 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 22:55:59 +00:00
947ede4c4e
MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239310 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 20:43:10 +00:00
b33c66efc5
MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239291 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:55:20 +00:00
e3d555a656
MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 17:03:27 +00:00
f49ba355e5
MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:57:35 +00:00
d1f805f942
MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238887 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 00:51:40 +00:00
05efddf28e
MAPREDUCE-3749. ConcurrentModificationException in counter groups.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238734 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:30:58 +00:00
a8b6ee0491
MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238721 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:08:11 +00:00
7f23d72352
MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238255 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 08:30:31 +00:00
7ed0f74997
MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 06:22:22 +00:00
443d8f6c0b
MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
76b653a367
MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
7e4725db41
MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
5652e71992
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 06:20:53 +00:00
327c216c2f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
5262b7ba4d
MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
2b2e56056e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
8a234f394e
HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
fe4bff77e1
MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
fdb9d51cec
MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
f57de0d6dd
MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:49:18 +00:00
0cb3dd913b
MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:44:19 +00:00
3cdc100369
MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
54f738575c
MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
af6448e543
MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
5283398187
MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236358 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:00 +00:00
2bd728b366
MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236356 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:28:45 +00:00
faa6806df3
MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:10:11 +00:00
1c95060a72
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
34a6a9f4bc
MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236066 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:30:17 +00:00
d06948002f
MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:36:52 +00:00
fae75c2d7f
MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236041 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:40:29 +00:00
21c9116309
MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00
1149d9a13d
MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235956 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:22:33 +00:00
9d1621da52
MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235858 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:17:55 +00:00
1853b9d188
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235856 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 18:07:43 +00:00
a02f07c4bc
MAPREDUCE-3630. Fixes a NullPointer exception while running TeraGen - if a map is asked to generate 0 records. (Contributed by Mahadev Konar)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235641 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:30:09 +00:00
c43a5a992e
MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235639 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 06:24:46 +00:00
c7642a135c
MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235566 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 00:14:26 +00:00
078ae89a47
MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235545 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 23:18:05 +00:00
dc615c312b
MAPREDUCE-3710. Improved FileInputFormat to return better locality for the last split. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 21:29:39 +00:00
f73daf6af1
MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235391 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 18:21:27 +00:00
83bcb1bbf4
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:59:14 +00:00
5dfe62d845
HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
9a153334ac
MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235103 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 01:00:51 +00:00
fa4a33a566
Merge trunk into HA branch.
...
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 00:00:05 +00:00
27c56b02b3
MAPREDUCE-3646. Remove redundant URL info from "mapred job" output. (Jonathan Eagles via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235034 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:22:53 +00:00
4b36997b1b
MAPREDUCE-3702. internal server error trying access application master via proxy with filter enabled. (Thomas Graves via mahadev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234991 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:22:09 +00:00
c415dee2b7
MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:15:55 +00:00
e42bbfbca2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
355ba01374
MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234227 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 01:15:24 +00:00
8a1719e999
MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
b49aae0635
MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234148 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:27:39 +00:00
c6923061d0
MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234120 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 20:44:17 +00:00
2abe5c818d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
6861560098
MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233605 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:23:53 +00:00
6177bf6c8f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 23:02:17 +00:00
10325d9732
MAPREDUCE-3582. Move successfully passing MR1 tests to MR2 maven tree.(ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233090 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:10:12 +00:00
8b2f6909ec
MAPREDUCE-3684. LocalDistributedCacheManager does not shut down its thread pool.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232981 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 18:20:13 +00:00
d737c323a6
MAPREDUCE-3669. Allow clients to talk to MR HistoryServer using both delegation tokens and kerberos. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232580 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 21:25:08 +00:00
d05e6d2671
MAPREDUCE-2450. Fixed a corner case with interrupted communication threads leading to a long timeout in Task. Contributed by Rajesh Balamohan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 06:10:50 +00:00
940eeb866c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
4a343c9d4a
MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232182 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:56:14 +00:00
c81995e370
MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232167 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:22:21 +00:00
a24339e50d
MAPREDUCE-3649. Job End notification gives an error on calling back. (Ravi Prakash via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232126 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 19:35:06 +00:00
b62c1b8563
MAPREDUCE-3404. Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231395 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 23:41:23 +00:00
90f096d86c
MAPREDUCE-3532. Modified NM to report correct http address when an ephemeral web port is configured. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231342 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 22:21:33 +00:00
0c278b0f63
MAPREDUCE-3656. Fixed a race condition in MR AM which is failing the sort benchmark consistently. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:31:40 +00:00
78ff0b720e
MAPREDUCE-3596. Fix scheduler to handle cleaned up containers, which NMs may subsequently report as running. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231297 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:15:22 +00:00
58f2da1c85
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231242 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 18:54:02 +00:00
f717c5785e
MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230708 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:11:33 +00:00
8610a9231a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00
74697f2317
MAPREDUCE-3512. Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230353 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:42:10 +00:00
0086014703
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 00:15:35 +00:00
5f79f180f6
MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230330 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:59:23 +00:00
0510e0659c
MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 23:50:09 +00:00
d0f89303e9
MAPREDUCE-3645. TestJobHistory fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230307 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:53:36 +00:00
c832b46d0b
MAPREDUCE-3651. TestQueueManagerRefresh fails. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230292 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 22:32:56 +00:00
ede7f21278
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 20:53:50 +00:00
c4c6d8ece3
MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230202 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 19:37:52 +00:00
39b8bbe663
MAPREDUCE-3618. Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229906 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 06:53:10 +00:00
bc4b1f48d3
MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229855 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 01:50:10 +00:00
7712e70090
MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR AM. Improved the earlier patch to not to JobHistoryServer repeatedly. Contributed by Anupam Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:07:54 +00:00
bc374626be
MAPREDUCE-3299. Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers. (Jonathan Eagles via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229766 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 22:26:45 +00:00
44e0bb831b
MAPREDUCE-3382. Enhanced MR AM to use a proxy to ping the job-end notification URL. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229736 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 21:08:34 +00:00
849c68c7b5
MAPREDUCE-3312. Modified MR AM to not send a stop-container request for a container that isn't launched at all. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229451 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 02:15:48 +00:00
48150cddaf
MAPREDUCE-3639. Fixed TokenCache to work with absent FileSystem canonical service-names. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229444 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 01:38:27 +00:00
428529b58f
MAPREDUCE-3528. Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property. (Siddharth Seth via vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229403 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:37:00 +00:00
239a5549ea
MAPREDUCE-3616. Thread pool for launching containers in MR AM not expanding as expected. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229394 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:20:23 +00:00
e8645636ce
MAPREDUCE-3511. Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs. (vinodkv)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229347 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 21:04:58 +00:00
ade897636d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 18:01:55 +00:00
5ba6477099
MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. Contributed by Mahadev Konar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228354 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 19:12:02 +00:00
d680080da0
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
5f5561d057
Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 21:55:43 +00:00
2919ce8c8b
MAPREDUCE-3617. Removed wrong default value for yarn.resourcemanager.principal and yarn.nodemanager.principal. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227808 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:11:09 +00:00
7440a8aa37
MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227801 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 20:01:20 +00:00
4404f20671
MAPREDUCE-3326. Added detailed information about queue's to the CapacityScheduler web-ui. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227788 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:50:18 +00:00
6d45b9e31d
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
3187a3ae05
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
a2bcb867e1
MAPREDUCE-3615. Fix some ant test failures. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227741 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:47:59 +00:00
03d46dc571
MAPREDUCE-3569. TaskAttemptListener holds a global lock for all task-updates. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227485 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 05:19:44 +00:00
08f8abf563
MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227426 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:37:13 +00:00
0870734787
MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. Contributed by Vinod K V.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227422 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:29:52 +00:00
e793ba8cba
MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227408 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:13:39 +00:00
be285fc27f
MAPREDUCE-3595. Add missing TestCounters#testCounterValue test from branch 1 to 0.23 (Contributed by Tom White)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:15:41 +00:00
f445eb31f1
MAPREDUCE-3529. TokenCache does not cache viewfs credentials correctly. (sseth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227374 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 23:07:27 +00:00
cd81cc6664
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 18:47:51 +00:00
c27de4bd0b
MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when adding a file/archive to the path. (Dick King via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227238 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 17:51:17 +00:00
55e94dc5ef
MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce ramp up. Contributed by Sharad Agarwal and Arun C Murthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227226 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 17:10:31 +00:00
2f19c59f1d
MAPREDUCE-3610. Remove use of the 'dfs.block.size' config for default block size fetching. Use FS#getDefaultBlocksize instead. (Sho Shimauchi via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227091 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 09:39:14 +00:00
Thomas Graves
Vinod Kumar Vavilapalli
Aaron Myers
Siddharth Seth
Amar Kamat
Alejandro Abdelnur
Steve Loughran
Arun Murthy
Todd Lipcon
Tsz-wo Sze
Robert Joseph Evans
Ravi Gummadi
Mahadev Konar
Konstantin Shvachko
Suresh Srinivas
Eli Collins
Thomas White
Jitendra Nath Pandey
Harsh J